The Open UniversitySkip to content
 

Selection of weights for weighted model averaging

Garthwaite, Paul H. and Mubwandarikwa, Emmanuel (2010). Selection of weights for weighted model averaging. Australian & New Zealand Journal of Statistics, 52(4) pp. 363–382.

DOI (Digital Object Identifier) Link: http://dx.doi.org/10.1111/j.1467-842X.2010.00589.x
Google Scholar: Look up in Google Scholar

Abstract

We address the task of choosing prior weights for models that are to be used for weighted model averaging. Models that are very similar should usually be given smaller weights than models that are quite distinct. Otherwise, the importance of a model in the weighted average could be increased by augmenting the set of models with duplicates of the model or virtual duplicates of it. Similarly, the importance of a particular model feature (a certain covariate, say) could be exaggerated by including many models with that feature. Ways of forming a correlation matrix that reflects the similarity between models are suggested. Then, weighting schemes are proposed that assign prior weights to models on the basis of this matrix. The weighting schemes give smaller weights to models that are more highly correlated. Other desirable properties of a weighting scheme are identified, and we examine the extent to which these properties are held by the proposed methods. The weighting schemes are applied to real data, and prior weights, posterior weights and Bayesian model averages are determined. For these data, empirical Bayes methods were used to form the correlation matrices that yield the prior weights. Predictive variances are examined, as empirical Bayes methods can result in unrealistically small variances.

Item Type: Journal Article
Copyright Holders: 2010 Australian Statistical Publishing Association Inc. Published by Blackwell Publishing Asia Pty Ltd.
ISSN: 1467-842X
Keywords: Bayesian model averaging; dilution priors; model uncertainty; prior weights
Academic Unit/Department: Mathematics, Computing and Technology > Mathematics and Statistics
Item ID: 28333
Depositing User: Sarah Frain
Date Deposited: 02 Mar 2011 15:17
Last Modified: 03 Dec 2012 12:07
URI: http://oro.open.ac.uk/id/eprint/28333
Share this page:

Actions (login may be required)

View Item
Report issue / request change

Policies | Disclaimer

© The Open University   + 44 (0)870 333 4340   general-enquiries@open.ac.uk