Calibration and Empirical Bayes Variable Selection

Loading...
Thumbnail Image
Penn collection
Statistics Papers
Degree type
Discipline
Subject
AIC
BIC
conditional likelihood
Cp
hierarchical model
marginal likelihood
model selection
RIC
Risk
Selection bias
shrinkage estimation
wavelets
Statistics and Probability
Funder
Grant number
License
Copyright date
Distributor
Related resources
Author
George, Edward I
Foster, Dean P
Contributor
Abstract

For the problem of variable selection for the normal linear model, selection criteria such as AIC, Cp, BIC and RIC have fixed dimensionality penalties. Such criteria are shown to correspond to selection of maximum posterior models under implicit hyperparameter choices for a particular hierarchical Bayes formulation. Based on this calibration, we propose empirical Bayes selection criteria that use hyperparameter estimates instead of fixed choices. For obtaining these estimates, both marginal and conditional maximum likelihood methods are considered. As opposed to traditional fixed penalty criteria, these empirical Bayes criteria have dimensionality penalties that depend on the data. Their performance is seen to approximate adaptively the performance of the best fixed‐penalty criterion across a variety of orthogonal and nonorthogonal set‐ups, including wavelet regression. Empirical Bayes shrinkage estimators of the selected coefficients are also proposed.

Advisor
Date Range for Data Collection (Start Date)
Date Range for Data Collection (End Date)
Digital Object Identifier
Series name and number
Publication date
2000-12-01
Journal title
Biometrika
Volume number
Issue number
Publisher
Publisher DOI
Journal Issue
Comments
Recommended citation
Collection