Hunting for Significance: Bayesian Classifiers Under a Mixture Loss Function

Loading...
Thumbnail Image
Penn collection
Statistics Papers
Degree type
Discipline
Subject
high dimensional sparse inference
Bayes classification rule
nonparametric estimation
false discoveries
false nondiscoveries
Statistics and Probability
Funder
Grant number
License
Copyright date
Distributor
Related resources
Author
Fuki, Igar
Brown, Lawrence D
Han, Xu
Zhao, Linda
Contributor
Abstract

Detecting significance in a high-dimensional sparse data structure has received a large amount of attention in modern statistics. In the current paper, we introduce a compound decision rule to simultaneously classify signals from noise. This procedure is a Bayes rule subject to a mixture loss function. The loss function minimizes the number of false discoveries while controlling the false nondiscoveries by incorporating the signal strength information. Based on our criterion, strong signals will be penalized more heavily for nondiscovery than weak signals. In constructing this classification rule, we assume a mixture prior for the parameter which adapts to the unknown sparsity. This Bayes rule can be viewed as thresholding the “local fdr” (Efron, 2007) by adaptive thresholds. Both parametric and nonparametric methods will be discussed. The nonparametric procedure adapts to the unknown data structure well and outperforms the parametric one. Performance of the procedure is illustrated by various simulation studies and a real data application.

Advisor
Date Range for Data Collection (Start Date)
Date Range for Data Collection (End Date)
Digital Object Identifier
Series name and number
Publication date
2014-11-01
Journal title
Journal of Statistical Planning and Inference
Volume number
Issue number
Publisher
Publisher DOI
Journal Issue
Comments
Recommended citation
Collection