Law of Log Determinant of Sample Covariance Matrix and Optimal Estimation of Differential Entropy for High-Dimensional Gaussian Distributions

Loading...
Thumbnail Image
Penn collection
Statistics Papers
Degree type
Discipline
Subject
asymptotic optimality
central limit theorem
covariance matrix
determinant
differential entropy
minimax lower bound
sharp minimaxity
Business
Statistics and Probability
Funder
Grant number
License
Copyright date
Distributor
Related resources
Author
Cai, T. Tony
Liang, Tengyuan
Zhou, Harrison H
Contributor
Abstract

Differential entropy and log determinant of the covariance matrix of a multivariate Gaussian distribution have many applications in coding, communications, signal processing and statistical inference. In this paper we consider in the high-dimensional setting optimal estimation of the differential entropy and the log-determinant of the covariance matrix. We first establish a central limit theorem for the log determinant of the sample covariance matrix in the high-dimensional setting where the dimension p(n) can grow with the sample size n. An estimator of the differential entropy and the log determinant is then considered. Optimal rate of convergence is obtained. It is shown that in the case p(n) / n → 0 the estimator is asymptotically sharp minimax. The ultra-high-dimensional setting where p(n) > n is also discussed.

Advisor
Date Range for Data Collection (Start Date)
Date Range for Data Collection (End Date)
Digital Object Identifier
Series name and number
Publication date
2015-05-01
Volume number
Issue number
Publisher
Publisher DOI
Journal Issue
Comments
Recommended citation
Collection