Phase Transition in Limiting Distributions of Coherence of High-Dimensional Random Matrices

Loading...
Thumbnail Image
Penn collection
Statistics Papers
Degree type
Discipline
Subject
coherence
correlation coefficient
limiting distribution
maximum
phase transition
random matrix
sample correlation matrix
Chen-Stein mathoud
Statistics and Probability
Funder
Grant number
License
Copyright date
Distributor
Related resources
Author
Cai, T. Tony
Jiang, Tiefeng
Contributor
Abstract

The coherence of a random matrix, which is defined to be the largest magnitude of the Pearson correlation coefficients between the columns of the random matrix, is an important quantity for a wide range of applications including high-dimensional statistics and signal processing. Inspired by these applications, this paper studies the limiting laws of the coherence of n×p random matrices for a full range of the dimension p with a special focus on the ultra high-dimensional setting. Assuming the columns of the random matrix are independent random vectors with a common spherical distribution, we give a complete characterization of the behavior of the limiting distributions of the coherence. More specifically, the limiting distributions of the coherence are derived separately for three regimes: 1⁄n log p → 0, 1⁄n log p → β ∈ (0, ∞), and 1⁄n log p → ∞. The results show that the limiting behavior of the coherence differs significantly in different regimes and exhibits interesting phase transition phenomena as the dimension p grows as a function of n. Applications to statistics and compressed sensing in the ultra high-dimensional setting are also discussed.

Advisor
Date Range for Data Collection (Start Date)
Date Range for Data Collection (End Date)
Digital Object Identifier
Series name and number
Publication date
2012-05-01
Journal title
Journal of Multivariate Analysis
Volume number
Issue number
Publisher
Publisher DOI
Journal Issue
Comments
Recommended citation
Collection