Non-asymptotic properties of spectral decomposition of large Gram-type matrices and applications

Zhang, Lyuou; Zhou, Wen; Wang, Haonan

doi:10.3150/21-bej1384

Non-asymptotic properties of spectral decomposition of large Gram-type matrices and applications

Journal Article · 01 May 2022 · Bernoulli

DOI:https://doi.org/10.3150/21-bej1384· OSTI ID:1981062

Zhang, Lyuou ^[1]; Zhou, Wen ^[2]; Wang, Haonan ^[2]

School of Statistics and Management, Shanghai University of Finance of Economics, 777 Guoding Road, Shanghai, 200433, P.R. China; OSTI
Department of Statistics, Colorado State University, Fort Collins, CO 80523, USA

Not provided.

Research Organization:: J. Craig Venter Institute, Inc., Rockville, MD (United States)

Sponsoring Organization:: USDOE Office of Science (SC)

DOE Contract Number:: SC0018344

OSTI ID:: 1981062

Journal Information:: Bernoulli, Journal Name: Bernoulli Journal Issue: 2 Vol. 28; ISSN 1350-7265

Publisher:: Project Euclid

Country of Publication:: United States

Language:: English

References (75)

Approximating a Gram Matrix for Improved Kernel-Based Learning Drineas, Petros; Mahoney, Michael W. Learning Theory https://doi.org/10.1007/11503415_22	book	January 2005
Time Series: Theory and Methods Brockwell, Peter J.; Davis, Richard A. Springer Series in Statistics https://doi.org/10.1007/978-1-4419-0320-4	book	January 1991
Perturbation bounds in connection with singular value decomposition Wedin, Per-Åke BIT, Vol. 12, Issue 1 https://doi.org/10.1007/BF01932678	journal	March 1972
A Bernstein type inequality and moderate deviations for weakly dependent sequences Merlevède, Florence; Peligrad, Magda; Rio, Emmanuel Probability Theory and Related Fields, Vol. 151, Issue 3-4 https://doi.org/10.1007/s00440-010-0304-9	journal	June 2010
Bootstrap confidence sets for spectral projectors of sample covariance Naumov, Alexey; Spokoiny, Vladimir; Ulyanov, Vladimir Probability Theory and Related Fields, Vol. 174, Issue 3-4 https://doi.org/10.1007/s00440-018-0877-2	journal	October 2018
On Concentration Functions of Random Variables Bobkov, Sergey G.; Chistyakov, Gennadiy P. Journal of Theoretical Probability, Vol. 28, Issue 3 https://doi.org/10.1007/s10959-013-0504-1	journal	July 2013
The determinant of the Gram matrix for a Specht module James, G. D.; Murphy, G. E. Journal of Algebra, Vol. 59, Issue 1 https://doi.org/10.1016/0021-8693(79)90158-3	journal	July 1979
Some limit theorems for the eigenvalues of a sample covariance matrix Jonsson, Dag Journal of Multivariate Analysis, Vol. 12, Issue 1 https://doi.org/10.1016/0047-259X(82)90080-X	journal	March 1982
On limiting spectral distribution of product of two random matrices when the underlying distribution is isotropic Bai, Z. D.; Yin, Y. Q.; Krishnaiah, P. R. Journal of Multivariate Analysis, Vol. 19, Issue 1 https://doi.org/10.1016/0047-259X(86)90103-X	journal	June 1986
Block length selection in the bootstrap for time series Bühlmann, Peter; Künsch, Hans R. Computational Statistics & Data Analysis, Vol. 31, Issue 3 https://doi.org/10.1016/S0167-9473(99)00014-6	journal	September 1999
GMM estimation of linear panel data models with time-varying individual effects Ahn, Seung Chan; Hoon Lee, Young; Schmidt, Peter Journal of Econometrics, Vol. 101, Issue 2 https://doi.org/10.1016/S0304-4076(00)00083-X	journal	April 2001
Asymptotics of the principal components estimator of large factor models with weakly influential factors Onatski, Alexei Journal of Econometrics, Vol. 168, Issue 2 https://doi.org/10.1016/j.jeconom.2012.01.034	journal	June 2012
Principal components estimation and identification of static factors Bai, Jushan; Ng, Serena Journal of Econometrics, Vol. 176, Issue 1 https://doi.org/10.1016/j.jeconom.2013.03.007	journal	September 2013
Minimax rate-optimal estimation of high-dimensional covariance matrices with incomplete data Cai, T. Tony; Zhang, Anru Journal of Multivariate Analysis, Vol. 150 https://doi.org/10.1016/j.jmva.2016.05.002	journal	September 2016
Dynamic Linear Panel Regression Models with Interactive Fixed Effects Moon, Hyungsik Roger; Weidner, Martin Econometric Theory, Vol. 33, Issue 1 https://doi.org/10.1017/S0266466615000328	journal	December 2015
Analysis of a complex of statistical variables into principal components. Hotelling, H. Journal of Educational Psychology, Vol. 24, Issue 6 https://doi.org/10.1037/h0071325	journal	January 1933
Use of the Singular Value Decomposition in Regression Analysis Mandel, John The American Statistician, Vol. 36, Issue 1 https://doi.org/10.1080/00031305.1982.10482771	journal	February 1982
Two-Sample Covariance Matrix Testing and Support Recovery in High-Dimensional and Sparse Settings Cai, Tony; Liu, Weidong; Xia, Yin Journal of the American Statistical Association, Vol. 108, Issue 501 https://doi.org/10.1080/01621459.2012.758041	journal	March 2013
Convex Banding of the Covariance Matrix Bien, Jacob; Bunea, Florentina; Xiao, Luo Journal of the American Statistical Association, Vol. 111, Issue 514 https://doi.org/10.1080/01621459.2015.1058265	journal	April 2016
FarmTest: Factor-Adjusted Robust Multiple Testing With Approximate False Discovery Control Fan, Jianqing; Ke, Yuan; Sun, Qiang Journal of the American Statistical Association, Vol. 114, Issue 528 https://doi.org/10.1080/01621459.2018.1527700	journal	March 2019
Dynamic Semiparametric Factor Model With Structural Breaks Chen, Likai; Wang, Weining; Wu, Wei Biao Journal of Business & Economic Statistics, Vol. 39, Issue 3 https://doi.org/10.1080/07350015.2020.1730857	journal	March 2020
LIII. On lines and planes of closest fit to systems of points in space Pearson, Karl The London, Edinburgh, and Dublin Philosophical Magazine and Journal of Science, Vol. 2, Issue 11 https://doi.org/10.1080/14786440109462720	journal	November 1901
Quantitative estimates of the convergence of the empirical covariance matrix in log-concave ensembles Adamczak, Radosław; Litvak, Alexander E.; Pajor, Alain Journal of the American Mathematical Society, Vol. 23, Issue 2 https://doi.org/10.1090/S0894-0347-09-00650-X	journal	October 2009
On blocking rules for the bootstrap with dependent data Hall, Peter; Horowitz, Joel L.; Jing, Bing-Yi Biometrika, Vol. 82, Issue 3 https://doi.org/10.1093/biomet/82.3.561	journal	January 1995
A useful variant of the Davis–Kahan theorem for statisticians Yu, Y.; Wang, T.; Samworth, R. J. Biometrika, Vol. 102, Issue 2 https://doi.org/10.1093/biomet/asv008	journal	April 2015
Self-consistent tomography of the state-measurement Gram matrix Stark, Cyril Physical Review A, Vol. 89, Issue 5 https://doi.org/10.1103/PhysRevA.89.052109	journal	May 2014
A Selective Overview of Sparse Principal Component Analysis Zou, Hui; Xue, Lingzhou Proceedings of the IEEE, Vol. 106, Issue 8 https://doi.org/10.1109/JPROC.2018.2846588	journal	August 2018
PCA in High Dimensions: An Orientation Johnstone, Iain M.; Paul, Debashis Proceedings of the IEEE, Vol. 106, Issue 8 https://doi.org/10.1109/JPROC.2018.2846730	journal	August 2018
Hyperspectral Image Denoising via Noise-Adjusted Iterative Low-Rank Matrix Approximation He, Wei; Zhang, Hongyan; Zhang, Liangpei IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 8, Issue 6 https://doi.org/10.1109/JSTARS.2015.2398433	journal	June 2015
A Grid-Less Approach to Underdetermined Direction of Arrival Estimation Via Low Rank Matrix Denoising Pal, Piya; Vaidyanathan, P. P. IEEE Signal Processing Letters, Vol. 21, Issue 6 https://doi.org/10.1109/LSP.2014.2314175	journal	June 2014
Hyperspectral Image Restoration Using Low-Rank Matrix Recovery No authors listed IEEE Transactions on Geoscience and Remote Sensing, Vol. 52, Issue 8 https://doi.org/10.1109/TGRS.2013.2284280	journal	August 2014
On the Eigenspectrum of the Gram Matrix and the Generalization Error of Kernel-PCA Shawe-Taylor, J.; Williams, C. K. I.; Cristianini, N. IEEE Transactions on Information Theory, Vol. 51, Issue 7 https://doi.org/10.1109/TIT.2005.850052	journal	July 2005
Multiclass Feature Selection With Kernel Gram-Matrix-Based Criteria Ramona, M.; Richard, G.; David, B. IEEE Transactions on Neural Networks and Learning Systems, Vol. 23, Issue 10 https://doi.org/10.1109/TNNLS.2012.2201748	journal	October 2012
On the Use of Gram Matrix in Observability Analysis de Almeida, Madson C.; Asada, Eduardo N.; Garcia, Ariovaldo V. IEEE Transactions on Power Systems, Vol. 23, Issue 1 https://doi.org/10.1109/TPWRS.2007.913731	journal	February 2008
Power System Observability Analysis Based on Gram Matrix and Minimum Norm Solution de Almeida, M. C.; Asada, E. N.; Garcia, A. V. IEEE Transactions on Power Systems, Vol. 23, Issue 4 https://doi.org/10.1109/TPWRS.2008.2004741	journal	November 2008
Determining the Number of Factors in Approximate Factor Models Bai, Jushan; Ng, Serena Econometrica, Vol. 70, Issue 1 https://doi.org/10.1111/1468-0262.00273	journal	January 2002
Inferential Theory for Factor Models of Large Dimensions Bai, Jushan Econometrica, Vol. 71, Issue 1 https://doi.org/10.1111/1468-0262.00392	journal	January 2003
Large covariance estimation by thresholding principal orthogonal complements Fan, Jianqing; Liao, Yuan; Mincheva, Martina Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 75, Issue 4 https://doi.org/10.1111/rssb.12016	journal	August 2013
The Rotation of Eigenvectors by a Perturbation. III Davis, Chandler; Kahan, W. M. SIAM Journal on Numerical Analysis, Vol. 7, Issue 1 https://doi.org/10.1137/0707001	journal	March 1970
Matrix Decomposition Algorithms in Orthogonal Spline Collocation for Separable Elliptic Boundary Value Problems Bialecki, Bernard; Fairweather, Graeme SIAM Journal on Scientific Computing, Vol. 16, Issue 2 https://doi.org/10.1137/0916022	journal	March 1995
Minimizing the Condition Number of a Gram Matrix Chen, Xiaojun; Womersley, Robert S.; Ye, Jane J. SIAM Journal on Optimization, Vol. 21, Issue 1 https://doi.org/10.1137/100786022	journal	January 2011
Robust Video Restoration by Joint Sparse and Low Rank Matrix Approximation Ji, Hui; Huang, Sibin; Shen, Zuowei SIAM Journal on Imaging Sciences, Vol. 4, Issue 4 https://doi.org/10.1137/100817206	journal	January 2011
On the Limiting Empirical Distribution Function of the Eigenvalues of a Multivariate F Matrix Bai, Z. D.; Yin, Y. Q.; Krishnaiah, P. R. Theory of Probability & Its Applications, Vol. 32, Issue 3 https://doi.org/10.1137/1132067	journal	January 1988
Lower Bounds for the Partitioning of Graphs Donath, W. E.; Hoffman, A. J. IBM Journal of Research and Development, Vol. 17, Issue 5 https://doi.org/10.1147/rd.175.0420	journal	September 1973
Forecasting Using Principal Components From a Large Number of Predictors Stock, James H.; Watson, Mark W. Journal of the American Statistical Association, Vol. 97, Issue 460 https://doi.org/10.1198/016214502388618960	journal	December 2002
Sparse Principal Component Analysis Zou, Hui; Hastie, Trevor; Tibshirani, Robert Journal of Computational and Graphical Statistics, Vol. 15, Issue 2 https://doi.org/10.1198/106186006X113430	journal	June 2006
On Consistency and Sparsity for Principal Components Analysis in High Dimensions Johnstone, Iain M.; Lu, Arthur Yu Journal of the American Statistical Association, Vol. 104, Issue 486 https://doi.org/10.1198/jasa.2009.0121	journal	June 2009
Regularized estimation of large covariance matrices Bickel, Peter J.; Levina, Elizaveta The Annals of Statistics, Vol. 36, Issue 1 https://doi.org/10.1214/009053607000000758	journal	February 2008
Normal approximation under local dependence Chen, Louis H. Y.; Shao, Qi-Man The Annals of Probability, Vol. 32, Issue 3 https://doi.org/10.1214/009117904000000450	journal	July 2004
Phase transition of the largest eigenvalue for nonnull complex sample covariance matrices Baik, Jinho; Ben Arous, Gérard; Péché, Sandrine The Annals of Probability, Vol. 33, Issue 5 https://doi.org/10.1214/009117905000000233	journal	September 2005
Covariance regularization by thresholding Bickel, Peter J.; Levina, Elizaveta The Annals of Statistics, Vol. 36, Issue 6 https://doi.org/10.1214/08-AOS600	journal	December 2008
Factor modeling for high-dimensional time series: Inference for the number of factors Lam, Clifford; Yao, Qiwei The Annals of Statistics, Vol. 40, Issue 2 https://doi.org/10.1214/12-AOS970	journal	April 2012
Theory and methods of panel data models with interactive effects Bai, Jushan; Li, Kunpeng The Annals of Statistics, Vol. 42, Issue 1 https://doi.org/10.1214/13-AOS1183	journal	February 2014
Asymptotics and concentration bounds for bilinear forms of spectral projectors of sample covariance Koltchinskii, Vladimir; Lounici, Karim Annales de l'Institut Henri Poincaré, Probabilités et Statistiques, Vol. 52, Issue 4 https://doi.org/10.1214/15-AIHP705	journal	November 2016
Berry–Esseen theorems under weak dependence Jirak, Moritz The Annals of Probability, Vol. 44, Issue 3 https://doi.org/10.1214/15-AOP1017	journal	May 2016
Projected principal component analysis in factor models Fan, Jianqing; Liao, Yuan; Wang, Weichen The Annals of Statistics, Vol. 44, Issue 1 https://doi.org/10.1214/15-AOS1364	journal	February 2016
Normal approximation and concentration of spectral projectors of sample covariance Koltchinskii, Vladimir; Lounici, Karim The Annals of Statistics, Vol. 45, Issue 1 https://doi.org/10.1214/16-AOS1437	journal	February 2017
Asymptotics of empirical eigenstructure for high dimensional spiked covariance Wang, Weichen; Fan, Jianqing The Annals of Statistics, Vol. 45, Issue 3 https://doi.org/10.1214/16-AOS1487	journal	June 2017
Selecting the number of principal components: Estimation of the true rank of a noisy matrix Choi, Yunjin; Taylor, Jonathan; Tibshirani, Robert The Annals of Statistics, Vol. 45, Issue 6 https://doi.org/10.1214/16-AOS1536	journal	December 2017
Consistency of AIC and BIC in estimating the number of significant components in high-dimensional principal component analysis Bai, Zhidong; Choi, Kwok Pui; Fujikoshi, Yasunori The Annals of Statistics, Vol. 46, Issue 3 https://doi.org/10.1214/17-AOS1577	journal	June 2018
Limiting laws for divergent spiked eigenvalues and largest nonspiked eigenvalue of sample covariance matrices Cai, T. Tony; Han, Xiao; Pan, Guangming The Annals of Statistics, Vol. 48, Issue 3 https://doi.org/10.1214/18-AOS1798	journal	June 2020
Berry–Esseen bounds for typical weighted sums Bobkov, S. G.; Chistyakov, G. P.; Götze, F. Electronic Journal of Probability, Vol. 23, Issue none https://doi.org/10.1214/18-EJP195	journal	January 2018
Berry-Esseen Bounds for Projections of Coordinate Symmetric Random Vectors Goldstein, Larry; Shao, Qi-Man Electronic Communications in Probability, Vol. 14, Issue none https://doi.org/10.1214/ECP.v14-1502	journal	January 2009
Asymptotic Theory for Principal Component Analysis Anderson, T. W. The Annals of Mathematical Statistics, Vol. 34, Issue 1 https://doi.org/10.1214/aoms/1177704248	journal	March 1963
Limit of the Smallest Eigenvalue of a Large Dimensional Sample Covariance Matrix Bai, Z. D.; Yin, Y. Q. The Annals of Probability, Vol. 21, Issue 3 https://doi.org/10.1214/aop/1176989118	journal	July 1993
The Strong Limits of Random Matrix Spectra for Sample Matrices of Independent Elements Wachter, Kenneth W. The Annals of Probability, Vol. 6, Issue 1 https://doi.org/10.1214/aop/1176995607	journal	February 1978
On the Berry-Esseen Theorem for $U$-Statistics Chan, Y. -K.; Wierman, John The Annals of Probability, Vol. 5, Issue 1 https://doi.org/10.1214/aop/1176995897	journal	February 1977
components analysis Johnstone, Iain M. The Annals of Statistics, Vol. 29, Issue 2 https://doi.org/10.1214/aos/1009210544	journal	April 2001
The Berry-Esseen Theorem for $U$-Statistics Callaert, Herman; Janssen, Paul The Annals of Statistics, Vol. 6, Issue 2 https://doi.org/10.1214/aos/1176344132	journal	March 1978
Large Dimensional Factor Analysis Bai, Jushan; Ng, Serena Foundations and Trends® in Econometrics, Vol. 3, Issue 2 https://doi.org/10.1561/0800000002	journal	January 2008
Arbitrage, Factor Structure, and Mean-Variance Analysis on Large Asset Markets Chamberlain, Gary; Rothschild, Michael Econometrica, Vol. 51, Issue 5 https://doi.org/10.2307/1912275	journal	September 1983
Factor Analysis as a Statistical Method Lawley, D. N.; Maxwell, A. E. The Statistician, Vol. 12, Issue 3 https://doi.org/10.2307/2986915	journal	January 1962
Normal approximation for nonlinear statistics using a concentration inequality approach Chen, Louis H. Y.; Shao, Qi-Man Bernoulli, Vol. 13, Issue 2 https://doi.org/10.3150/07-BEJ5164	journal	May 2007
On the sample covariance matrix estimator of reduced effective rank population matrices, with applications to fPCA Bunea, Florentina; Xiao, Luo Bernoulli, Vol. 21, Issue 2 https://doi.org/10.3150/14-BEJ602	journal	May 2015
Gaussian approximation for high dimensional vector under physical dependence Zhang, Xianyang; Cheng, Guang Bernoulli, Vol. 24, Issue 4A https://doi.org/10.3150/17-BEJ939	journal	November 2018

Similar Records

Asymptotic properties of large random matrices with independent entries

Journal Article · 1996 · Journal of Mathematical Physics · OSTI ID:434702

Gordon decompositions for. gamma. -type matrices and some of their applications

Journal Article · 1988 · Chin. Phys.; (United States) · OSTI ID:6737119

Large-scale multiple inference of collective dependence with applications to protein function

Journal Article · 2021 · The Annals of Applied Statistics · OSTI ID:1852608

Related Subjects

Mathematics

Non-asymptotic properties of spectral decomposition of large Gram-type matrices and applications

Citation Formats

References (75)

Similar Records

Related Subjects