Constructive Regularization of the Random Matrix Norm

被引:2
|
作者
Rebrova, Elizaveta [1 ]
机构
[1] Univ Calif Los Angeles, Dept Math, 520 Portola Plaza, Los Angeles, CA 90095 USA
关键词
Random matrices; Operator norms; Heavy tails; LARGEST EIGENVALUE; SPARSE; LIMIT;
D O I
10.1007/s10959-019-00929-6
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We study the structure of nxn random matrices with centered i.i.d. entries having only two finite moments. In the recent jointworkwith R. Vershynin, we have shown that the operator norm of such matrix A can be reduced to the optimal order O(root n) with high probability by zeroing out a small submatrix of A, but did not describe the structure of this "bad" submatrix nor provide a constructive way to find it. In the current paper, we give a very simple description of a small "bad" subset of entries. We show that it is enough to zero out a small fraction of the rows and columns of A with largest L-2 norms to bring the operator norm of A to the almost optimal order O(root n log log n), under additional assumption that the matrix entries are symmetrically distributed. As a corollary, we also obtain a constructive procedure to find a small submatrix of A that one can zero out to achieve the same norm regularization. The main component of the proof is the development of techniques extending constructive regularization approaches known for the Bernoulli matrices (from the works of Feige and Ofek, and Le, Levina and Vershynin) to the considerably broader class of heavy-tailed random matrices.
引用
收藏
页码:1768 / 1790
页数:23
相关论文
共 50 条
  • [11] LOW RANK MATRIX MINIMIZATION WITH A TRUNCATED DIFFERENCE OF NUCLEAR NORM AND FROBENIUS NORM REGULARIZATION
    Guo, Huiyuan
    Yu, Quan
    Zhang, Xinzhen
    Cheng, Lulu
    JOURNAL OF INDUSTRIAL AND MANAGEMENT OPTIMIZATION, 2023, 19 (04) : 2354 - 2366
  • [12] Reexamining low rank matrix factorization for trace norm regularization
    Ciliberto, Carlo
    Pontil, Massimiliano
    Stamos, Dimitrios
    MATHEMATICS IN ENGINEERING, 2022, 5 (03): : 1 - 22
  • [13] Variational Bayesian View of Weighted Trace Norm Regularization for Matrix Factorization
    Kim, Yong-Deok
    Choi, Seungjin
    IEEE SIGNAL PROCESSING LETTERS, 2013, 20 (03) : 261 - 264
  • [14] Fast and Accurate Matrix Completion via Truncated Nuclear Norm Regularization
    Hu, Yao
    Zhang, Debing
    Ye, Jieping
    Li, Xuelong
    He, Xiaofei
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (09) : 2117 - 2130
  • [15] Nuclear norm regularization with a low-rank constraint for matrix completion
    Zhang, Hui
    Cheng, Lizhi
    Zhu, Wei
    INVERSE PROBLEMS, 2010, 26 (11)
  • [16] EFFICIENCY OF THE ADAPTIVE ALGORITHM WITH REGULARIZATION OF THE RANDOM CORRELATION MATRIX
    CHEREMISIN, OP
    RADIOTEKHNIKA I ELEKTRONIKA, 1982, 27 (10): : 1933 - 1941
  • [17] On the operator norm of a Hermitian random matrix with correlated entries
    Reker, Jana
    RANDOM MATRICES-THEORY AND APPLICATIONS, 2022, 11 (04)
  • [18] Estimation with Norm Regularization
    Banerjee, Arindam
    Chen, Sheng
    Fazayeli, Farideh
    Sivakumar, Vidyashankar
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 27 (NIPS 2014), 2014, 27
  • [19] Constructive neural networks with regularization
    Lahnajärvi, Jani
    Lehtokangas, Mikko
    Saarinen, Jukka
    2001, World Scientific and Engineering Academy and Society
  • [20] Bound for the L2 norm of random matrix and succinct matrix approximation
    Liu, Rong
    Yan, Nian
    Shi, Yong
    Chen, Zhengxin
    COMPUTATIONAL SCIENCE - ICCS 2008, PT 2, 2008, 5102 : 426 - +