Constructive Regularization of the Random Matrix Norm

被引:2
|
作者
Rebrova, Elizaveta [1 ]
机构
[1] Univ Calif Los Angeles, Dept Math, 520 Portola Plaza, Los Angeles, CA 90095 USA
关键词
Random matrices; Operator norms; Heavy tails; LARGEST EIGENVALUE; SPARSE; LIMIT;
D O I
10.1007/s10959-019-00929-6
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We study the structure of nxn random matrices with centered i.i.d. entries having only two finite moments. In the recent jointworkwith R. Vershynin, we have shown that the operator norm of such matrix A can be reduced to the optimal order O(root n) with high probability by zeroing out a small submatrix of A, but did not describe the structure of this "bad" submatrix nor provide a constructive way to find it. In the current paper, we give a very simple description of a small "bad" subset of entries. We show that it is enough to zero out a small fraction of the rows and columns of A with largest L-2 norms to bring the operator norm of A to the almost optimal order O(root n log log n), under additional assumption that the matrix entries are symmetrically distributed. As a corollary, we also obtain a constructive procedure to find a small submatrix of A that one can zero out to achieve the same norm regularization. The main component of the proof is the development of techniques extending constructive regularization approaches known for the Bernoulli matrices (from the works of Feige and Ofek, and Le, Levina and Vershynin) to the considerably broader class of heavy-tailed random matrices.
引用
收藏
页码:1768 / 1790
页数:23
相关论文
共 50 条
  • [21] An Optimal Hybrid Nuclear Norm Regularization for Matrix Sensing With Subspace Prior Information
    Bayat, Siavash
    Daei, Sajad
    IEEE ACCESS, 2020, 8 (08): : 130937 - 130946
  • [22] Regularization parameters determination method based on random matrix clustering
    Zhang, Yuanyuan
    Yue, Shihong
    Li, Jia
    Sun, Chang
    2021 IEEE INTERNATIONAL INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE (I2MTC 2021), 2021,
  • [23] Random Fourier extreme learning machine with l2,1-norm regularization
    Zhou, Sihang
    Liu, Xinwang
    Liu, Qiang
    Wang, Siqi
    Zhu, Chengzhang
    Yin, Jianping
    NEUROCOMPUTING, 2016, 174 : 143 - 153
  • [24] THE SPIN-GLASS RANDOM MATRIX ENSEMBLE - SOME INEQUALITIES FOR A NEW MATRIX NORM
    LARSEN, U
    JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1988, 21 (06): : 1371 - 1385
  • [25] Sparse trace norm regularization
    Jianhui Chen
    Jieping Ye
    Computational Statistics, 2014, 29 : 623 - 639
  • [26] Weighted truncated nuclear norm regularization for low-rank quaternion matrix completion
    Yang, Liqiao
    Kou, Kit Ian
    Miao, Jifei
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 81
  • [27] A Truncated Nuclear Norm Regularization Method Based on Weighted Residual Error for Matrix Completion
    Liu, Qing
    Lai, Zhihui
    Zhou, Zongwei
    Kuang, Fangjun
    Jin, Zhong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (01) : 316 - 330
  • [28] Sparse trace norm regularization
    Chen, Jianhui
    Ye, Jieping
    COMPUTATIONAL STATISTICS, 2014, 29 (3-4) : 623 - 639
  • [29] Covariance Matrix Regularization for Banded Toeplitz Structure via Frobenius-Norm Discrepancy
    Cui, Xiangzhao
    Li, Zhenyang
    Zhao, Jine
    Zhang, Defei
    Pan, Jianxin
    MATRICES, STATISTICS AND BIG DATA, 2019, : 111 - 125
  • [30] Weighted hybrid truncated norm regularization method for low-rank matrix completion
    Xiying Wan
    Guanghui Cheng
    Numerical Algorithms, 2023, 94 : 619 - 641