PRACTICAL SKETCHING ALGORITHMS FOR LOW-RANK MATRIX APPROXIMATION

被引:110
|
作者
Tropp, Joel A. [1 ]
Yurtsever, Alp [2 ]
Udell, Madeleine [3 ]
Cevher, Volkan [2 ]
机构
[1] CALTECH, Comp & Math Sci, Pasadena, CA 91125 USA
[2] Ecole Polytech Fed Lausanne, CH-1015 Lausanne, Switzerland
[3] Cornell Univ, Ithaca, NY 14853 USA
关键词
dimension reduction; matrix approximation; numerical linear algebra; randomized algorithm; single-pass algorithm; sketching; streaming algorithm; subspace embedding; DIMENSIONALITY REDUCTION; RANDOMIZED ALGORITHM; LINEAR ALGEBRA;
D O I
10.1137/17M1111590
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This paper describes a suite of algorithms for constructing low-rank approximations of an input matrix from a random linear image, or sketch, of the matrix. These methods can preserve structural properties of the input matrix, such as positive-semidefiniteness, and they can produce approximations with a user-specified rank. The algorithms are simple, accurate, numerically stable, and provably correct. Moreover, each method is accompanied by an informative error bound that allows users to select parameters a priori to achieve a given approximation quality. These claims are supported by numerical experiments with real and synthetic data.
引用
收藏
页码:1454 / 1485
页数:32
相关论文
共 50 条
  • [21] Low-rank approximation pursuit for matrix completion
    Xu, An-Bao
    Xie, Dongxiu
    MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2017, 95 : 77 - 89
  • [22] Parameterized low-rank binary matrix approximation
    Fedor V. Fomin
    Petr A. Golovach
    Fahad Panolan
    Data Mining and Knowledge Discovery, 2020, 34 : 478 - 532
  • [23] Optimal low-rank approximation to a correlation matrix
    Zhang, ZY
    Wu, LX
    LINEAR ALGEBRA AND ITS APPLICATIONS, 2003, 364 : 161 - 187
  • [24] Parameterized low-rank binary matrix approximation
    Fomin, Fedor, V
    Golovach, Petr A.
    Panolan, Fahad
    DATA MINING AND KNOWLEDGE DISCOVERY, 2020, 34 (02) : 478 - 532
  • [25] Lower bounds for the low-rank matrix approximation
    Jicheng Li
    Zisheng Liu
    Guo Li
    Journal of Inequalities and Applications, 2017
  • [26] Low-rank matrix approximation in the infinity norm
    Gillis, Nicolas
    Shitov, Yaroslav
    LINEAR ALGEBRA AND ITS APPLICATIONS, 2019, 581 (367-382) : 367 - 382
  • [27] LLORMA : Local Low-Rank Matrix Approximation
    Lee, Joonseok
    Kim, Seungyeon
    Lebanon, Guy
    Singer, Yoram
    Bengio, Samy
    JOURNAL OF MACHINE LEARNING RESEARCH, 2016, 17
  • [28] A Schur method for low-rank matrix approximation
    vanderVeen, AJ
    SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 1996, 17 (01) : 139 - 160
  • [29] Low-Rank Matrix Approximation with Manifold Regularization
    Zhang, Zhenyue
    Zhao, Keke
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (07) : 1717 - 1729
  • [30] Accelerated algorithms for low-rank matrix recovery
    Zhang, Shuiping
    Tian, Jinwen
    MIPPR 2013: PARALLEL PROCESSING OF IMAGES AND OPTIMIZATION AND MEDICAL IMAGING PROCESSING, 2013, 8920