PRACTICAL SKETCHING ALGORITHMS FOR LOW-RANK MATRIX APPROXIMATION

被引:110
|
作者
Tropp, Joel A. [1 ]
Yurtsever, Alp [2 ]
Udell, Madeleine [3 ]
Cevher, Volkan [2 ]
机构
[1] CALTECH, Comp & Math Sci, Pasadena, CA 91125 USA
[2] Ecole Polytech Fed Lausanne, CH-1015 Lausanne, Switzerland
[3] Cornell Univ, Ithaca, NY 14853 USA
关键词
dimension reduction; matrix approximation; numerical linear algebra; randomized algorithm; single-pass algorithm; sketching; streaming algorithm; subspace embedding; DIMENSIONALITY REDUCTION; RANDOMIZED ALGORITHM; LINEAR ALGEBRA;
D O I
10.1137/17M1111590
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This paper describes a suite of algorithms for constructing low-rank approximations of an input matrix from a random linear image, or sketch, of the matrix. These methods can preserve structural properties of the input matrix, such as positive-semidefiniteness, and they can produce approximations with a user-specified rank. The algorithms are simple, accurate, numerically stable, and provably correct. Moreover, each method is accompanied by an informative error bound that allows users to select parameters a priori to achieve a given approximation quality. These claims are supported by numerical experiments with real and synthetic data.
引用
收藏
页码:1454 / 1485
页数:32
相关论文
共 50 条
  • [41] ERROR ANALYSIS OF THE GENERALIZED LOW-RANK MATRIX APPROXIMATION
    Soto-Quiros, Pablo
    ELECTRONIC JOURNAL OF LINEAR ALGEBRA, 2021, 37 : 544 - 548
  • [42] Fast and Memory Optimal Low-Rank Matrix Approximation
    Yun, Se-Young
    Lelarge, Marc
    Proutiere, Alexandre
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 28 (NIPS 2015), 2015, 28
  • [43] Adaptive sampling and fast low-rank matrix approximation
    Deshpande, Amit
    Vempala, Santosh
    APPROXIMATION, RANDOMIZATION AND COMBINATORIAL OPTIMIZATION: ALGORITHMS AND TECHNIQUES, 2006, 4110 : 292 - 303
  • [44] A LOW-RANK APPROXIMATION FOR COMPUTING THE MATRIX EXPONENTIAL NORM
    Nechepurenko, Yuri M.
    Sadkane, Miloud
    SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2011, 32 (02) : 349 - 363
  • [45] A Fast and Efficient Algorithm for Low-rank Approximation of a Matrix
    Nguyen, Nam H.
    Do, Thong T.
    Tran, Trac D.
    STOC'09: PROCEEDINGS OF THE 2009 ACM SYMPOSIUM ON THEORY OF COMPUTING, 2009, : 215 - 224
  • [46] Supervised Quantile Normalization for Low-rank Matrix Approximation
    Cuturi, Marco
    Teboul, Olivier
    Niles-Weed, Jonathan
    Vert, Jean-Philippe
    25TH AMERICAS CONFERENCE ON INFORMATION SYSTEMS (AMCIS 2019), 2019,
  • [47] Adaptive Local Low-rank Matrix Approximation for Recommendation
    Liu, Huafeng
    Jing, Liping
    Qian, Yuhua
    Yu, Jian
    ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2019, 37 (04)
  • [48] Improved Low-Rank Matrix Approximation in Multivariate Case
    Kittisuwan, Pichid
    Akkaraekthalin, Prayoot
    INTERNATIONAL JOURNAL OF COMPUTATIONAL METHODS, 2024,
  • [49] Sparse Low-Rank Matrix Approximation for Data Compression
    Hou, Junhui
    Chau, Lap-Pui
    Magnenat-Thalmann, Nadia
    He, Ying
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2017, 27 (05) : 1043 - 1054
  • [50] Numerical low-rank approximation of matrix differential equations
    Mena, Hermann
    Ostermann, Alexander
    Pfurtscheller, Lena-Maria
    Piazzola, Chiara
    JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2018, 340 : 602 - 614