PRACTICAL SKETCHING ALGORITHMS FOR LOW-RANK MATRIX APPROXIMATION

被引:110
|
作者
Tropp, Joel A. [1 ]
Yurtsever, Alp [2 ]
Udell, Madeleine [3 ]
Cevher, Volkan [2 ]
机构
[1] CALTECH, Comp & Math Sci, Pasadena, CA 91125 USA
[2] Ecole Polytech Fed Lausanne, CH-1015 Lausanne, Switzerland
[3] Cornell Univ, Ithaca, NY 14853 USA
关键词
dimension reduction; matrix approximation; numerical linear algebra; randomized algorithm; single-pass algorithm; sketching; streaming algorithm; subspace embedding; DIMENSIONALITY REDUCTION; RANDOMIZED ALGORITHM; LINEAR ALGEBRA;
D O I
10.1137/17M1111590
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This paper describes a suite of algorithms for constructing low-rank approximations of an input matrix from a random linear image, or sketch, of the matrix. These methods can preserve structural properties of the input matrix, such as positive-semidefiniteness, and they can produce approximations with a user-specified rank. The algorithms are simple, accurate, numerically stable, and provably correct. Moreover, each method is accompanied by an informative error bound that allows users to select parameters a priori to achieve a given approximation quality. These claims are supported by numerical experiments with real and synthetic data.
引用
收藏
页码:1454 / 1485
页数:32
相关论文
共 50 条
  • [1] Practical Sketching Algorithms for Low-Rank Tucker Approximation of Large Tensors
    Dong, Wandi
    Yu, Gaohang
    Qi, Liqun
    Cai, Xiaohao
    JOURNAL OF SCIENTIFIC COMPUTING, 2023, 95 (02)
  • [2] Practical Sketching Algorithms for Low-Rank Tucker Approximation of Large Tensors
    Wandi Dong
    Gaohang Yu
    Liqun Qi
    Xiaohao Cai
    Journal of Scientific Computing, 2023, 95
  • [3] Sketching for a low-rank nonnegative matrix approximation: Numerical study
    Matveev, Sergey
    Budzinskiy, Stanislav
    RUSSIAN JOURNAL OF NUMERICAL ANALYSIS AND MATHEMATICAL MODELLING, 2023, 38 (02) : 99 - 114
  • [4] Low-Rank Approximation Algorithms for Matrix Completion with Random Sampling
    O. S. Lebedeva
    A. I. Osinsky
    S. V. Petrov
    Computational Mathematics and Mathematical Physics, 2021, 61 : 799 - 815
  • [5] Low-Rank Approximation Algorithms for Matrix Completion with Random Sampling
    Lebedeva, O. S.
    Osinsky, A., I
    Petrov, S., V
    COMPUTATIONAL MATHEMATICS AND MATHEMATICAL PHYSICS, 2021, 61 (05) : 799 - 815
  • [6] Low-Rank Approximation: Algorithms, Implementation, Approximation
    Khoromskij, Boris N.
    SIAM REVIEW, 2021, 63 (04) : 870 - 871
  • [7] Simple and practical algorithms for lp-norm low-rank approximation
    Kyrillidis, Anastasios
    UNCERTAINTY IN ARTIFICIAL INTELLIGENCE, 2018, : 414 - 424
  • [8] Algorithms for lp Low-Rank Approximation
    Chierichetti, Flavio
    Gollapudi, Sreenivas
    Kumar, Ravi
    Lattanzi, Silvio
    Panigrahy, Rina
    Woodruff, David P.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 70, 2017, 70
  • [9] Stochastic algorithms for solving structured low-rank matrix approximation problems
    Gillard, J. W.
    Zhigljavsky, A. A.
    COMMUNICATIONS IN NONLINEAR SCIENCE AND NUMERICAL SIMULATION, 2015, 21 (1-3) : 70 - 88
  • [10] Enhanced Low-Rank Matrix Approximation
    Parekh, Ankit
    Selesnick, Ivan W.
    IEEE SIGNAL PROCESSING LETTERS, 2016, 23 (04) : 493 - 497