Low-rank nonnegative tensor approximation via alternating projections and sketching

被引:8
|
作者
Sultonov, Azamat [1 ]
Matveev, Sergey [1 ,2 ]
Budzinskiy, Stanislav [2 ]
机构
[1] Lomonosov Moscow State Univ, Fac Computat Math & Cybernet, Moscow, Russia
[2] Marchuk Inst Numer Math RAS, Moscow, Russia
来源
COMPUTATIONAL & APPLIED MATHEMATICS | 2023年 / 42卷 / 02期
基金
俄罗斯科学基金会;
关键词
low-rank approximation; nonnegative tensors; alternating projections; sketching; Tucker decomposition; Tensor train decomposition; RANDOMIZED ALGORITHMS; DECOMPOSITION; TRAIN; TUCKER; SVD;
D O I
10.1007/s40314-023-02211-2
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We show how to construct nonnegative low-rank approximations of nonnegative tensors in Tucker and tensor train formats. We use alternating projections between the nonnegative orthant and the set of low-rank tensors, using STHOSVD and TTSVD algorithms, respectively, and further accelerate the alternating projections using randomized sketching. The numerical experiments on both synthetic data and hyperspectral images show the decay of the negative elements and that the error of the resulting approximation is close to the initial error obtained with STHOSVD and TTSVD. The proposed method for the Tucker case is superior to the previous ones in terms of computational complexity and decay of negative elements. The tensor train case, to the best of our knowledge, has not been studied before.
引用
收藏
页数:20
相关论文
共 50 条
  • [41] ROBUST HIGH-ORDER TENSOR RECOVERY VIA NONCONVEX LOW-RANK APPROXIMATION
    Qin, Wenjin
    Wang, Hailin
    Ma, Weijun
    Wang, Jianjun
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 3633 - 3637
  • [42] THE EPSILON-ALTERNATING LEAST SQUARES FOR ORTHOGONAL LOW-RANK TENSOR APPROXIMATION AND ITS GLOBAL CONVERGENCE
    Yang, Yuning
    SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2020, 41 (04) : 1797 - 1825
  • [43] A Robust Canonical Polyadic Tensor Decomposition via Structured Low-Rank Matrix Approximation
    Akema, Riku
    Yamagishi, Masao
    Yamada, Isao
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2022, E105A (01) : 11 - 24
  • [44] Hyperspectral Restoration and Fusion With Multispectral Imagery via Low-Rank Tensor-Approximation
    Liu, Na
    Li, Lu
    Li, Wei
    Tao, Ran
    Fowler, James E.
    Chanussot, Jocelyn
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (09): : 7817 - 7830
  • [45] SymNMF: nonnegative low-rank approximation of a similarity matrix for graph clustering
    Kuang, Da
    Yun, Sangwoon
    Park, Haesun
    JOURNAL OF GLOBAL OPTIMIZATION, 2015, 62 (03) : 545 - 574
  • [46] An Approximate Augmented Lagrangian Method for Nonnegative Low-Rank Matrix Approximation
    Hong Zhu
    Michael K. Ng
    Guang-Jing Song
    Journal of Scientific Computing, 2021, 88
  • [47] An Approximate Augmented Lagrangian Method for Nonnegative Low-Rank Matrix Approximation
    Zhu, Hong
    Ng, Michael K.
    Song, Guang-Jing
    JOURNAL OF SCIENTIFIC COMPUTING, 2021, 88 (02)
  • [48] SymNMF: nonnegative low-rank approximation of a similarity matrix for graph clustering
    Da Kuang
    Sangwoon Yun
    Haesun Park
    Journal of Global Optimization, 2015, 62 : 545 - 574
  • [49] Penalty hyperparameter optimization with diversity measure for nonnegative low-rank approximation
    Del Buono, Nicoletta
    Esposito, Flavia
    Selicato, Laura
    Zdunek, Rafal
    APPLIED NUMERICAL MATHEMATICS, 2025, 208 : 189 - 204
  • [50] Robust Low-Rank and Sparse Tensor Decomposition for Low-Rank Tensor Completion
    Shi, Yuqing
    Du, Shiqiang
    Wang, Weilan
    PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 7138 - 7143