Low-rank nonnegative tensor approximation via alternating projections and sketching

被引:8
|
作者
Sultonov, Azamat [1 ]
Matveev, Sergey [1 ,2 ]
Budzinskiy, Stanislav [2 ]
机构
[1] Lomonosov Moscow State Univ, Fac Computat Math & Cybernet, Moscow, Russia
[2] Marchuk Inst Numer Math RAS, Moscow, Russia
来源
COMPUTATIONAL & APPLIED MATHEMATICS | 2023年 / 42卷 / 02期
基金
俄罗斯科学基金会;
关键词
low-rank approximation; nonnegative tensors; alternating projections; sketching; Tucker decomposition; Tensor train decomposition; RANDOMIZED ALGORITHMS; DECOMPOSITION; TRAIN; TUCKER; SVD;
D O I
10.1007/s40314-023-02211-2
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We show how to construct nonnegative low-rank approximations of nonnegative tensors in Tucker and tensor train formats. We use alternating projections between the nonnegative orthant and the set of low-rank tensors, using STHOSVD and TTSVD algorithms, respectively, and further accelerate the alternating projections using randomized sketching. The numerical experiments on both synthetic data and hyperspectral images show the decay of the negative elements and that the error of the resulting approximation is close to the initial error obtained with STHOSVD and TTSVD. The proposed method for the Tucker case is superior to the previous ones in terms of computational complexity and decay of negative elements. The tensor train case, to the best of our knowledge, has not been studied before.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] Low-rank nonnegative tensor approximation via alternating projections and sketching
    Azamat Sultonov
    Sergey Matveev
    Stanislav Budzinskiy
    Computational and Applied Mathematics, 2023, 42
  • [2] Sketching for a low-rank nonnegative matrix approximation: Numerical study
    Matveev, Sergey
    Budzinskiy, Stanislav
    RUSSIAN JOURNAL OF NUMERICAL ANALYSIS AND MATHEMATICAL MODELLING, 2023, 38 (02) : 99 - 114
  • [3] Mixed Alternating Projections with Application to Hankel Low-Rank Approximation
    Zvonarev, Nikita
    Golyandina, Nina
    ALGORITHMS, 2022, 15 (12)
  • [4] Fast Nonnegative Matrix/Tensor Factorization Based on Low-Rank Approximation
    Zhou, Guoxu
    Cichocki, Andrzej
    Xie, Shengli
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2012, 60 (06) : 2928 - 2940
  • [5] Tangent Space Based Alternating Projections for Nonnegative Low Rank Matrix Approximation
    Song, Guangjing
    Ng, Michael K.
    Jiang, Tai-Xiang
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (11) : 11917 - 11934
  • [6] Tensor Recovery via Nonconvex Low-Rank Approximation
    Chen, Lin
    Jiang, Xue
    Liu, Xingzhao
    Zhou, Zhixin
    28TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2020), 2021, : 710 - 714
  • [7] ALTERNATING LINEAR SCHEME IN A BAYESIAN FRAMEWORK FOR LOW-RANK TENSOR APPROXIMATION
    Menzen, Clara
    Kok, Manon
    Batselier, Kim
    SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2022, 44 (03): : A1116 - A1144
  • [8] Near Optimal Sketching of Low-Rank Tensor Regression
    Haupt, Jarvis
    Li, Xingguo
    Woodruff, David P.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [9] ISLET: Fast and Optimal Low-Rank Tensor Regression via Importance Sketching
    Zhang, Anru
    Luo, Yuetian
    Raskutti, Garvesh
    Yuan, Ming
    SIAM JOURNAL ON MATHEMATICS OF DATA SCIENCE, 2020, 2 (02): : 444 - 479
  • [10] PRACTICAL SKETCHING ALGORITHMS FOR LOW-RANK MATRIX APPROXIMATION
    Tropp, Joel A.
    Yurtsever, Alp
    Udell, Madeleine
    Cevher, Volkan
    SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2017, 38 (04) : 1454 - 1485