Low-rank nonnegative tensor approximation via alternating projections and sketching

被引:8
|
作者
Sultonov, Azamat [1 ]
Matveev, Sergey [1 ,2 ]
Budzinskiy, Stanislav [2 ]
机构
[1] Lomonosov Moscow State Univ, Fac Computat Math & Cybernet, Moscow, Russia
[2] Marchuk Inst Numer Math RAS, Moscow, Russia
来源
COMPUTATIONAL & APPLIED MATHEMATICS | 2023年 / 42卷 / 02期
基金
俄罗斯科学基金会;
关键词
low-rank approximation; nonnegative tensors; alternating projections; sketching; Tucker decomposition; Tensor train decomposition; RANDOMIZED ALGORITHMS; DECOMPOSITION; TRAIN; TUCKER; SVD;
D O I
10.1007/s40314-023-02211-2
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We show how to construct nonnegative low-rank approximations of nonnegative tensors in Tucker and tensor train formats. We use alternating projections between the nonnegative orthant and the set of low-rank tensors, using STHOSVD and TTSVD algorithms, respectively, and further accelerate the alternating projections using randomized sketching. The numerical experiments on both synthetic data and hyperspectral images show the decay of the negative elements and that the error of the resulting approximation is close to the initial error obtained with STHOSVD and TTSVD. The proposed method for the Tucker case is superior to the previous ones in terms of computational complexity and decay of negative elements. The tensor train case, to the best of our knowledge, has not been studied before.
引用
收藏
页数:20
相关论文
共 50 条
  • [21] On Approximation Algorithm for Orthogonal Low-Rank Tensor Approximation
    Yang, Yuning
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2022, 194 (03) : 821 - 851
  • [22] Recovery guarantee of weighted low-rank approximation via alternating minimization
    Li, Yuanzhi
    Liang, Yingyu
    Risteski, Andrej
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 48, 2016, 48
  • [23] A Nonnegative Projection Based Algorithm for Low-Rank Nonnegative Matrix Approximation
    Wang, Peitao
    He, Zhaoshui
    Xie, Kan
    Gao, Junbin
    Antolovich, Michael
    NEURAL INFORMATION PROCESSING, ICONIP 2017, PT I, 2017, 10634 : 240 - 247
  • [24] Compact implicit surface reconstruction via low-rank tensor approximation
    Pan, Maodong
    Tong, Weihua
    Chen, Falai
    COMPUTER-AIDED DESIGN, 2016, 78 : 158 - 167
  • [25] Locally Linear Low-rank Tensor Approximation
    Ozdemir, Alp
    Iwen, Mark A.
    Aviyente, Selin
    2015 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2015, : 839 - 843
  • [26] HYPERSPECTRAL IMAGERY DENOISING VIA REWEIGHED SPARSE LOW-RANK NONNEGATIVE TENSOR FACTORIZATION
    Xiong, Fengchao
    Zhou, Jun
    Qian, Yuntao
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 3219 - 3223
  • [27] Federated low-rank tensor projections for sequential recommendation
    Li, Li
    Lin, Fan
    Xiahou, Jianbing
    Lin, Yuanguo
    Wu, Pengcheng
    Liu, Yong
    KNOWLEDGE-BASED SYSTEMS, 2022, 255
  • [28] NONLOCAL LOW-RANK NONNEGATIVE TENSOR FACTORIZATION FOR HYPERSPECTRAL UNMIXING
    Xiong, Fengchao
    Qian, Kun
    Ltd, Jianfeng
    Zhou, Jun
    Qian, Yuntao
    IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 2157 - 2160
  • [29] Study of performance of low-rank nonnegative tensor factorization methods
    Shcherbakova, Elena M.
    Matveev, Sergey A.
    Smirnov, Alexander P.
    Tyrtyshnikov, Eugene E.
    RUSSIAN JOURNAL OF NUMERICAL ANALYSIS AND MATHEMATICAL MODELLING, 2023, 38 (04) : 231 - 239
  • [30] FAST MULTIDIMENSIONAL CONVOLUTION IN LOW-RANK TENSOR FORMATS VIA CROSS APPROXIMATION
    Rakhuba, M. V.
    Oseledets, I. V.
    SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2015, 37 (02): : A565 - A582