Efficient Nonnegative Tensor Factorization via Saturating Coordinate Descent

被引:9
|
作者
Balasubramaniam, Thirunavukarasu [1 ]
Nayak, Richi [1 ]
Yuen, Chau [2 ]
机构
[1] Queensland Univ Technol, 2 George St, Brisbane, Qld 4000, Australia
[2] Singapore Univ Technol & Design, 8 Somapah Rd, Singapore 487372, Singapore
关键词
Nonnegative tensor factorization; coordinate descent; element selection; saturating coordinate descent; pattern mining; recommender systems; INDIVIDUAL-DIFFERENCES; MATRIX; ALGORITHMS; DECOMPOSITIONS; OPTIMIZATION;
D O I
10.1145/3385654
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the advancements in computing technology and web-based applications, data are increasingly generated in multi-dimensional form. These data are usually sparse due to the presence of a large number of users and fewer user interactions. To deal with this, the Nonnegative Tensor Factorization (NTF) based methods have been widely used. However existing factorization algorithms are not suitable to process in all three conditions of size, density, and rank of the tensor. Consequently, their applicability becomes limited. In this article, we propose a novel fast and efficient NTF algorithm using the element selection approach. We calculate the element importance using Lipschitz continuity and propose a saturation point-based element selection method that chooses a set of elements column-wise for updating to solve the optimization problem. Empirical analysis reveals that the proposed algorithm is scalable in terms of tensor size, density, and rank in comparison to the relevant state-of-the-art algorithms.
引用
收藏
页数:28
相关论文
共 50 条
  • [1] Accelerating block coordinate descent for nonnegative tensor factorization
    Ang, Andersen Man Shun
    Cohen, Jeremy E.
    Gillis, Nicolas.
    Hien, Le Thi Khanh
    NUMERICAL LINEAR ALGEBRA WITH APPLICATIONS, 2021, 28 (05)
  • [2] Efficient and Non-Convex Coordinate Descent for Symmetric Nonnegative Matrix Factorization
    Vandaele, Arnaud
    Gillis, Nicolas
    Lei, Qi
    Zhong, Kai
    Dhillon, Inderjit
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2016, 64 (21) : 5571 - 5584
  • [3] A Block Coordinate Descent Method for Regularized Multiconvex Optimization with Applications to Nonnegative Tensor Factorization and Completion
    Xu, Yangyang
    Yin, Wotao
    SIAM JOURNAL ON IMAGING SCIENCES, 2013, 6 (03): : 1758 - 1789
  • [4] Variable Selection for Efficient Nonnegative Tensor Factorization
    Kimura, Keigo
    Kudo, Mineichi
    2015 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2015, : 805 - 810
  • [5] Inexact Block Coordinate Descent Methods for Symmetric Nonnegative Matrix Factorization
    Shi, Qingjiang
    Sun, Haoran
    Lu, Songtao
    Hong, Mingyi
    Razaviyayn, Meisam
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2017, 65 (22) : 5995 - 6008
  • [6] DID: Distributed Incremental Block Coordinate Descent for Nonnegative Matrix Factorization
    Gao, Tianxiang
    Chu, Chris
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 2991 - 2998
  • [7] Dictionary Learning Based on Nonnegative Matrix Factorization Using Parallel Coordinate Descent
    Tang, Zunyi
    Ding, Shuxue
    Li, Zhenni
    Jiang, Linlin
    ABSTRACT AND APPLIED ANALYSIS, 2013,
  • [8] Coordinate projected gradient descent minimization and its application to orthogonal nonnegative matrix factorization
    Chorobura, Flavia
    Lupu, Daniela
    Necoara, Ion
    2022 IEEE 61ST CONFERENCE ON DECISION AND CONTROL (CDC), 2022, : 6929 - 6934
  • [9] Nonnegative matrix and tensor factorization
    Cichocki, Andrzej
    Zdunek, Rafal
    Amari, Shun-Ichi
    IEEE SIGNAL PROCESSING MAGAZINE, 2008, 25 (01) : 142 - 145
  • [10] Parallel Nonnegative Tensor Factorization via Newton Iteration on Matrices
    Flatz, Markus
    Vajtersic, Marian
    2014 INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING & SIMULATION (HPCS), 2014, : 1014 - 1015