Low-rank factorization for rank minimization with nonconvex regularizers

被引:4
|
作者
Sagan, April [1 ]
Mitchell, John E. [1 ]
机构
[1] Rensselaer Polytech Inst, Dept Math Sci, Troy, NY 12180 USA
基金
美国国家科学基金会;
关键词
Rank minimization; Matrix completion; Nonconvex regularizers; Semidefinite programming; MATRIX COMPLETION; VARIABLE SELECTION; ALGORITHM;
D O I
10.1007/s10589-021-00276-5
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
Rank minimization is of interest in machine learning applications such as recommender systems and robust principal component analysis. Minimizing the convex relaxation to the rank minimization problem, the nuclear norm, is an effective technique to solve the problem with strong performance guarantees. However, nonconvex relaxations have less estimation bias than the nuclear norm and can more accurately reduce the effect of noise on the measurements. We develop efficient algorithms based on iteratively reweighted nuclear norm schemes, while also utilizing the low rank factorization for semidefinite programs put forth by Burer and Monteiro. We prove convergence and computationally show the advantages over convex relaxations and alternating minimization methods. Additionally, the computational complexity of each iteration of our algorithm is on par with other state of the art algorithms, allowing us to quickly find solutions to the rank minimization problem for large matrices.
引用
收藏
页码:273 / 300
页数:28
相关论文
共 50 条
  • [31] Iterative tensor eigen rank minimization for low-rank tensor completion
    Su, Liyu
    Liu, Jing
    Tian, Xiaoqing
    Huang, Kaiyu
    Tan, Shuncheng
    INFORMATION SCIENCES, 2022, 616 : 303 - 329
  • [32] On the Minimal Problems of Low-Rank Matrix Factorization
    Jiang, Fangyuan
    Oskarsson, Magnus
    Astrom, Kalle
    2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 2549 - 2557
  • [33] Structural Identifiability in Low-Rank Matrix Factorization
    Fritzilas, Epameinondas
    Milanic, Martin
    Rahmann, Sven
    Rios-Solis, Yasmin A.
    ALGORITHMICA, 2010, 56 (03) : 313 - 332
  • [34] Adaptive quantile low-rank matrix factorization
    Xu, Shuang
    Zhang, Chun-Xia
    Zhang, Jiangshe
    PATTERN RECOGNITION, 2020, 103
  • [35] Structural Identifiability in Low-Rank Matrix Factorization
    Epameinondas Fritzilas
    Martin Milanič
    Sven Rahmann
    Yasmin A. Rios-Solis
    Algorithmica, 2010, 56 : 313 - 332
  • [36] Approximate low-rank factorization with structured factors
    Markovsky, Ivan
    Niranjan, Mahesan
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2010, 54 (12) : 3411 - 3420
  • [37] Low-Rank Factorization of Determinantal Point Processes
    Gartrell, Mike
    Paquet, Ulrich
    Koenigstein, Noam
    THIRTY-FIRST AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 1912 - 1918
  • [38] ON THE COMPLEXITY OF THE BLOCK LOW-RANK MULTIFRONTAL FACTORIZATION
    Amestoy, Patrick
    Buttari, Alfredo
    L'Excellent, Jean-Yves
    Mary, Theo
    SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2017, 39 (04): : A1710 - A1740
  • [39] Tensor Factorization for Low-Rank Tensor Completion
    Zhou, Pan
    Lu, Canyi
    Lin, Zhouchen
    Zhang, Chao
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (03) : 1152 - 1163
  • [40] Dropout as a Low-Rank Regularizer for Matrix Factorization
    Cavazza, Jacopo
    Haeffele, Benjamin D.
    Lane, Connor
    Morerio, Pietro
    Murino, Vittorio
    Vidal, Rene
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 84, 2018, 84