Low-rank factorization for rank minimization with nonconvex regularizers

被引:4
|
作者
Sagan, April [1 ]
Mitchell, John E. [1 ]
机构
[1] Rensselaer Polytech Inst, Dept Math Sci, Troy, NY 12180 USA
基金
美国国家科学基金会;
关键词
Rank minimization; Matrix completion; Nonconvex regularizers; Semidefinite programming; MATRIX COMPLETION; VARIABLE SELECTION; ALGORITHM;
D O I
10.1007/s10589-021-00276-5
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
Rank minimization is of interest in machine learning applications such as recommender systems and robust principal component analysis. Minimizing the convex relaxation to the rank minimization problem, the nuclear norm, is an effective technique to solve the problem with strong performance guarantees. However, nonconvex relaxations have less estimation bias than the nuclear norm and can more accurately reduce the effect of noise on the measurements. We develop efficient algorithms based on iteratively reweighted nuclear norm schemes, while also utilizing the low rank factorization for semidefinite programs put forth by Burer and Monteiro. We prove convergence and computationally show the advantages over convex relaxations and alternating minimization methods. Additionally, the computational complexity of each iteration of our algorithm is on par with other state of the art algorithms, allowing us to quickly find solutions to the rank minimization problem for large matrices.
引用
收藏
页码:273 / 300
页数:28
相关论文
共 50 条
  • [41] Structural identifiability in low-rank matrix factorization
    Fritzilas, Epameinondas
    Rios-Solis, Yasmin A.
    Rahmann, Sven
    COMPUTING AND COMBINATORICS, PROCEEDINGS, 2008, 5092 : 140 - +
  • [42] A Nonconvex Relaxation Approach to Low-Rank Tensor Completion
    Zhang, Xiongjun
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (06) : 1659 - 1671
  • [43] Low-Rank tensor completion based on nonconvex regularization
    Su, Xinhua
    Ge, Huanmin
    Liu, Zeting
    Shen, Yanfei
    SIGNAL PROCESSING, 2023, 212
  • [44] Tensor Recovery via Nonconvex Low-Rank Approximation
    Chen, Lin
    Jiang, Xue
    Liu, Xingzhao
    Zhou, Zhixin
    28TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2020), 2021, : 710 - 714
  • [45] Discriminative Low-Rank Subspace Learning with Nonconvex Penalty
    Xie, Kan
    Liu, Wei
    Lai, Yue
    Li, Weijun
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2019, 33 (10)
  • [46] Fast Low-Rank Matrix Learning with Nonconvex Regularization
    Yao, Quanming
    Kwok, James T.
    Zhong, Wenliang
    2015 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2015, : 539 - 548
  • [47] A unified framework for nonconvex nonsmooth sparse and low-rank decomposition by majorization-minimization algorithm
    Zheng, Qian-Zhen
    Xu, Ping-Feng
    JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2022, 359 (16): : 9376 - 9400
  • [48] Generalized Low-Rank Matrix Completion via Nonconvex Schatten p-Norm Minimization
    Wu, Qiong
    Zhang, Fan
    Wang, Hao
    Shi, Yuanming
    2018 IEEE 88TH VEHICULAR TECHNOLOGY CONFERENCE (VTC-FALL), 2018,
  • [49] Recovery of Corrupted Low-Rank Matrices via Half-Quadratic based Nonconvex Minimization
    He, Ran
    Sun, Zhenan
    Tan, Tieniu
    Zheng, Wei-Shi
    2011 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2011,
  • [50] LOW-RANK APPROXIMATION OF MATRICES VIA A RANK-REVEALING FACTORIZATION WITH RANDOMIZATION
    Kaloorazi, Maboud Farzaneh
    Chen, Jie
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 5815 - 5819