Low-rank factorization for rank minimization with nonconvex regularizers

被引:4
|
作者
Sagan, April [1 ]
Mitchell, John E. [1 ]
机构
[1] Rensselaer Polytech Inst, Dept Math Sci, Troy, NY 12180 USA
基金
美国国家科学基金会;
关键词
Rank minimization; Matrix completion; Nonconvex regularizers; Semidefinite programming; MATRIX COMPLETION; VARIABLE SELECTION; ALGORITHM;
D O I
10.1007/s10589-021-00276-5
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
Rank minimization is of interest in machine learning applications such as recommender systems and robust principal component analysis. Minimizing the convex relaxation to the rank minimization problem, the nuclear norm, is an effective technique to solve the problem with strong performance guarantees. However, nonconvex relaxations have less estimation bias than the nuclear norm and can more accurately reduce the effect of noise on the measurements. We develop efficient algorithms based on iteratively reweighted nuclear norm schemes, while also utilizing the low rank factorization for semidefinite programs put forth by Burer and Monteiro. We prove convergence and computationally show the advantages over convex relaxations and alternating minimization methods. Additionally, the computational complexity of each iteration of our algorithm is on par with other state of the art algorithms, allowing us to quickly find solutions to the rank minimization problem for large matrices.
引用
收藏
页码:273 / 300
页数:28
相关论文
共 50 条
  • [21] NONCONVEX ROBUST LOW-RANK MATRIX RECOVERY
    Li, Xiao
    Zhu, Zhihui
    So, Anthony Man-Cho
    Vidal, Rene
    SIAM JOURNAL ON OPTIMIZATION, 2020, 30 (01) : 660 - 686
  • [22] Robust Recovery of Corrupted Low-Rank Matrix by Implicit Regularizers
    He, Ran
    Tan, Tieniu
    Wang, Liang
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2014, 36 (04) : 770 - 783
  • [23] Stable recovery of low-rank matrix via nonconvex Schatten p-minimization
    Chen WenGu
    Li YaLing
    SCIENCE CHINA-MATHEMATICS, 2015, 58 (12) : 2643 - 2654
  • [24] Phase retrieval from multiple FRFT measurements based on nonconvex low-rank minimization
    Su, Xinhua
    Tao, Ran
    Li, Yongzhe
    SIGNAL PROCESSING, 2022, 198
  • [25] Stable recovery of low-rank matrix via nonconvex Schatten p-minimization
    WenGu Chen
    YaLing Li
    Science China Mathematics, 2015, 58 : 2643 - 2654
  • [26] Stable recovery of low-rank matrix via nonconvex Schatten p-minimization
    CHEN WenGu
    LI YaLing
    Science China(Mathematics), 2015, 58 (12) : 2643 - 2654
  • [27] EXACT LOW-RANK MATRIX RECOVERY VIA NONCONVEX SCHATTEN p-MINIMIZATION
    Kong, Lingchen
    Xiu, Naihua
    ASIA-PACIFIC JOURNAL OF OPERATIONAL RESEARCH, 2013, 30 (03)
  • [28] Image registration via low-rank factorization and maximum rank resolving
    Wenjie Zhang
    Qingyu Xiong
    Multimedia Tools and Applications, 2017, 76 : 23643 - 23659
  • [29] Image registration via low-rank factorization and maximum rank resolving
    Zhang, Wenjie
    Xiong, Qingyu
    MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (22) : 23643 - 23659
  • [30] Low-Rank Matrix Recovery via Continuation-Based Approximate Low-Rank Minimization
    Zhang, Xiang
    Gao, Yongqiang
    Lan, Long
    Guo, Xiaowei
    Huang, Xuhui
    Luo, Zhigang
    PRICAI 2018: TRENDS IN ARTIFICIAL INTELLIGENCE, PT I, 2018, 11012 : 559 - 573