Low-rank factorization for rank minimization with nonconvex regularizers

被引:4
|
作者
Sagan, April [1 ]
Mitchell, John E. [1 ]
机构
[1] Rensselaer Polytech Inst, Dept Math Sci, Troy, NY 12180 USA
基金
美国国家科学基金会;
关键词
Rank minimization; Matrix completion; Nonconvex regularizers; Semidefinite programming; MATRIX COMPLETION; VARIABLE SELECTION; ALGORITHM;
D O I
10.1007/s10589-021-00276-5
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
Rank minimization is of interest in machine learning applications such as recommender systems and robust principal component analysis. Minimizing the convex relaxation to the rank minimization problem, the nuclear norm, is an effective technique to solve the problem with strong performance guarantees. However, nonconvex relaxations have less estimation bias than the nuclear norm and can more accurately reduce the effect of noise on the measurements. We develop efficient algorithms based on iteratively reweighted nuclear norm schemes, while also utilizing the low rank factorization for semidefinite programs put forth by Burer and Monteiro. We prove convergence and computationally show the advantages over convex relaxations and alternating minimization methods. Additionally, the computational complexity of each iteration of our algorithm is on par with other state of the art algorithms, allowing us to quickly find solutions to the rank minimization problem for large matrices.
引用
收藏
页码:273 / 300
页数:28
相关论文
共 50 条
  • [1] Low-rank factorization for rank minimization with nonconvex regularizers
    April Sagan
    John E. Mitchell
    Computational Optimization and Applications, 2021, 79 : 273 - 300
  • [2] Generalized Nonconvex Nonsmooth Low-Rank Minimization
    Lu, Canyi
    Tang, Jinhui
    Yan, Shuicheng
    Lin, Zhouchen
    2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 4130 - 4137
  • [3] Large-Scale Low-Rank Matrix Learning with Nonconvex Regularizers
    Yao, Quanming
    Kwok, James T.
    Wang, Taifeng
    Liu, Tie-Yan
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (11) : 2628 - 2643
  • [4] Nonconvex Low-Rank Sparse Factorization for Image Segmentation
    Li, Xiaoping
    Wang, Weiwei
    Razi, Amir
    Li, Tao
    2015 11TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND SECURITY (CIS), 2015, : 227 - 230
  • [5] Nonconvex Optimization Meets Low-Rank Matrix Factorization: An Overview
    Chi, Yuejie
    Lu, Yue M.
    Chen, Yuxin
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2019, 67 (20) : 5239 - 5269
  • [6] Low-rank matrix factorization with nonconvex regularization and bilinear decomposition
    Wang, Sijie
    Xia, Kewen
    Wang, Li
    Yin, Zhixian
    He, Ziping
    Zhang, Jiangnan
    Aslam, Naila
    SIGNAL PROCESSING, 2022, 201
  • [7] Efficient Recovery of Low-Rank Matrix via Double Nonconvex Nonsmooth Rank Minimization
    Zhang, Hengmin
    Gong, Chen
    Qian, Jianjun
    Zhang, Bob
    Xu, Chunyan
    Yang, Jian
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (10) : 2916 - 2925
  • [8] Nonconvex low-rank tensor minimization based on lp norm
    Su Y.
    Liu G.
    Liu W.
    Zhu D.
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2019, 32 (06): : 494 - 503
  • [9] Low-rank matrix recovery via novel double nonconvex nonsmooth rank minimization with ADMM
    Yulin Wang
    Yunjie Zhang
    Xianping Fu
    Multimedia Tools and Applications, 2024, 83 : 15547 - 15564
  • [10] Low-rank matrix recovery via novel double nonconvex nonsmooth rank minimization with ADMM
    Wang, Yulin
    Zhang, Yunjie
    Fu, Xianping
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (06) : 15547 - 15564