Alternating direction method of multipliers with difference of convex functions

被引:21
|
作者
Sun, Tao [1 ]
Yin, Penghang [2 ]
Cheng, Lizhi [3 ,4 ]
Jiang, Hao [5 ]
机构
[1] Natl Univ Def Technol, Coll Sci, Changsha 410073, Hunan, Peoples R China
[2] Univ Calif Los Angeles, Dept Math, Los Angeles, CA 90095 USA
[3] Natl Univ Def Technol, Coll Sci, Changsha 410073, Hunan, Peoples R China
[4] Natl Univ Def Technol, State Key Lab High Performance Computat, Changsha 410073, Hunan, Peoples R China
[5] Natl Univ Def Technol, Coll Comp, Changsha 410073, Hunan, Peoples R China
基金
美国国家科学基金会;
关键词
Nonconvex; Alternating direction method of multipliers; Difference of convex functions; Kurdyka-Lojasiewicz property; MINIMIZATION; CONVERGENCE; NONCONVEX; ALGORITHM;
D O I
10.1007/s10444-017-9559-3
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper, we consider the minimization of a class of nonconvex composite functions with difference of convex structure under linear constraints. While this kind of problems in theory can be solved by the celebrated alternating direction method of multipliers (ADMM), a direct application of ADMM often leads to difficult nonconvex subproblems. To address this issue, we propose to convexify the subproblems through a linearization technique as done in the difference of convex functions algorithm (DCA). By assuming the Kurdyka-Aojasiewicz property, we prove that the resulting algorithm sequentially converges to a critical point. It turns out that in the applications of signal and image processing such as compressed sensing and image denoising, the proposed algorithm usually enjoys closed-form solutions of the subproblems and thus can be very efficient. We provide numerical experiments to demonstrate the effectiveness of our algorithm.
引用
收藏
页码:723 / 744
页数:22
相关论文
共 50 条
  • [21] A HOMOTOPY-BASED ALTERNATING DIRECTION METHOD OF MULTIPLIERS FOR STRUCTURED CONVEX OPTIMIZATION
    Yiqing Dai
    Zheng Peng
    Annals of Applied Mathematics, 2015, 31 (03) : 262 - 273
  • [22] Distributed Linearized Alternating Direction Method of Multipliers for Composite Convex Consensus Optimization
    Aybat, N. S.
    Wang, Z.
    Lin, T.
    Ma, S.
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2018, 63 (01) : 5 - 20
  • [23] An alternating direction method of multipliers with the BFGS update for structured convex quadratic optimization
    Gu, Yan
    Yamashita, Nobuo
    COMPUTATIONAL & APPLIED MATHEMATICS, 2021, 40 (03):
  • [24] A golden ratio proximal alternating direction method of multipliers for separable convex optimization
    Chen, Hongmei
    Gu, Guoyong
    Yang, Junfeng
    JOURNAL OF GLOBAL OPTIMIZATION, 2023, 87 (2-4) : 581 - 602
  • [25] Linear Rate Convergence of the Alternating Direction Method of Multipliers for Convex Composite Programming
    Han, Deren
    Sun, Defeng
    Zhang, Liwei
    MATHEMATICS OF OPERATIONS RESEARCH, 2018, 43 (02) : 622 - 637
  • [26] Alternating Direction Method of Multipliers for Convex Optimization in Machine Learning Interpretation and Implementation
    Huang, Kuan-Min
    Samani, Hooman
    Yang, Chan-Yun
    Chen, Jie-Sheng
    2022 2ND INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND ROBOTICS (ICIPROB), 2022,
  • [27] A golden ratio proximal alternating direction method of multipliers for separable convex optimization
    Hongmei Chen
    Guoyong Gu
    Junfeng Yang
    Journal of Global Optimization, 2023, 87 : 581 - 602
  • [28] A fundamental proof of convergence of alternating direction method of multipliers for weakly convex optimization
    Zhang, Tao
    Shen, Zhengwei
    JOURNAL OF INEQUALITIES AND APPLICATIONS, 2019, 2019 (1)
  • [29] Convergence Analysis of Alternating Direction Method of Multipliers for a Class of Separable Convex Programming
    Jia, Zehui
    Guo, Ke
    Cai, Xingju
    ABSTRACT AND APPLIED ANALYSIS, 2013,
  • [30] A Homotopy Alternating Direction Method of Multipliers for Linearly Constrained Separable Convex Optimization
    Yang J.
    Dai Y.-Q.
    Peng Z.
    Zhuang J.-P.
    Zhu W.-X.
    Journal of the Operations Research Society of China, 2017, 5 (2) : 271 - 290