Alternating direction method of multipliers with difference of convex functions

被引:21
|
作者
Sun, Tao [1 ]
Yin, Penghang [2 ]
Cheng, Lizhi [3 ,4 ]
Jiang, Hao [5 ]
机构
[1] Natl Univ Def Technol, Coll Sci, Changsha 410073, Hunan, Peoples R China
[2] Univ Calif Los Angeles, Dept Math, Los Angeles, CA 90095 USA
[3] Natl Univ Def Technol, Coll Sci, Changsha 410073, Hunan, Peoples R China
[4] Natl Univ Def Technol, State Key Lab High Performance Computat, Changsha 410073, Hunan, Peoples R China
[5] Natl Univ Def Technol, Coll Comp, Changsha 410073, Hunan, Peoples R China
基金
美国国家科学基金会;
关键词
Nonconvex; Alternating direction method of multipliers; Difference of convex functions; Kurdyka-Lojasiewicz property; MINIMIZATION; CONVERGENCE; NONCONVEX; ALGORITHM;
D O I
10.1007/s10444-017-9559-3
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper, we consider the minimization of a class of nonconvex composite functions with difference of convex structure under linear constraints. While this kind of problems in theory can be solved by the celebrated alternating direction method of multipliers (ADMM), a direct application of ADMM often leads to difficult nonconvex subproblems. To address this issue, we propose to convexify the subproblems through a linearization technique as done in the difference of convex functions algorithm (DCA). By assuming the Kurdyka-Aojasiewicz property, we prove that the resulting algorithm sequentially converges to a critical point. It turns out that in the applications of signal and image processing such as compressed sensing and image denoising, the proposed algorithm usually enjoys closed-form solutions of the subproblems and thus can be very efficient. We provide numerical experiments to demonstrate the effectiveness of our algorithm.
引用
收藏
页码:723 / 744
页数:22
相关论文
共 50 条
  • [1] Alternating direction method of multipliers with difference of convex functions
    Tao Sun
    Penghang Yin
    Lizhi Cheng
    Hao Jiang
    Advances in Computational Mathematics, 2018, 44 : 723 - 744
  • [2] Alternating Direction Method of Multipliers for Separable Convex Optimization of Real Functions in Complex Variables
    Li, Lu
    Wang, Xingyu
    Wang, Guoqiang
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2015, 2015
  • [3] A hybrid Bregman alternating direction method of multipliers for the linearly constrained difference-of-convex problems
    Kai Tu
    Haibin Zhang
    Huan Gao
    Junkai Feng
    Journal of Global Optimization, 2020, 76 : 665 - 693
  • [4] A hybrid Bregman alternating direction method of multipliers for the linearly constrained difference-of-convex problems
    Tu, Kai
    Zhang, Haibin
    Gao, Huan
    Feng, Junkai
    JOURNAL OF GLOBAL OPTIMIZATION, 2020, 76 (04) : 665 - 693
  • [5] Optimally linearizing the alternating direction method of multipliers for convex programming
    Bingsheng He
    Feng Ma
    Xiaoming Yuan
    Computational Optimization and Applications, 2020, 75 : 361 - 388
  • [6] Optimally linearizing the alternating direction method of multipliers for convex programming
    He, Bingsheng
    Ma, Feng
    Yuan, Xiaoming
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2020, 75 (02) : 361 - 388
  • [7] Infeasibility Detection in the Alternating Direction Method of Multipliers for Convex Optimization
    Banjac, Goran
    Goulart, Paul
    Stellato, Bartolomeo
    Boyd, Stephen
    2018 UKACC 12TH INTERNATIONAL CONFERENCE ON CONTROL (CONTROL), 2018, : 340 - 340
  • [8] Infeasibility Detection in the Alternating Direction Method of Multipliers for Convex Optimization
    Goran Banjac
    Paul Goulart
    Bartolomeo Stellato
    Stephen Boyd
    Journal of Optimization Theory and Applications, 2019, 183 : 490 - 519
  • [9] Infeasibility Detection in the Alternating Direction Method of Multipliers for Convex Optimization
    Banjac, Goran
    Goulart, Paul
    Stellato, Bartolomeo
    Boyd, Stephen
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2019, 183 (02) : 490 - 519
  • [10] LINEARIZED ALTERNATING DIRECTION METHOD OF MULTIPLIERS FOR SEPARABLE CONVEX OPTIMIZATION OF REAL FUNCTIONS IN COMPLEX DOMAIN
    Li, Lu
    Wang, Lun
    Wang, Guoqiang
    Li, Na
    Zhang, Juli
    JOURNAL OF APPLIED ANALYSIS AND COMPUTATION, 2019, 9 (05): : 1686 - 1705