Alternating direction method of multipliers with difference of convex functions

被引:21
|
作者
Sun, Tao [1 ]
Yin, Penghang [2 ]
Cheng, Lizhi [3 ,4 ]
Jiang, Hao [5 ]
机构
[1] Natl Univ Def Technol, Coll Sci, Changsha 410073, Hunan, Peoples R China
[2] Univ Calif Los Angeles, Dept Math, Los Angeles, CA 90095 USA
[3] Natl Univ Def Technol, Coll Sci, Changsha 410073, Hunan, Peoples R China
[4] Natl Univ Def Technol, State Key Lab High Performance Computat, Changsha 410073, Hunan, Peoples R China
[5] Natl Univ Def Technol, Coll Comp, Changsha 410073, Hunan, Peoples R China
基金
美国国家科学基金会;
关键词
Nonconvex; Alternating direction method of multipliers; Difference of convex functions; Kurdyka-Lojasiewicz property; MINIMIZATION; CONVERGENCE; NONCONVEX; ALGORITHM;
D O I
10.1007/s10444-017-9559-3
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper, we consider the minimization of a class of nonconvex composite functions with difference of convex structure under linear constraints. While this kind of problems in theory can be solved by the celebrated alternating direction method of multipliers (ADMM), a direct application of ADMM often leads to difficult nonconvex subproblems. To address this issue, we propose to convexify the subproblems through a linearization technique as done in the difference of convex functions algorithm (DCA). By assuming the Kurdyka-Aojasiewicz property, we prove that the resulting algorithm sequentially converges to a critical point. It turns out that in the applications of signal and image processing such as compressed sensing and image denoising, the proposed algorithm usually enjoys closed-form solutions of the subproblems and thus can be very efficient. We provide numerical experiments to demonstrate the effectiveness of our algorithm.
引用
收藏
页码:723 / 744
页数:22
相关论文
共 50 条
  • [41] An Adaptive Alternating Direction Method of Multipliers
    Sedi Bartz
    Rubén Campoy
    Hung M. Phan
    Journal of Optimization Theory and Applications, 2022, 195 : 1019 - 1055
  • [42] A Note on the Alternating Direction Method of Multipliers
    Deren Han
    Xiaoming Yuan
    Journal of Optimization Theory and Applications, 2012, 155 : 227 - 238
  • [43] On the Convergence Properties of a Majorized Alternating Direction Method of Multipliers for Linearly Constrained Convex Optimization Problems with Coupled Objective Functions
    Ying Cui
    Xudong Li
    Defeng Sun
    Kim-Chuan Toh
    Journal of Optimization Theory and Applications, 2016, 169 : 1013 - 1041
  • [44] On the Convergence Properties of a Majorized Alternating Direction Method of Multipliers for Linearly Constrained Convex Optimization Problems with Coupled Objective Functions
    Cui, Ying
    Li, Xudong
    Sun, Defeng
    Toh, Kim-Chuan
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2016, 169 (03) : 1013 - 1041
  • [45] LINEARIZED ALTERNATING DIRECTION METHOD OF MULTIPLIERS WITH GAUSSIAN BACK SUBSTITUTION FOR SEPARABLE CONVEX PROGRAMMING
    He, Bingsheng
    Yuan, Xiaoming
    NUMERICAL ALGEBRA CONTROL AND OPTIMIZATION, 2013, 3 (02): : 247 - 260
  • [46] ALTERNATING DIRECTION METHOD OF MULTIPLIERS WITH VARIABLE METRIC INDEFINITE PROXIMAL TERMS FOR CONVEX OPTIMIZATION
    Gu, Yan
    Yamashita, Nobuo
    NUMERICAL ALGEBRA CONTROL AND OPTIMIZATION, 2020, 10 (04): : 487 - 510
  • [47] A Non-convex Alternating Direction Method of Multipliers Heuristic for Optimal Power Flow
    You, Seungil
    Peng, Qiuyu
    2014 IEEE INTERNATIONAL CONFERENCE ON SMART GRID COMMUNICATIONS (SMARTGRIDCOMM), 2014, : 788 - 793
  • [48] A Penalty Alternating Direction Method of Multipliers for Convex Composite Optimization Over Decentralized Networks
    Zhang, Jiaojiao
    Liu, Huikang
    Sow, Anthony Man-Cho
    Ling, Qing
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2021, 69 : 4282 - 4295
  • [49] Alternating Direction Method of Multipliers for Strictly Convex Quadratic Programs: Optimal Parameter Selection
    Raghunathan, Arvind U.
    Di Cairano, Stefano
    2014 AMERICAN CONTROL CONFERENCE (ACC), 2014, : 4324 - 4329
  • [50] Inexact alternating direction methods of multipliers for separable convex optimization
    Hager, William W.
    Zhang, Hongchao
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2019, 73 (01) : 201 - 235