Alternating direction method of multipliers with difference of convex functions

被引:21
|
作者
Sun, Tao [1 ]
Yin, Penghang [2 ]
Cheng, Lizhi [3 ,4 ]
Jiang, Hao [5 ]
机构
[1] Natl Univ Def Technol, Coll Sci, Changsha 410073, Hunan, Peoples R China
[2] Univ Calif Los Angeles, Dept Math, Los Angeles, CA 90095 USA
[3] Natl Univ Def Technol, Coll Sci, Changsha 410073, Hunan, Peoples R China
[4] Natl Univ Def Technol, State Key Lab High Performance Computat, Changsha 410073, Hunan, Peoples R China
[5] Natl Univ Def Technol, Coll Comp, Changsha 410073, Hunan, Peoples R China
基金
美国国家科学基金会;
关键词
Nonconvex; Alternating direction method of multipliers; Difference of convex functions; Kurdyka-Lojasiewicz property; MINIMIZATION; CONVERGENCE; NONCONVEX; ALGORITHM;
D O I
10.1007/s10444-017-9559-3
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper, we consider the minimization of a class of nonconvex composite functions with difference of convex structure under linear constraints. While this kind of problems in theory can be solved by the celebrated alternating direction method of multipliers (ADMM), a direct application of ADMM often leads to difficult nonconvex subproblems. To address this issue, we propose to convexify the subproblems through a linearization technique as done in the difference of convex functions algorithm (DCA). By assuming the Kurdyka-Aojasiewicz property, we prove that the resulting algorithm sequentially converges to a critical point. It turns out that in the applications of signal and image processing such as compressed sensing and image denoising, the proposed algorithm usually enjoys closed-form solutions of the subproblems and thus can be very efficient. We provide numerical experiments to demonstrate the effectiveness of our algorithm.
引用
收藏
页码:723 / 744
页数:22
相关论文
共 50 条
  • [31] A fundamental proof of convergence of alternating direction method of multipliers for weakly convex optimization
    Tao Zhang
    Zhengwei Shen
    Journal of Inequalities and Applications, 2019
  • [32] An Inertial Alternating Direction Method of Multipliers
    Bot, Radu Ioan
    Csetnek, Ernoe Robert
    MINIMAX THEORY AND ITS APPLICATIONS, 2016, 1 (01): : 29 - 49
  • [33] Parallel alternating direction method of multipliers
    Yan, Jiaqi
    Guo, Fanghong
    Wen, Changyun
    Li, Guoqi
    INFORMATION SCIENCES, 2020, 507 : 185 - 196
  • [34] Distributed Alternating Direction Method of Multipliers
    Wei, Ermin
    Ozdaglar, Asuman
    2012 IEEE 51ST ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2012, : 5445 - 5450
  • [35] An Adaptive Alternating Direction Method of Multipliers
    Bartz, Sedi
    Campoy, Ruben
    Phan, Hung M.
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2022, 195 (03) : 1019 - 1055
  • [36] Bregman Alternating Direction Method of Multipliers
    Wang, Huahua
    Banerjee, Arindam
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 27 (NIPS 2014), 2014, 27
  • [37] A Note on the Alternating Direction Method of Multipliers
    Han, Deren
    Yuan, Xiaoming
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2012, 155 (01) : 227 - 238
  • [38] Alternating Direction Method of Multipliers for Quantization
    Huang, Tianjian
    Singhania, Prajwal
    Sanjabi, Maziar
    Mitra, Pabitra
    Razaviyayn, Meisam
    24TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS (AISTATS), 2021, 130 : 208 - +
  • [39] Accelerated Alternating Direction Method of Multipliers
    Kadkhodaie, Mojtaba
    Christakopoulou, Konstantina
    Sanjabi, Maziar
    Banerjee, Arindam
    KDD'15: PROCEEDINGS OF THE 21ST ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2015, : 497 - 506
  • [40] Emulation Alternating Direction Method of Multipliers
    Routray, Chinmay
    Sahoo, Soumya Ranjan
    2022 EIGHTH INDIAN CONTROL CONFERENCE, ICC, 2022, : 403 - 408