The convergence properties of infeasible inexact proximal alternating linearized minimization

被引:2
|
作者
Hu, Yukuan [1 ,2 ]
Liu, Xin [1 ,2 ]
机构
[1] Chinese Acad Sci, Acad Math & Syst Sci, State Key Lab Sci & Engn Comp, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Math Sci, Beijing 100049, Peoples R China
基金
中国国家自然科学基金;
关键词
proximal alternating linearized minimization; infeasibility; nonmonotonicity; surrogate sequence; inexact criterion; iterate convergence; asymptotic convergence rate; Lojasiewicz property; FAST ALGORITHMS; ERROR-BOUNDS; NONCONVEX; PROJECTION; CONVEX; OPTIMIZATION;
D O I
10.1007/s11425-022-2074-7
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The proximal alternating linearized minimization (PALM) method suits well for solving block-structured optimization problems, which are ubiquitous in real applications. In the cases where subproblems do not have closed-form solutions, e.g., due to complex constraints, infeasible subsolvers are indispensable, giving rise to an infeasible inexact PALM (PALM-I). Numerous efforts have been devoted to analyzing the feasible PALM, while little attention has been paid to the PALM-I. The usage of the PALM-I thus lacks a theoretical guarantee. The essential difficulty of analysis consists in the objective value nonmonotonicity induced by the infeasibility. We study in the present work the convergence properties of the PALM-I. In particular, we construct a surrogate sequence to surmount the nonmonotonicity issue and devise an implementable inexact criterion. Based upon these, we manage to establish the stationarity of any accumulation point, and moreover, show the iterate convergence and the asymptotic convergence rates under the assumption of the Lojasiewicz property. The prominent advantages of the PALM-I on CPU time are illustrated via numerical experiments on problems arising from quantum physics and 3-dimensional anisotropic frictional contact.
引用
收藏
页码:2385 / 2410
页数:26
相关论文
共 50 条
  • [21] Matrix Completion via Sparse Factorization Solved by Accelerated Proximal Alternating Linearized Minimization
    Fan, Jicong
    Zhao, Mingbo
    Chow, Tommy W. S.
    IEEE TRANSACTIONS ON BIG DATA, 2020, 6 (01) : 119 - 130
  • [22] Stochastic Gauss–Seidel type inertial proximal alternating linearized minimization and its application to proximal neural networks
    Qingsong Wang
    Deren Han
    Mathematical Methods of Operations Research, 2024, 99 : 39 - 74
  • [23] On the convergence of adaptive first order methods: proximal gradient and alternating minimization algorithms
    Latafat, Puya
    Themelis, Andreas
    Patrinos, Panagiotis
    6TH ANNUAL LEARNING FOR DYNAMICS & CONTROL CONFERENCE, 2024, 242 : 197 - 208
  • [24] A Gauss–Seidel type inertial proximal alternating linearized minimization for a class of nonconvex optimization problems
    Xue Gao
    Xingju Cai
    Deren Han
    Journal of Global Optimization, 2020, 76 : 863 - 887
  • [25] PALMNUT: An Enhanced Proximal Alternating Linearized Minimization Algorithm With Application to Separate Regularization of Magnitude and Phase
    Liu, Yunsong
    Haldar, Justin P.
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2021, 7 : 518 - 530
  • [26] Multi-view Sparse Co-clustering via Proximal Alternating Linearized Minimization
    Sun, Jiangwen
    Lu, Jin
    Xu, Tingyang
    Bi, Jinbo
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 37, 2015, 37 : 757 - 766
  • [27] Correction to: Stochastic Gauss–Seidel type inertial proximal alternating linearized minimization and its application to proximal neural networks
    Qingsong Wang
    Deren Han
    Mathematical Methods of Operations Research, 2024, 99 : 75 - 75
  • [28] Convergence Analysis of an Inexact Infeasible Interior Point Method for Semidefinite Programming
    Stefania Bellavia
    Sandra Pieraccini
    Computational Optimization and Applications, 2004, 29 : 289 - 313
  • [29] Convergence analysis of an inexact infeasible Interior Point method for semidefinite programming
    Bellavia, S
    Pieraccini, S
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2004, 29 (03) : 289 - 313
  • [30] Network manipulation algorithm based on inexact alternating minimization
    David Müller
    Vladimir Shikhman
    Computational Management Science, 2022, 19 : 627 - 664