On the convergence of the iterates of proximal gradient algorithm with extrapolation for convex nonsmooth minimization problems

被引:2
|
作者
Wen, Bo [1 ,2 ]
Xue, Xiaoping [2 ,3 ]
机构
[1] Hebei Univ Technol, Inst Math, Tianjin, Peoples R China
[2] Harbin Inst Technol, Dept Math, Harbin, Heilongjiang, Peoples R China
[3] Harbin Inst Technol, Inst Adv Study Math, Harbin, Heilongjiang, Peoples R China
关键词
Convex minimization; Proximal gradient algorithm; Extrapolation; Lojasiewicz inequality; Convergence;
D O I
10.1007/s10898-019-00789-8
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
In this paper, we consider the proximal gradient algorithm with extrapolation for solving a class of convex nonsmooth minimization problems. We show that for a large class of extrapolation parameters including the extrapolation parameters chosen in FISTA (Beck and Teboulle in SIAM J Imaging Sci 2:183-202, 2009), the successive changes of iterates go to 0. Moreover, based on the Lojasiewicz inequality, we establish the global convergence of iterates generated by the proximal gradient algorithm with extrapolation with an additional assumption on the extrapolation coefficients. The assumption is general enough to allow the threshold of the extrapolation coefficients to be 1. In particular, we prove the length of the iterates is finite. Finally, we perform numerical experiments on the least squares problems with l(1) regularization to illustrate our theoretical results.
引用
收藏
页码:767 / 787
页数:21
相关论文
共 50 条
  • [41] Inertial Proximal Gradient Method Using Adaptive Stepsize for Convex Minimization Problems
    Kankam, Kunrada
    Cholamjiak, Prasit
    THAI JOURNAL OF MATHEMATICS, 2023, 21 (02): : 277 - 287
  • [42] Alternating Proximal Gradient Method for Convex Minimization
    Shiqian Ma
    Journal of Scientific Computing, 2016, 68 : 546 - 572
  • [43] Alternating Proximal Gradient Method for Convex Minimization
    Ma, Shiqian
    JOURNAL OF SCIENTIFIC COMPUTING, 2016, 68 (02) : 546 - 572
  • [44] A proximal difference-of-convex algorithm with extrapolation
    Wen, Bo
    Chen, Xiaojun
    Pong, Ting Kei
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2018, 69 (02) : 297 - 324
  • [45] A proximal difference-of-convex algorithm with extrapolation
    Bo Wen
    Xiaojun Chen
    Ting Kei Pong
    Computational Optimization and Applications, 2018, 69 : 297 - 324
  • [46] A new trust region algorithm for nonsmooth convex minimization
    Zhang, Liping
    APPLIED MATHEMATICS AND COMPUTATION, 2007, 193 (01) : 135 - 142
  • [47] Convergence rate analysis of proximal gradient methods with applications to composite minimization problems
    Sahu, D. R.
    Yao, J. C.
    Verma, M.
    Shukla, K. K.
    OPTIMIZATION, 2021, 70 (01) : 75 - 100
  • [48] Inertial proximal alternating minimization for nonconvex and nonsmooth problems
    Zhang, Yaxuan
    He, Songnian
    JOURNAL OF INEQUALITIES AND APPLICATIONS, 2017,
  • [49] Inertial proximal alternating minimization for nonconvex and nonsmooth problems
    Yaxuan Zhang
    Songnian He
    Journal of Inequalities and Applications, 2017
  • [50] Proximal alternating linearized minimization for nonconvex and nonsmooth problems
    Jérôme Bolte
    Shoham Sabach
    Marc Teboulle
    Mathematical Programming, 2014, 146 : 459 - 494