On the convergence of the iterates of proximal gradient algorithm with extrapolation for convex nonsmooth minimization problems

被引:2
|
作者
Wen, Bo [1 ,2 ]
Xue, Xiaoping [2 ,3 ]
机构
[1] Hebei Univ Technol, Inst Math, Tianjin, Peoples R China
[2] Harbin Inst Technol, Dept Math, Harbin, Heilongjiang, Peoples R China
[3] Harbin Inst Technol, Inst Adv Study Math, Harbin, Heilongjiang, Peoples R China
关键词
Convex minimization; Proximal gradient algorithm; Extrapolation; Lojasiewicz inequality; Convergence;
D O I
10.1007/s10898-019-00789-8
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
In this paper, we consider the proximal gradient algorithm with extrapolation for solving a class of convex nonsmooth minimization problems. We show that for a large class of extrapolation parameters including the extrapolation parameters chosen in FISTA (Beck and Teboulle in SIAM J Imaging Sci 2:183-202, 2009), the successive changes of iterates go to 0. Moreover, based on the Lojasiewicz inequality, we establish the global convergence of iterates generated by the proximal gradient algorithm with extrapolation with an additional assumption on the extrapolation coefficients. The assumption is general enough to allow the threshold of the extrapolation coefficients to be 1. In particular, we prove the length of the iterates is finite. Finally, we perform numerical experiments on the least squares problems with l(1) regularization to illustrate our theoretical results.
引用
收藏
页码:767 / 787
页数:21
相关论文
共 50 条
  • [1] On the convergence of the iterates of proximal gradient algorithm with extrapolation for convex nonsmooth minimization problems
    Bo Wen
    Xiaoping Xue
    Journal of Global Optimization, 2019, 75 : 767 - 787
  • [2] CONVERGENCE ANALYSIS OF PROXIMAL GRADIENT ALGORITHM WITH EXTRAPOLATION FOR A CLASS OF CONVEX NONSMOOTH MINIMIZATION PROBLEMS
    Pan, Mengxi
    Wen, Bo
    PACIFIC JOURNAL OF OPTIMIZATION, 2023, 19 (03): : 477 - 487
  • [3] LINEAR CONVERGENCE OF PROXIMAL GRADIENT ALGORITHM WITH EXTRAPOLATION FOR A CLASS OF NONCONVEX NONSMOOTH MINIMIZATION PROBLEMS
    Wen, Bo
    Chen, Xiaojun
    Pong, Ting Kei
    SIAM JOURNAL ON OPTIMIZATION, 2017, 27 (01) : 124 - 145
  • [4] On the Linear Convergence of a Proximal Gradient Method for a Class of Nonsmooth Convex Minimization Problems
    Zhang, Haibin
    Jiang, Jiaojiao
    Luo, Zhi-Quan
    JOURNAL OF THE OPERATIONS RESEARCH SOCIETY OF CHINA, 2013, 1 (02) : 163 - 186
  • [5] Bregman Proximal Gradient Algorithm With Extrapolation for a Class of Nonconvex Nonsmooth Minimization Problems
    Zhang, Xiaoya
    Barrio, Roberto
    Angeles Martinez, M.
    Jiang, Hao
    Cheng, Lizhi
    IEEE ACCESS, 2019, 7 : 126515 - 126529
  • [6] Bregman proximal gradient algorithm with extrapolation for a class of nonconvex nonsmooth minimization problems
    Department of Mathematics, National University of Defense Technology, Changsha, Hunan
    410073, China
    不详
    不详
    410073, China
    arXiv,
  • [7] ON CONVERGENCE ANALYSIS OF DUAL PROXIMAL-GRADIENT METHODS WITH APPROXIMATE GRADIENT FOR A CLASS OF NONSMOOTH CONVEX MINIMIZATION PROBLEMS
    Liu, Sanming
    Wang, Zhijie
    Liu, Chongyang
    JOURNAL OF INDUSTRIAL AND MANAGEMENT OPTIMIZATION, 2016, 12 (01) : 389 - 402
  • [8] An inexact proximal gradient algorithm with extrapolation for a class of nonconvex nonsmooth optimization problems
    Jia, Zehui
    Wu, Zhongming
    Dong, Xiaomei
    JOURNAL OF INEQUALITIES AND APPLICATIONS, 2019, 2019 (1)
  • [9] An inexact proximal gradient algorithm with extrapolation for a class of nonconvex nonsmooth optimization problems
    Zehui Jia
    Zhongming Wu
    Xiaomei Dong
    Journal of Inequalities and Applications, 2019
  • [10] PROXIMAL ITERATIVE GAUSSIAN SMOOTHING ALGORITHM FOR A CLASS OF NONSMOOTH CONVEX MINIMIZATION PROBLEMS
    Liu, Sanming
    Wang, Zhijie
    Liu, Chongyang
    NUMERICAL ALGEBRA CONTROL AND OPTIMIZATION, 2015, 5 (01): : 79 - 89