Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications

被引:0
|
作者
Yaohua Hu
Chong Li
Jinhua Wang
Xiaoqi Yang
Linglingzhi Zhu
机构
[1] Shenzhen University,College of Mathematics and Statistics
[2] Zhejiang University,School of Mathematical Sciences
[3] Hangzhou Normal University,Department of Mathematics
[4] The Hong Kong Polytechnic University,Department of Applied Mathematics
[5] The Chinese University of Hong Kong,Department of Systems Engineering and Engineering Management
来源
关键词
Convex composite optimization; Linearized proximal algorithm; Adaptive stepsize; Quadratic convergence; Convex inclusion problem; Primary 65K05; 49M37; Secondary 90C26;
D O I
暂无
中图分类号
学科分类号
摘要
We propose an inexact linearized proximal algorithm with an adaptive stepsize, together with its globalized version based on the backtracking line-search, to solve a convex composite optimization problem. Under the assumptions of local weak sharp minima of order p(p≥1)\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$p\ (p\ge 1)$$\end{document} for the outer convex function and a quasi-regularity condition for the inclusion problem associated to the inner function, we establish superlinear/quadratic convergence results for proposed algorithms. Compared to the linearized proximal algorithms with a constant stepsize proposed in Hu et al. (SIAM J Optim 26(2):1207–1235, 2016), our algorithms own broader applications and higher convergence rates, and the idea of analysis used in the present paper deviates significantly from that of Hu et al. (2016). Numerical applications to the nonnegative inverse eigenvalue problem and the wireless sensor network localization problem indicate that the proposed algorithms are more efficient and robust, and outperform the algorithms in Hu et al. (2016) and some popular algorithms for relevant problems.
引用
收藏
相关论文
共 50 条
  • [1] Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications
    Hu, Yaohua
    Li, Chong
    Wang, Jinhua
    Yang, Xiaoqi
    Zhu, Linglingzhi
    APPLIED MATHEMATICS AND OPTIMIZATION, 2023, 87 (03):
  • [2] ON CONVERGENCE RATES OF LINEARIZED PROXIMAL ALGORITHMS FOR CONVEX COMPOSITE OPTIMIZATION WITH APPLICATIONS
    Hu, Yaohua
    Li, Chong
    Yang, Xiaoqi
    SIAM JOURNAL ON OPTIMIZATION, 2016, 26 (02) : 1207 - 1235
  • [3] Decentralized Inexact Proximal Gradient Method With Network-Independent Stepsizes for Convex Composite Optimization
    Guo, Luyao
    Shi, Xinli
    Cao, Jinde
    Wang, Zihao
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2023, 71 : 786 - 801
  • [4] Decentralized proximal splitting algorithms for composite constrained convex optimization
    Zheng, Lifeng
    Ran, Liang
    Li, Huaqing
    Feng, Liping
    Wang, Zheng
    Lu, Qingguo
    Xia, Dawen
    JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2022, 359 (14): : 7482 - 7509
  • [5] FAC (FAST ADAPTIVE COMPOSITE) ALGORITHMS IN CONVEX-OPTIMIZATION
    BOYER, R
    RAIRO-MATHEMATICAL MODELLING AND NUMERICAL ANALYSIS-MODELISATION MATHEMATIQUE ET ANALYSE NUMERIQUE, 1994, 28 (01): : 95 - 119
  • [6] Double Inertial Proximal Gradient Algorithms for Convex Optimization Problems and Applications
    Kankam, Kunrada
    Cholamjiak, Prasit
    ACTA MATHEMATICA SCIENTIA, 2023, 43 (03) : 1462 - 1476
  • [7] DOUBLE INERTIAL PROXIMAL GRADIENT ALGORITHMS FOR CONVEX OPTIMIZATION PROBLEMS AND APPLICATIONS
    Kunrada KANKAM
    Prasit CHOLAMJIAK
    Acta Mathematica Scientia, 2023, 43 (03) : 1462 - 1476
  • [8] Double Inertial Proximal Gradient Algorithms for Convex Optimization Problems and Applications
    Kunrada Kankam
    Prasit Cholamjiak
    Acta Mathematica Scientia, 2023, 43 : 1462 - 1476
  • [9] Adaptive proximal algorithms for convex optimization under local Lipschitz continuity of the gradient
    Latafat, Puya
    Themelis, Andreas
    Stella, Lorenzo
    Patrinos, Panagiotis
    MATHEMATICAL PROGRAMMING, 2024,
  • [10] Fast proximal algorithms for nonsmooth convex optimization
    Ouorou, Adam
    OPERATIONS RESEARCH LETTERS, 2020, 48 (06) : 777 - 783