Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications

被引:0
|
作者
Yaohua Hu
Chong Li
Jinhua Wang
Xiaoqi Yang
Linglingzhi Zhu
机构
[1] Shenzhen University,College of Mathematics and Statistics
[2] Zhejiang University,School of Mathematical Sciences
[3] Hangzhou Normal University,Department of Mathematics
[4] The Hong Kong Polytechnic University,Department of Applied Mathematics
[5] The Chinese University of Hong Kong,Department of Systems Engineering and Engineering Management
来源
关键词
Convex composite optimization; Linearized proximal algorithm; Adaptive stepsize; Quadratic convergence; Convex inclusion problem; Primary 65K05; 49M37; Secondary 90C26;
D O I
暂无
中图分类号
学科分类号
摘要
We propose an inexact linearized proximal algorithm with an adaptive stepsize, together with its globalized version based on the backtracking line-search, to solve a convex composite optimization problem. Under the assumptions of local weak sharp minima of order p(p≥1)\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$p\ (p\ge 1)$$\end{document} for the outer convex function and a quasi-regularity condition for the inclusion problem associated to the inner function, we establish superlinear/quadratic convergence results for proposed algorithms. Compared to the linearized proximal algorithms with a constant stepsize proposed in Hu et al. (SIAM J Optim 26(2):1207–1235, 2016), our algorithms own broader applications and higher convergence rates, and the idea of analysis used in the present paper deviates significantly from that of Hu et al. (2016). Numerical applications to the nonnegative inverse eigenvalue problem and the wireless sensor network localization problem indicate that the proposed algorithms are more efficient and robust, and outperform the algorithms in Hu et al. (2016) and some popular algorithms for relevant problems.
引用
收藏
相关论文
共 50 条
  • [41] Golden Ratio Proximal Gradient ADMM for Distributed Composite Convex Optimization
    Yin, Chao
    Yang, Junfeng
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2024, 200 (03) : 895 - 922
  • [42] On Stochastic Proximal-Point Method for Convex-Composite Optimization
    Nedic, Angelia
    Tatarenko, Tatiana
    2017 55TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2017, : 198 - 203
  • [43] A single cut proximal bundle method for stochastic convex composite optimization
    Liang, Jiaming
    Guigues, Vincent
    Monteiro, Renato D. C.
    MATHEMATICAL PROGRAMMING, 2024, 208 (1-2) : 173 - 208
  • [44] Golden Ratio Proximal Gradient ADMM for Distributed Composite Convex Optimization
    Chao Yin
    Junfeng Yang
    Journal of Optimization Theory and Applications, 2024, 200 (3) : 895 - 922
  • [45] Adaptive Mirror Descent Algorithms for Convex and Strongly Convex Optimization Problems with Functional Constraints
    Stonyakin F.S.
    Alkousa M.
    Stepanov A.N.
    Titov A.A.
    Journal of Applied and Industrial Mathematics, 2019, 13 (03) : 557 - 574
  • [46] On the asymptotic behavior of the Douglas–Rachford and proximal-point algorithms for convex optimization
    Goran Banjac
    John Lygeros
    Optimization Letters, 2021, 15 : 2719 - 2732
  • [47] Primal-Dual Proximal Algorithms for Structured Convex Optimization: A Unifying Framework
    Latafat, Puya
    Patrinos, Panagiotis
    LARGE-SCALE AND DISTRIBUTED OPTIMIZATION, 2018, 2227 : 97 - 120
  • [48] Proximal Splitting Algorithms for Convex Optimization: A Tour of Recent Advances, with New Twists
    Condat, Laurent
    Kitahara, Daichi
    Contreras, Andres
    Hirabayashi, Akira
    SIAM REVIEW, 2023, 65 (02) : 375 - 435
  • [49] Fast Inertial Proximal ADMM Algorithms for Convex Structured Optimization with Linear Constraint
    Attouch, Hedy
    MINIMAX THEORY AND ITS APPLICATIONS, 2021, 6 (01): : 1 - 24
  • [50] The log-quadratic proximal methodology in convex optimization algorithms and variational inequalities
    Auslender, A
    Teboulle, M
    EQUILIBRIUM PROBLEMS AND VARIATIONAL MODELS, 2003, 68 : 19 - 52