MGPROX: A NONSMOOTH MULTIGRID PROXIMAL GRADIENT METHOD WITH ADAPTIVE RESTRICTION FOR STRONGLY CONVEX OPTIMIZATION

被引:0
|
作者
Ang, Andersen [1 ]
de Sterck, Hans [2 ]
Vavasis, Stephen [3 ]
机构
[1] Univ Southampton, Elect & Comp Sci, Southampton, England
[2] Univ Waterloo, Dept Appl Math, Waterloo, ON, Canada
[3] Univ Waterloo, Dept Combinator & Optimizat, Waterloo, ON, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
multigrid; restriction; proximal gradient; subdifferential; convex optimization; obstacle problem; MONOTONE-OPERATORS; CONVERGENCE; ALGORITHM;
D O I
10.1137/23M1552140
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We study the combination of proximal gradient descent with multigrid for solving a class of possibly nonsmooth strongly convex optimization problems. We propose a multigrid proximal gradient method called MGProx, which accelerates the proximal gradient method by multigrid, based on using hierarchical information of the optimization problem. MGProx applies a newly introduced adaptive restriction operator to simplify the Minkowski sum of subdifferentials of the nondifferentiable objective function across different levels. We provide a theoretical characterization of MGProx. First we show that the MGProx update operator exhibits a fixed-point property. Next, we show that the coarse correction is a descent direction for the fine variable of the original fine level problem in the general nonsmooth case. Last, under some assumptions we provide the convergence rate for the algorithm. In the numerical tests on the elastic obstacle problem, which is an example of a nonsmooth convex optimization problem where the multigrid method can be applied, we show that MGProx has a faster convergence speed than competing methods.
引用
收藏
页码:2788 / 2820
页数:33
相关论文
共 50 条
  • [1] A Modified Proximal Gradient Method for a Family of Nonsmooth Convex Optimization Problems
    Li Y.-Y.
    Zhang H.-B.
    Li F.
    Journal of the Operations Research Society of China, 2017, 5 (3) : 391 - 403
  • [2] A DUAL BREGMAN PROXIMAL GRADIENT METHOD FOR RELATIVELY-STRONGLY CONVEX OPTIMIZATION
    Liu, Jin-Zan
    Liu, Xin-Wei
    NUMERICAL ALGEBRA CONTROL AND OPTIMIZATION, 2022, 12 (04): : 679 - 692
  • [3] Smoothing Accelerated Proximal Gradient Method with Fast Convergence Rate for Nonsmooth Convex Optimization Beyond Differentiability
    Fan Wu
    Wei Bian
    Journal of Optimization Theory and Applications, 2023, 197 : 539 - 572
  • [4] Smoothing Accelerated Proximal Gradient Method with Fast Convergence Rate for Nonsmooth Convex Optimization Beyond Differentiability
    Wu, Fan
    Bian, Wei
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2023, 197 (02) : 539 - 572
  • [5] Fast Proximal Gradient Methods for Nonsmooth Convex Optimization for Tomographic Image Reconstruction
    Elias S. Helou
    Marcelo V. W. Zibetti
    Gabor T. Herman
    Sensing and Imaging, 2020, 21
  • [6] Fast Proximal Gradient Methods for Nonsmooth Convex Optimization for Tomographic Image Reconstruction
    Helou, Elias S.
    Zibetti, Marcelo V. W.
    Herman, Gabor T.
    SENSING AND IMAGING, 2020, 21 (01):
  • [7] A Simple Proximal Stochastic Gradient Method for Nonsmooth Nonconvex Optimization
    Li, Zhize
    Li, Jian
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [8] PROXIMAL GRADIENT METHOD FOR NONSMOOTH OPTIMIZATION OVER THE STIEFEL MANIFOLD
    Chen, Shixiang
    Ma, Shiqian
    So, Anthony Man-Cho
    Zhang, Tong
    SIAM JOURNAL ON OPTIMIZATION, 2020, 30 (01) : 210 - 239
  • [9] Proximal gradient method for nonconvex and nonsmooth optimization on Hadamard manifolds
    Feng, Shuailing
    Huang, Wen
    Song, Lele
    Ying, Shihui
    Zeng, Tieyong
    OPTIMIZATION LETTERS, 2022, 16 (08) : 2277 - 2297
  • [10] Proximal gradient method for nonconvex and nonsmooth optimization on Hadamard manifolds
    Shuailing Feng
    Wen Huang
    Lele Song
    Shihui Ying
    Tieyong Zeng
    Optimization Letters, 2022, 16 : 2277 - 2297