Nesterov's Method for Convex Optimization

被引:6
|
作者
Walkington, Noel J. [1 ]
机构
[1] Carnegie Mellon Univ, Dept Math, Pittsburgh, PA 15213 USA
关键词
convex optimization; Nesterov's algorithm; steepest descent;
D O I
10.1137/21M1390037
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
While Nesterov's algorithm for computing the minimum of a convex function is now over forty years old, it is rarely presented in texts for a first course in optimization. This is unfortunate since for many problems this algorithm is superior to the ubiquitous steepest descent algorithm, and it is equally simple to implement. This article presents an elementary analysis of Nesterov's algorithm that parallels that of steepest descent. It is envisioned that this presentation of Nesterov's algorithm could easily be covered in a few lectures following the introductory material on convex functions and steepest descent included in every course on optimization.
引用
收藏
页码:539 / 562
页数:24
相关论文
共 50 条
  • [31] Polyak Minorant Method for Convex Optimization
    Devanathan, Nikhil
    Boyd, Stephen
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2024, 203 (03) : 2263 - 2282
  • [32] New method for nonsmooth convex optimization
    Wei, Z
    Qi, L
    Birge, JR
    JOURNAL OF INEQUALITIES AND APPLICATIONS, 1998, 2 (02) : 157 - 179
  • [33] Barrier method in nonsmooth convex optimization without convex representation
    Dutta, Joydeep
    OPTIMIZATION LETTERS, 2015, 9 (06) : 1177 - 1185
  • [34] Accelerated Distributed Nesterov Gradient Descent for Convex and Smooth Functions
    Qu, Guannan
    Li, Na
    2017 IEEE 56TH ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2017,
  • [35] Barrier method in nonsmooth convex optimization without convex representation
    Joydeep Dutta
    Optimization Letters, 2015, 9 : 1177 - 1185
  • [36] On the Practical Robustness of the Nesterov's Accelerated Quasi-Newton Method
    Indrapriyadarsini, S.
    Ninomiya, Hiroshi
    Kamio, Takeshi
    Asai, Hideki
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 12884 - 12885
  • [37] A Neural Network approach to Analog Circuit Design Optimization using Nesterov's Accelerated Quasi-Newton Method
    Indrapriyadarsini, S.
    Mahboubi, Shahrzad
    Ninomiya, Hiroshi
    Kamio, Takeshi
    Asai, Hideki
    2020 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2020,
  • [38] A Stochastic Quasi-Newton Method with Nesterov's Accelerated Gradient
    Indrapriyadarsini, S.
    Mahboubi, Shahrzad
    Ninomiya, Hiroshi
    Asai, Hideki
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2019, PT I, 2020, 11906 : 743 - 760
  • [39] Dynamical Primal-Dual Nesterov Accelerated Method and Its Application to Network Optimization
    Zeng, Xianlin
    Lei, Jinlong
    Chen, Jie
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2023, 68 (03) : 1760 - 1767
  • [40] An engineering interpretation of Nesterov's convex minimization algorithm and time integration: application to optimal fiber orientation
    Areias, P.
    Rabczuk, T.
    COMPUTATIONAL MECHANICS, 2021, 68 (01) : 211 - 227