OSGA: a fast subgradient algorithm with optimal complexity

被引:13
|
作者
Neumaier, Arnold [1 ]
机构
[1] Univ Vienna, Fak Math, Oskar Morgenstern Pl 1, A-1090 Vienna, Austria
关键词
Complexity bound; Convex optimization; Optimal subgradient method; Large-scale optimization; Nesterov's optimal method; Nonsmooth optimization; Optimal first-order method; Smooth optimization; Strongly convex; GRADIENT METHODS; CONVEX; MINIMIZATION; SPARSE;
D O I
10.1007/s10107-015-0911-4
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
This paper presents an algorithm for approximately minimizing a convex function in simple, not necessarily bounded convex, finite-dimensional domains, assuming only that function values and subgradients are available. No global information about the objective function is needed apart from a strong convexity parameter (which can be put to zero if only convexity is known). The worst case number of iterations needed to achieve a given accuracy is independent of the dimension and-apart from a constant factor-best possible under a variety of smoothness assumptions on the objective function.
引用
收藏
页码:1 / 21
页数:21
相关论文
共 50 条
  • [41] SUBGRADIENT PROJECTION ALGORITHM .2.
    SREEDHARAN, VP
    JOURNAL OF APPROXIMATION THEORY, 1984, 41 (03) : 217 - 243
  • [42] A weighting subgradient algorithm for multiobjective optimization
    G. C. Bento
    J. X. Cruz Neto
    P. S. M. Santos
    S. S. Souza
    Optimization Letters, 2018, 12 : 399 - 410
  • [43] A modified subgradient algorithm for Lagrangean relaxation
    Fumero, F
    COMPUTERS & OPERATIONS RESEARCH, 2001, 28 (01) : 33 - 52
  • [44] A fast pruning algorithm for optimal sequence alignment
    Davidson, A
    2ND ANNUAL IEEE INTERNATIONAL SYMPOSIUM ON BIOINFORMATICS AND BIOENGINEERING, PROCEEDINGS, 2001, : 49 - 56
  • [45] Iterative Optimal Design for Fast Filter Bank with Low Complexity
    Hao, Jinguang
    Pei, Wenjiang
    Wang, Kai
    Xia, Yili
    Pu, Cunlai
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2016, E99A (02): : 639 - 642
  • [46] A Markovian Incremental Stochastic Subgradient Algorithm
    Massambone, Rafael
    Costa, Eduardo Fontoura
    Helou, Elias Salomao
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2023, 68 (01) : 124 - 139
  • [47] An inexact subgradient algorithm for Equilibrium Problems
    Santos, Paulo
    Scheimberg, Susana
    Computational and Applied Mathematics, 2011, 30 (01) : 91 - 107
  • [48] A weighting subgradient algorithm for multiobjective optimization
    Bento, G. C.
    Cruz Neto, J. X.
    Santos, P. S. M.
    Souza, S. S.
    OPTIMIZATION LETTERS, 2018, 12 (02) : 399 - 410
  • [49] EPSILON-SUBGRADIENT PROJECTION ALGORITHM
    SREEDHARAN, VP
    JOURNAL OF APPROXIMATION THEORY, 1987, 51 (01) : 27 - 46
  • [50] A SUBGRADIENT ALGORITHM AND CLASSIFICATION OF QUALITATIVE DATA
    SCHADER, M
    TUSHAUS, U
    OR SPEKTRUM, 1985, 7 (01) : 1 - 5