Adaptive subgradient methods for online learning and stochastic optimization

被引：0
|
作者：
Duchi, John [1 ]
Hazan, Elad [2 ]
Singer, Yoram [3 ]
机构：
[1] Computer Science Division, University of California, Berkeley, Berkeley, CA 94720, United States
[2] Technion - Israel Institute of Technology, Technion City Haifa, 32000, Israel
[3] Google, 1600 Amphitheatre Parkway, Mountain View, CA 94043, United States
来源：
Journal of Machine Learning Research | 2011年 / 12卷
关键词：
D O I：
暂无
中图分类号：
学科分类号：
摘要：
引用
收藏
页码：2121 / 2159
相关论文
共 50 条
  • [41] Convergence of approximate and incremental subgradient methods for convex optimization
    Kiwiel, KC
    SIAM JOURNAL ON OPTIMIZATION, 2004, 14 (03) : 807 - 840
  • [42] Online Learning for DNN Training: A Stochastic Block Adaptive Gradient Algorithm
    Liu, Jianghui
    Li, Baozhu
    Zhou, Yangfan
    Zhao, Xuhui
    Zhu, Junlong
    Zhang, Mingchuan
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [43] Adaptive Submodularity: Theory and Applications in Active Learning and Stochastic Optimization
    Golovin, Daniel
    Krause, Andreas
    JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2011, 42 : 427 - 486
  • [44] Subgradient methods for huge-scale optimization problems
    Yu. Nesterov
    Mathematical Programming, 2014, 146 : 275 - 297
  • [45] Communication-Adaptive Stochastic Gradient Methods for Distributed Learning
    Chen, Tianyi
    Sun, Yuejiao
    Yin, Wotao
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2021, 69 : 4637 - 4651
  • [46] THE ADAPTIVE PROJECTED SUBGRADIENT METHOD CONSTRAINED BY FAMILIES OF QUASI-NONEXPANSIVE MAPPINGS AND ITS APPLICATION TO ONLINE LEARNING
    Slavakis, Konstantinos
    Yamada, Isao
    SIAM JOURNAL ON OPTIMIZATION, 2013, 23 (01) : 126 - 152
  • [47] Distributed adaptive online learning for convex optimization with weight decay
    Shen, Xiuyu
    Li, Dequan
    Fang, Runyue
    Zhou, Yuejin
    Wu, Xiongjun
    ASIAN JOURNAL OF CONTROL, 2022, 24 (02) : 562 - 575
  • [48] Adaptive Subgradient Methods for Mathematical Programming Problems with Quasiconvex Functions
    Ablaev, S. S.
    Stonyakin, F. S.
    Alkousa, M. S.
    Gasnikov, A. V.
    PROCEEDINGS OF THE STEKLOV INSTITUTE OF MATHEMATICS, 2023, 323 (SUPPL 1) : S1 - S18
  • [49] Adaptive Subgradient Methods for Mathematical Programming Problems with Quasiconvex Functions
    S. S. Ablaev
    F. S. Stonyakin
    M. S. Alkousa
    A. V. Gasnikov
    Proceedings of the Steklov Institute of Mathematics, 2023, 323 : S1 - S18
  • [50] A Variance Reduced Nonconvex Stochastic Optimization framework for Online Kernel Learning
    Pradhan, Hrusikesha
    Rajawat, Ketan
    2022 56TH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2022, : 1281 - 1285
12345