Adaptive subgradient methods for online learning and stochastic optimization

被引：0
|
作者：
Duchi, John [1 ]
Hazan, Elad [2 ]
Singer, Yoram [3 ]
机构：
[1] Computer Science Division, University of California, Berkeley, Berkeley, CA 94720, United States
[2] Technion - Israel Institute of Technology, Technion City Haifa, 32000, Israel
[3] Google, 1600 Amphitheatre Parkway, Mountain View, CA 94043, United States
来源：
Journal of Machine Learning Research | 2011年 / 12卷
关键词：
D O I：
暂无
中图分类号：
学科分类号：
摘要：
引用
收藏
页码：2121 / 2159
相关论文
共 50 条
  • [1] Adaptive Subgradient Methods for Online Learning and Stochastic Optimization
    Duchi, John
    Hazan, Elad
    Singer, Yoram
    JOURNAL OF MACHINE LEARNING RESEARCH, 2011, 12 : 2121 - 2159
  • [2] On stochastic gradient and subgradient methods with adaptive steplength sequences
    Yousefian, Farzad
    Nedic, Angelia
    Shanbhag, Uday V.
    AUTOMATICA, 2012, 48 (01) : 56 - 67
  • [3] Dual Averaging Methods for Regularized Stochastic Learning and Online Optimization
    Xiao, Lin
    JOURNAL OF MACHINE LEARNING RESEARCH, 2010, 11 : 2543 - 2596
  • [4] Stochastic subgradient projection methods for composite optimization with functional constraints
    Necoara, Ion
    Singh, Nitesh Kumar
    JOURNAL OF MACHINE LEARNING RESEARCH, 2022, 23
  • [5] SAdaBoundNc: an adaptive subgradient online learning algorithm with logarithmic regret bounds
    Wang, Lin
    Wang, Xin
    Li, Tao
    Zheng, Ruijuan
    Zhu, Junlong
    Zhang, Mingchuan
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (11): : 8051 - 8063
  • [6] SAdaBoundNc: an adaptive subgradient online learning algorithm with logarithmic regret bounds
    Lin Wang
    Xin Wang
    Tao Li
    Ruijuan Zheng
    Junlong Zhu
    Mingchuan Zhang
    Neural Computing and Applications, 2023, 35 : 8051 - 8063
  • [7] Privacy Masking Stochastic Subgradient-Push Algorithm for Distributed Online Optimization
    Lu, Qingguo
    Liao, Xiaofeng
    Xiang, Tao
    Li, Huaqing
    Huang, Tingwen
    IEEE TRANSACTIONS ON CYBERNETICS, 2021, 51 (06) : 3224 - 3237
  • [8] Distributed online adaptive subgradient optimization with dynamic bound of learning rate over time-varying networks
    Fang, Runyue
    Li, Dequan
    Shen, Xiuyu
    IET CONTROL THEORY AND APPLICATIONS, 2022, 16 (18): : 1834 - 1846
  • [9] An Adaptive Primal-Dual Subgradient Algorithm for Online Distributed Constrained Optimization
    Yuan, Deming
    Ho, Daniel W. C.
    Jiang, Guo-Ping
    IEEE TRANSACTIONS ON CYBERNETICS, 2018, 48 (11) : 3045 - 3055
  • [10] Stochastic Learning Rate Optimization in the Stochastic Approximation and Online Learning Settings
    Mamalis, Theodoros
    Stipanovic, Dusan
    Voulgaris, Petros
    2022 AMERICAN CONTROL CONFERENCE, ACC, 2022, : 4286 - 4291
12345