Adaptive subgradient methods for online learning and stochastic optimization

被引:0
|
作者
Duchi, John [1 ]
Hazan, Elad [2 ]
Singer, Yoram [3 ]
机构
[1] Computer Science Division, University of California, Berkeley, Berkeley, CA 94720, United States
[2] Technion - Israel Institute of Technology, Technion City Haifa, 32000, Israel
[3] Google, 1600 Amphitheatre Parkway, Mountain View, CA 94043, United States
关键词
D O I
暂无
中图分类号
学科分类号
摘要
引用
收藏
页码:2121 / 2159
相关论文
共 50 条
  • [31] A STOCHASTIC SUBGRADIENT METHOD FOR NONSMOOTH NONCONVEX MULTILEVEL COMPOSITION OPTIMIZATION
    Ruszczynski, Andrzej
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2021, 59 (03) : 2301 - 2320
  • [32] Accelerating Sequential Minimal Optimization via Stochastic Subgradient Descent
    Gu, Bin
    Shan, Yingying
    Quan, Xin
    Zheng, Guansheng
    IEEE TRANSACTIONS ON CYBERNETICS, 2021, 51 (04) : 2215 - 2223
  • [33] An Adaptive Projected Subgradient Approach to Learning in Diffusion Networks
    Cavalcante, Renato L. G.
    Yamada, Isao
    Mulgrew, Bernard
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2009, 57 (07) : 2762 - 2774
  • [34] Mini-batch stochastic subgradient for functional constrained optimization
    Singh, Nitesh Kumar
    Necoara, Ion
    Kungurtsev, Vyacheslav
    OPTIMIZATION, 2024, 73 (07) : 2159 - 2185
  • [35] STOCHASTIC SUBGRADIENT METHOD FOR QUASI-CONVEX OPTIMIZATION PROBLEMS
    Hu, Yaohua
    Yu, Carisa Kwok Wai
    Li, Chong
    JOURNAL OF NONLINEAR AND CONVEX ANALYSIS, 2016, 17 (04) : 711 - 724
  • [36] Learning CRFs for Image Parsing with Adaptive Subgradient Descent
    Zhang, Honghui
    Wang, Jingdong
    Tan, Ping
    Wang, Jinglu
    Quan, Long
    2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 3080 - 3087
  • [37] The efficiency of ballstep subgradient level methods for convex optimization
    Kiwiel, KC
    Larsson, T
    Lindberg, PO
    MATHEMATICS OF OPERATIONS RESEARCH, 1999, 24 (01) : 237 - 254
  • [38] Distributed Subgradient Methods for Multi-Agent Optimization
    Nedic, Angelia
    Ozdaglar, Asurrian
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2009, 54 (01) : 48 - 61
  • [39] LEARNING IN DIFFUSION NETWORKS WITH AN ADAPTIVE PROJECTED SUBGRADIENT METHOD
    Cavalcante, Renato L. G.
    Yamada, Isao
    Mulgrew, Bernard
    2009 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS 1- 8, PROCEEDINGS, 2009, : 2853 - +
  • [40] Subgradient methods for huge-scale optimization problems
    Nesterov, Yu
    MATHEMATICAL PROGRAMMING, 2014, 146 (1-2) : 275 - 297