Using curvature information for fast stochastic search

被引：0
|
作者：
Orr, GB
Leen, TK
机构：
来源：
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 9: PROCEEDINGS OF THE 1996 CONFERENCE | 1997年 / 9卷
关键词：
D O I：
暂无
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
We present an algorithm for fast stochastic gradient descent that uses a nonlinear adaptive momentum scheme tea optimize the late time convergence rate. The algorithm makes effective use of curvature information, requires only O(n) storage and computation, and delivers convergence rates close to the theoretical optimum. We demonstrate the technique on linear and large nonlinear back-prop networks.
引用
收藏
页码：606 / 612
页数：7
相关论文
共 50 条
  • [31] Parking easier by using context information of a Smart City Enabling fast search and management of parking resources
    Rico, Juan
    Sancho, Juan
    Cendon, Bruno
    Camus, Miguel
    2013 IEEE 27TH INTERNATIONAL CONFERENCE ON ADVANCED INFORMATION NETWORKING AND APPLICATIONS WORKSHOPS (WAINA), 2013, : 1380 - 1385
  • [32] Fast and Accurate Computation using Stochastic Circuits
    Alaghi, Armin
    Hayes, John P.
    2014 DESIGN, AUTOMATION AND TEST IN EUROPE CONFERENCE AND EXHIBITION (DATE), 2014,
  • [33] Using hypertext for studying and information search
    Beishuizen, J
    Stoutjesdijk, E
    Zanting, A
    JOURNAL OF EDUCATIONAL COMPUTING RESEARCH, 1996, 15 (04) : 289 - 316
  • [34] INFORMATION SEARCH USING SUPERIMPOSED HOLOGRAMS
    AKAHORI, H
    SAKURAI, K
    APPLIED OPTICS, 1971, 10 (03): : 665 - &
  • [35] TRACKING POINTS ON DEFORMABLE OBJECTS USING CURVATURE INFORMATION
    COHEN, I
    AYACHE, N
    SULGER, P
    LECTURE NOTES IN COMPUTER SCIENCE, 1992, 588 : 458 - 466
  • [36] Improved boundary element calculations using curvature information
    Greenblatt, RE
    INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 1999, 33 (01) : 57 - 57
  • [37] Image representation using curvature information in intensity profiles
    Liu, HH
    Twu, JH
    Wang, SJ
    INTERNATIONAL CONFERENCE ON IMAGE PROCESSING - PROCEEDINGS, VOL II, 1997, : 720 - 723
  • [38] A new vertex selection scheme using curvature information
    Yun, BJ
    Lee, SW
    Cho, JS
    Choi, JG
    Kang, HS
    KNOWLEDGE-BASED INTELLIGENT INFORMATION AND ENGINEERING SYSTEMS, PT 3, PROCEEDINGS, 2004, 3215 : 887 - 893
  • [39] Information sharing impact of stochastic diffusion search on differential evolution algorithm
    al-Rifaie, Mohammad Majid
    Bishop, John Mark
    Blackwell, Tim
    MEMETIC COMPUTING, 2012, 4 (04) : 327 - 338
  • [40] Information sharing impact of stochastic diffusion search on differential evolution algorithm
    Mohammad Majid al-Rifaie
    John Mark Bishop
    Tim Blackwell
    Memetic Computing, 2012, 4 : 327 - 338
12345