A back-propagation algorithm with adaptive momentum factor

被引：0
|
作者：
Department of Applied Mathematics, Dalian University of Technology, Dalian 116024, China [1 ]
不详 [2 ]
机构：
来源：
Dalian Haishi Daxue Xuebao | 2008年 / 4卷 / 45-47+51期
关键词：
Momentum;
D O I：
暂无
中图分类号：
O3 [力学];
学科分类号：
08 ; 0801 ;
摘要：
A method was developed to adaptively determine the momentum factor of back-propagation (BP) algorithm to enhance the training speed of the neural networks. Taking the learning rate as constant, the algorithm adjusted the momentum factor according to the gradient of the error function with respect to the weight vector. Numerical experiments show that the proposed algorithm is effective for both the batch and online training. Moreover, it is superior to the BP algorithm with constant momentum factor in respect of convergence rate and stability.
引用
收藏
相关论文
共 50 条
  • [1] Back-propagation algorithm with variable adaptive momentum
    Hameed, Alaa Ali
    Karlik, Bekir
    Salman, Mohammad Shukri
    KNOWLEDGE-BASED SYSTEMS, 2016, 114 : 79 - 87
  • [2] Convergence analysis of a back-propagation algorithm with adaptive momentum
    Shao, Hongmei
    Zheng, Gaofeng
    NEUROCOMPUTING, 2011, 74 (05) : 749 - 752
  • [3] AN ADAPTIVE MOMENTUM BACK-PROPAGATION (AMBP)
    DRAGO, GP
    MORANDO, M
    RIDELLA, S
    NEURAL COMPUTING & APPLICATIONS, 1995, 3 (04): : 213 - 221
  • [4] Forecasting foreign exchange rates with an improved back-propagation learning algorithm with adaptive smoothing momentum terms
    Lean Yu
    Shouyang Wang
    Kin Keung Lai
    Frontiers of Computer Science in China, 2009, 3 : 167 - 176
  • [5] Forecasting foreign exchange rates with an improved back-propagation learning algorithm with adaptive smoothing momentum terms
    Yu, Lean
    Wang, Shouyang
    Lai, Kin Keung
    FRONTIERS OF COMPUTER SCIENCE IN CHINA, 2009, 3 (02): : 167 - 176
  • [6] L(P) NORM BACK-PROPAGATION ALGORITHM FOR ADAPTIVE EQUALIZATION
    SIU, S
    CHANG, CH
    WEI, CH
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-ANALOG AND DIGITAL SIGNAL PROCESSING, 1995, 42 (09): : 604 - 607
  • [7] Boundedness and Convergence of Split-Complex Back-Propagation Algorithm with Momentum and Penalty
    Zhang, Huisheng
    Xu, Dongpo
    Zhang, Ying
    NEURAL PROCESSING LETTERS, 2014, 39 (03) : 297 - 307
  • [8] Boundedness and Convergence of Split-Complex Back-Propagation Algorithm with Momentum and Penalty
    Huisheng Zhang
    Dongpo Xu
    Ying Zhang
    Neural Processing Letters, 2014, 39 : 297 - 307
  • [9] Fast Adaptive Digital Back-Propagation Algorithm for Unrepeatered Optical Systems
    Junior, Jose Helio C.
    Sutili, Tiago
    Rossi, Sandro M.
    Figueiredo, Rafael C.
    Mello, Darli A. A.
    2020 OPTICAL FIBER COMMUNICATIONS CONFERENCE AND EXPOSITION (OFC), 2020,
  • [10] Fast Adaptive Digital Back-propagation Algorithm For Fiber Nonlinear Compensation
    Chen, Xi
    Zhang, Qi
    Gao, Ran
    Xin, Xiangjun
    Wang, Xishuo
    Tian, Qinghua
    Tian, Feng
    Wang, Yongjun
    Hou, Yujuan
    Yang, Leijing
    2020 ASIA COMMUNICATIONS AND PHOTONICS CONFERENCE (ACP) AND INTERNATIONAL CONFERENCE ON INFORMATION PHOTONICS AND OPTICAL COMMUNICATIONS (IPOC), 2020,
12345