TRAINING FEEDFORWARD NETWORKS WITH THE MARQUARDT ALGORITHM

被引：5495
|
作者：
HAGAN, MT
MENHAJ, MB
机构：
来源：
IEEE TRANSACTIONS ON NEURAL NETWORKS | 1994年 / 5卷 / 06期
关键词：
D O I：
10.1109/72.329697
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
The Marquardt algorithm for nonlinear least squares is presented and is incorporated into the backpropagation algorithm for training feedforward neural networks. The algorithm is tested on several function approximation problems, and is compared with a conjugate gradient algorithm and a variable learning rate algorithm. It is found that the Marquardt algorithm is much more efficient than either of the-other techniques when the network contains no more than a few hundred weights.
引用
收藏
页码：989 / 993
页数：5
相关论文
共 50 条
  • [31] Step acceleration based training algorithm for feedforward neural networks
    Li, YL
    Wang, KQ
    Zhang, D
    16TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL II, PROCEEDINGS, 2002, : 84 - 87
  • [32] Extended least squares based algorithm for training feedforward networks
    Yam, JYF
    Chow, TWS
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 1997, 8 (03): : 806 - 810
  • [33] Training feedforward neural networks: An algorithm giving improved generalization
    Lee, CW
    NEURAL NETWORKS, 1997, 10 (01) : 61 - 68
  • [34] AN IMPROVED GENETIC ALGORITHM FOR TRAINING LAYERED FEEDFORWARD NEURAL NETWORKS
    刘平
    程翼宇
    Journal of Zhejiang University Science, 2000, (03) : 85 - 89
  • [35] A hybrid linear/nonlinear training algorithm for feedforward neural networks
    McLoone, S
    Brown, MD
    Irwin, G
    Lightbody, G
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 1998, 9 (04): : 669 - 684
  • [36] A Second Order Training Algorithm for Multilayer Feedforward Neural Networks
    谭营
    何振亚
    邓超
    Journal of Southeast University(English Edition), 1997, (01) : 32 - 36
  • [37] A local linearized least squares algorithm for training feedforward neural networks
    Stan, O
    Kamen, E
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2000, 11 (02): : 487 - 495
  • [38] ODE-LM: A hybrid training algorithm for feedforward neural networks
    Zhang, L. (lzhang@xidian.edu.cn), 1600, Springer Verlag (215):
  • [39] Towards a Very Fast Feedforward Multilayer Neural Networks Training Algorithm
    Bilski, Jaroslaw
    Kowalczyk, Bartosz
    Kisiel-Dorohinicki, Marek
    Siwocha, Agnieszka
    Zurada, Jacek
    JOURNAL OF ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING RESEARCH, 2022, 12 (03) : 181 - 195
  • [40] A fuzzy neighborhood-based training algorithm for feedforward neural networks
    Mounir Ben Nasr
    Mohamed Chtourou
    Neural Computing and Applications, 2009, 18 : 127 - 133
12345