TRAINING FEEDFORWARD NETWORKS WITH THE MARQUARDT ALGORITHM

被引：5495
|
作者：
HAGAN, MT
MENHAJ, MB
机构：
来源：
IEEE TRANSACTIONS ON NEURAL NETWORKS | 1994年 / 5卷 / 06期
关键词：
D O I：
10.1109/72.329697
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
The Marquardt algorithm for nonlinear least squares is presented and is incorporated into the backpropagation algorithm for training feedforward neural networks. The algorithm is tested on several function approximation problems, and is compared with a conjugate gradient algorithm and a variable learning rate algorithm. It is found that the Marquardt algorithm is much more efficient than either of the-other techniques when the network contains no more than a few hundred weights.
引用
收藏
页码：989 / 993
页数：5
相关论文
共 50 条
  • [21] THE UD RLS ALGORITHM FOR TRAINING FEEDFORWARD NEURAL NETWORKS
    Bilski, Jaroslaw
    INTERNATIONAL JOURNAL OF APPLIED MATHEMATICS AND COMPUTER SCIENCE, 2005, 15 (01) : 115 - 123
  • [22] A parallel algorithm for gradient training of feedforward neural networks
    Hanzalek, Z
    PARALLEL COMPUTING, 1998, 24 (5-6) : 823 - 839
  • [23] A Modified Backpropagation Training Algorithm for Feedforward Neural Networks*
    T. Kathirvalavakumar
    P. Thangavel
    Neural Processing Letters, 2006, 23 : 111 - 119
  • [24] Improved Marquardt Algorithm for Training Neural Networks for Chemical Process Modeling
    吴建昱
    何小荣
    Tsinghua Science and Technology, 2002, (05) : 454 - 457
  • [25] An Optimal PID Control Algorithm for Training Feedforward Neural Networks
    Jing, Xingjian
    Cheng, Li
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2013, 60 (06) : 2273 - 2283
  • [26] Feedforward neural networks training with optimal bounded ellipsoid algorithm
    Rubio Avila, Jose De Jesus
    Ramirez, Andres Ferreyra
    Aviles-Cruz, Carlos
    PROCEEDINGS OF THE 9TH WSEAS INTERNATIONAL CONFERENCE ON NEURAL NETWORKS (NN' 08): ADVANCED TOPICS ON NEURAL NETWORKS, 2008, : 174 - 180
  • [27] The Upstart Algorithm: A Method for Constructing and Training Feedforward Neural Networks
    Frean, Marcus
    NEURAL COMPUTATION, 1990, 2 (02) : 198 - 209
  • [28] An improved genetic algorithm for training layered feedforward neural networks
    Liu Ping
    Cheng Yi-yu
    Journal of Zhejiang University-SCIENCE A, 2000, 1 (3): : 322 - 326
  • [29] A CONSTRUCTIVE BASED HYBRID TRAINING ALGORITHM FOR FEEDFORWARD NEURAL NETWORKS
    Ben Nasr, Mounir
    Chtourou, Mohamed
    2009 6TH INTERNATIONAL MULTI-CONFERENCE ON SYSTEMS, SIGNALS AND DEVICES, VOLS 1 AND 2, 2009, : 97 - 100
  • [30] A New Variant of the GQR Algorithm for Feedforward Neural Networks Training
    Bilski, Jaroslaw
    Kowalczyk, Bartosz
    ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING (ICAISC 2021), PT I, 2021, 12854 : 41 - 53
12345