Variable projection method and levenberg-marquardt algorithm for neural network training

被引：0
|
作者：
Kim, Cheol-Taek [1 ]
Lee, Ju-Jang [1 ]
Kim, Hyejin [2 ]
机构：
[1] Korea Adv Inst Sci & Technol, 373-1,Kuseongdong, Taejon 305701, South Korea
[2] ETRI, Taejon, South Korea
来源：
IECON 2006 - 32ND ANNUAL CONFERENCE ON IEEE INDUSTRIAL ELECTRONICS, VOLS 1-11 | 2006年
关键词：
D O I：
暂无
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
An optimal solution for single hidden layered feedforward neural network(SLFN) is proposed. SLFN can be considered as separable nonlinear least squares problem and variable projection(VP) method gives the approximation of the jacobian matrix of the problem. The jacobian calculation of VP-SLFN is suggested with simplified form. Based on this simplification, Levenberg-Marquardt(LM) algorithm for VP-SLFN is suggested and has faster convergence rate than LM algorithm without VP. Two numerical examples show the superiority than extreme learning machine and LM without variable projection.
引用
收藏
页码：2084 / +
页数：2
相关论文
共 50 条
  • [21] A Parallel Levenberg-Marquardt Algorithm
    Cao, Jun
    Novstrup, Krista A.
    Goyal, Ayush
    Midkiff, Samuel R.
    Caruthers, James M.
    ICS'09: PROCEEDINGS OF THE 2009 ACM SIGARCH INTERNATIONAL CONFERENCE ON SUPERCOMPUTING, 2009, : 450 - 459
  • [22] An artificial neural network and Levenberg-Marquardt training algorithm-based mathematical model for performance prediction
    Bano, Farheen
    Serbaya, Suhail H.
    Rizwan, Ali
    Shabaz, Mohammad
    Hasan, Faraz
    Khalifa, Hany S.
    APPLIED MATHEMATICS IN SCIENCE AND ENGINEERING, 2024,
  • [23] The assessment of Levenberg-Marquardt and Bayesian Framework training algorithm for prediction of concrete shrinkage by the artificial neural network
    Garoosiha, Hosein
    Ahmadi, Jamal
    Bayat, Hossein
    COGENT ENGINEERING, 2019, 6 (01):
  • [24] Applying Bayesian Regularization for Acceleration of Levenberg-Marquardt based Neural Network Training
    Suliman, Azizah
    Omarov, Batyrkhan S.
    INTERNATIONAL JOURNAL OF INTERACTIVE MULTIMEDIA AND ARTIFICIAL INTELLIGENCE, 2018, 5 (01): : 68 - 72
  • [25] Lateral control of autonomous vehicle using levenberg-marquardt neural network algorithm
    Lee, K.B.
    Kim, Y.J.
    Ahn, O.S.
    Kim, Y.B.
    International Journal of Automotive Technology, 2002, 3 (02) : 79 - 88
  • [26] An Improved Levenberg-Marquardt Algorithm with Adaptive Learning Rate for RBF Neural Network
    An Ru
    Li Wen Jing
    Han Hong Gui
    Qiao Jun Fei
    PROCEEDINGS OF THE 35TH CHINESE CONTROL CONFERENCE 2016, 2016, : 3630 - 3635
  • [27] A New Levenberg-Marquardt Algorithm for feedforward neural networks
    Li, Yanlai
    Wang, Kuanquan
    Li, Tao
    DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES B-APPLICATIONS & ALGORITHMS, 2006, 13E : 3516 - 3519
  • [28] Modified Levenberg-Marquardt Algorithm for Backpropagation Neural Network Training in Dynamic Model Identification of Mechanical Systems
    Li, Ming
    Wu, Huapeng
    Wang, Yongbo
    Handroos, Heikki
    Carbone, Giuseppe
    JOURNAL OF DYNAMIC SYSTEMS MEASUREMENT AND CONTROL-TRANSACTIONS OF THE ASME, 2017, 139 (03):
  • [29] Application of the Neural Network in Diagnosis of Breast Cancer Based on Levenberg-Marquardt Algorithm
    Min, Zeng
    Xiao, Liang
    Cao, Lin
    Yan, Hangcheng
    2017 INTERNATIONAL CONFERENCE ON SECURITY, PATTERN ANALYSIS, AND CYBERNETICS (SPAC), 2017, : 268 - 272
  • [30] A Parallel Levenberg-Marquardt Algorithm for Recursive Neural Network in a Robot Control System
    Wang, Wei
    Pu, Yunming
    Li, Wang
    INTERNATIONAL JOURNAL OF COGNITIVE INFORMATICS AND NATURAL INTELLIGENCE, 2018, 12 (02) : 32 - 47
12345