Variable projection method and levenberg-marquardt algorithm for neural network training

被引：0
|
作者：
Kim, Cheol-Taek [1 ]
Lee, Ju-Jang [1 ]
Kim, Hyejin [2 ]
机构：
[1] Korea Adv Inst Sci & Technol, 373-1,Kuseongdong, Taejon 305701, South Korea
[2] ETRI, Taejon, South Korea
来源：
IECON 2006 - 32ND ANNUAL CONFERENCE ON IEEE INDUSTRIAL ELECTRONICS, VOLS 1-11 | 2006年
关键词：
D O I：
暂无
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
An optimal solution for single hidden layered feedforward neural network(SLFN) is proposed. SLFN can be considered as separable nonlinear least squares problem and variable projection(VP) method gives the approximation of the jacobian matrix of the problem. The jacobian calculation of VP-SLFN is suggested with simplified form. Based on this simplification, Levenberg-Marquardt(LM) algorithm for VP-SLFN is suggested and has faster convergence rate than LM algorithm without VP. Two numerical examples show the superiority than extreme learning machine and LM without variable projection.
引用
收藏
页码：2084 / +
页数：2
相关论文
共 50 条
  • [41] The Parallel Modification to the Levenberg-Marquardt Algorithm
    Bilski, Jaroslaw
    Kowalczyk, Bartosz
    Grzanek, Konrad
    ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, ICAISC 2018, PT I, 2018, 10841 : 15 - 24
  • [42] LOCAL LEVENBERG-MARQUARDT ALGORITHM FOR LEARNING FEEDFORWAD NEURAL NETWORKS
    Bilski, Jaroslaw
    Kowalczyk, Bartosz
    Marchlewska, Alina
    Zurada, Jacek M.
    JOURNAL OF ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING RESEARCH, 2020, 10 (04) : 299 - 316
  • [43] Study on the Levenberg-Marquardt neural network model for rock rheology
    Jiang, Yu-zhou
    Wang, Rui-hong
    Zhu, Jie-bing
    FRONTIERS OF GREEN BUILDING, MATERIALS AND CIVIL ENGINEERING, PTS 1-8, 2011, 71-78 : 4103 - +
  • [44] Online Levenberg-Marquardt Algorithm for Neural Network based Estimation and Control of Power Systems
    Arif, Jawad
    Chaudhuri, Nilanjan Ray
    Ray, Swakshar
    Chaudhuri, Balarko
    IJCNN: 2009 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1- 6, 2009, : 3407 - +
  • [45] Aerodynamic coefficients modeling using Levenberg-Marquardt algorithm and network
    Wang, Zhigang
    Li, Aijun
    Wang, Lihao
    Zhou, Xiangchen
    Wu, Boning
    AIRCRAFT ENGINEERING AND AEROSPACE TECHNOLOGY, 2022, 94 (03): : 336 - 350
  • [46] Fuzzy Wavelet Neural Network with the Improved Levenberg-Marquardt Algorithm for the AC Servo System
    Hou, Run-Min
    Shi, Di-Fen
    Gao, Qiang
    Hou, Yuan-Long
    COMPLEXITY, 2021, 2021
  • [47] Neural Network hybrid learning:: Genetic Algorithms & Levenberg-Marquardt
    Prudêncio, RBC
    Ludermir, TB
    BETWEEN DATA SCIENCE AND APPLIED DATA ANALYSIS, 2003, : 464 - 472
  • [48] The application and modeling of the Levenberg-Marquardt algorithm
    Li, Jian-rong
    2010 2ND INTERNATIONAL CONFERENCE ON E-BUSINESS AND INFORMATION SYSTEM SECURITY (EBISS 2010), 2010, : 278 - 280
  • [49] Method of vertical parallax reduction combined with Levenberg-Marquardt algorithm
    Li Qing-yu
    Zhao Yan
    Wang Shi-gang
    CHINESE OPTICS, 2016, 9 (03): : 312 - 319
  • [50] Efficient training of neural nets for nonlinear adaptive filtering using a recursive Levenberg-Marquardt algorithm
    Ngia, LSH
    Sjöberg, J
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2000, 48 (07) : 1915 - 1927
12345