Convergence of hybrid algorithm with adaptive learning parameter for multilayer neural network

被引：0
|
作者：
Damak, Fadwa [1 ]
Ben Nasr, Mounir [1 ]
Chtourou, Mohamed [1 ]
机构：
[1] ENIS, Dept Elect Engn, Sfax, Tunisia
来源：
WORLD CONGRESS ON COMPUTER & INFORMATION TECHNOLOGY (WCCIT 2013) | 2013年
关键词：
Feedforward; neural network; Hybrid training; Adaptive learning rate; Lyapunov theory; TRAINING ALGORITHM; MOMENTUM;
D O I：
暂无
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
A new learning algorithm suited for training multilayered neural networks that we have named hybrid is hereby introduced. With this algorithm the weights of the hidden layer are adjusted using the Kohonen algorithm. While the weights of the output layer are trained using a gradient descent method with adaptive learning parameter based Lyapunov function. The effectiveness of the proposed approach is shown by the simulation results.
引用
收藏
页数：4
相关论文
共 50 条
  • [11] Optimizing a neural network architecture with an adaptive parameter genetic algorithm
    Ribert, A
    Stocker, E
    Lecourtier, Y
    Ennaji, A
    BIOLOGICAL AND ARTIFICIAL COMPUTATION: FROM NEUROSCIENCE TO TECHNOLOGY, 1997, 1240 : 527 - 535
  • [12] An efficient learning algorithm with second-order convergence for multilayer neural networks
    Ninomiya, H
    Tomita, C
    Asai, H
    PROCEEDINGS OF THE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS 2003, VOLS 1-4, 2003, : 2028 - 2032
  • [13] LYAPUNOV THEORY BASED ADAPTIVE LEARNING ALGORITHM FOR MULTILAYER NEURAL NETWORKS
    Acir, Nurettin
    Menguc, Engin Cemal
    NEURAL NETWORK WORLD, 2014, 24 (06) : 619 - 636
  • [14] A Hybrid Learning Algorithm for the Optimization of Convolutional Neural Network
    Zang, Di
    Ding, Jianping
    Cheng, Jiujun
    Zhang, Dongdong
    Tang, Keshuang
    INTELLIGENT COMPUTING METHODOLOGIES, ICIC 2017, PT III, 2017, 10363 : 694 - 705
  • [15] Supervised adaptive clustering: A hybrid neural network clustering algorithm
    M. F. Augusteijn
    U. J. Steck
    Neural Computing & Applications, 1998, 7 : 78 - 89
  • [16] Supervised adaptive clustering: A hybrid neural network clustering algorithm
    Augusteijn, MF
    Steck, UJ
    NEURAL COMPUTING & APPLICATIONS, 1998, 7 (01): : 78 - 89
  • [17] An adaptive neural network algorithm for parameter identification of linearizable nonlinear systems
    Lee, SJ
    Lee, GK
    10TH INTERNATIONAL CONFERENCE ON COMPUTER APPLICATIONS IN INDUSTRY AND ENGINEERING, 1997, : 25 - 28
  • [18] A multiple multilayer perceptron neural network with an adaptive learning algorithm for thyroid disease diagnosis in the internet of medical things
    Mehdi Hosseinzadeh
    Omed Hassan Ahmed
    Marwan Yassin Ghafour
    Fatemeh Safara
    Hawkar kamaran hama
    Saqib Ali
    Bay Vo
    Hsiu-Sen Chiang
    The Journal of Supercomputing, 2021, 77 : 3616 - 3637
  • [19] A multiple multilayer perceptron neural network with an adaptive learning algorithm for thyroid disease diagnosis in the internet of medical things
    Hosseinzadeh, Mehdi
    Ahmed, Omed Hassan
    Ghafour, Marwan Yassin
    Safara, Fatemeh
    Hama, Hawkar Kamaran
    Ali, Saqib
    Vo, Bay
    Chiang, Hsiu-Sen
    JOURNAL OF SUPERCOMPUTING, 2021, 77 (04): : 3616 - 3637
  • [20] Cascade steepest descendant learning algorithm for multilayer feedforward neural network
    Wang, GJ
    Chen, JJ
    JSME INTERNATIONAL JOURNAL SERIES C-MECHANICAL SYSTEMS MACHINE ELEMENTS AND MANUFACTURING, 2000, 43 (02): : 350 - 358
12345