A fast learning algorithm of neural network with tunable activation function

被引:0
|
作者
SHEN Yanjun
机构
关键词
neural networks; RLS algorithm; TAF neural model; learning algorithm;
D O I
暂无
中图分类号
TP181 [自动推理、机器学习];
学科分类号
摘要
This paper presents a modified structure of a neural network with tunable activation function and provides a new learning algorithm for the neural network training. Simulation results of XOR problem, Feigenbaum function, and Henon map show that the new algorithm has better performance than BP (back propagation) algorithm in terms of shorter convergence time and higher convergence accuracy. Further modifications of the structure of the neural network with the faster learning algorithm demonstrate simpler structure with even faster convergence speed and better convergence accuracy.
引用
收藏
页码:126 / 136
页数:11
相关论文
共 50 条
  • [41] Neural network with NewSigmoid activation function
    Kumar, Arvind
    Sodhi, Sartaj Singh
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2022, 43 (01) : 545 - 559
  • [42] A Recurrent Neural Network with a Tunable Activation Function for Solving K-Winners-Take-All
    Miao Peng
    Shen Yanjun
    Hou Jianshu
    Shen Yi
    2014 33RD CHINESE CONTROL CONFERENCE (CCC), 2014, : 4957 - 4962
  • [43] Improved Convolutional Neural Network Based on Fast Exponentially Linear Unit Activation Function
    Zheng Qiumei
    Tan Dan
    Wang Fenghua
    IEEE ACCESS, 2019, 7 : 151359 - 151367
  • [44] A fast adaptive algorithm for Hopfield neural network
    Zhao, XC
    Wang, XG
    Tang, Z
    Tamura, H
    Ishii, M
    Zeng, GZ
    SICE 2003 ANNUAL CONFERENCE, VOLS 1-3, 2003, : 638 - 642
  • [45] Relating the slope of the activation function and the learning rate within a recurrent neural network
    Mandic, DP
    Chambers, JA
    NEURAL COMPUTATION, 1999, 11 (05) : 1069 - 1077
  • [46] Genetic algorithm based K-means fast learning artificial neural network
    Xiang, Y
    Phuan, ATL
    AI 2004: ADVANCES IN ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2004, 3339 : 828 - 839
  • [47] Study of the fast learning algorithm of the T-S fuzzy RBF neural network
    Bao, Hong
    Huang, Xinhan
    Li, Xixiong
    Huazhong Ligong Daxue Xuebao/Journal Huazhong (Central China) University of Science and Technology, 1999, 27 (02): : 84 - 86
  • [48] Learning algorithm of symbolic neural network
    Zhejiang Univ, Hangzhou, China
    Tien Tzu Hsueh Pao, 8 (90-93):
  • [49] On Neural Network Online Learning Algorithm
    Zuev, D. V.
    Garbaruk, V. V.
    Khodakovsky, V. A.
    Fedorchuk, P. E.
    Blagoveshchenskaya, E. A.
    Kunets, D. S.
    PROCEEDINGS OF THE XIX IEEE INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND MEASUREMENTS (SCM 2016), 2016, : 279 - 280
  • [50] A growing and pruning sequential learning algorithm of hyper basis function neural network for function approximation
    Vukovic, Najdan
    Miljkovic, Zoran
    NEURAL NETWORKS, 2013, 46 : 210 - 226