Fractional-order convolutional neural networks with population extremal optimization

被引:18
|
作者
Chen, Bi-Peng [1 ]
Chen, Yun [1 ]
Zeng, Guo-Qiang [2 ]
She, Qingshan [1 ]
机构
[1] Hangzhou Dianzi Univ, Sch Automat, Hangzhou 310018, Peoples R China
[2] Wenzhou Univ, Natl Local Joint Engn Lab Digitalize Elect Design, Wenzhou 325035, Peoples R China
基金
中国国家自然科学基金;
关键词
Caputo fractional-order gradient method; Population extremal optimization; Initial bias and weight; MNIST dataset; Fractional-order convolutional neural networks; PARTICLE SWARM OPTIMIZATION; QUANTITATIVE-ANALYSIS; STABILITY;
D O I
10.1016/j.neucom.2022.01.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article is devoted to the intelligent optimization issue by means of PEO-FOCNN, i.e., the fractional order convolutional neural networks (FOCNNs) with population extremal optimization (PEO). The Caputo fractional-order gradient method (CFOGM) is adopted to improve the dynamic updating effectiveness of the biases and weights for convolutional neural networks (CNN). Moreover, considering the significance of the initial biases and weights and their updating mechanisms to the optimization performance of FOCNN, the PEO algorithm is used to seek an optimal selection from lots of the initial biases and weights. The optimization effect of PEO method for FOCNN is demonstrated by the training and testing accuracies of PEO-FOCNN compared with standard FOCNN. And, the superiority of the proposed PEO-FOCNN to FOCNN based on some other popular optimization algorithms, such as the genetic algorithm-based FOCNN (GA-FOCNN), differential evolution-based FOCNN (DE-FOCNN) and particle swarm optimization-based FOCNN (PSO-FOCNN), is verified by the experiments on the MNIST dataset in terms of three types of statistical tests. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:36 / 45
页数:10
相关论文
共 50 条
  • [31] Synchronization of a Class of Fractional-Order Chaotic Neural Networks
    Chen, Liping
    Qu, Jianfeng
    Chai, Yi
    Wu, Ranchao
    Qi, Guoyuan
    ENTROPY, 2013, 15 (08): : 3265 - 3276
  • [32] Fractional-order discontinuous systems with indefinite LKFs: An application to fractional-order neural networks with time delays
    Udhayakumar, K.
    Rihan, Fathalla A.
    Rakkiyappan, R.
    Cao, Jinde
    NEURAL NETWORKS, 2022, 145 : 319 - 330
  • [33] Convolutional neural networks with fractional order gradient method
    Sheng, Dian
    Wei, Yiheng
    Chen, Yuquan
    Wang, Yong
    NEUROCOMPUTING, 2020, 408 : 42 - 50
  • [34] The Optimization of Synchronization Control Parameters for Fractional-Order Delayed Memristive Neural Networks Using SIWPSO
    Qi Chang
    Aihua Hu
    Yongqing Yang
    Li Li
    Neural Processing Letters, 2020, 51 : 1541 - 1556
  • [35] Synchronization of Fractional-Order Delayed Neural Networks with Hybrid Coupling
    Bao, Haibo
    Park, Ju H.
    Cao, Jinde
    COMPLEXITY, 2016, 21 (S1) : 106 - 112
  • [36] alpha-stability of fractional-order Hopfield neural networks
    Xu, Changjin
    Li, Peiluan
    INTERNATIONAL JOURNAL OF DYNAMICAL SYSTEMS AND DIFFERENTIAL EQUATIONS, 2018, 8 (04) : 270 - 279
  • [37] Synchronization in fractional-order neural networks by the energy balance strategy
    Yao, Zhao
    Sun, Kehui
    He, Shaobo
    COGNITIVE NEURODYNAMICS, 2024, 18 (02) : 701 - 713
  • [38] The Optimization of Synchronization Control Parameters for Fractional-Order Delayed Memristive Neural Networks Using SIWPSO
    Chang, Qi
    Hu, Aihua
    Yang, Yongqing
    Li, Li
    NEURAL PROCESSING LETTERS, 2020, 51 (02) : 1541 - 1556
  • [39] Projective Synchronization of Nonidentical Fractional-Order Memristive Neural Networks
    Chen, Chong
    Ding, Zhixia
    DISCRETE DYNAMICS IN NATURE AND SOCIETY, 2019, 2019
  • [40] Dynamics of Fractional-Order Neural Networks With Discrete and Distributed Delays
    Si, Lingzhi
    Xiao, Min
    Jiang, Guoping
    Cheng, Zunshui
    Song, Qiankun
    Cao, Jinde
    IEEE ACCESS, 2020, 8 (46071-46080): : 46071 - 46080