Fractional-order convolutional neural networks with population extremal optimization

被引:18
|
作者
Chen, Bi-Peng [1 ]
Chen, Yun [1 ]
Zeng, Guo-Qiang [2 ]
She, Qingshan [1 ]
机构
[1] Hangzhou Dianzi Univ, Sch Automat, Hangzhou 310018, Peoples R China
[2] Wenzhou Univ, Natl Local Joint Engn Lab Digitalize Elect Design, Wenzhou 325035, Peoples R China
基金
中国国家自然科学基金;
关键词
Caputo fractional-order gradient method; Population extremal optimization; Initial bias and weight; MNIST dataset; Fractional-order convolutional neural networks; PARTICLE SWARM OPTIMIZATION; QUANTITATIVE-ANALYSIS; STABILITY;
D O I
10.1016/j.neucom.2022.01.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article is devoted to the intelligent optimization issue by means of PEO-FOCNN, i.e., the fractional order convolutional neural networks (FOCNNs) with population extremal optimization (PEO). The Caputo fractional-order gradient method (CFOGM) is adopted to improve the dynamic updating effectiveness of the biases and weights for convolutional neural networks (CNN). Moreover, considering the significance of the initial biases and weights and their updating mechanisms to the optimization performance of FOCNN, the PEO algorithm is used to seek an optimal selection from lots of the initial biases and weights. The optimization effect of PEO method for FOCNN is demonstrated by the training and testing accuracies of PEO-FOCNN compared with standard FOCNN. And, the superiority of the proposed PEO-FOCNN to FOCNN based on some other popular optimization algorithms, such as the genetic algorithm-based FOCNN (GA-FOCNN), differential evolution-based FOCNN (DE-FOCNN) and particle swarm optimization-based FOCNN (PSO-FOCNN), is verified by the experiments on the MNIST dataset in terms of three types of statistical tests. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:36 / 45
页数:10
相关论文
共 50 条
  • [41] State Estimation of Fractional-Order Neural Networks with Time Delay
    Bao, Haibo
    Cao, Jinde
    2017 CHINESE AUTOMATION CONGRESS (CAC), 2017, : 1573 - 1577
  • [42] State estimation of fractional-order delayed memristive neural networks
    Haibo Bao
    Jinde Cao
    Jürgen Kurths
    Nonlinear Dynamics, 2018, 94 : 1215 - 1225
  • [43] Dynamics of complex-valued fractional-order neural networks
    Kaslik, Eva
    Radulescu, Ileana Rodica
    NEURAL NETWORKS, 2017, 89 : 39 - 49
  • [44] State estimation of fractional-order delayed memristive neural networks
    Bao, Haibo
    Cao, Jinde
    Kurths, Juergen
    NONLINEAR DYNAMICS, 2018, 94 (02) : 1215 - 1225
  • [45] Synchronization of fractional-order memristive neural networks with time delays
    Chen, Chong
    Ding, Zhixia
    Li, Sai
    Wang, Liheng
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 2754 - 2759
  • [46] Stability Analysis and Synchronization for a Class of Fractional-Order Neural Networks
    Li, Guanjun
    Liu, Heng
    ENTROPY, 2016, 18 (02):
  • [47] New results on passivity of fractional-order uncertain neural networks
    Ding, Zhixia
    Zeng, Zhigang
    Zhang, Hao
    Wang, Leimin
    Wang, Liheng
    NEUROCOMPUTING, 2019, 351 : 51 - 59
  • [48] SYNCHRONIZATION FOR A CLASS OF PROPORTIONAL CAPUTO FRACTIONAL-ORDER NEURAL NETWORKS
    Nagy, Abdelhameed Mohamed
    Ben Makhlouf, Abdellatif
    Alsenafi, Abdulaziz
    Alazemi, Fares
    JOURNAL OF APPLIED MATHEMATICS AND COMPUTATIONAL MECHANICS, 2024, 23 (04) : 76 - 88
  • [49] Global Synchronization of Coupled Fractional-Order Recurrent Neural Networks
    Liu, Peng
    Zeng, Zhigang
    Wang, Jun
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (08) : 2358 - 2368
  • [50] Adaptive fuzzy synchronization for a class of fractional-order neural networks
    Liu, Heng
    Li, Sheng-Gang
    Wang, Hong-Xing
    Li, Guan-Jun
    CHINESE PHYSICS B, 2017, 26 (03)