Selfish herds optimization algorithm with orthogonal design and information update for training multi-layer perceptron neural network

被引:17
|
作者
Zhao, Ruxin [1 ]
Wang, Yongli [1 ]
Hu, Peng [1 ]
Jelodar, Hamed [1 ]
Yuan, Chi [1 ]
Li, YanChao [1 ]
Masood, Isma [1 ]
Rabbani, Mandi [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Selfish herd optimization algorithm; Orthogonal design; Multi-layer perceptron (MLP) neural network; Information update; Meta-heuristic optimization algorithm; CLASSIFICATION; RECOGNITION; MODEL;
D O I
10.1007/s10489-018-1373-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Selfish herd optimization algorithm is a novel meta-heuristic optimization algorithm, which simulates the group behavior of herds when attacked by predators in nature. With the further research of algorithm, it is found that the algorithm cannot get a better global optimal solution in solving some problems. In order to improve the optimization ability of the algorithm, we propose a selfish herd optimization algorithm with orthogonal design and information update (OISHO) in this paper. Through using orthogonal design method, a more competitive candidate solution can be generated. If the candidate solution is better than the global optimal solution, it will replace the global optimal solution. At the same time, at the end of each iteration, we update the population information of the algorithm. The purpose is to increase the diversity of the population, so that the algorithm expands its search space to find better solutions. In order to verify the effectiveness of the proposed algorithm, it is used to train multi-layer perceptron (MLP) neural network. For training multi-layer perceptron neural network, this is a challenging task to present a satisfactory and effective training algorithm. We chose twenty different datasets from UCI machine learning repository as training dataset, and the experimental results are compared with SSA, GG-GSA, GSO, GOA, WOA and SOS, respectively. Experimental results show that the proposed algorithm has better optimization accuracy, convergence speed and stability compared with other algorithms for training multi-layer perceptron neural network.
引用
收藏
页码:2339 / 2381
页数:43
相关论文
共 50 条
  • [41] Fortified Cuckoo Search Algorithm on training multi-layer perceptron for solving classification problems
    Thirugnanasambandam K.
    Prabu U.
    Saravanan D.
    Anguraj D.K.
    Raghav R.S.
    Personal and Ubiquitous Computing, 2023, 27 (03) : 1039 - 1049
  • [42] Underwater targets classification using local wavelet acoustic pattern and Multi-Layer Perceptron neural network optimized by modified Whale Optimization Algorithm
    Qiao, Weibiao
    Khishe, Mohammad
    Ravakhah, Sajjad
    OCEAN ENGINEERING, 2021, 219
  • [43] Prediction and optimization of heating and cooling loads in a residential building based on multi-layer perceptron neural network and different optimization algorithms
    Xu, Yuanjin
    Li, Fei
    Asgari, Armin
    ENERGY, 2022, 240
  • [44] A multi-energy load prediction of a building using the multi-layer perceptron neural network method with different optimization algorithms
    Yan, Zhongzhen
    Zhu, Xinyuan
    Wang, Xianglong
    Ye, Zhiwei
    Guo, Feng
    Xie, Lei
    Zhang, Guiju
    ENERGY EXPLORATION & EXPLOITATION, 2023, 41 (01) : 273 - 305
  • [45] A Dynamic Collaborative Filtering Algorithm based on Convolutional Neural Networks and Multi-layer Perceptron
    Sun, Qiang
    Shi, Lei-lei
    Liu, Lu
    Han, Zi-xuan
    Jiang, Liang
    Lu, Yao
    Panneerselvam, John
    20TH INT CONF ON UBIQUITOUS COMP AND COMMUNICAT (IUCC) / 20TH INT CONF ON COMP AND INFORMATION TECHNOLOGY (CIT) / 4TH INT CONF ON DATA SCIENCE AND COMPUTATIONAL INTELLIGENCE (DSCI) / 11TH INT CONF ON SMART COMPUTING, NETWORKING, AND SERV (SMARTCNS), 2021, : 459 - 466
  • [46] Performance Comparison of Multi-layer Perceptron Training on Electrical and Optical Network-on-Chips
    Dai, Fei
    Chen, Yawen
    Huang, Zhiyi
    Zhang, Haibo
    PARALLEL AND DISTRIBUTED COMPUTING, APPLICATIONS AND TECHNOLOGIES, PDCAT 2021, 2022, 13148 : 129 - 141
  • [47] Comparing the performance of multi-layer perceptron training on electrical and optical network-on-chips
    Dai, Fei
    Chen, Yawen
    Huang, Zhiyi
    Zhang, Haibo
    Zhang, Hao
    Xia, Chengpeng
    JOURNAL OF SUPERCOMPUTING, 2023, 79 (10): : 10725 - 10746
  • [48] Comparing the performance of multi-layer perceptron training on electrical and optical network-on-chips
    Fei Dai
    Yawen Chen
    Zhiyi Huang
    Haibo Zhang
    Hao Zhang
    Chengpeng Xia
    The Journal of Supercomputing, 2023, 79 : 10725 - 10746
  • [49] Hybrid wolf-bat algorithm for optimization of connection weights in multi-layer perceptron
    Agrawal, Utkarsh
    Arora, Jatin
    Singh, Rahul
    Gupta, Deepak
    Khanna, Ashish
    Khamparia, Aditya
    Gupta, Deepak (deepakgupta@mait.ac.in), 1600, Association for Computing Machinery, 2 Penn Plaza, Suite 701, New York, NY 10121-0701, United States (16):
  • [50] Hybrid neural network model based on multi-layer perceptron and adaptive resonance theory
    Gavrilov, Andrey
    Lee, Young-Koo
    Lee, Stlngyoung
    ADVANCES IN NEURAL NETWORKS - ISNN 2006, PT 1, 2006, 3971 : 707 - 713