A new selective neural network ensemble with negative correlation

被引:0
|
作者
Heesung Lee
Euntai Kim
Witold Pedrycz
机构
[1] Yonsei University,School of Electrical and Electronic Engineering
[2] University of Alberta,Department of Electrical and Computer Engineering
[3] Polish Academy of Sciences,Systems Research Institute
来源
Applied Intelligence | 2012年 / 37卷
关键词
Neural network ensemble; Selective neural network ensemble; Hierarchical fair competition-based parallel genetic algorithm; Feature selection; Negative correlation;
D O I
暂无
中图分类号
学科分类号
摘要
An ensemble of neural networks exhibits higher generalization performance compared to a single neural network. In this paper, a new design method for a neural network ensemble is proposed. The hierarchical pair competition-based parallel genetic algorithm (HFC-PGA) is employed to train the neural networks forming the ensemble. The aim of the HFC-PGA is to achieve not only the best neural network, but also a diversity of potential neural networks. A set of component neural networks is selected to build an ensemble such that the generalization error is minimized and the negative correlation is maximized. Finally, some experiments are carried out using several data sets to illustrate and quantify the performance of the proposed method.
引用
收藏
页码:488 / 498
页数:10
相关论文
共 50 条
  • [31] CrescendoNet: A New Deep Convolutional Neural Network with Ensemble Behavior
    Zhang, Xiang
    Vishwamitra, Nishant
    Hu, Hongxin
    Luo, Feng
    2018 17TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2018, : 311 - 317
  • [32] Trustworthiness prediction of cloud services based on selective neural network ensemble learning
    Mao, Chengying
    Lin, Rongru
    Towey, Dave
    Wang, Wenle
    Chen, Jifu
    He, Qiang
    EXPERT SYSTEMS WITH APPLICATIONS, 2021, 168
  • [33] Ant colony optimization-based approach for selective neural network ensemble
    School of Information and Electrical Engineering, Zhejiang University City College, Hangzhou 310015, China
    Zhejiang Daxue Xuebao (Gongxue Ban), 2009, 9 (1568-1573):
  • [34] A DYNAMIC SELECTIVE NEURAL NETWORK ENSEMBLE METHOD FOR FAULT DIAGNOSIS OF STEAM TURBINE
    Li, Yan
    Wang, Dong-Feng
    Han, Pu
    PROCEEDINGS OF 2009 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-6, 2009, : 1 - 6
  • [35] The Diversified Ensemble Neural Network
    Zhang, Shaofeng
    Liu, Meng
    Yan, Junchi
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [36] Graph ensemble neural network
    Duan, Rui
    Yan, Chungang
    Wang, Junli
    Jiang, Changjun
    INFORMATION FUSION, 2024, 110
  • [37] An interpretable neural network ensemble
    Hartono, Pitoyo
    Hashimoto, Shuji
    IECON 2007: 33RD ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, VOLS 1-3, CONFERENCE PROCEEDINGS, 2007, : 228 - +
  • [38] Multiobjective Neural Network Ensembles Based on Regularized Negative Correlation Learning
    Chen, Huanhuan
    Yao, Xin
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2010, 22 (12) : 1738 - 1751
  • [39] A selective deep stacked denoising autoencoders ensemble with negative correlation learning for gearbox fault diagnosis
    Yu, Jianbo
    COMPUTERS IN INDUSTRY, 2019, 108 : 62 - 72
  • [40] Algorithm of heterogeneous neural network ensemble based on new evolutionary programming
    School of Automation Science and Engineering, South China University of Technology, Guangzhou 510640, China
    Huanan Ligong Daxue Xuebao, 2009, 1 (86-90): : 86 - 90