An evolutionary filter approach to feature selection in classification for both single- and multi-objective scenarios

被引:14
|
作者
Hancer, Emrah [1 ,2 ,3 ]
Xue, Bing [1 ,2 ]
Zhang, Mengjie [1 ,2 ]
机构
[1] Victoria Univ Wellington, Ctr Data Sci & Artificial Intelligence, Wellington 6140, New Zealand
[2] Victoria Univ Wellington, Sch Engn & Comp Sci, Wellington 6140, New Zealand
[3] Mehmet Akif Ersoy Univ, Dept Software Engn, TR-15039 Burdur, Turkiye
关键词
Differential evolution; Neighborhood component analysis; Multi-objective optimization; Classification; PARTICLE SWARM OPTIMIZATION; DIFFERENTIAL EVOLUTION; MUTUAL INFORMATION; ALGORITHM; DENSITY;
D O I
10.1016/j.knosys.2023.111008
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The high-dimensional datasets in various domains, such as text categorization, information retrieval and bioinformatics, have highlighted the importance of feature selection in data mining. Despite the numerous existing approaches to feature selection, there is still a need for further research in this field. In this paper, we propose an evolutionary filter feature selection approach that can be used for both single-and multi-objective scenarios by introducing an objective function inspired by Neighborhood Component Analysis (NCA)-based method and then integrating it into the differential evolution framework. The proposed approach applicable to two scenarios aims to identify an optimal feature subset through an evolutionary search process that maximizes class separation while minimizing the dimensionality. Through comprehensive experimental studies conducted on diverse datasets, the results show that the proposed approach outperforms recently proposed evolutionary information-theoretic, rough set-based and state-of-the-art feature selection approaches in both scenarios. Notably, this study is the first to integrate an NCA-based strategy into an evolutionary feature selection approach. Furthermore, you can access the source code of this approach at https://github.com/ ehancer06/DENCA this link.
引用
收藏
页数:15
相关论文
共 50 条
  • [11] A Simple and Effective Termination Condition for Both Single- and Multi-Objective Evolutionary Algorithms
    Kukkonen, Saku
    Coello Coello, Carlos A.
    2019 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2019, : 3053 - 3059
  • [12] An interactive filter-wrapper multi-objective evolutionary algorithm for feature selection
    Liu, Zhengyi
    Chang, Bo
    Cheng, Fan
    SWARM AND EVOLUTIONARY COMPUTATION, 2021, 65
  • [13] Simultaneous feature selection and weighting - An evolutionary multi-objective optimization approach
    Paul, Sujoy
    Das, Swagatam
    PATTERN RECOGNITION LETTERS, 2015, 65 : 51 - 59
  • [14] Feature weighting for antimicrobial peptides classification: a multi-objective evolutionary approach
    Beltran, Jesus A.
    Aguilera-Mendoza, Longendri
    Brizuela, Carlos A.
    2017 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2017, : 276 - 283
  • [15] The Comparative Analysis of Single-Objective and Multi-objective Evolutionary Feature Selection Methods
    Ali, Syed Imran
    Lee, Sungyoung
    PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON UBIQUITOUS INFORMATION MANAGEMENT AND COMMUNICATION (IMCOM) 2019, 2019, 935 : 975 - 985
  • [16] Particle Swarm Optimization for Feature Selection in Classification: A Multi-Objective Approach
    Xue, Bing
    Zhang, Mengjie
    Browne, Will N.
    IEEE TRANSACTIONS ON CYBERNETICS, 2013, 43 (06) : 1656 - 1671
  • [17] Archivers for Single- and Multi-objective Evolutionary Optimization Algorithms
    Hernandez, Carlos
    Schutze, Oliver
    PROCEEDINGS OF THE 2022 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE COMPANION, GECCO 2022, 2022, : 37 - 38
  • [18] Single- and Multi-Objective Evolutionary Algorithms for Graph Bisectioning
    Greiner, Gero
    FOGA'09: PROCEEDINGS OF THE 10TH ACM SIGRVO CONFERENCE ON FOUNDATIONS OF GENETIC ALGORITHMS, 2009, : 29 - 38
  • [19] An evolutionary decomposition-based multi-objective feature selection for multi-label classification
    Bidgoli, Azam Asilian
    Ebrahimpour-Komleh, Hossein
    Rahnamayan, Shahryar
    PEERJ COMPUTER SCIENCE, 2020, 2020 (03) : 1 - 32
  • [20] A methodology for evaluating multi-objective evolutionary feature selection for classification in the context of virtual screening
    Jimenez, Fernando
    Perez-Sanchez, Horacio
    Palma, Jose
    Sanchez, Gracia
    Martinez, Carlos
    SOFT COMPUTING, 2019, 23 (18) : 8775 - 8800