An evolutionary filter approach to feature selection in classification for both single- and multi-objective scenarios

被引:14
|
作者
Hancer, Emrah [1 ,2 ,3 ]
Xue, Bing [1 ,2 ]
Zhang, Mengjie [1 ,2 ]
机构
[1] Victoria Univ Wellington, Ctr Data Sci & Artificial Intelligence, Wellington 6140, New Zealand
[2] Victoria Univ Wellington, Sch Engn & Comp Sci, Wellington 6140, New Zealand
[3] Mehmet Akif Ersoy Univ, Dept Software Engn, TR-15039 Burdur, Turkiye
关键词
Differential evolution; Neighborhood component analysis; Multi-objective optimization; Classification; PARTICLE SWARM OPTIMIZATION; DIFFERENTIAL EVOLUTION; MUTUAL INFORMATION; ALGORITHM; DENSITY;
D O I
10.1016/j.knosys.2023.111008
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The high-dimensional datasets in various domains, such as text categorization, information retrieval and bioinformatics, have highlighted the importance of feature selection in data mining. Despite the numerous existing approaches to feature selection, there is still a need for further research in this field. In this paper, we propose an evolutionary filter feature selection approach that can be used for both single-and multi-objective scenarios by introducing an objective function inspired by Neighborhood Component Analysis (NCA)-based method and then integrating it into the differential evolution framework. The proposed approach applicable to two scenarios aims to identify an optimal feature subset through an evolutionary search process that maximizes class separation while minimizing the dimensionality. Through comprehensive experimental studies conducted on diverse datasets, the results show that the proposed approach outperforms recently proposed evolutionary information-theoretic, rough set-based and state-of-the-art feature selection approaches in both scenarios. Notably, this study is the first to integrate an NCA-based strategy into an evolutionary feature selection approach. Furthermore, you can access the source code of this approach at https://github.com/ ehancer06/DENCA this link.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] A methodology for evaluating multi-objective evolutionary feature selection for classification in the context of virtual screening
    Fernando Jiménez
    Horacio Pérez-Sánchez
    José Palma
    Gracia Sánchez
    Carlos Martínez
    Soft Computing, 2019, 23 : 8775 - 8800
  • [22] An evolutionary multi-objective optimization framework of discretization-based feature selection for classification
    Zhou, Yu
    Kang, Junhao
    Kwong, Sam
    Wang, Xu
    Zhang, Qingfu
    SWARM AND EVOLUTIONARY COMPUTATION, 2021, 60
  • [23] Multi-Objective Feature Selection With Missing Data in Classification
    Xue, Yu
    Tang, Yihang
    Xu, Xin
    Liang, Jiayu
    Neri, Ferrante
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2022, 6 (02): : 355 - 364
  • [24] A self-adaptive multi-objective feature selection approach for classification problems
    Xue, Yu
    Zhu, Haokai
    Neri, Ferrante
    INTEGRATED COMPUTER-AIDED ENGINEERING, 2022, 29 (01) : 3 - 21
  • [25] Single- and Multi-Objective Game-Benchmark for Evolutionary Algorithms
    Volz, Vanessa
    Naujoks, Boris
    Kerschke, Pascal
    Tusar, Tea
    PROCEEDINGS OF THE 2019 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE (GECCO'19), 2019, : 647 - 655
  • [26] Multi-objective evolutionary feature selection for online sales forecasting
    Jimenez, F.
    Sanchez, G.
    Garcia, J. M.
    Sciavicco, G.
    Miralles, L.
    NEUROCOMPUTING, 2017, 234 : 75 - 92
  • [27] A Bayesian approach to constrained single- and multi-objective optimization
    Feliot, Paul
    Bect, Julien
    Vazquez, Emmanuel
    JOURNAL OF GLOBAL OPTIMIZATION, 2017, 67 (1-2) : 97 - 133
  • [28] A Multi-Objective Evolutionary Approach to Imbalanced Classification Problems
    Chira, Camelia
    Lemnaru, Camelia
    2015 IEEE 11TH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTER COMMUNICATION AND PROCESSING (ICCP), 2015, : 149 - 154
  • [29] A Bayesian approach to constrained single- and multi-objective optimization
    Paul Feliot
    Julien Bect
    Emmanuel Vazquez
    Journal of Global Optimization, 2017, 67 : 97 - 133
  • [30] Multi-objective Evolutionary Instance Selection for Multi-label Classification
    Liu, Dingming
    Shang, Haopu
    Hong, Wenjing
    Qian, Chao
    PRICAI 2022: TRENDS IN ARTIFICIAL INTELLIGENCE, PT I, 2022, 13629 : 548 - 561