An evolutionary filter approach to feature selection in classification for both single- and multi-objective scenarios

被引:14
|
作者
Hancer, Emrah [1 ,2 ,3 ]
Xue, Bing [1 ,2 ]
Zhang, Mengjie [1 ,2 ]
机构
[1] Victoria Univ Wellington, Ctr Data Sci & Artificial Intelligence, Wellington 6140, New Zealand
[2] Victoria Univ Wellington, Sch Engn & Comp Sci, Wellington 6140, New Zealand
[3] Mehmet Akif Ersoy Univ, Dept Software Engn, TR-15039 Burdur, Turkiye
关键词
Differential evolution; Neighborhood component analysis; Multi-objective optimization; Classification; PARTICLE SWARM OPTIMIZATION; DIFFERENTIAL EVOLUTION; MUTUAL INFORMATION; ALGORITHM; DENSITY;
D O I
10.1016/j.knosys.2023.111008
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The high-dimensional datasets in various domains, such as text categorization, information retrieval and bioinformatics, have highlighted the importance of feature selection in data mining. Despite the numerous existing approaches to feature selection, there is still a need for further research in this field. In this paper, we propose an evolutionary filter feature selection approach that can be used for both single-and multi-objective scenarios by introducing an objective function inspired by Neighborhood Component Analysis (NCA)-based method and then integrating it into the differential evolution framework. The proposed approach applicable to two scenarios aims to identify an optimal feature subset through an evolutionary search process that maximizes class separation while minimizing the dimensionality. Through comprehensive experimental studies conducted on diverse datasets, the results show that the proposed approach outperforms recently proposed evolutionary information-theoretic, rough set-based and state-of-the-art feature selection approaches in both scenarios. Notably, this study is the first to integrate an NCA-based strategy into an evolutionary feature selection approach. Furthermore, you can access the source code of this approach at https://github.com/ ehancer06/DENCA this link.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] An Evolutionary Based Multi-Objective Filter Approach for Feature Selection
    Labani, Mahdieh
    Moradi, Parham
    Jalili, Mahdi
    Yu, Xinghuo
    2017 2ND WORLD CONGRESS ON COMPUTING AND COMMUNICATION TECHNOLOGIES (WCCCT), 2017, : 151 - 154
  • [2] MULTI-OBJECTIVE EVOLUTIONARY ALGORITHMS FOR FILTER BASED FEATURE SELECTION IN CLASSIFICATION
    Xue, Bing
    Cervante, Liam
    Shang, Lin
    Browne, Will N.
    Zhang, Mengjie
    INTERNATIONAL JOURNAL ON ARTIFICIAL INTELLIGENCE TOOLS, 2013, 22 (04)
  • [3] A Multi-objective hybrid filter-wrapper evolutionary approach for feature selection
    Hammami, Marwa
    Bechikh, Slim
    Hung, Chih-Cheng
    Ben Said, Lamjed
    MEMETIC COMPUTING, 2019, 11 (02) : 193 - 208
  • [4] A Multi-objective hybrid filter-wrapper evolutionary approach for feature selection
    Marwa Hammami
    Slim Bechikh
    Chih-Cheng Hung
    Lamjed Ben Said
    Memetic Computing, 2019, 11 : 193 - 208
  • [5] A Multimodal Multi-Objective Evolutionary Algorithm for Filter Feature Selection in Multi-Label Classification
    Hancer E.
    Xue B.
    Zhang M.
    IEEE Transactions on Artificial Intelligence, 2024, 5 (09): : 1 - 14
  • [6] Multi-objective Evolutionary Feature Selection
    Kundu, Partha Pratim
    Mitra, Sushmita
    PATTERN RECOGNITION AND MACHINE INTELLIGENCE, PROCEEDINGS, 2009, 5909 : 74 - 79
  • [7] Evolutionary Multi-Objective Approach for Prototype Generation and Feature Selection
    Rosales-Perez, Alejandro
    Gonzalez, Jesus A.
    Coello-Coello, Carlos A.
    Reyes-Garcia, Carlos A.
    Escalante, Hugo Jair
    PROGRESS IN PATTERN RECOGNITION IMAGE ANALYSIS, COMPUTER VISION, AND APPLICATIONS, CIARP 2014, 2014, 8827 : 424 - 431
  • [8] Evolutionary Sequential Transfer Learning for Multi-Objective Feature Selection in Classification
    Lin, Jiabin
    Chen, Qi
    Xue, Bing
    Zhang, Mengjie
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2025, 9 (01): : 1019 - 1033
  • [9] Interpretability of Music Classification as a Criterion for Evolutionary Multi-objective Feature Selection
    Vatolkin, Igor
    Rudolph, Guenter
    Weihs, Claus
    EVOLUTIONARY AND BIOLOGICALLY INSPIRED MUSIC, SOUND, ART AND DESIGN (EVOMUSART 2015), 2015, 9027 : 236 - 248
  • [10] Multi-objective Feature Selection in Classification: A Differential Evolution Approach
    Xue, Bing
    Fu, Wenlong
    Zhang, Mengjie
    SIMULATED EVOLUTION AND LEARNING (SEAL 2014), 2014, 8886 : 516 - 528