A new feature selection method based on a validity index of feature subset

被引:53
|
作者
Liu, Chuan [1 ]
Wang, Wenyong [1 ]
Zhao, Qiang [1 ]
Shen, Xiaoming [2 ]
Konan, Martin [1 ]
机构
[1] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu 611731, Peoples R China
[2] Zhejiang Elect Power Res Inst, Hangzhou 310014, Zhejiang, Peoples R China
关键词
Feature selection; Wrapper methods; Filter methods; INFORMATION; VALIDATION; ALGORITHMS; FILTER;
D O I
10.1016/j.patrec.2017.03.018
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The wrapper feature selection method can achieve high classification accuracy. However, the cross-validation scheme of the wrapper method in evaluation phase is very expensive regarding computing resource consumption. In this paper, we propose a new statistical measure named as LW-index which could replace the expensive cross-validation scheme to evaluate the feature subset. Then, a new feature selection method, which is the combination of the proposed LW-index with Sequence Forward Search algorithm (SFS-LW), is presented in this paper. Further, we show through plenty of experiments conducted on nine UCI datasets that the proposed method can obtain similar classification accuracy as the wrapper method with centroid-based classifier or support vector machine, and its computation cost is approximate to the compared filter methods. (C) 2017 The Authors. Published by Elsevier B.V.
引用
收藏
页码:1 / 8
页数:8
相关论文
共 50 条
  • [1] Hybrid Feature Selection Method Based on Feature Subset and Factor Analysis
    Gong, Lizeng
    Xie, Shanshan
    Zhang, Yan
    Wang, Mengyao
    Wang, Xiaoyan
    IEEE ACCESS, 2022, 10 : 120792 - 120803
  • [2] A new validity index of feature subset for evaluating the dimensionality reduction algorithms
    Liu, Chuan
    Wang, Wenyong
    Konan, Martin
    Wang, Siyang
    Huang, Lisheng
    Tang, Yong
    Zhang, Xiang
    KNOWLEDGE-BASED SYSTEMS, 2017, 121 : 83 - 98
  • [3] A novel grey-based feature ranking method for feature subset selection
    Huang, Chi-Chun
    Chang, Hsin-Yun
    Yang, Cheng-Hong
    JOURNAL OF THE CHINESE INSTITUTE OF ENGINEERS, 2008, 31 (03) : 509 - 514
  • [4] A novel grey-based feature ranking method for feature subset selection
    Huang, Chi-Chun
    Chang, Hsin-Yun
    Yang, Cheng-Hong
    2006 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND SECURITY, PTS 1 AND 2, PROCEEDINGS, 2006, : 129 - 132
  • [5] An Adaptive Multiple Feature Subset Method for Feature Ranking and Selection
    Chang, Fu
    Chen, Jen-Cheng
    INTERNATIONAL CONFERENCE ON TECHNOLOGIES AND APPLICATIONS OF ARTIFICIAL INTELLIGENCE (TAAI 2010), 2010, : 255 - 262
  • [6] A new approach to feature subset selection
    Liu, DZ
    Feng, ZJ
    Wang, XZ
    PROCEEDINGS OF THE 2004 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2004, : 1822 - 1825
  • [7] A new method for feature subset selection for handling classification problems
    Chen, SM
    Shie, JD
    FUZZ-IEEE 2005: PROCEEDINGS OF THE IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS: BIGGEST LITTLE CONFERENCE IN THE WORLD, 2005, : 183 - 188
  • [8] A genetic algorithm-based method for feature subset selection
    Tan, Feng
    Fu, Xuezheng
    Zhang, Yanqing
    Bourgeois, Anu G.
    SOFT COMPUTING, 2008, 12 (02) : 111 - 120
  • [9] A genetic algorithm-based method for feature subset selection
    Feng Tan
    Xuezheng Fu
    Yanqing Zhang
    Anu G. Bourgeois
    Soft Computing, 2008, 12 : 111 - 120
  • [10] Feature ranking based consensus clustering for feature subset selection
    Rani, D. Sandhya
    Rani, T. Sobha
    Bhavani, S. Durga
    Krishna, G. Bala
    APPLIED INTELLIGENCE, 2024, 54 (17-18) : 8154 - 8169