A new feature selection method based on a validity index of feature subset

被引:53
|
作者
Liu, Chuan [1 ]
Wang, Wenyong [1 ]
Zhao, Qiang [1 ]
Shen, Xiaoming [2 ]
Konan, Martin [1 ]
机构
[1] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu 611731, Peoples R China
[2] Zhejiang Elect Power Res Inst, Hangzhou 310014, Zhejiang, Peoples R China
关键词
Feature selection; Wrapper methods; Filter methods; INFORMATION; VALIDATION; ALGORITHMS; FILTER;
D O I
10.1016/j.patrec.2017.03.018
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The wrapper feature selection method can achieve high classification accuracy. However, the cross-validation scheme of the wrapper method in evaluation phase is very expensive regarding computing resource consumption. In this paper, we propose a new statistical measure named as LW-index which could replace the expensive cross-validation scheme to evaluate the feature subset. Then, a new feature selection method, which is the combination of the proposed LW-index with Sequence Forward Search algorithm (SFS-LW), is presented in this paper. Further, we show through plenty of experiments conducted on nine UCI datasets that the proposed method can obtain similar classification accuracy as the wrapper method with centroid-based classifier or support vector machine, and its computation cost is approximate to the compared filter methods. (C) 2017 The Authors. Published by Elsevier B.V.
引用
收藏
页码:1 / 8
页数:8
相关论文
共 50 条
  • [31] A new feature selection method based on feature distinguishing ability and network influence
    Qi, Yanpeng
    Su, Benzhe
    Lin, Xiaohui
    Zhou, Huiwei
    JOURNAL OF BIOMEDICAL INFORMATICS, 2022, 128
  • [32] Remainder Subset Awareness for Feature Subset Selection
    Prat-Masramon, Gabriel
    Belanche-Munoz, Lluis A.
    RESEARCH AND DEVELOPMENT IN INTELLIGENT SYSTEMS XXVI: INCORPORATING APPLICATIONS AND INNOVATIONS IN INTELLIGENT SYSTEMS XVII, 2010, : 317 - 322
  • [33] A hybrid feature selection method based on instance learning and cooperative subset search
    Ben Brahim, Afef
    Limam, Mohamed
    PATTERN RECOGNITION LETTERS, 2016, 69 : 28 - 34
  • [34] AN OPTIMAL FEATURE SUBSET SELECTION METHOD BASED ON DISTANCE DISCRIMINANT AND DISTRIBUTION OVERLAPPING
    Liang, Jianning
    Yang, Su
    Wang, Yuanyuan
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2009, 23 (08) : 1577 - 1597
  • [35] A Feature Subset Selection Method Based On High-Dimensional Mutual Information
    Zheng, Yun
    Kwoh, Chee Keong
    ENTROPY, 2011, 13 (04) : 860 - 901
  • [36] A novel hybrid Taguchi-Grey-based method for feature subset selection
    Chang, Hsin-Yun
    Sun, Chung-Shan
    PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS AND APPLICATIONS, PROCEEDINGS, 2007, 4756 : 457 - +
  • [37] Fusion Feature Selection: New Insights into Feature Subset Detection in Biological Data Mining
    Athilakshmi, Rajangam
    Rajavel, Ramadoss
    Jacob, Shomona Gracia
    STUDIES IN INFORMATICS AND CONTROL, 2019, 28 (03): : 327 - 336
  • [38] Feature Subset Selection based on Redundancy Maximized Clusters
    Tarek, Md Hasan
    Kadir, Md Eusha
    Sharmin, Sadia
    Sajib, Abu Ashfaqur
    Ali, Amin Ahsan
    Shoyaib, Mohammad
    20TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2021), 2021, : 521 - 526
  • [39] Axiomatic approach to feature subset selection based on relevance
    Wang, H
    Bell, D
    Murtagh, F
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1999, 21 (03) : 271 - 277
  • [40] Feature subset selection: A correlation based filter approach
    Hall, MA
    Smith, LA
    PROGRESS IN CONNECTIONIST-BASED INFORMATION SYSTEMS, VOLS 1 AND 2, 1998, : 855 - 858