A new feature selection method based on a validity index of feature subset

被引:53
|
作者
Liu, Chuan [1 ]
Wang, Wenyong [1 ]
Zhao, Qiang [1 ]
Shen, Xiaoming [2 ]
Konan, Martin [1 ]
机构
[1] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu 611731, Peoples R China
[2] Zhejiang Elect Power Res Inst, Hangzhou 310014, Zhejiang, Peoples R China
关键词
Feature selection; Wrapper methods; Filter methods; INFORMATION; VALIDATION; ALGORITHMS; FILTER;
D O I
10.1016/j.patrec.2017.03.018
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The wrapper feature selection method can achieve high classification accuracy. However, the cross-validation scheme of the wrapper method in evaluation phase is very expensive regarding computing resource consumption. In this paper, we propose a new statistical measure named as LW-index which could replace the expensive cross-validation scheme to evaluate the feature subset. Then, a new feature selection method, which is the combination of the proposed LW-index with Sequence Forward Search algorithm (SFS-LW), is presented in this paper. Further, we show through plenty of experiments conducted on nine UCI datasets that the proposed method can obtain similar classification accuracy as the wrapper method with centroid-based classifier or support vector machine, and its computation cost is approximate to the compared filter methods. (C) 2017 The Authors. Published by Elsevier B.V.
引用
收藏
页码:1 / 8
页数:8
相关论文
共 50 条
  • [21] Feature transformation and subset selection
    Liu, H
    Motoda, H
    IEEE INTELLIGENT SYSTEMS & THEIR APPLICATIONS, 1998, 13 (02): : 26 - 28
  • [22] Wrappers for feature subset selection
    Kohavi, R
    John, GH
    ARTIFICIAL INTELLIGENCE, 1997, 97 (1-2) : 273 - 324
  • [23] Feature transformation and subset selection
    Natl Univ of Singapore, Singapore, Singapore
    IEEE Intell Syst their Appl, 2 (26-28):
  • [24] Wrappers for feature subset selection
    Silicon Graphics, Inc, Mountain View, United States
    Artif Intell, 1-2 (273-324):
  • [25] THE FEATURE SUBSET SELECTION ALGORITHM
    Liu Yongguo Li Xueming Wu Zhongfu (Department of Computer Science and Engineering
    Journal of Electronics(China), 2003, (01) : 57 - 61
  • [26] Feature subset selection for data and feature streams: a review
    Carlos Villa-Blanco
    Concha Bielza
    Pedro Larrañaga
    Artificial Intelligence Review, 2023, 56 : 1011 - 1062
  • [27] A new method for feature selection
    Wu, Yan
    Yang, Yang
    ADVANCES IN NEURAL NETWORKS - ISNN 2006, PT 1, 2006, 3971 : 1367 - 1372
  • [28] A Population Based Feature Subset Selection Algorithm Guided by Fuzzy Feature Dependency
    Al-Ani, Ahmed
    Khushaba, Rami N.
    ADVANCED MACHINE LEARNING TECHNOLOGIES AND APPLICATIONS, 2012, 322 : 430 - +
  • [29] Feature subset selection using a new definition of classifiability
    Dong, M
    Kothari, R
    PATTERN RECOGNITION LETTERS, 2003, 24 (9-10) : 1215 - 1225
  • [30] Feature subset selection for data and feature streams: a review
    Villa-Blanco, Carlos
    Bielza, Concha
    Larranaga, Pedro
    ARTIFICIAL INTELLIGENCE REVIEW, 2023, 56 (SUPPL 1) : 1011 - 1062