An iterative SVM approach to feature selection and classification in high-dimensional datasets

被引:43
|
作者
Liu, Dehua [1 ]
Qian, Hui [1 ]
Dai, Guang [1 ]
Zhang, Zhihua [1 ]
机构
[1] Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Zhejiang, Peoples R China
关键词
Feature selection; SVM; DrSVM; Sparse learning;
D O I
10.1016/j.patcog.2013.02.007
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Support vector machine (SVM) is the state-of-the-art classification method, and the doubly regularized SVM (DrSVM) is an important extension based on the elastic net penalty. DrSVM has been successfully applied in handling variable selection while retaining (or discarding) correlated variables. However, it is challenging to solve this model. In this paper we develop an iterative l(2)-SVM approach to implement DrSVM over high-dimensional datasets. Our approach can significantly reduce the computation complexity. Moreover, the corresponding algorithms have global convergence property. Empirical results over the simulated and real-world gene datasets are encouraging. (C) 2013 Elsevier Ltd. All rights reserved.
引用
收藏
页码:2531 / 2537
页数:7
相关论文
共 50 条
  • [11] Feature Selection and Classification for High-Dimensional Incomplete Multimodal Data
    Deng, Wan-Yu
    Liu, Dan
    Dong, Ying-Ying
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2018, 2018
  • [12] A hybrid approach using rough set theory and hypergraph for feature selection on high-dimensional medical datasets
    M. R. Gauthama Raman
    Somu Nivethitha
    Krithivasan Kannan
    V. S. Shankar Sriram
    Soft Computing, 2019, 23 : 12655 - 12672
  • [13] A hybrid approach using rough set theory and hypergraph for feature selection on high-dimensional medical datasets
    Raman, M. R. Gauthama
    Nivethitha, Somu
    Kannan, Krithivasan
    Sriram, V. S. Shankar
    SOFT COMPUTING, 2019, 23 (23) : 12655 - 12672
  • [14] Research on classification method of high-dimensional class-imbalanced datasets based on SVM
    Chunkai Zhang
    Ying Zhou
    Jianwei Guo
    Guoquan Wang
    Xuan Wang
    International Journal of Machine Learning and Cybernetics, 2019, 10 : 1765 - 1778
  • [15] Research on classification method of high-dimensional class-imbalanced datasets based on SVM
    Zhang, Chunkai
    Zhou, Ying
    Guo, Jianwei
    Wang, Guoquan
    Wang, Xuan
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2019, 10 (07) : 1765 - 1778
  • [16] A Adaptive Cooperative Coevolutionary Algorithm for Parallel Feature Selection in High-Dimensional Datasets
    Firouznia, Marjan
    Trunfio, Giuseppe A.
    30TH EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED AND NETWORK-BASED PROCESSING (PDP 2022), 2022, : 211 - 218
  • [17] Analytical and Experimental Study of Filter Feature Selection Algorithms for High-dimensional Datasets
    Pino, Adrian
    Morell, Carlos
    PROCEEDINGS OF THE FOURTH INTERNATIONAL WORKSHOP ON KNOWLEDGE DISCOVERY, KNOWLEDGE MANAGEMENT AND DECISION SUPPORT (EUREKA-2013), 2013, 51 : 339 - 349
  • [18] A GA-BASED FEATURE SELECTION AND ENSEMBLE LEARNING FOR HIGH-DIMENSIONAL DATASETS
    Xia, Pei-Yong
    Ding, Xiang-Qian
    Jiang, Bai-Ning
    PROCEEDINGS OF 2009 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-6, 2009, : 7 - +
  • [19] A Nested Genetic Algorithm for feature selection in high-dimensional cancer Microarray datasets
    Sayed, Sabah
    Nassef, Mohammad
    Badr, Amr
    Farag, Ibrahim
    EXPERT SYSTEMS WITH APPLICATIONS, 2019, 121 : 233 - 243
  • [20] An Efficient SVM-Based Feature Selection Model for Cancer Classification Using High-Dimensional Microarray Data
    El Kafrawy, Passent
    Fathi, Hanaa
    Qaraad, Mohammed
    Kelany, Ayda K.
    Chen, Xumin
    IEEE ACCESS, 2021, 9 : 155353 - 155369