An iterative SVM approach to feature selection and classification in high-dimensional datasets

被引:43
|
作者
Liu, Dehua [1 ]
Qian, Hui [1 ]
Dai, Guang [1 ]
Zhang, Zhihua [1 ]
机构
[1] Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Zhejiang, Peoples R China
关键词
Feature selection; SVM; DrSVM; Sparse learning;
D O I
10.1016/j.patcog.2013.02.007
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Support vector machine (SVM) is the state-of-the-art classification method, and the doubly regularized SVM (DrSVM) is an important extension based on the elastic net penalty. DrSVM has been successfully applied in handling variable selection while retaining (or discarding) correlated variables. However, it is challenging to solve this model. In this paper we develop an iterative l(2)-SVM approach to implement DrSVM over high-dimensional datasets. Our approach can significantly reduce the computation complexity. Moreover, the corresponding algorithms have global convergence property. Empirical results over the simulated and real-world gene datasets are encouraging. (C) 2013 Elsevier Ltd. All rights reserved.
引用
收藏
页码:2531 / 2537
页数:7
相关论文
共 50 条
  • [21] A Space Transformation-Based Multiform Approach for Multiobjective Feature Selection in High-Dimensional Classification
    Yu, Kunjie
    Sun, Shaoru
    Liang, Jing
    Chen, Ke
    Qu, Boyang
    Yue, Caitong
    Suganthan, Ponnuthurai Nagaratnam
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2024, 54 (12): : 7305 - 7317
  • [22] A Light Causal Feature Selection Approach to High-Dimensional Data
    Ling, Zhaolong
    Li, Ying
    Zhang, Yiwen
    Yu, Kui
    Zhou, Peng
    Li, Bo
    Wu, Xindong
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (08) : 7639 - 7650
  • [23] Multistage feature selection approach for high-dimensional cancer data
    Alkuhlani, Alhasan
    Nassef, Mohammad
    Farag, Ibrahim
    SOFT COMPUTING, 2017, 21 (22) : 6895 - 6906
  • [24] Multistage feature selection approach for high-dimensional cancer data
    Alhasan Alkuhlani
    Mohammad Nassef
    Ibrahim Farag
    Soft Computing, 2017, 21 : 6895 - 6906
  • [25] A sequential approach to feature selection in high-dimensional additive models
    Gong, Yuan
    Chen, Zehua
    JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2021, 215 : 289 - 298
  • [26] A PSO Based Hybrid Feature Selection Algorithm for High-Dimensional Classification
    Binh Tran
    Zhang, Mengjie
    Xue, Bing
    2016 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2016, : 3801 - 3808
  • [27] Feature Augmentation via Nonparametrics and Selection (FANS) in High-Dimensional Classification
    Fan, Jianqing
    Feng, Yang
    Jiang, Jiancheng
    Tong, Xin
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2016, 111 (513) : 275 - 287
  • [28] Feature selection for high-dimensional classification using a competitive swarm optimizer
    Gu, Shenkai
    Cheng, Ran
    Jin, Yaochu
    SOFT COMPUTING, 2018, 22 (03) : 811 - 822
  • [29] Feature selection for high-dimensional classification using a competitive swarm optimizer
    Shenkai Gu
    Ran Cheng
    Yaochu Jin
    Soft Computing, 2018, 22 : 811 - 822
  • [30] Genetic programming for feature construction and selection in classification on high-dimensional data
    Binh Tran
    Bing Xue
    Mengjie Zhang
    Memetic Computing, 2016, 8 : 3 - 15