An iterative SVM approach to feature selection and classification in high-dimensional datasets

被引:43
|
作者
Liu, Dehua [1 ]
Qian, Hui [1 ]
Dai, Guang [1 ]
Zhang, Zhihua [1 ]
机构
[1] Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Zhejiang, Peoples R China
关键词
Feature selection; SVM; DrSVM; Sparse learning;
D O I
10.1016/j.patcog.2013.02.007
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Support vector machine (SVM) is the state-of-the-art classification method, and the doubly regularized SVM (DrSVM) is an important extension based on the elastic net penalty. DrSVM has been successfully applied in handling variable selection while retaining (or discarding) correlated variables. However, it is challenging to solve this model. In this paper we develop an iterative l(2)-SVM approach to implement DrSVM over high-dimensional datasets. Our approach can significantly reduce the computation complexity. Moreover, the corresponding algorithms have global convergence property. Empirical results over the simulated and real-world gene datasets are encouraging. (C) 2013 Elsevier Ltd. All rights reserved.
引用
收藏
页码:2531 / 2537
页数:7
相关论文
共 50 条
  • [31] Benchmark for filter methods for feature selection in high-dimensional classification data
    Bommert, Andrea
    Sun, Xudong
    Bischl, Bernd
    Rahnenfuehrer, Joerg
    Lang, Michel
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2020, 143
  • [32] Stability of feature selection in classification issues for high-dimensional correlated data
    Émeline Perthame
    Chloé Friguet
    David Causeur
    Statistics and Computing, 2016, 26 : 783 - 796
  • [33] Guided Particle Adaptation PSO for Feature Selection on High-dimensional Classification
    Huang, Mingshen
    Yuan, Weiwei
    Guan, Donghai
    Lu, Mengze
    Koc, Cetin Kaya
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT I, ICIC 2024, 2024, 14862 : 14 - 26
  • [34] Stability of feature selection in classification issues for high-dimensional correlated data
    Perthame, Emeline
    Friguet, Chloe
    Causeur, David
    STATISTICS AND COMPUTING, 2016, 26 (04) : 783 - 796
  • [35] Genetic programming for feature construction and selection in classification on high-dimensional data
    Binh Tran
    Xue, Bing
    Zhang, Mengjie
    MEMETIC COMPUTING, 2016, 8 (01) : 3 - 15
  • [36] Feature selection for high-dimensional data
    Destrero A.
    Mosci S.
    De Mol C.
    Verri A.
    Odone F.
    Computational Management Science, 2009, 6 (1) : 25 - 40
  • [37] Feature selection for high-dimensional data
    Bolón-Canedo V.
    Sánchez-Maroño N.
    Alonso-Betanzos A.
    Progress in Artificial Intelligence, 2016, 5 (2) : 65 - 75
  • [38] Adaptive cooperative coevolutionary differential evolution for parallel feature selection in high-dimensional datasets
    Marjan Firouznia
    Pietro Ruiu
    Giuseppe A. Trunfio
    The Journal of Supercomputing, 2023, 79 : 15215 - 15244
  • [39] Distributed feature selection: A hesitant fuzzy correlation concept for microarray high-dimensional datasets
    Ebrahimpour, Mohammad Kazem
    Eftekhari, Mahdi
    CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2018, 173 : 51 - 64
  • [40] Adaptive cooperative coevolutionary differential evolution for parallel feature selection in high-dimensional datasets
    Firouznia, Marjan
    Ruiu, Pietro
    Trunfio, Giuseppe A.
    JOURNAL OF SUPERCOMPUTING, 2023, 79 (14): : 15215 - 15244