MCR SVM classifier with group sparsity

被引:4
|
作者
Liu, Jian-wei [1 ]
Cui, Li-peng [1 ]
Luo, Xiong-lin [1 ]
机构
[1] Univ Petr Beijing, Dept Automat China, Beijing, Peoples R China
来源
OPTIK | 2016年 / 127卷 / 17期
关键词
Sparsity; Feature selection; Group feature selection; MCR penalty; MCR SVM; SUPPORT VECTOR MACHINES; VARIABLE SELECTION; GENE SELECTION; REGRESSION; PENALTY;
D O I
10.1016/j.ijleo.2016.03.060
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Classification and dimensionality reduction of high-dimensional data are two important topics in bioinformatics, data mining and machine learning. We propose a novel sparse minimax concave ridge support vector machine (MCR SVM) classifier that simultaneously performs classification and dimensionality reduction. The MCR SVM classifier proposed in this study combines the advantages of the unbiasedness of the estimators of the SCAD SVM and the ability of feature group selection of HHSVM to overcome the disadvantages. We also provide a theoretical justification for the group sparsity of the selected features. The experiments on artificial highly correlated data and high-dimensional real-world data with a small sample size show that the MCR SVM classifier is a attractive technique of classification and dimensionality reduction and its performance is better than the other sparse SVMs. (C) 2016 Elsevier GmbH. All rights reserved.
引用
收藏
页码:6915 / 6926
页数:12
相关论文
共 50 条
  • [1] Analysis of Timing Constraint On Combined SVM-HMM Classifier And SVM Classifier
    Kumawat, Ashish Kumar
    Khandelwal, Sarika
    PROCEEDINGS OF THE 2013 IEEE INTERNATIONAL CONFERENCE IN MOOC, INNOVATION AND TECHNOLOGY IN EDUCATION (MITE), 2013, : 214 - 218
  • [2] On Improving the Generalization of SVM Classifier
    Seetha, H.
    Murty, Narasimha M.
    Saravanan, R.
    COMPUTER NETWORKS AND INTELLIGENT COMPUTING, 2011, 157 : 11 - +
  • [3] A novel classifier ensemble method with sparsity and diversity
    Yin, Xu-Cheng
    Huang, Kaizhu
    Hao, Hong-Wei
    Iqbal, Khalid
    Wang, Zhi-Bin
    NEUROCOMPUTING, 2014, 134 : 214 - 221
  • [4] Sparsity analysis versus sparse representation classifier
    Zhang, Baochang
    Ji, Suli
    Li, Li
    Zhang, Shengping
    Yang, Wankou
    NEUROCOMPUTING, 2016, 171 : 387 - 393
  • [5] Sparsity-driven weighted ensemble classifier
    Atilla Özgür
    Fatih Nar
    Hamit Erdem
    International Journal of Computational Intelligence Systems, 2018, 11 : 962 - 978
  • [6] Sparsity-driven weighted ensemble classifier
    Oezguer, Atilla
    Nar, Fatih
    Erdem, Hamit
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2018, 11 (01) : 962 - 978
  • [7] THE BENEFIT OF GROUP SPARSITY
    Huang, Junzhou
    Zhang, Tong
    ANNALS OF STATISTICS, 2010, 38 (04): : 1978 - 2004
  • [8] THE RESEARCH OF THE FAST SVM CLASSIFIER METHOD
    Yang, Yujun
    Li, Jianping
    Yang, Yimei
    2015 12TH INTERNATIONAL COMPUTER CONFERENCE ON WAVELET ACTIVE MEDIA TECHNOLOGY AND INFORMATION PROCESSING (ICCWAMTIP), 2015, : 121 - 124
  • [9] An ensemble svm classifier with feature selection
    Hu, Han
    En-en, Ren
    2007 INTERNATIONAL SYMPOSIUM ON COMPUTER SCIENCE & TECHNOLOGY, PROCEEDINGS, 2007, : 6 - 8
  • [10] An efficient SVM classifier for lopsided corpora
    Zhang, XianFei
    Li, BiCheng
    Shi, Wang
    Cheng, Luo
    18TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2006, : 1144 - +