Multiclass MTS for Simultaneous Feature Selection and Classification

被引:51
|
作者
Su, Chao-Ton [1 ]
Hsiao, Yu-Hsiang [1 ]
机构
[1] Natl Tsing Hua Univ, Dept Ind Engn & Engn Management, Hsinchu 30013, Taiwan
关键词
Classification; feature selection; multiclass problem; Mahalanobis-Taguchi system (MTS); weighted Mahalanobis distance; Gram-Schmidt orthogonalization process; gestational diabetes mellitus; MAHALANOBIS DISTANCE; VECTOR MACHINES; ROBUSTNESS; WOMEN; RISK;
D O I
10.1109/TKDE.2008.128
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multiclass Mahalanobis-Taguchi system (MMTS), the extension of MTS, is developed for simultaneous multiclass classification and feature selection. In MMTS, the multiclass measurement scale is constructed by establishing an individual Mahalanobis space for each class. To increase the validity of the measurement scale, the Gram-Schmidt process is performed to mutually orthogonalize the features and eliminate the multicollinearity. The important features are identified using the orthogonal arrays and the signal-to-noise ratio, and are then used to construct a reduced model measurement scale. The contribution of each important feature to classification is also derived according to the effect gain to develop a weighted Mahalanobis distance which is finally used as the distance metric for the classification of MMTS. Using the reduced model measurement scale, an unknown example will be classified into the class with minimum weighted Mahalanobis distance considering only the important features. For evaluating the effectiveness of MMTS, a numerical experiment is implemented, and the results show that MMTS outperforms other well-known algorithms not only on classification accuracy but also on feature selection efficiency. Finally, a real case about gestational diabetes mellitus is studied, and the results indicate the practicality of MMTS in real-world applications.
引用
收藏
页码:192 / 205
页数:14
相关论文
共 50 条
  • [1] Sparse distance-based learning for simultaneous multiclass classification and feature selection of metagenomic data
    Liu, Zhenqiu
    Hsiao, William
    Cantarel, Brandi L.
    Drabek, Elliott Franco
    Fraser-Liggett, Claire
    BIOINFORMATICS, 2011, 27 (23) : 3242 - 3249
  • [2] Discriminative Feature Combination Selection for Enhancing Multiclass Classification
    Song, Aibo
    Qian, Wei
    Wu, Zhiang
    Zhao, Jinghua
    PROCEEDINGS OF 2015 IEEE INTERNATIONAL CONFERENCE ON BEHAVIORAL, ECONOMIC, SOCIO-CULTURAL COMPUTING (BESC), 2015, : 89 - 95
  • [3] Stable feature selection and classification algorithms for multiclass microarray data
    Student, Sebastian
    Fujarewicz, Krzysztof
    BIOLOGY DIRECT, 2012, 7
  • [4] Stable feature selection and classification algorithms for multiclass microarray data
    Sebastian Student
    Krzysztof Fujarewicz
    Biology Direct, 7
  • [5] Discriminative Least Squares Regression for Multiclass Classification and Feature Selection
    Xiang, Shiming
    Nie, Feiping
    Meng, Gaofeng
    Pan, Chunhong
    Zhang, Changshui
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2012, 23 (11) : 1738 - 1754
  • [6] Iterative ensemble feature selection for multiclass classification of imbalanced microarray data
    Yang, Junshan
    Zhou, Jiarui
    Zhu, Zexuan
    Ma, Xiaoliang
    Ji, Zhen
    JOURNAL OF BIOLOGICAL RESEARCH-THESSALONIKI, 2016, 23
  • [7] Multiclass classification of sarcomas using pathway based feature selection method
    Gu, Jian-lei
    Lu, Yao
    Liu, Cong
    Lu, Hui
    JOURNAL OF THEORETICAL BIOLOGY, 2014, 362 : 3 - 8
  • [8] PRIVACY PRESERVING FEATURE SELECTION AND MULTICLASS CLASSIFICATION FOR HORIZONTALLY DISTRIBUTED DATA
    Lu, Yunmei
    Yan, Mingyuan
    Han, Meng
    Yang, Qingliang
    Zhang, Yanqing
    MATHEMATICAL FOUNDATIONS OF COMPUTING, 2018, 1 (04): : 331 - 348
  • [9] MULTICLASS BAYESIAN FEATURE SELECTION
    Foroughi, Ali
    Dalton, Lori A.
    2017 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP 2017), 2017, : 725 - 729
  • [10] Multiclass Gastrointestinal Diseases Classification Based on Hybrid Features and Duo Feature Selection
    Joseph, J. Sharmila
    Vidyarthi, Abhay
    JOURNAL OF BIOMEDICAL NANOTECHNOLOGY, 2023, 19 (02) : 288 - 298