Multiclass MTS for Simultaneous Feature Selection and Classification

被引:51
|
作者
Su, Chao-Ton [1 ]
Hsiao, Yu-Hsiang [1 ]
机构
[1] Natl Tsing Hua Univ, Dept Ind Engn & Engn Management, Hsinchu 30013, Taiwan
关键词
Classification; feature selection; multiclass problem; Mahalanobis-Taguchi system (MTS); weighted Mahalanobis distance; Gram-Schmidt orthogonalization process; gestational diabetes mellitus; MAHALANOBIS DISTANCE; VECTOR MACHINES; ROBUSTNESS; WOMEN; RISK;
D O I
10.1109/TKDE.2008.128
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multiclass Mahalanobis-Taguchi system (MMTS), the extension of MTS, is developed for simultaneous multiclass classification and feature selection. In MMTS, the multiclass measurement scale is constructed by establishing an individual Mahalanobis space for each class. To increase the validity of the measurement scale, the Gram-Schmidt process is performed to mutually orthogonalize the features and eliminate the multicollinearity. The important features are identified using the orthogonal arrays and the signal-to-noise ratio, and are then used to construct a reduced model measurement scale. The contribution of each important feature to classification is also derived according to the effect gain to develop a weighted Mahalanobis distance which is finally used as the distance metric for the classification of MMTS. Using the reduced model measurement scale, an unknown example will be classified into the class with minimum weighted Mahalanobis distance considering only the important features. For evaluating the effectiveness of MMTS, a numerical experiment is implemented, and the results show that MMTS outperforms other well-known algorithms not only on classification accuracy but also on feature selection efficiency. Finally, a real case about gestational diabetes mellitus is studied, and the results indicate the practicality of MMTS in real-world applications.
引用
收藏
页码:192 / 205
页数:14
相关论文
共 50 条
  • [21] A technique for feature selection in multiclass problems
    Bruzzone, L
    Serpico, SB
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2000, 21 (03) : 549 - 563
  • [22] Simultaneous Feature Selection And Feature Weighting With K Selection For KNN Classification Using BBO Algorithm
    Kardan, Ahmad A.
    Kavian, Atena
    Esmaeili, Amir
    2013 5TH CONFERENCE ON INFORMATION AND KNOWLEDGE TECHNOLOGY (IKT), 2013, : 349 - 354
  • [23] Filter Selection Methods for Multiclass Classification
    Cascaro, Rhodessa J.
    Gerardo, Bobby D.
    Medina, Ruji P.
    2019 2ND INTERNATIONAL CONFERENCE ON COMPUTING AND BIG DATA (ICCBD 2019), 2019, : 27 - 31
  • [24] Simultaneous feature selection and classification via Minimax Probability Machine
    Yang, Liming
    Wang, Laisheng
    Sun, Yuhua
    Zhang, Ruiyan
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2010, 3 (06) : 754 - 760
  • [25] Simultaneous Feature Selection and Classification for High-Dimensional Data
    Pai, Vriddhi
    Gupta, Subhash Chand
    PROCEEDINGS OF THE SECOND INTERNATIONAL CONFERENCE ON GREEN COMPUTING AND INTERNET OF THINGS (ICGCIOT 2018), 2018, : 153 - 158
  • [26] Simultaneous feature selection and classification for relevance feedback in image retrieval
    Prasanna, R
    Ramakrishnan, KR
    Bhattacharyya, C
    IEEE TENCON 2003: CONFERENCE ON CONVERGENT TECHNOLOGIES FOR THE ASIA-PACIFIC REGION, VOLS 1-4, 2003, : 576 - 580
  • [27] Simultaneous feature selection and classification via Minimax Probability Machine
    Yang L.
    Wang L.
    Sun Y.
    Zhang R.
    International Journal of Computational Intelligence Systems, 2010, 3 (6) : 754 - 760
  • [28] Feature selection for multiclass support vector machines
    Aazi, F. Z.
    Abdesselam, R.
    Achchab, B.
    Elouardighi, A.
    AI COMMUNICATIONS, 2016, 29 (05) : 583 - 593
  • [29] SUBOPTIMUM LINEAR FEATURE SELECTION IN MULTICLASS PROBLEM
    ICHINO, M
    HIRAMATSU, K
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1974, SMC4 (01): : 28 - 33
  • [30] Synthesized Feature Space for Multiclass Emotion Classification
    Thomas, Bincy
    Dhanya, K. A.
    Vinod, P.
    2014 FIRST INTERNATIONAL CONFERENCE ON NETWORKS & SOFT COMPUTING (ICNSC), 2014, : 188 - 192