On the Feature Selection Criterion Based on an Approximation of Multidimensional Mutual Information

被引：45
|
作者：
Balagani, Kiran S. [1 ]
Phoha, Vir V. [1 ]
机构：
[1] Louisiana Tech Univ, Ctr Secure Cyberspace, Ruston, LA 71272 USA
来源：
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE | 2010年 / 32卷 / 07期
关键词：
Feature selection; entropy; mutual information; Bayes classification error; entropy estimation; CLASSIFICATION;
D O I：
10.1109/TPAMI.2010.62
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
We derive the feature selection criterion presented in [1] and [2] from the multidimensional mutual information between features and the class. Our derivation: 1) specifies and validates the lower-order dependency assumptions of the criterion and 2) mathematically justifies the utility of the criterion by relating it to Bayes classification error.
引用
收藏
页码：1342 / 1343
页数：2
相关论文
共 50 条
  • [1] Active Feature Selection for the Mutual Information Criterion
    Schnapp, Shachar
    Sabato, Sivan
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 9497 - 9504
  • [2] Hybrid Feature Selection: Combining Fisher Criterion and Mutual Information for Efficient Feature Selection
    Dhir, Chandra Shekhar
    Lee, Soo Young
    ADVANCES IN NEURO-INFORMATION PROCESSING, PT I, 2009, 5506 : 613 - 620
  • [3] Mutual information criterion for feature selection from incomplete data
    Qian, Wenbin
    Shu, Wenhao
    NEUROCOMPUTING, 2015, 168 : 210 - 220
  • [4] Mutual information criterion for feature selection with application to classification of breast microcalcifications
    Diamant, Idit
    Shalhon, Moran
    Goldberger, Jacob
    Greenspan, Hayit
    MEDICAL IMAGING 2016: IMAGE PROCESSING, 2016, 9784
  • [5] Conditional Mutual Information based Feature Selection
    Cheng, Hongrong
    Qin, Zhiguang
    Qian, Weizhong
    Liu, Wei
    KAM: 2008 INTERNATIONAL SYMPOSIUM ON KNOWLEDGE ACQUISITION AND MODELING, PROCEEDINGS, 2008, : 103 - 107
  • [6] A wrapper for feature selection based on mutual information
    Huang, Jinjie
    Cai, Yunze
    Xu, Xiaoming
    18TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 2, PROCEEDINGS, 2006, : 618 - +
  • [7] Feature Selection and Discretization based on Mutual Information
    Sharmin, Sadia
    Ali, Amin Ahsan
    Khan, Muhammad Asif Hossain
    Shoyaib, Mohammad
    2017 IEEE INTERNATIONAL CONFERENCE ON IMAGING, VISION & PATTERN RECOGNITION (ICIVPR), 2017,
  • [8] A Fast Information-Theoretic Approximation of Joint Mutual Information Feature Selection
    Liu, Heng
    Ditzler, Gregory
    2017 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2017, : 4610 - 4617
  • [9] PCA based on mutual information for feature selection
    Fan, X.-L. (fanxueli@mail.ioa.ac.cn), 1600, Northeast University (28):
  • [10] HOFS: Higher order mutual information approximation for feature selection in R
    Gajowniczek, Krzysztof
    Wu, Jialin
    Gupta, Soumyajit
    Bajaj, Chandrajit
    SOFTWAREX, 2022, 19
12345