On the Feature Selection Criterion Based on an Approximation of Multidimensional Mutual Information

被引：45
|
作者：
Balagani, Kiran S. [1 ]
Phoha, Vir V. [1 ]
机构：
[1] Louisiana Tech Univ, Ctr Secure Cyberspace, Ruston, LA 71272 USA
来源：
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE | 2010年 / 32卷 / 07期
关键词：
Feature selection; entropy; mutual information; Bayes classification error; entropy estimation; CLASSIFICATION;
D O I：
10.1109/TPAMI.2010.62
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
We derive the feature selection criterion presented in [1] and [2] from the multidimensional mutual information between features and the class. Our derivation: 1) specifies and validates the lower-order dependency assumptions of the criterion and 2) mathematically justifies the utility of the criterion by relating it to Bayes classification error.
引用
收藏
页码：1342 / 1343
页数：2
相关论文
共 50 条
  • [21] Mutual Information Based Feature Selection for Fingerprint Identification
    Adjimi, Ahlem
    Hacine-Gharbi, Abdenour
    Ravier, Philippe
    Mostefai, Messaoud
    INFORMATICA-AN INTERNATIONAL JOURNAL OF COMPUTING AND INFORMATICS, 2019, 43 (02): : 187 - 198
  • [22] Feature selection based on weighted conditional mutual information
    Zhou, Hongfang
    Wang, Xiqian
    Zhang, Yao
    APPLIED COMPUTING AND INFORMATICS, 2024, 20 (1/2) : 55 - 68
  • [23] Feature Selection Based on Mutual Information for Language Recognition
    Deng, Yan
    Liu, Jia
    PROCEEDINGS OF THE 2009 2ND INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, VOLS 1-9, 2009, : 4319 - 4322
  • [24] Feature Selection by Computing Mutual Information Based on Partitions
    Yin, Chengxiang
    Zhang, Hongjun
    Zhang, Rui
    Zeng, Zilin
    Qi, Xiuli
    Feng, Yuntian
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2018, E101D (02): : 437 - 446
  • [25] Improved Feature Selection Based On Normalized Mutual Information
    Li Yin
    Ma Xingfei
    Yang Mengxi
    Zhao Wei
    Gu Wenqiang
    14TH INTERNATIONAL SYMPOSIUM ON DISTRIBUTED COMPUTING AND APPLICATIONS FOR BUSINESS, ENGINEERING AND SCIENCE (DCABES 2015), 2015, : 518 - 522
  • [26] Feature selection based on mutual information with correlation coefficient
    Zhou, Hongfang
    Wang, Xiqian
    Zhu, Rourou
    APPLIED INTELLIGENCE, 2022, 52 (05) : 5457 - 5474
  • [27] Simultaneous feature selection and discretization based on mutual information
    Sharmin, Sadia
    Shoyaib, Mohammad
    Ali, Amin Ahsan
    Khan, Muhammad Asif Hossain
    Chae, Oksam
    PATTERN RECOGNITION, 2019, 91 : 162 - 174
  • [28] Optimal feature selection using distance-based discrete firefly algorithm with mutual information criterion
    Long Zhang
    Linlin Shan
    Jianhua Wang
    Neural Computing and Applications, 2017, 28 : 2795 - 2808
  • [29] Optimal feature selection using distance-based discrete firefly algorithm with mutual information criterion
    Zhang, Long
    Shan, Linlin
    Wang, Jianhua
    NEURAL COMPUTING & APPLICATIONS, 2017, 28 (09): : 2795 - 2808
  • [30] A SURVEY FOR STUDY OF FEATURE SELECTION BASED ON MUTUAL INFORMATION
    Su, Xiangchenyang
    Liu, Fang
    2018 9TH WORKSHOP ON HYPERSPECTRAL IMAGE AND SIGNAL PROCESSING: EVOLUTION IN REMOTE SENSING (WHISPERS), 2018,
12345