On the Feature Selection Criterion Based on an Approximation of Multidimensional Mutual Information

被引：45

作者：

Balagani, Kiran S. ^{[1
]}

Phoha, Vir V. ^{[1
]}

机构：

[1] Louisiana Tech Univ, Ctr Secure Cyberspace, Ruston, LA 71272 USA

来源：

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE | 2010年 / 32卷 / 07期

关键词：

Feature selection; entropy; mutual information; Bayes classification error; entropy estimation; CLASSIFICATION;

D O I：

10.1109/TPAMI.2010.62

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

We derive the feature selection criterion presented in [1] and [2] from the multidimensional mutual information between features and the class. Our derivation: 1) specifies and validates the lower-order dependency assumptions of the criterion and 2) mathematically justifies the utility of the criterion by relating it to Bayes classification error.

引用

页码：1342 / 1343

页数：2

共 50 条

[41] FEATURE SELECTION ALGORITHM BASED ON CONDITIONAL DYNAMIC MUTUAL INFORMATION
Wang Liping
INTERNATIONAL JOURNAL ON SMART SENSING AND INTELLIGENT SYSTEMS, 2015, 8 (01): : 316 - 337
[42] A feature selection algorithm based on Hoeffding inequality and mutual information
Yin, Chunyong
Feng, Lu
Ma, Luyu
Yin, Zhichao
Wang, Jin
International Journal of Signal Processing, Image Processing and Pattern Recognition, 2015, 8 (11) : 433 - 444
[43] A novel feature selection method based on normalized mutual information
La The Vinh
Sungyoung Lee
Young-Tack Park
Brian J. d’Auriol
Applied Intelligence, 2012, 37 : 100 - 120
[44] Fuzzy Mutual Information Feature Selection Based on Representative Samples
Salem, Omar A. M.
Wang, Liwei
INTERNATIONAL JOURNAL OF SOFTWARE INNOVATION, 2018, 6 (01) : 58 - 72
[45] Conditional mutual information based feature selection for classification task
Novovicova, Jana
Somol, Petr
Haindl, Michal
Pudil, Pavel
PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS AND APPLICATIONS, PROCEEDINGS, 2007, 4756 : 417 - 426
[46] Time Series Feature Selection Method Based on Mutual Information
Huang, Lin
Zhou, Xingqiang
Shi, Lianhui
Gong, Li
APPLIED SCIENCES-BASEL, 2024, 14 (05):
[47] Theoretical evaluation of feature selection methods based on mutual information
Pascoal, Claudia
Oliveira, M. Rosario
Pacheco, Antonio
Valadas, Rui
NEUROCOMPUTING, 2017, 226 : 168 - 181
[48] Mutual Information Based Feature Selection for Stereo Visual Odometry
Kottath, Rahul
Poddar, Shashi
Sardana, Raghav
Bhondekar, Amol P.
Karar, Vinod
JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2020, 100 (3-4) : 1559 - 1568
[49] Privacy-preserving Feature Selection based on Mutual Information
Wu, Ningning
Li, Hongwei
Chen, Hanxiao
Zhang, Xilin
Wang, Yingzhe
IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 1789 - 1794
[50] Mutual Information Based Feature Selection for Medical Image Retrieval
Zhi, Lijia
Zhang, Shaomin
Li, Yan
NINTH INTERNATIONAL CONFERENCE ON GRAPHIC AND IMAGE PROCESSING (ICGIP 2017), 2018, 10615

← 1 2 3 4 5 →