A Comparison of MCC and CEN Error Measures in Multi-Class Prediction

被引:216
|
作者
Jurman, Giuseppe [1 ]
Riccadonna, Samantha [1 ]
Furlanello, Cesare [1 ]
机构
[1] Fdn Bruno Kessler, Trento, Italy
来源
PLOS ONE | 2012年 / 7卷 / 08期
关键词
ROC CURVE; STATISTICAL COMPARISONS; AREA; PERFORMANCE; CLASSIFIERS; CLASSIFICATION; ACCURACY; AUC;
D O I
10.1371/journal.pone.0041882
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
We show that the Confusion Entropy, a measure of performance in multiclass problems has a strong (monotone) relation with the multiclass generalization of a classical metric, the Matthews Correlation Coefficient. Analytical results are provided for the limit cases of general no-information (n-face dice rolling) of the binary classification. Computational evidence supports the claim in the general case.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] A Total Error Rate Multi-class Classification
    Wang, Xizhao
    Zhang, Meng
    Lu, Shuxia
    Zhou, Xu
    PROCEEDINGS 2012 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2012, : 964 - 969
  • [2] Learning to Bound the Multi-Class Bayes Error
    Sekeh, Salimeh Yasaei
    Oselio, Brandon
    Hero, Alfred O.
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2020, 68 : 3793 - 3807
  • [3] Generalization error for multi-class margin classification
    Shen, Xiaotong
    Wang, Lifeng
    ELECTRONIC JOURNAL OF STATISTICS, 2007, 1 : 307 - 330
  • [4] Aggregated Performance Measures for Multi-class Classification
    Peszor, Damian
    Wojciechowski, Konrad
    INTELLIGENT INFORMATION AND DATABASE SYSTEMS, ACIIDS 2022, PT II, 2022, 13758 : 103 - 115
  • [5] Evaluation Measures for Multi-class Subgroup Discovery
    Abudawood, Tarek
    Flach, Peter
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, PT I, 2009, 5781 : 35 - 50
  • [6] Quantitative Comparison of Monte-Carlo Dropout Uncertainty Measures for Multi-class Segmentation
    Camarasa, Robin
    Bos, Daniel
    Hendrikse, Jeroen
    Nederkoorn, Paul
    Kooi, Eline
    van der Lugt, Aad
    de Bruijne, Marleen
    UNCERTAINTY FOR SAFE UTILIZATION OF MACHINE LEARNING IN MEDICAL IMAGING, AND GRAPHS IN BIOMEDICAL IMAGE ANALYSIS, UNSURE 2020, GRAIL 2020, 2020, 12443 : 32 - 41
  • [7] Multiple classifier error probability for multi-class problems
    Huk, Maciej
    Szczepanik, Michal
    Eksploatacja i Niezawodnosc, 2011, 51 (03) : 12 - 16
  • [8] Process targeting with multi-class screening and measurement error
    Duffuaa, SO
    Siddiqui, AW
    INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 2003, 41 (07) : 1373 - 1391
  • [9] MULTIPLE CLASSIFIER ERROR PROBABILITY FOR MULTI-CLASS PROBLEMS
    Huk, Maciej
    Szczepanik, Michal
    EKSPLOATACJA I NIEZAWODNOSC-MAINTENANCE AND RELIABILITY, 2011, (03): : 12 - 16
  • [10] Minimizer of the Reconstruction Error for multi-class document categorization
    Gomez, Juan Carlos
    Moens, Marie-Francine
    EXPERT SYSTEMS WITH APPLICATIONS, 2014, 41 (03) : 861 - 868