Entropy-Based Estimation in Classification Problems

被引:0
|
作者
Yu. A. Dubnov
机构
[1] Institute for Systems Analysis of the “Computer Science and Control” Federal Research Center of the Russian Academy of Sciences,
[2] National Research University Higher School of Economics,undefined
[3] Moscow Institute (State University) of Physics and Technology,undefined
来源
关键词
machine learning; classification; maximum entropy method;
D O I
暂无
中图分类号
学科分类号
摘要
The problem of binary classification is considered, an algorithm for its solution is proposed, based on the method of entropy-based estimation of the decision rule parameters. A detailed description of the entropy-based estimation method and the classification algorithm is given, the advantages and disadvantages of this approach are described, the results of numerical experiments and comparisons with the traditional support vector machine for classification accuracy and degree of dependence on the training sample size are presented.
引用
收藏
页码:502 / 512
页数:10
相关论文
共 50 条
  • [21] Entropy-based classification approach for personalized privacy anonymity
    Wang, Bo
    Yang, Jing
    Zhang, Jian-Pei
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2013, 43 (01): : 179 - 185
  • [22] Rank Entropy-Based Decision Trees for Monotonic Classification
    Hu, Qinghua
    Che, Xunjian
    Zhang, Lei
    Zhang, David
    Guo, Maozu
    Yu, Daren
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2012, 24 (11) : 2052 - 2064
  • [23] Texture Entropy-Based Classification for Iris Recognition Systems
    Papic, Veljko
    Krmar, Jelena
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2020, 29 (04)
  • [24] Entropy-based fuzzy rough classification approach for extracting classification rules
    Tsai, Ying-Chieh
    Cheng, Ching-Hsue
    Chang, Jing-Rong
    EXPERT SYSTEMS WITH APPLICATIONS, 2006, 31 (02) : 436 - 443
  • [25] An Entropy-Based Framework for Dynamic Clustering and Coverage Problems
    Sharma, Puneet
    2009 47TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING, VOLS 1 AND 2, 2009, : 976 - 983
  • [26] ON ENTROPY-BASED METHODS FOR NONLINEAR-PROGRAMMING PROBLEMS
    CHEN, GJ
    TEMPLEMAN, AB
    ENGINEERING OPTIMIZATION, 1995, 23 (03) : 225 - 238
  • [27] A comprehensive evaluation of entropy-based directionality estimation method
    Donghyeok Kim
    Eun Lee
    Jiyoung Kang
    Journal of the Korean Physical Society, 2023, 83 (6) : 499 - 510
  • [28] A comprehensive evaluation of entropy-based directionality estimation method
    Kim, Donghyeok
    Lee, Eun
    Kang, Jiyoung
    JOURNAL OF THE KOREAN PHYSICAL SOCIETY, 2023, 83 (06) : 499 - 510
  • [29] Entropy-Based Framework for Dynamic Coverage and Clustering Problems
    Sharma, Puneet
    Salapaka, Srinivasa M.
    Beck, Carolyn L.
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2012, 57 (01) : 135 - 150
  • [30] Entropy-based estimation of the birth-death ratio
    Lazov, Igor
    Lazov, Petar
    MATHEMATICAL POPULATION STUDIES, 2022, 29 (02) : 73 - 94