Entropy-Based Estimation in Classification Problems

被引:0
|
作者
Yu. A. Dubnov
机构
[1] Institute for Systems Analysis of the “Computer Science and Control” Federal Research Center of the Russian Academy of Sciences,
[2] National Research University Higher School of Economics,undefined
[3] Moscow Institute (State University) of Physics and Technology,undefined
来源
关键词
machine learning; classification; maximum entropy method;
D O I
暂无
中图分类号
学科分类号
摘要
The problem of binary classification is considered, an algorithm for its solution is proposed, based on the method of entropy-based estimation of the decision rule parameters. A detailed description of the entropy-based estimation method and the classification algorithm is given, the advantages and disadvantages of this approach are described, the results of numerical experiments and comparisons with the traditional support vector machine for classification accuracy and degree of dependence on the training sample size are presented.
引用
收藏
页码:502 / 512
页数:10
相关论文
共 50 条
  • [1] Entropy-Based Estimation in Classification Problems
    Dubnov, Yu. A.
    AUTOMATION AND REMOTE CONTROL, 2019, 80 (03) : 502 - 512
  • [2] Estimation of an Entropy-based Functional
    Maurizi, Brian N.
    ENTROPY, 2010, 12 (03) : 338 - 374
  • [3] Distinguishing the Leading Agents in Classification Problems Using the Entropy-Based Metric
    Kagan, Evgeny
    Ben-Gal, Irad
    ENTROPY, 2024, 26 (04)
  • [4] Entropy-Based Iterative Face Classification
    Kyperountas, Marios
    Tefas, Anastasios
    Pitas, Ioannis
    BIOMETRICS AND ID MANAGEMENT, 2011, 6583 : 137 - 143
  • [5] Contextual classification by entropy-based polygonization
    Hermes, L
    Buhmann, JM
    2001 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 2, PROCEEDINGS, 2001, : 442 - 447
  • [6] Entropy-based adaptive attitude estimation
    Kiani, Maryam
    Barzegar, Aylin
    Pourtakdoust, Seid H.
    ACTA ASTRONAUTICA, 2018, 144 : 271 - 282
  • [7] Entropy-Based Covariance Determinant Estimation
    De Cabrera, Ferran
    Riba, Jaume
    Vazquez, Gregori
    2017 IEEE 18TH INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (SPAWC), 2017,
  • [8] Entropy-based estimation of transfers in a terminal
    Sun, Lishan
    Rong, Jian
    Yao, Liya
    Xu, Hao
    Liu, Hongchao
    TRANSPORTATION PLANNING AND TECHNOLOGY, 2012, 35 (03) : 303 - 315
  • [9] Entropy-based Histograms for Selectivity Estimation
    To, Hien
    Chiang, Kuorong
    Shahabi, Cyrus
    PROCEEDINGS OF THE 22ND ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT (CIKM'13), 2013, : 1939 - 1948
  • [10] Random forests with parametric entropy-based information gains for classification and regression problems
    Ignatenko, Vera
    Surkov, Anton
    Koltcov, Sergei
    PEERJ COMPUTER SCIENCE, 2024, 10