Entropy-Based Estimation in Classification Problems

被引：0
|
作者：
Yu. A. Dubnov
机构：
[1] Institute for Systems Analysis of the “Computer Science and Control” Federal Research Center of the Russian Academy of Sciences,
[2] National Research University Higher School of Economics,undefined
[3] Moscow Institute (State University) of Physics and Technology,undefined
来源：
Automation and Remote Control | 2019年 / 80卷
关键词：
machine learning; classification; maximum entropy method;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
The problem of binary classification is considered, an algorithm for its solution is proposed, based on the method of entropy-based estimation of the decision rule parameters. A detailed description of the entropy-based estimation method and the classification algorithm is given, the advantages and disadvantages of this approach are described, the results of numerical experiments and comparisons with the traditional support vector machine for classification accuracy and degree of dependence on the training sample size are presented.
引用
收藏
页码：502 / 512
页数：10
相关论文
共 50 条
  • [31] Entropy-based subspace separation for multiple frequency estimation
    Ince, Erhan A.
    Yu, Runyi
    Hocanin, Aykut
    DIGITAL SIGNAL PROCESSING, 2013, 23 (01) : 30 - 37
  • [32] Testing entropy-based search strategies for a visual classification task
    Liliya Avdiyenko
    Nils Bertschingen
    Juergen Jost
    BMC Neuroscience, 13 (Suppl 1)
  • [33] An entropy-based discretization method for classification rules with inconsistency checking
    Li, RP
    Wang, ZO
    2002 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-4, PROCEEDINGS, 2002, : 243 - 246
  • [34] An entropy-based adaptive genetic algorithm for learning classification rules
    Yang, LY
    Widyantoro, DH
    Ioerger, T
    Yen, J
    PROCEEDINGS OF THE 2001 CONGRESS ON EVOLUTIONARY COMPUTATION, VOLS 1 AND 2, 2001, : 790 - 796
  • [35] Information entropy-based classification of triterpenoids and steroids from Ganoderma
    Castellano, Gloria
    Torrens, Francisco
    PHYTOCHEMISTRY, 2015, 116 : 305 - 313
  • [36] Gene selection and classification by entropy-based recursive feature elimination
    Furlanello, C
    Serafini, M
    Merler, S
    Jurman, G
    PROCEEDINGS OF THE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS 2003, VOLS 1-4, 2003, : 3077 - 3082
  • [37] Entropy-based associative classification algorithm for mining manufacturing data
    Siradeghyan, Y.
    Zakarian, A.
    Mohanty, P.
    INTERNATIONAL JOURNAL OF COMPUTER INTEGRATED MANUFACTURING, 2008, 21 (07) : 825 - 838
  • [38] Entropy-based profile characterization and classification for automatic profile management
    Kim, Jinpyo
    Hsu, Wei-Chung
    Yew, Pen-Chung
    Nair, Sreekumar R.
    Geva, Robert Y.
    ADVANCES IN COMPUTER SYSTEMS ARCHITECTURE, PROCEEDINGS, 2007, 4697 : 40 - +
  • [39] Renyi entropy-based classification of daily electrical load patterns
    Chicco, G.
    Akilimali, J. Sumaili
    IET GENERATION TRANSMISSION & DISTRIBUTION, 2010, 4 (06) : 736 - 745
  • [40] A geometric and fractional entropy-based method for family photo classification
    Kaljahi M.A.
    Shivakumara P.
    Hu T.
    Jalab H.A.
    Ibrahim R.W.
    Blumenstein M.
    Lu T.
    Ayub M.N.B.
    Expert Systems with Applications: X, 2019, 3
12345