MAXIMUM-LIKELIHOOD-ESTIMATION FOR HIDDEN MARKOV-MODELS

被引:249
|
作者
LEROUX, BG
机构
关键词
MARKOV CHAIN; CONSISTENCY; SUBADDITIVE ERGODIC THEOREM; IDENTIFIABILITY; ENTROPY; KULLBACK-LEIBLER DIVERGENCE; SHANNON-MCMILLAN-BREIMAN THEOREM;
D O I
10.1016/0304-4149(92)90141-C
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Hidden Markov models assume a sequence of random variables to be conditionally independent given a sequence of state variables which forms a Markov chain. Maximum-likelihood estimation for these models can be performed using the EM algorithm. In this paper the consistency of a sequence of maximum-likelihood estimators is proved. Also, the conclusion of the Shannon-McMillan-Breiman theorem on entropy convergence is established for hidden Markov models.
引用
收藏
页码:127 / 143
页数:17
相关论文
共 50 条
  • [32] Maximum likelihood estimation in discrete mixed hidden Markov models using the SAEM algorithm
    Delattre, M.
    Lavielle, M.
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2012, 56 (06) : 2073 - 2085
  • [33] Maximum likelihood estimation of bivariate circular hidden Markov models from incomplete data
    Lagona, Francesco
    Picone, Marco
    JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2013, 83 (07) : 1223 - 1237
  • [34] An error correction approach based on maximum likelihood estimation combined with hidden Markov models
    Yonezaki, T
    Yoshida, K
    Yagi, T
    Shikano, K
    ELECTRONICS AND COMMUNICATIONS IN JAPAN PART III-FUNDAMENTAL ELECTRONIC SCIENCE, 2002, 85 (05): : 63 - 71
  • [35] An algorithm for maximum likelihood estimation of hidden Markov models with unknown state-tying
    Cappe, O
    Mokbel, CE
    Jouvet, D
    Moulines, E
    IEEE TRANSACTIONS ON SPEECH AND AUDIO PROCESSING, 1998, 6 (01): : 61 - 70
  • [36] MAXIMUM-LIKELIHOOD-ESTIMATION FOR INCOMPLETE DATA
    CARDOSO, JF
    LAVIELLE, M
    MOULINES, E
    COMPTES RENDUS DE L ACADEMIE DES SCIENCES SERIE I-MATHEMATIQUE, 1995, 320 (03): : 363 - 368
  • [37] MAXIMUM-LIKELIHOOD-ESTIMATION OF REGIONAL ACTIVITY
    MUELLER, SP
    KIJEWSKI, MF
    MOORE, SC
    HOLMAN, BL
    JOURNAL OF NUCLEAR MEDICINE, 1986, 27 (06) : 895 - 896
  • [38] ESTIMATING THE ORDER OF HIDDEN MARKOV-MODELS
    RYDEN, T
    STATISTICS, 1995, 26 (04) : 345 - 354
  • [39] MAXIMUM-LIKELIHOOD-ESTIMATION OF THE ENTROPY OF AN ATTRACTOR
    SCHOUTEN, JC
    TAKENS, F
    VANDENBLEEK, CM
    PHYSICAL REVIEW E, 1994, 49 (01): : 126 - 129
  • [40] BIAS ERROR IN MAXIMUM-LIKELIHOOD-ESTIMATION
    KOCH, SP
    JOURNAL OF HYDROLOGY, 1991, 122 (1-4) : 289 - 300