Efficient particle-based online smoothing in general hidden Markov models: The PaRIS algorithm

被引:32
|
作者
Olsson, Jimmy [1 ]
Westerborn, Johan [1 ]
机构
[1] KTH Royal Inst Technol, Dept Math, SE-10044 Stockholm, Sweden
基金
瑞典研究理事会;
关键词
central limit theorem; general hidden Markov models; Hoeffding-type inequality; online estimation; particle filter; particle path degeneracy; sequential Monte Carlo; smoothing; MONTE-CARLO METHODS; STABILITY; SIMULATION;
D O I
10.3150/16-BEJ801
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
This paper presents a novel algorithm, the particle-based, rapid incremental smoother (PaRIS), for efficient online approximation of smoothed expectations of additive state functionals in general hidden Markov models. The algorithm, which has a linear computational complexity under weak assumptions and very limited memory requirements, is furnished with a number of convergence results, including a central limit theorem. An interesting feature of PaRIS, which samples on-the-fly from the retrospective dynamics induced by the particle filter, is that it requires two or more backward draws per particle in order to cope with degeneracy of the sampled trajectories and to stay numerically stable in the long run with an asymptotic variance that grows only linearly with time.
引用
收藏
页码:1951 / 1996
页数:46
相关论文
共 50 条
  • [31] Particle Gibbs for Infinite Hidden Markov Models
    Tripuraneni, Nilesh
    Gu, Shixiang
    Ge, Hong
    Ghahramani, Zoubin
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 28 (NIPS 2015), 2015, 28
  • [32] AN ONLINE EM ALGORITHM IN HIDDEN (SEMI-)MARKOV MODELS FOR AUDIO SEGMENTATION AND CLUSTERING
    Bietti, Alberto
    Bach, Francis
    Cont, Arshia
    2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), 2015, : 1881 - 1885
  • [33] A Fast Online Algorithm for Large Margin Training of Continuous Density Hidden Markov Models
    Cheng, Chih-Chieh
    Sha, Fei
    Saul, Lawrence K.
    INTERSPEECH 2009: 10TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2009, VOLS 1-5, 2009, : 676 - +
  • [34] Efficient sensitivity analysis in hidden Markov models
    Renooij, Silja
    INTERNATIONAL JOURNAL OF APPROXIMATE REASONING, 2012, 53 (09) : 1397 - 1414
  • [35] Efficient sensitivity analysis in hidden markov models
    Renooij, S. (S.Renooij@uu.nl), 1600, Elsevier Inc. (53):
  • [36] Optimizing hidden Markov models with a genetic algorithm
    Slimane, M
    Venturini, G
    Brouard, T
    deBeauville, JPA
    Brandeau, A
    ARTIFICIAL EVOLUTION, 1996, 1063 : 384 - 396
  • [37] A discriminative training algorithm for hidden Markov models
    Ben-Yishai, A
    Burshtein, D
    IEEE TRANSACTIONS ON SPEECH AND AUDIO PROCESSING, 2004, 12 (03): : 204 - 217
  • [38] A spectral algorithm for learning Hidden Markov Models
    Hsu, Daniel
    Kakade, Sham M.
    Zhang, Tong
    JOURNAL OF COMPUTER AND SYSTEM SCIENCES, 2012, 78 (05) : 1460 - 1480
  • [39] A model reduction algorithm for hidden Markov models
    Kotsalis, Georgios
    Megretski, Alexandre
    Dahleh, Munther A.
    PROCEEDINGS OF THE 45TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-14, 2006, : 3425 - +
  • [40] Fuzzy Hidden Markov Models for Speech Recognition on based FEM Algorithm
    Taheri, Asghar
    Tarihi, Mohammad Reza
    Baghgar, Hassan
    Abad, Bostan
    Bababeyk, Hassan
    PROCEEDINGS OF WORLD ACADEMY OF SCIENCE, ENGINEERING AND TECHNOLOGY, VOL 4, 2005, 4 : 59 - 61