Efficient particle-based online smoothing in general hidden Markov models: The PaRIS algorithm

被引:32
|
作者
Olsson, Jimmy [1 ]
Westerborn, Johan [1 ]
机构
[1] KTH Royal Inst Technol, Dept Math, SE-10044 Stockholm, Sweden
基金
瑞典研究理事会;
关键词
central limit theorem; general hidden Markov models; Hoeffding-type inequality; online estimation; particle filter; particle path degeneracy; sequential Monte Carlo; smoothing; MONTE-CARLO METHODS; STABILITY; SIMULATION;
D O I
10.3150/16-BEJ801
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
This paper presents a novel algorithm, the particle-based, rapid incremental smoother (PaRIS), for efficient online approximation of smoothed expectations of additive state functionals in general hidden Markov models. The algorithm, which has a linear computational complexity under weak assumptions and very limited memory requirements, is furnished with a number of convergence results, including a central limit theorem. An interesting feature of PaRIS, which samples on-the-fly from the retrospective dynamics induced by the particle filter, is that it requires two or more backward draws per particle in order to cope with degeneracy of the sampled trajectories and to stay numerically stable in the long run with an asymptotic variance that grows only linearly with time.
引用
收藏
页码:1951 / 1996
页数:46
相关论文
共 50 条
  • [21] Particle smoothing via Markov chain Monte Carlo in general state space models
    Gao, Meng
    Zhang, Hui
    INTERNATIONAL JOURNAL OF COMPUTING SCIENCE AND MATHEMATICS, 2018, 9 (02) : 181 - 188
  • [22] A simulation based algorithm for optimal quantization of hidden Markov models
    Tadic, VB
    Doucet, A
    2003 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY - PROCEEDINGS, 2003, : 482 - 482
  • [23] A Novel Character Recognition Algorithm Based on Hidden Markov Models
    Wang, Yu
    Wei, Xueye
    Han, Lei
    Wu, Xiaojin
    ARTIFICIAL INTELLIGENCE AND COMPUTATIONAL INTELLIGENCE, PROCEEDINGS, 2009, 5855 : 298 - 305
  • [24] EFFICIENT PARAMETER INFERENCE IN GENERAL HIDDEN MARKOV MODELS USING THE FILTER DERIVATIVES
    Olsson, Jimmy
    Westerborn, Johan
    2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 3984 - 3988
  • [25] Online learning in discrete hidden Markov models
    Alamino, Roberto
    Caticha, Nestor
    BAYESIAN INFERENCE AND MAXIMUM ENTROPY METHODS IN SCIENCE AND ENGINEERING, 2006, 872 : 187 - +
  • [26] Adapting Hidden Markov Models for Online Learning
    Chis, Tiberiu
    Harrison, Peter G.
    ELECTRONIC NOTES IN THEORETICAL COMPUTER SCIENCE, 2015, 318 : 109 - 127
  • [27] Filtering and Smoothing State Estimation for Flag Hidden Markov Models
    Doty, Kyle
    Roy, Sandip
    Fischer, Thomas R.
    2016 AMERICAN CONTROL CONFERENCE (ACC), 2016, : 7042 - 7047
  • [28] Exact Smoothing in Hidden Conditionally Markov Switching Linear Models
    Pieczynski, Wojciech
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2011, 40 (16) : 2823 - 2829
  • [29] Online Expectation Maximization based algorithms for inference in Hidden Markov Models
    Le Corff, Sylvain
    Fort, Gersende
    ELECTRONIC JOURNAL OF STATISTICS, 2013, 7 : 763 - 792
  • [30] Reversed particle filtering for hidden markov models
    Rotiroti, Frank
    Walker, Stephen G.
    STATISTICS AND COMPUTING, 2024, 34 (03)