Consistent Estimation of the Filtering and Marginal Smoothing Distributions in Nonparametric Hidden Markov Models

被引:14
|
作者
De Castro, Yohann [1 ]
Gassiat, Elisabeth [1 ]
Le Corff, Sylvain [1 ]
机构
[1] Univ Paris Saclay, Lab Math Orsay, Univ Paris Sud, CNRS, F-91405 Orsay, France
关键词
Hidden Markov models; nonparametric estimation; filtering; smoothing; spectral methods; MAXIMUM-LIKELIHOOD-ESTIMATION; INFERENCE;
D O I
10.1109/TIT.2017.2696959
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we consider the filtering and smoothing recursions in nonparametric finite state space hidden Markov models (HMMs) when the parameters of the model are unknown and replaced by estimators. We provide an explicit and time uniform control of the filtering and smoothing errors in total variation norm as a function of the parameter estimation errors. We prove that the risk for the filtering and smoothing errors may be uniformly upper bounded by the L-1-risk of the estimators. It has been proved very recently that statistical inference for finite state space nonparametric HMMs is possible. We study how the recent spectral methods developed in the parametric setting may be extended to the nonparametric framework and we give explicit upper bounds for the L-2-risk of the nonparametric spectral estimators. In the case where the observation space is compact, this provides explicit rates for the filtering and smoothing errors in total variation norm. The performance of the spectral method is assessed with simulated data for both the estimation of the (nonparametric) conditional distribution of the observations and the estimation of the marginal smoothing distributions.
引用
收藏
页码:4758 / 4777
页数:20
相关论文
共 50 条
  • [41] Online estimation of hidden Markov models
    Stiller, JC
    Radons, G
    IEEE SIGNAL PROCESSING LETTERS, 1999, 6 (08) : 213 - 215
  • [42] Recursive estimation in hidden Markov models
    LeGland, F
    Mevel, L
    PROCEEDINGS OF THE 36TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-5, 1997, : 3468 - 3473
  • [43] Exponential forgetting of smoothing distributions for pairwise Markov models
    Lember, Juri
    Sova, Joonas
    ELECTRONIC JOURNAL OF PROBABILITY, 2021, 26
  • [44] ESTIMATION OF STOCHASTIC VOLATILITY MODELS BY NONPARAMETRIC FILTERING
    Kanaya, Shin
    Kristensen, Dennis
    ECONOMETRIC THEORY, 2016, 32 (04) : 861 - 916
  • [45] NONPARAMETRIC LEARNING FOR HIDDEN MARKOV MODELS WITH PREFERENTIAL ATTACHMENT DYNAMICS
    Hensley, Asher A.
    Djuric, Petar M.
    2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 3854 - 3858
  • [46] Exact Smoothing in Hidden Conditionally Markov Switching Linear Models
    Pieczynski, Wojciech
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2011, 40 (16) : 2823 - 2829
  • [47] Nonparametric approach to learning the Bayesian procedure for Hidden Markov Models
    State, L
    Cocianu, C
    Panayiotis, V
    6TH WORLD MULTICONFERENCE ON SYSTEMICS, CYBERNETICS AND INFORMATICS, VOL III, PROCEEDINGS: IMAGE, ACOUSTIC, SPEECH AND SIGNAL PROCESSING I, 2002, : 362 - 366
  • [48] Nonasymptotic control of the MLE for misspecified nonparametric hidden Markov models
    Lehericy, Luc
    ELECTRONIC JOURNAL OF STATISTICS, 2021, 15 (02): : 4916 - 4965
  • [49] Nonparametric hidden Markov models: Principles and applications to speech recognition
    Trentin, E
    NEURAL NETS, 2003, 2859 : 3 - 21
  • [50] Scalable Adaptation of State Complexity for Nonparametric Hidden Markov Models
    Hughes, Michael C.
    Stephenson, William
    Sudderth, Erik B.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 28 (NIPS 2015), 2015, 28