General smoothing formulas for Markov-modulated Poisson observations

被引:15
|
作者
Elliott, RJ [1 ]
Malcolm, WP
机构
[1] Univ Calgary, Haskayne Sch Business, Calgary, AB T2N 1N4, Canada
[2] Natl ICT Australia, Canberra, ACT 2601, Australia
基金
澳大利亚研究理事会;
关键词
filtering; martingales; Poisson processes; reference probability; smoothing;
D O I
10.1109/TAC.2005.852565
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we compute general smoothing dynamics for partially observed dynamical systems generating Poisson observations. We consider two model classes, each Markov modulated Poisson processes, whose stochastic intensities depend upon the state of an unobserved Markov process. In one model class, the hidden state process is a continuously-valued Ito process, which gives rise to a continuous sample-path stochastic intensity. In the other model class, the hidden state process is a continuous-time Markov chain, giving rise to a pure jump stochastic intensity. To compute filtered estimates of state process, we establish dynamics, whose solutions are unnormalized marginal probabilities; however, these dynamics include Lebesgue-Stieltjes stochastic integrals. By adapting the transformation techniques introduced by J. M. C. Clark, we compute filter dynamics which do not include these stochastic integrals. To construct smoothers, we exploit a duality between our forward and backward transformed dynamics and thereby completely avoid the technical complexities of backward evolving stochastic integral equations. The general smoother dynamics we present can readily be applied to specific smoothing algorithms, referred to in the literature as: Fixed point smoothing, fixed lag smoothing and fixed interval smoothing. It is shown that there is a clear motivation to compute smoothers via transformation techniques similar to those presented by J. M. C. Clark, that is, our smoothers are easily obtained without recourse to two sided stochastic integration. A computer simulation is included.
引用
收藏
页码:1123 / 1134
页数:12
相关论文
共 50 条
  • [21] TRANSIENT ANALYSIS OF MULTISERVER QUEUES WITH MARKOV-MODULATED POISSON ARRIVALS AND OVERLOAD CONTROL
    LEE, DS
    LI, SQ
    PERFORMANCE EVALUATION, 1992, 16 (1-3) : 49 - 66
  • [22] M-ary detection of Markov-modulated Poisson processes in inventory models
    Aggoun, L
    Benkherouf, L
    APPLIED MATHEMATICS AND COMPUTATION, 2002, 132 (2-3) : 315 - 324
  • [23] A FITTING ALGORITHM FOR MARKOV-MODULATED POISSON PROCESSES HAVING 2 ARRIVAL RATES
    MEIERHELLSTERN, KS
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 1987, 29 (03) : 370 - 377
  • [24] Discrete-time expectation maximization algorithms for Markov-modulated Poisson processes
    Elliott, Robert J.
    Malcolm, W. R.
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2008, 53 (01) : 247 - 256
  • [25] Analysis of SIP Retransmission Probability Using a Markov-Modulated Poisson Process Model
    Hong, Yang
    Huang, Changcheng
    Yan, James
    PROCEEDINGS OF THE 2010 IEEE-IFIP NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM, 2010, : 179 - 186
  • [26] Equity with Markov-modulated dividends
    Di Graziano, Giuseppe
    Rogers, L. C. G.
    QUANTITATIVE FINANCE, 2009, 9 (01) : 19 - 26
  • [27] Markov-modulated affine processes
    Kurt, Kevin
    Frey, Rudiger
    STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 2022, 153 : 391 - 422
  • [28] Markov-Modulated Poisson Process Modeling for Machine-to-Machine Heterogeneous Traffic
    El Fawal, Ahmad Hani
    Mansour, Ali
    Nasser, Abbass
    APPLIED SCIENCES-BASEL, 2024, 14 (18):
  • [29] Markov-modulated infinite-server queues with general service times
    Blom, J.
    Kella, O.
    Mandjes, M.
    Thorsdottir, H.
    QUEUEING SYSTEMS, 2014, 76 (04) : 403 - 424
  • [30] Markov-modulated infinite-server queues with general service times
    J. Blom
    O. Kella
    M. Mandjes
    H. Thorsdottir
    Queueing Systems, 2014, 76 : 403 - 424