Conditioning continuous-time Markov processes by guiding

被引:0
|
作者
Corstanje, Marc [1 ,4 ]
van der Meulen, Frank [1 ]
Schauer, Moritz [2 ,3 ]
机构
[1] Vrije Univ, Dept Math, Amsterdam, Netherlands
[2] Univ Goteburg, Dept Math Sci, Gothenburg, Sweden
[3] Chalmers Tech Univ, Gothenburg, Sweden
[4] Vrije Univ Amsterdam, Fac Sci, Dept Math, Boelelaan 1111, NL-1081 HV Amsterdam, Netherlands
关键词
Markov processes; jump processes; Doob's h-transform; conditional process; landmark dynamics; diffusions; guided process; SIMULATION; DIFFUSION;
D O I
10.1080/17442508.2022.2150081
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
A continuous-time Markov process X can be conditioned to be in a given state at a fixed time T > 0 using Doob's h-transform. This transform requires the typically intractable transition density of X. The effect of the h-transform can be described as introducing a guiding force on the process. Replacing this force with an approximation defines the wider class of guided processes. For certain approximations the law of a guided process approximates - and is equivalent to - the actual conditional distribution, with tractable likelihood-ratio. The main contribution of this paper is to prove that the principle of a guided process, introduced in [M. Schauer, F. van der Meulen, and H. van Zanten, Guided proposals for simulating multi-dimensional diffusion bridges, Bernoulli 23 (2017a), pp. 2917-2950. doi:] for stochastic differential equations, can be extended to a more general class of Markov processes. In particular we apply the guiding technique to jump processes in discrete state spaces. The Markov process perspective enables us to improve upon existing results for hypo-elliptic diffusions.
引用
收藏
页码:963 / 996
页数:34
相关论文
共 50 条
  • [31] Bias optimality for multichain continuous-time Markov decision processes
    Guo, Xianping
    Song, XinYuan
    Zhang, Junyu
    OPERATIONS RESEARCH LETTERS, 2009, 37 (05) : 317 - 321
  • [32] Bisimulations and Logical Characterizations on Continuous-Time Markov Decision Processes
    Song, Lei
    Zhang, Lijun
    Godskesen, Jens Chr.
    VERIFICATION, MODEL CHECKING, AND ABSTRACT INTERPRETATION: (VMCAI 2014), 2014, 8318 : 98 - 117
  • [33] Bisimulation and logical preservation for continuous-time Markov decision processes
    Neuhaeusser, Martin R.
    Katoen, Joost-Pieter
    CONCUR 2007 - CONCURRENCY THEORY, PROCEEDINGS, 2007, 4703 : 412 - +
  • [34] DENSITY DEPENDENT CONTINUOUS-TIME MARKOV BRANCHING-PROCESSES
    VIAUD, DPL
    ANNALES DE L INSTITUT HENRI POINCARE-PROBABILITES ET STATISTIQUES, 1985, 21 (03): : 289 - 303
  • [35] A survey of recent results on continuous-time Markov decision processes
    Guo, Xianping
    Hernandez-Lerma, Onesimo
    Prieto-Rumeau, Tomas
    TOP, 2006, 14 (02) : 177 - 243
  • [36] Constrained total undiscounted continuous-time Markov decision processes
    Guo, Xianping
    Zhang, Yi
    BERNOULLI, 2017, 23 (03) : 1694 - 1736
  • [37] Piecewise Deterministic Markov Processes for Continuous-Time Monte Carlo
    Fearnhead, Paul
    Bierkens, Joris
    Pollock, Murray
    Roberts, Gareth O.
    STATISTICAL SCIENCE, 2018, 33 (03) : 386 - 412
  • [38] Continuous-time Markov processes, orthogonal polynomials and Lancaster probabilities
    Mena, Ramses H.
    Palma, Freddy
    ESAIM-PROBABILITY AND STATISTICS, 2020, 24 : 100 - 112
  • [40] SEQUENTIAL ESTIMATION FOR CONTINUOUS-TIME FINITE MARKOV-PROCESSES
    ADKE, SR
    MANJUNATH, SM
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 1984, 13 (09) : 1089 - 1106