Conditioning continuous-time Markov processes by guiding

被引:0
|
作者
Corstanje, Marc [1 ,4 ]
van der Meulen, Frank [1 ]
Schauer, Moritz [2 ,3 ]
机构
[1] Vrije Univ, Dept Math, Amsterdam, Netherlands
[2] Univ Goteburg, Dept Math Sci, Gothenburg, Sweden
[3] Chalmers Tech Univ, Gothenburg, Sweden
[4] Vrije Univ Amsterdam, Fac Sci, Dept Math, Boelelaan 1111, NL-1081 HV Amsterdam, Netherlands
关键词
Markov processes; jump processes; Doob's h-transform; conditional process; landmark dynamics; diffusions; guided process; SIMULATION; DIFFUSION;
D O I
10.1080/17442508.2022.2150081
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
A continuous-time Markov process X can be conditioned to be in a given state at a fixed time T > 0 using Doob's h-transform. This transform requires the typically intractable transition density of X. The effect of the h-transform can be described as introducing a guiding force on the process. Replacing this force with an approximation defines the wider class of guided processes. For certain approximations the law of a guided process approximates - and is equivalent to - the actual conditional distribution, with tractable likelihood-ratio. The main contribution of this paper is to prove that the principle of a guided process, introduced in [M. Schauer, F. van der Meulen, and H. van Zanten, Guided proposals for simulating multi-dimensional diffusion bridges, Bernoulli 23 (2017a), pp. 2917-2950. doi:] for stochastic differential equations, can be extended to a more general class of Markov processes. In particular we apply the guiding technique to jump processes in discrete state spaces. The Markov process perspective enables us to improve upon existing results for hypo-elliptic diffusions.
引用
收藏
页码:963 / 996
页数:34
相关论文
共 50 条
  • [41] Constrained Continuous-Time Markov Decision Processes on the Finite Horizon
    Guo, Xianping
    Huang, Yonghui
    Zhang, Yi
    APPLIED MATHEMATICS AND OPTIMIZATION, 2017, 75 (02): : 317 - 341
  • [42] ASYMPTOTIC INFERENCE IN CONTINUOUS-TIME SEMI-MARKOV PROCESSES
    AKRITAS, MG
    ROUSSAS, GG
    SCANDINAVIAN JOURNAL OF STATISTICS, 1980, 7 (02) : 73 - 79
  • [43] Deterministic Anytime Inference for Stochastic Continuous-Time Markov Processes
    Celikkaya, E. Busra
    Shelton, Christian R.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 32 (CYCLE 2), 2014, 32 : 1962 - 1970
  • [44] Testing for embeddability by stationary reversible continuous-time Markov processes
    Florens, JP
    Renault, E
    Touzi, N
    ECONOMETRIC THEORY, 1998, 14 (06) : 744 - 769
  • [45] A survey of recent results on continuous-time Markov decision processes
    Xianping Guo
    Onésimo Hernández-Lerma
    Tomás Prieto-Rumeau
    Xi-Ren Cao
    Junyu Zhang
    Qiying Hu
    Mark E. Lewis
    Ricardo Vélez
    TOP, 2006, 14 : 177 - 261
  • [46] A characterization of meaningful schedulers for continuous-time Markov decision processes
    Wolovick, Nicolas
    Johr, Sven
    FORMAL MODELING AND ANALYSIS OF TIMED SYSTEMS, 2006, 4202 : 352 - 367
  • [47] Heat Release by Controlled Continuous-Time Markov Jump Processes
    Paolo Muratore-Ginanneschi
    Carlos Mejía-Monasterio
    Luca Peliti
    Journal of Statistical Physics, 2013, 150 : 181 - 203
  • [48] Policy learning in continuous-time Markov decision processes using Gaussian Processes
    Bartocci, Ezio
    Bortolussi, Luca
    Brazdil, Tomas
    Milios, Dimitrios
    Sanguinetti, Guido
    PERFORMANCE EVALUATION, 2017, 116 : 84 - 100
  • [49] On the Kemeny time for continuous-time reversible and irreversible Markov processes with applications to stochastic resetting and to conditioning towards forever-survival
    Mazzolo, Alain
    Monthus, Cecile
    JOURNAL OF STATISTICAL MECHANICS-THEORY AND EXPERIMENT, 2023, 2023 (06):
  • [50] Martingale approximations for continuous-time and discrete-time stationary Markov processes
    Holzmann, H
    STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 2005, 115 (09) : 1518 - 1529