On the forward algorithm for stopping problems on continuous-time Markov chains

被引：2
|
作者：
Miclo, Laurent [1 ,2 ,3 ]
Villeneuve, Stephane [2 ,3 ]
机构：
[1] CNRS, Paris, France
[2] Univ Toulouse, Toulouse, France
[3] Toulouse Sch Econ, 1 Esplanade Univ, F-31080 Toulouse 06, France
来源：
JOURNAL OF APPLIED PROBABILITY | 2021年 / 58卷 / 04期
关键词：
Forward algorithm; constrained optimal stopping; Markov chains; CONSTRUCTION; AMERICAN;
D O I：
10.1017/jpr.2021.11
中图分类号：
O21 [概率论与数理统计]; C8 [统计学];
学科分类号：
020208 ; 070103 ; 0714 ;
摘要：
We revisit the forward algorithm, developed by Irle, to characterize both the value function and the stopping set for a large class of optimal stopping problems on continuous-time Markov chains. Our objective is to renew interest in this constructive method by showing its usefulness in solving some constrained optimal stopping problems that have emerged recently.
引用
收藏
页码：1043 / 1063
页数：21
相关论文
共 50 条
  • [1] Risk-sensitive stopping problems for continuous-time Markov chains
    Baeuerle, Nicole
    Popp, Anton
    STOCHASTICS-AN INTERNATIONAL JOURNAL OF PROBABILITY AND STOCHASTIC PROCESSES, 2018, 90 (03) : 411 - 431
  • [2] An EM algorithm for continuous-time bivariate Markov chains
    Mark, Brian L.
    Ephraim, Yariv
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2013, 57 (01) : 504 - 517
  • [3] An MM Algorithm to Estimate Parameters in Continuous-Time Markov Chains
    Bacci, Giovanni
    Ingolfsdottir, Anna
    Larsen, Kim G.
    Reynouard, Raphael
    QUANTITATIVE EVALUATION OF SYSTEMS, QEST 2023, 2023, 14287 : 82 - 100
  • [4] Perturbations of continuous-time Markov chains
    Li, Pei-Sen
    STATISTICS & PROBABILITY LETTERS, 2017, 125 : 17 - 24
  • [5] Filtering of Continuous-Time Markov Chains
    Aggoun, L.
    Benkherouf, L.
    Tadj, L.
    Mathematical and Computer Modelling (Oxford), 26 (12):
  • [6] Imprecise continuous-time Markov chains
    Krak, Thomas
    De Bock, Jasper
    Siebes, Arno
    INTERNATIONAL JOURNAL OF APPROXIMATE REASONING, 2017, 88 : 452 - 528
  • [7] Filtering of continuous-time Markov chains
    Aggoun, L
    Benkherouf, L
    Tadj, L
    MATHEMATICAL AND COMPUTER MODELLING, 1997, 26 (12) : 73 - 83
  • [8] Continuous-time controlled Markov chains
    Guo, XP
    Hernández-Lerma, O
    ANNALS OF APPLIED PROBABILITY, 2003, 13 (01): : 363 - 388
  • [9] Integrals for continuous-time Markov chains
    Pollett, PK
    MATHEMATICAL BIOSCIENCES, 2003, 182 (02) : 213 - 225
  • [10] Optimization problems in chemical reactions using continuous-time Markov chains
    Lizeth Carrillo
    Jesica A. Escobar
    Julio B. Clempner
    Alexander S. Poznyak
    Journal of Mathematical Chemistry, 2016, 54 : 1233 - 1254
12345