MARKOV DECISION CHAINS IN DISCRETE- AND CONTINUOUS-TIME; A UNIFIED APPROACH

被引：0
|
作者：
Sladky, Karel [1 ]
机构：
[1] Acad Sci Czech Republ, Inst Informat Theory & Automat, Dept Econometr, CR-18208 Prague 8, Czech Republic
来源：
QUANTITATIVE METHODS IN ECONOMICS [MULTIPLE CRITERIA DECISION MAKING XV] | 2010年
关键词：
discrete-time and continuous-time Markov decision chains; discounted and averaging optimality; connections between discounted and averaging models; uniformization; GAIN;
D O I：
暂无
中图分类号：
F [经济];
学科分类号：
02 ;
摘要：
In this note we consider Markov decision chains with finite state space in discrete- and continuous-time setting for discounting and averaging optimality criteria. Connections between discounted and averaging optimality along with uniformization methods are employed for producing bounds on optimal discounted and average rewards.
引用
收藏
页码：207 / 219
页数：13
相关论文
共 50 条
  • [31] Perturbation analysis for continuous-time Markov chains
    YuanYuan Liu
    Science China Mathematics, 2015, 58 : 2633 - 2642
  • [32] Lumpability for Uncertain Continuous-Time Markov Chains
    Cardelli, Luca
    Grosu, Radu
    Larsen, Kim G.
    Tribastone, Mirco
    Tschaikowski, Max
    Vandin, Andrea
    QUANTITATIVE EVALUATION OF SYSTEMS (QEST 2021), 2021, 12846 : 391 - 409
  • [33] SIMILAR STATES IN CONTINUOUS-TIME MARKOV CHAINS
    Yap, V. B.
    JOURNAL OF APPLIED PROBABILITY, 2009, 46 (02) : 497 - 506
  • [34] Matrix Analysis for Continuous-Time Markov Chains
    Le, Hung, V
    Tsatsomeros, M. J.
    SPECIAL MATRICES, 2021, 10 (01): : 219 - 233
  • [35] Algorithmic Randomness in Continuous-Time Markov Chains
    Huang, Xiang
    Lutz, Jack H.
    Migunov, Andrei N.
    2019 57TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2019, : 615 - 622
  • [36] Path integrals for continuous-time Markov chains
    Pollett, PK
    Stefanov, VT
    JOURNAL OF APPLIED PROBABILITY, 2002, 39 (04) : 901 - 904
  • [37] Ergodic degrees for continuous-time Markov chains
    MAO YonghuaDepartment of Mathematics Beijing Normal University Beijing China
    ScienceinChina,SerA., 2004, Ser.A.2004 (02) : 161 - 174
  • [38] Convergence of Continuous-Time Imprecise Markov Chains
    De Bock, Jasper
    PROCEEDINGS OF THE 9TH INTERNATIONAL SYMPOSIUM ON IMPRECISE PROBABILITY: THEORIES AND APPLICATIONS (ISIPTA '15), 2015, : 337 - 337
  • [39] Maxentropic continuous-time homogeneous Markov chains☆
    Bolzern, Paolo
    Colaneri, Patrizio
    De Nicolao, Giuseppe
    AUTOMATICA, 2025, 175
  • [40] Ergodic degrees for continuous-time Markov chains
    Yonghua Mao
    Science in China Series A: Mathematics, 2004, 47 : 161 - 174
12345