TURNPIKES IN FINITE MARKOV DECISION PROCESSES AND RANDOM WALK*

被引：0
|
作者：
Piunovskiy, A. B. [1 ]
机构：
[1] Univ Liverpool, Dept Math Sci, Liverpool, England
来源：
THEORY OF PROBABILITY AND ITS APPLICATIONS | 2023年 / 68卷 / 01期
关键词：
Markov decision process; discounted reward; average reward; random walk; stochastic knapsack problem; turnpike;
D O I：
10.1137/S0040585X97T991325
中图分类号：
O21 [概率论与数理统计]; C8 [统计学];
学科分类号：
020208 ; 070103 ; 0714 ;
摘要：
In this paper we revise the theory of turnpikes in discounted Markov decision pro-cesses, prove the turnpike theorem for the undiscounted model, and apply the results to the specific random walk.
引用
收藏
页码：123 / 149
页数：27
相关论文
共 50 条
  • [31] Markov Decision Processes on Borel Spaces with Total Cost and Random Horizon
    Cruz-Suarez, Hugo
    Ilhuicatzi-Roldan, Rocio
    Montes-de-Oca, Raul
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2014, 162 (01) : 329 - 346
  • [32] An evolutionary random policy search algorithm for solving Markov decision processes
    Hu, Jiaqiao
    Fu, Michael C.
    Ramezani, Vahid R.
    Marcus, Steven I.
    INFORMS JOURNAL ON COMPUTING, 2007, 19 (02) : 161 - 174
  • [33] Markov decision processes
    White, D.J.
    Journal of the Operational Research Society, 1995, 46 (06):
  • [34] Lexicographic refinements in possibilistic decision trees and finite-horizon Markov decision processes
    Ben Amor, Nahla
    El Khalfi, Zeineb
    Fargier, Helene
    Sabbadin, Regis
    FUZZY SETS AND SYSTEMS, 2019, 366 : 85 - 109
  • [35] Finite approximation for finite-horizon continuous-time Markov decision processes
    Wei, Qingda
    4OR-A QUARTERLY JOURNAL OF OPERATIONS RESEARCH, 2017, 15 (01): : 67 - 84
  • [36] Markov Decision Processes
    Bäuerle N.
    Rieder U.
    Jahresbericht der Deutschen Mathematiker-Vereinigung, 2010, 112 (4) : 217 - 243
  • [37] Finite approximation for finite-horizon continuous-time Markov decision processes
    Qingda Wei
    4OR, 2017, 15 : 67 - 84
  • [38] Uniqueness and stability of optimal policies of finite state Markov decision processes
    Leizarowitz, Arie
    Zaslavski, Alexander J.
    MATHEMATICS OF OPERATIONS RESEARCH, 2007, 32 (01) : 156 - 167
  • [39] FINITE LINEAR PROGRAMMING APPROXIMATIONS OF CONSTRAINED DISCOUNTED MARKOV DECISION PROCESSES
    Dufour, Francois
    Prieto-Rumeau, Tomas
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2013, 51 (02) : 1298 - 1324
  • [40] Constrained Continuous-Time Markov Decision Processes on the Finite Horizon
    Xianping Guo
    Yonghui Huang
    Yi Zhang
    Applied Mathematics & Optimization, 2017, 75 : 317 - 341
12345