TURNPIKES IN FINITE MARKOV DECISION PROCESSES AND RANDOM WALK*

被引：0
|
作者：
Piunovskiy, A. B. [1 ]
机构：
[1] Univ Liverpool, Dept Math Sci, Liverpool, England
来源：
THEORY OF PROBABILITY AND ITS APPLICATIONS | 2023年 / 68卷 / 01期
关键词：
Markov decision process; discounted reward; average reward; random walk; stochastic knapsack problem; turnpike;
D O I：
10.1137/S0040585X97T991325
中图分类号：
O21 [概率论与数理统计]; C8 [统计学];
学科分类号：
020208 ; 070103 ; 0714 ;
摘要：
In this paper we revise the theory of turnpikes in discounted Markov decision pro-cesses, prove the turnpike theorem for the undiscounted model, and apply the results to the specific random walk.
引用
收藏
页码：123 / 149
页数：27
相关论文
共 50 条
  • [41] Risk-optimization in finite state markov decision processes with a constraint
    Hou, Pingjun
    JOURNAL OF STATISTICS & MANAGEMENT SYSTEMS, 2012, 15 (2-3): : 309 - 322
  • [42] Reachability and Safety Objectives in Markov Decision Processes on Long but Finite Horizons
    Ashkenazi-Golan, Galit
    Flesch, Janos
    Predtetchinski, Arkadi
    Solan, Eilon
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2020, 185 (03) : 945 - 965
  • [43] An Approximate Stochastic Annealing Algorithm for Finite Horizon Markov Decision Processes
    Hu, Jiaqiao
    Chang, Hyeong Soo
    49TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2010, : 5338 - 5343
  • [44] Poisoning finite-horizon Markov decision processes at design time
    Caballero, William N.
    Jenkins, Phillip R.
    Keith, Andrew J.
    COMPUTERS & OPERATIONS RESEARCH, 2021, 129
  • [45] Convergence of Value Functions for Finite Horizon Markov Decision Processes with Constraints
    Naoyuki Ichihara
    Applied Mathematics & Optimization, 2021, 84 : 2177 - 2220
  • [46] A reinforcement learning based algorithm for finite horizon Markov decision processes
    Bhatnagar, Shalabh
    Abdulla, Mohammed Shahid
    PROCEEDINGS OF THE 45TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-14, 2006, : 5519 - 5524
  • [47] CONNECTEDNESS CONDITIONS USED IN FINITE STATE MARKOV DECISION-PROCESSES
    THOMAS, LC
    JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 1979, 68 (02) : 548 - 556
  • [48] Reachability and Safety Objectives in Markov Decision Processes on Long but Finite Horizons
    Galit Ashkenazi-Golan
    János Flesch
    Arkadi Predtetchinski
    Eilon Solan
    Journal of Optimization Theory and Applications, 2020, 185 : 945 - 965
  • [49] Finite horizon semi-Markov decision processes with multiple constraints
    Huang, Yonghui
    2014 11TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), 2014, : 1761 - 1768
  • [50] Convergence of Value Functions for Finite Horizon Markov Decision Processes with Constraints
    Ichihara, Naoyuki
    APPLIED MATHEMATICS AND OPTIMIZATION, 2021, 84 (02): : 2177 - 2220
12345