Constrained Markov control processes in Borel spaces:: the discounted case

被引:41
|
作者
Hernández-Lerma, O
González-Hernández, J
机构
[1] Inst Politecn Nacl, Ctr Invest & Estudios Avanzados, Dept Matemat, Mexico City 07000, DF, Mexico
[2] Univ Nacl Autonoma Mexico, IIMAS, Dept Probabilidad & Estadist, Mexico City 01000, DF, Mexico
关键词
constrained Markov control processes; discounted cost criterion; infinite-dimensional linear programming;
D O I
10.1007/s001860000071
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We consider constrained discounted-cost Markov control processes in Borel spaces, with unbounded costs. Conditions are given for the constrained problem to be solvable, and also equivalent to an equality-constrained (EC) linear program. In addition, it is shown that there is no duality gap between EC and its dual program EC*, and that, under additional assumptions, also EC* is solvable, so that in fact the strong duality condition holds. Finally, a Farkas-like theorem is included, which gives necessary and sufficient conditions for the primal program EC to be consistent.
引用
收藏
页码:271 / 285
页数:15
相关论文
共 50 条
  • [1] Constrained Markov control processes in Borel spaces: the discounted case
    Onésimo Hernández-Lerma
    Juan González-Hernández
    Mathematical Methods of Operations Research, 2000, 52 : 271 - 285
  • [2] Constrained discounted Markov decision processes with Borel state spaces
    Feinberg, Eugene A.
    Jaskiewicz, Anna
    Nowak, Andrzej S.
    AUTOMATICA, 2020, 111
  • [3] Constrained Markov decision processes in Borel spaces: from discounted to average optimality
    Armando F. Mendoza-Pérez
    Héctor Jasso-Fuentes
    Omar A. De-la-Cruz Courtois
    Mathematical Methods of Operations Research, 2016, 84 : 489 - 525
  • [4] Constrained Markov decision processes in Borel spaces: from discounted to average optimality
    Mendoza-Perez, Armando F.
    Jasso-Fuentes, Hector
    De-la-Cruz Courtois, Omar A.
    MATHEMATICAL METHODS OF OPERATIONS RESEARCH, 2016, 84 (03) : 489 - 525
  • [5] Constrained average cost Markov control processes in Borel spaces
    Hernández-Lerma, O
    González-Hernández, J
    López-Martínez, RR
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2003, 42 (02) : 442 - 468
  • [6] Weakly Coupled Constrained Markov Decision Processes in Borel Spaces
    Gagrani, Mukul
    Nayyar, Ashutosh
    2020 AMERICAN CONTROL CONFERENCE (ACC), 2020, : 2790 - 2795
  • [7] DISCOUNTED COST MARKOV DECISION-PROCESSES ON BOREL SPACES - THE LINEAR-PROGRAMMING FORMULATION
    HERNANDEZLERMA, O
    HERNANDEZHERNANDEZ, D
    JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 1994, 183 (02) : 335 - 351
  • [8] Risk-sensitive discounted Markov decision processes with unbounded reward functions and Borel spaces
    Guo, Xin
    STOCHASTICS-AN INTERNATIONAL JOURNAL OF PROBABILITY AND STOCHASTIC PROCESSES, 2024, 96 (01) : 649 - 666
  • [9] DISCOUNTED CONTINUOUS-TIME CONSTRAINED MARKOV DECISION PROCESSES IN POLISH SPACES
    Guo, Xianping
    Song, Xinyuan
    ANNALS OF APPLIED PROBABILITY, 2011, 21 (05): : 2016 - 2049
  • [10] Finite-State Approximations to Constrained Markov Decision Processes with Borel Spaces
    Saldi, Naci
    Yuksel, Serdar
    Linder, Tamas
    2015 53RD ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2015, : 567 - 572