NOTE ON STABILITY ESTIMATION IN AVERAGE MARKOV CONTROL PROCESSES

被引：0
|
作者：
Martinez Sanchez, Jaime [1 ]
Zaitseva, Elena [2 ]
机构：
[1] Univ Autonoma Metropolitana Iztapalapa, Dept Math, Mexico City 09340, DF, Mexico
[2] Inst Tecnol Autonomo Mexico, Mexico City 01080, DF, Mexico
来源：
KYBERNETIKA | 2015年 / 51卷 / 04期
关键词：
discrete-time Markov control processes; average criterion; stability index; Prokhorov metric;
D O I：
暂无
中图分类号：
TP3 [计算技术、计算机技术];
学科分类号：
0812 ;
摘要：
We study the stability of average optimal control of general discrete-time Markov processes. Under certain ergodicity and Lipschitz conditions the stability index is bounded by a constant times the Prokhorov distance between distributions of random vectors determinating the "original and the perturbated" control processes.
引用
收藏
页码：629 / 638
页数：10
相关论文
共 50 条
  • [1] Empirical estimation in average Markov control processes
    Minjarez-Sosa, J. Adolfo
    APPLIED MATHEMATICS LETTERS, 2008, 21 (05) : 459 - 464
  • [2] Average cost Markov control processes: stability with respect to the Kantorovich metric
    Gordienko, Evgueni
    Lemus-Rodriguez, Enrique
    Montes-de-Oca, Raul
    MATHEMATICAL METHODS OF OPERATIONS RESEARCH, 2009, 70 (01) : 13 - 33
  • [3] Average cost Markov control processes: stability with respect to the Kantorovich metric
    Evgueni Gordienko
    Enrique Lemus-Rodríguez
    Raúl Montes-de-Oca
    Mathematical Methods of Operations Research, 2009, 70 : 13 - 33
  • [4] Adaptive average control for piecewise deterministic Markov processes
    Costa, O. L. V.
    Dufour, F.
    Genadot, A.
    SYSTEMS & CONTROL LETTERS, 2024, 192
  • [5] WEAK CONDITIONS FOR AVERAGE OPTIMALITY IN MARKOV CONTROL PROCESSES
    HERNANDEZLERMA, O
    LASSERRE, JB
    SYSTEMS & CONTROL LETTERS, 1994, 22 (04) : 287 - 291
  • [6] AVERAGE CONTINUOUS CONTROL OF PIECEWISE DETERMINISTIC MARKOV PROCESSES
    Costa, O. L. V.
    Dufour, F.
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2010, 48 (07) : 4262 - 4291
  • [7] Approximation of Constrained Average Cost Markov Control Processes
    Sutter, Tobias
    Esfahani, Peyman Mohajerin
    Lygeros, John
    2014 IEEE 53RD ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2014, : 6597 - 6602
  • [8] Stability estimation of some Markov controlled processes
    Gordienko, Evgueni
    de Chavez, Juan Ruiz
    OPEN MATHEMATICS, 2022, 20 (01): : 1509 - 1520
  • [9] Stability Estimation of Transient Markov Decision Processes
    Gordienko, Evgueni
    Martinez, Jaime
    Ruiz de Chavez, Juan
    XI SYMPOSIUM ON PROBABILITY AND STOCHASTIC PROCESSES, 2015, 69 : 157 - 176
  • [10] Average continuous control of piecewise deterministic Markov processes
    Costa, O. L. V.
    Dufour, F.
    2005 44th IEEE Conference on Decision and Control & European Control Conference, Vols 1-8, 2005, : 1712 - 1717
12345