NOTE ON STABILITY ESTIMATION IN AVERAGE MARKOV CONTROL PROCESSES

被引：0

作者：

Martinez Sanchez, Jaime ^{[1
]}

Zaitseva, Elena ^{[2
]}

机构：

[1] Univ Autonoma Metropolitana Iztapalapa, Dept Math, Mexico City 09340, DF, Mexico

[2] Inst Tecnol Autonomo Mexico, Mexico City 01080, DF, Mexico

来源：

KYBERNETIKA | 2015年 / 51卷 / 04期

关键词：

discrete-time Markov control processes; average criterion; stability index; Prokhorov metric;

D O I：

暂无

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

We study the stability of average optimal control of general discrete-time Markov processes. Under certain ergodicity and Lipschitz conditions the stability index is bounded by a constant times the Prokhorov distance between distributions of random vectors determinating the "original and the perturbated" control processes.

引用

页码：629 / 638

页数：10

共 50 条

[21] Policy Iteration for Average Cost Markov Control Processes on Borel Spaces
Onésimo Hernández-Lerma
Jean B. Lasserre
Acta Applicandae Mathematica, 1997, 47 : 125 - 154
[22] A Note on Infectious Disease Control using Markov Decision Processes
Maeda Y.
IEEJ Transactions on Electronics, Information and Systems, 2022, 142 (03) : 339 - 340
[23] Estimates processes of stability of Markov control with unbounded costs
Gordienko, EI
Salem, F
KYBERNETIKA, 2000, 36 (02) : 195 - 210
[24] NOTE ON REGULARIZATION OF MARKOV PROCESSES
KNIGHT, F
ILLINOIS JOURNAL OF MATHEMATICS, 1965, 9 (03) : 548 - &
[25] A note on optimality conditions for continuous-time Markov decision processes with average cost criterion
Guo, XP
Liu, K
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2001, 46 (12) : 1984 - 1989
[26] A pause control approach to the value iteration scheme in average Markov decision processes
Cavazos-Cadena, Rolando
Systems and Control Letters, 1998, 33 (04): : 209 - 219
[27] The Policy Iteration Algorithm for Average Continuous Control of Piecewise Deterministic Markov Processes
Costa, O. L. V.
Dufour, F.
APPLIED MATHEMATICS AND OPTIMIZATION, 2010, 62 (02): : 185 - 204
[28] The Policy Iteration Algorithm for Average Continuous Control of Piecewise Deterministic Markov Processes
Costa, O. L. V.
Dufour, F.
PROCEEDINGS OF THE 48TH IEEE CONFERENCE ON DECISION AND CONTROL, 2009 HELD JOINTLY WITH THE 2009 28TH CHINESE CONTROL CONFERENCE (CDC/CCC 2009), 2009, : 506 - 511
[29] On the optimality equation for average cost Markov control processes with Feller transition probabilities
Jaskiewicz, A
Nowak, AS
JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 2006, 316 (02) : 495 - 509
[30] APPROXIMATION AND ADAPTIVE-CONTROL OF MARKOV-PROCESSES - AVERAGE REWARD CRITERION
HERNANDEZLERMA, O
KYBERNETIKA, 1987, 23 (04) : 265 - 288

← 1 2 3 4 5 →