Average cost Markov control processes: stability with respect to the Kantorovich metric

被引:6
|
作者
Gordienko, Evgueni [1 ]
Lemus-Rodriguez, Enrique [2 ]
Montes-de-Oca, Raul [1 ]
机构
[1] Univ Autonoma Metropolitana, Unidad Iztapalapa, Mexico City 09340, DF, Mexico
[2] Univ Anahuac, Colonia Lomas Anahuac Hu 52786, Edo De Mexico, Mexico
关键词
Discrete-time Markov control process; Average cost; Contraction; Stability inequality; Kantorovich metric;
D O I
10.1007/s00186-008-0229-6
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We study perturbations of a discrete-time Markov control process on a general state space. The amount of perturbation is measured by means of the Kantorovich distance. We assume that an average (per unit of time on the infinite horizon) optimal control policy can be found for the perturbed (supposedly known) process, and that it is used to control the original (unperturbed) process. The one-stage cost is not assumed to be bounded. Under Lyapunov-like conditions we find upper bounds for the average cost excess when such an approximation is used in place of the optimal (unknown) control policy. As an application of the found inequalities we consider the approximation by relevant empirical distributions. We illustrate our results by estimating the stability of a simple autoregressive control process. Also examples of unstable processes are provided.
引用
收藏
页码:13 / 33
页数:21
相关论文
共 50 条