A Matrosov Theorem for Adversarial Markov Decision Processes

被引:25
|
作者
Teel, Andrew R. [1 ]
机构
[1] Univ Calif Santa Barbara, Dept Elect & Comp Engn, Santa Barbara, CA 93106 USA
基金
美国国家科学基金会;
关键词
ASYMPTOTIC STABILITY;
D O I
10.1109/TAC.2013.2250073
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Matrosov's relaxation of Lyapunov conditions for uniform global asymptotic stability in time-varying systems is extended to stochastic, set-valued discrete-time systems. Nested Matrosov functions are used to give conditions for stability that complement invariance principles for time-invariant systems. Unlike invariance principles, Matrosov functions also can be applied to general time-varying systems.
引用
收藏
页码:2142 / 2148
页数:8
相关论文
共 50 条
  • [31] Algebraic Markov Decision Processes
    Perny, Patrice
    Spanjaard, Olivier
    Weng, Paul
    19TH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI-05), 2005, : 1372 - 1377
  • [32] Feature Markov Decision Processes
    Hutter, Marcus
    ARTIFICIAL GENERAL INTELLIGENCE PROCEEDINGS, 2009, 8 : 61 - 66
  • [33] Characterizing Markov decision processes
    Ratitch, B
    Precup, D
    MACHINE LEARNING: ECML 2002, 2002, 2430 : 391 - 404
  • [34] Absorbing Markov decision processes
    Dufour, Francois
    Prieto-Rumeau, Tomas
    ESAIM-CONTROL OPTIMISATION AND CALCULUS OF VARIATIONS, 2024, 30
  • [35] Logistic Markov Decision Processes
    Mladenov, Martin
    Boutilier, Craig
    Schuurmans, Dale
    Meshi, Ofer
    Elidan, Gal
    Lu, Tyler
    PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 2486 - 2493
  • [36] Quantile Markov Decision Processes
    Li, Xiaocheng
    Zhong, Huaiyang
    Brandeau, Margaret L.
    OPERATIONS RESEARCH, 2021, 70 (03) : 1428 - 1447
  • [37] Parallel markov decision processes
    Sucar, L. Enrique
    ADVANCES IN PROBABILISTIC GRAPHICAL MODELS, 2007, 213 : 295 - 309
  • [38] Configurable Markov Decision Processes
    Metelli, Alberto Maria
    Mutti, Mirco
    Restelli, Marcello
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [39] Possibilistic Markov decision processes
    Sabbadin, R
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2001, 14 (03) : 287 - 300
  • [40] On constrained Markov decision processes
    Department of Econometrics, University of Sydney, Sydney, NSW 2006, Australia
    不详
    Oper Res Lett, 1 (25-28):