Construction of Lyapunov Functions for Piecewise-Deterministic Markov Processes

被引:6
|
作者
Mesquita, Alexandre R. [1 ]
Hespanha, Joao P. [1 ]
机构
[1] Univ Calif Santa Barbara, Ctr Control Dynam Syst & Computat, Santa Barbara, CA 93106 USA
关键词
CONVERGENCE; HASTINGS; LIMIT;
D O I
10.1109/CDC.2010.5717973
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The purpose of this contribution is twofold: 1) to present for the first time a Lyapunov function that proves exponential ergodicity of a process studied by the authors in [1], where the problem of controlling the probability density of a swarm of robotic agents was solved; 2) to introduce alongside the method used to construct this Lyapunov function, which is of interest in its own since it may be applicable to a wide class of piecewise-deterministc Markov processes. Our method searches for the Lyapunov function that maximizes a measure of the rate of convergence that appears in the theory of large deviations. Analytical solutions are often possible as shown by examples.
引用
收藏
页码:2408 / 2413
页数:6
相关论文
共 50 条
  • [1] Piecewise-deterministic Markov processes
    Kazak, Jolanta
    ANNALES POLONICI MATHEMATICI, 2013, 109 (03) : 279 - 296
  • [2] Stability of piecewise-deterministic Markov processes
    Dufour, F
    Costa, OLV
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1999, 37 (05) : 1483 - 1502
  • [3] Stability of piecewise-deterministic Markov processes
    Dufour, François
    Costa, Oswaldo L. V.
    SIAM Journal on Control and Optimization, 37 (05): : 1483 - 1502
  • [4] PIECEWISE-DETERMINISTIC MARKOV PROCESSES AS LIMITS OF MARKOV JUMP PROCESSES
    Franz, Uwe
    Liebscher, Volkmar
    Zeiser, Stefan
    ADVANCES IN APPLIED PROBABILITY, 2012, 44 (03) : 729 - 748
  • [5] Safety Verification of Piecewise-Deterministic Markov Processes
    Wisniewski, Rafael
    Sloth, Christoffer
    Bujorianu, Manuela
    Piterman, Nir
    HSCC'16: PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON HYBRID SYSTEMS: COMPUTATION AND CONTROL, 2016, : 257 - 266
  • [6] On the Poisson equation for piecewise-deterministic Markov processes
    Costa, OLV
    Dufour, F
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2003, 42 (03) : 985 - 1001
  • [8] Quantifying and Managing Uncertainty in Piecewise-Deterministic Markov Processes
    Cartee, Elliot
    Farah, Antonio
    Nellis, April
    Van Hook, Jacob
    Vladimirsky, Alexander
    SIAM-ASA JOURNAL ON UNCERTAINTY QUANTIFICATION, 2023, 11 (03): : 814 - 847
  • [9] NONPARAMETRIC ESTIMATION FOR A CLASS OF PIECEWISE-DETERMINISTIC MARKOV PROCESSES
    Fujii, Takayuki
    JOURNAL OF APPLIED PROBABILITY, 2013, 50 (04) : 931 - 942
  • [10] Optimal stopping for partially observed piecewise-deterministic Markov processes
    Brandejsky, Adrien
    de Saporta, Benoite
    Dufour, Francois
    STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 2013, 123 (08) : 3201 - 3238