On the Controller Synthesis for Markov Decision Process of Conflict Tolerant Specification

被引:0
|
作者
Zhang, Junhua [1 ]
Huang, Zhiqiu [1 ]
Cao, Zining [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Dept Comp Sci & Technol, Nanjing 210016, Peoples R China
关键词
Markov Decision Process; controller synthesis; conflict tolerant; embedded control system; PCTL star;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
For an embedded control system, different requirements often need be satisfied at same time, and some of them make the system to act conflicted. Conflict tolerant specification is provided to denote this situation. In such a system, there often exist probabilistic and non-deterministic behaviors. We use Markov Decision Process (MDP) to denote these features. We study the controller synthesis for MDP over conflict tolerant specification. We extend PCTL star by adding past operator to denote the conflict tolerant specification succinctly. We use CT-PLTL to denote conflicted actions and PCTL to denote the specification for probability demand. We first synthesize a controller on a base system over CT-PLTL and then use it to prune the corresponding MDP of the system model. We use the resulting sub-MDP as the model to further synthesis a controller over PCTL. The whole controller for MDP is a conjunction of the two controllers obtained.
引用
收藏
页码:284 / 290
页数:7
相关论文
共 50 条
  • [1] Qualitative Controller Synthesis for Consumption Markov Decision Processes
    Blahoudek, Frantisek
    Brazdil, Tomas
    Novotny, Petr
    Ornik, Melkior
    Thangeda, Pranay
    Topcu, Ufuk
    COMPUTER AIDED VERIFICATION, PT II, 2020, 12225 : 421 - 447
  • [2] Quantitative controller synthesis for consumption Markov decision processes
    Fu, Jianling
    Huang, Cheng-Chao
    Li, Yong
    Mei, Jingyi
    Xu, Ming
    Zhang, Lijun
    INFORMATION PROCESSING LETTERS, 2023, 180
  • [3] On the controller synthesis for finite-state Markov decision processes
    Kucera, A
    Strazovsky, O
    FSTTCS 2005: FOUNDATIONS OF SOFTWARE TECHNOLOGY AND THEORETICAL COMPUTER SCIENCE, PROCEEDINGS, 2005, 3821 : 541 - 552
  • [4] On the controller synthesis for finite-state Markov decision processes
    Kucera, Antonin
    Strazovsky, Oldrich
    FUNDAMENTA INFORMATICAE, 2008, 82 (1-2) : 141 - 153
  • [5] Quantum logic gate synthesis as a Markov decision process
    Alam, M. Sohaib
    Berthusen, Noah F.
    Orth, Peter P.
    NPJ QUANTUM INFORMATION, 2023, 9 (01)
  • [6] Quantum logic gate synthesis as a Markov decision process
    M. Sohaib Alam
    Noah F. Berthusen
    Peter P. Orth
    npj Quantum Information, 9
  • [7] Controller synthesis and verification for Markov decision processes with qualitative branching time objectives
    Brazdil, Tomas
    Forejt, Vojtech
    Kucera, Antonin
    AUTOMATA, LANGUAGES AND PROGRAMMING, PT 2, PROCEEDINGS, 2008, 5126 : 148 - 159
  • [8] Markov Decision Process Toolbox
    Shan Peng
    Li Ran
    Ning Sheng-hua
    Yang Qin
    PROCEEDINGS 2009 IEEE INTERNATIONAL WORKSHOP ON OPEN-SOURCE SOFTWARE FOR SCIENTIFIC COMPUTATION, 2009, : 123 - 128
  • [9] Elaboration Tolerant Representation of Markov Decision Process via Decision-Theoretic Extension of Probabilistic Action Language pBC
    Wang, Yi
    Lee, Joohyung
    LOGIC PROGRAMMING AND NONMONOTONIC REASONING, LPNMR 2019, 2019, 11481 : 224 - 238
  • [10] Policy Synthesis for Switched Linear Systems With Markov Decision Process Switching
    Wu, Bo
    Cubuktepe, Murat
    Djeumou, Franck
    Xu, Zhe
    Topcu, Ufuk
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2023, 68 (01) : 532 - 539