On the Controller Synthesis for Markov Decision Process of Conflict Tolerant Specification

被引:0
|
作者
Zhang, Junhua [1 ]
Huang, Zhiqiu [1 ]
Cao, Zining [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Dept Comp Sci & Technol, Nanjing 210016, Peoples R China
关键词
Markov Decision Process; controller synthesis; conflict tolerant; embedded control system; PCTL star;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
For an embedded control system, different requirements often need be satisfied at same time, and some of them make the system to act conflicted. Conflict tolerant specification is provided to denote this situation. In such a system, there often exist probabilistic and non-deterministic behaviors. We use Markov Decision Process (MDP) to denote these features. We study the controller synthesis for MDP over conflict tolerant specification. We extend PCTL star by adding past operator to denote the conflict tolerant specification succinctly. We use CT-PLTL to denote conflicted actions and PCTL to denote the specification for probability demand. We first synthesize a controller on a base system over CT-PLTL and then use it to prune the corresponding MDP of the system model. We use the resulting sub-MDP as the model to further synthesis a controller over PCTL. The whole controller for MDP is a conjunction of the two controllers obtained.
引用
收藏
页码:284 / 290
页数:7
相关论文
共 50 条
  • [41] Controllable Summarization with Constrained Markov Decision Process
    Hou Pong Chan
    Wang, Lu
    King, Irwin
    TRANSACTIONS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, 2021, 9 : 1213 - 1232
  • [42] Asset Allocation Using Markov Decision Process
    Jilani, Tahseen
    Zaidi, Faheem
    Jamal, Syed Khalid
    Maqsood, Arfa
    Safdar, Suboohi
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2019, 19 (03): : 185 - 189
  • [43] A Markov decision process for response adaptive designs
    Yi, Yanqing
    Wang, Xikui
    ECONOMETRICS AND STATISTICS, 2023, 25 : 125 - 133
  • [44] Reinforcement Learning to Rank with Markov Decision Process
    Wei, Zeng
    Xu, Jun
    Lan, Yanyan
    Guo, Jiafeng
    Cheng, Xueqi
    SIGIR'17: PROCEEDINGS OF THE 40TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2017, : 945 - 948
  • [45] Parallel Algorithms for Solving Markov Decision Process
    Zhang, Qi
    Sun, Guangzhong
    Xu, Yinlong
    ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, PROCEEDINGS, 2009, 5574 : 466 - 477
  • [46] A Markov decision process with delayed state availability
    White, CC
    Bander, JL
    INFORMATION INTELLIGENCE AND SYSTEMS, VOLS 1-4, 1996, : 2689 - 2691
  • [47] Robust partially observable Markov decision process
    Osogami, Takayuki
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 37, 2015, 37 : 106 - 115
  • [48] Abstractive Meeting Summarization as a Markov Decision Process
    Murray, Gabriel
    ADVANCES IN ARTIFICIAL INTELLIGENCE (AI 2015), 2015, 9091 : 212 - 219
  • [49] Minimizing the Outage Probability in a Markov Decision Process
    Corlay, Vincent
    Sibel, Jean-Christophe
    2023 IEEE INFORMATION THEORY WORKSHOP, ITW, 2023, : 107 - 112
  • [50] VARIANCE CONSTRAINED MARKOV DECISION-PROCESS
    KAWAI, H
    KATOH, N
    JOURNAL OF THE OPERATIONS RESEARCH SOCIETY OF JAPAN, 1987, 30 (01) : 88 - 100