Dynamic Event-Triggered Reinforcement Learning Control of Stochastic Nonlinear Systems

被引:25
|
作者
Zhu, Hao-Yang [1 ]
Li, Yuan-Xin [1 ]
Tong, Shaocheng [1 ]
机构
[1] Liaoning Univ Technol, Coll Sci, Jinzhou 121001, Peoples R China
关键词
Event-triggered control (ETC); fuzzy logic systems (FLSs); Hamilton-Jacobi-Bellman equation; optimized control; reinforcement learning (RL); stochastic systems; ADAPTIVE OPTIMAL-CONTROL; MULTIAGENT SYSTEMS; LINEAR-SYSTEMS;
D O I
10.1109/TFUZZ.2023.3235417
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article investigates the event-triggered optimized tracking control problem for stochastic nonlinear systems based on reinforcement learning (RL). By using the backstepping strategy, an adaptive RL algorithm is performed under the identifier-critic-actor architecture to achieve event-triggered optimized control (ETOC). Moreover, a novel dynamically adjustable event-triggered mechanism is delicately designed, which adjusts the triggering threshold online to economize communication resources and reduce the computation burden. To overcome the difficulty that the virtual control signals are discontinuous due to the state-triggering, the virtual controllers are designed with the continuous sampling states signals, and the actual optimal controller is redesigned by using the triggered states in the last step. Furthermore, the proposed ETOC in this article has significant advantages in terms of saving network resources because the event-triggered mechanism is employed in the sensor-to-controller channel and the event-sampled states are utilized to directly activate the control actions. Finally, it can be guaranteed that all signals of the stochastic system are bounded under the presented ETOC method. A simulation example is carried out to illustrate the effectiveness of the proposed ETOC algorithm.
引用
收藏
页码:2917 / 2928
页数:12
相关论文
共 50 条
  • [41] Event-Triggered Nonlinear Iterative Learning Control
    Lin, Na
    Chi, Ronghu
    Huang, Biao
    Hou, Zhongsheng
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (11) : 5118 - 5128
  • [42] Dynamic event-triggered adaptive control for a class of uncertain nonlinear systems
    Xing, Lantao
    Wen, Changyun
    AUTOMATICA, 2023, 158
  • [43] Reinforcement learning-based event-triggered optimal control for unknown nonlinear systems with input delay
    Chen, Xiangyu
    Sun, Weiwei
    Gao, Xinci
    Li, Yongshu
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2024, 34 (07) : 4844 - 4863
  • [44] Adaptive dynamic event-triggered asymptotic control for uncertain nonlinear systems☆ ☆
    Liu, Yongchao
    Zhao, Ning
    CHAOS SOLITONS & FRACTALS, 2024, 189
  • [45] Dynamic Event-triggered Approximate Optimal Control Strategy for Nonlinear Systems
    Cheng, Songsong
    Zhu, Mingjian
    Fu, Yuhui
    Fang, Xiaohan
    Fan, Yuan
    INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2022, 20 (05) : 1418 - 1427
  • [46] Dynamic Event-triggered Approximate Optimal Control Strategy for Nonlinear Systems
    Songsong Cheng
    Mingjian Zhu
    Yuhui Fu
    Xiaohan Fang
    Yuan Fan
    International Journal of Control, Automation and Systems, 2022, 20 : 1418 - 1427
  • [47] Event-triggered dynamic output feedback control for networked nonlinear systems
    Liu, Xinxin
    Su, Xiaojie
    Shi, Peng
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2020, 30 (17) : 7031 - 7051
  • [48] Safety-critical dynamic event-triggered control of nonlinear systems
    Long, Lijun
    Wang, Jie
    SYSTEMS & CONTROL LETTERS, 2022, 162
  • [49] Improved Dynamic Event-Triggered Control for Nonlinear Systems with Fading Channels
    Zhang, Qiongwen
    Cheng, Jun
    Liao, Daixi
    Cao, Jinde
    Alsaadi, Fawaz E.
    APPLIED MATHEMATICS AND COMPUTATION, 2023, 450
  • [50] Robust Adaptive Dynamic Event-Triggered Control of Switched Nonlinear Systems
    Long, Lijun
    Wang, Fenglan
    Chen, Zhiyong
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2023, 68 (08) : 4873 - 4887