Dynamic Event-Triggered Reinforcement Learning Control of Stochastic Nonlinear Systems

被引:25
|
作者
Zhu, Hao-Yang [1 ]
Li, Yuan-Xin [1 ]
Tong, Shaocheng [1 ]
机构
[1] Liaoning Univ Technol, Coll Sci, Jinzhou 121001, Peoples R China
关键词
Event-triggered control (ETC); fuzzy logic systems (FLSs); Hamilton-Jacobi-Bellman equation; optimized control; reinforcement learning (RL); stochastic systems; ADAPTIVE OPTIMAL-CONTROL; MULTIAGENT SYSTEMS; LINEAR-SYSTEMS;
D O I
10.1109/TFUZZ.2023.3235417
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article investigates the event-triggered optimized tracking control problem for stochastic nonlinear systems based on reinforcement learning (RL). By using the backstepping strategy, an adaptive RL algorithm is performed under the identifier-critic-actor architecture to achieve event-triggered optimized control (ETOC). Moreover, a novel dynamically adjustable event-triggered mechanism is delicately designed, which adjusts the triggering threshold online to economize communication resources and reduce the computation burden. To overcome the difficulty that the virtual control signals are discontinuous due to the state-triggering, the virtual controllers are designed with the continuous sampling states signals, and the actual optimal controller is redesigned by using the triggered states in the last step. Furthermore, the proposed ETOC in this article has significant advantages in terms of saving network resources because the event-triggered mechanism is employed in the sensor-to-controller channel and the event-sampled states are utilized to directly activate the control actions. Finally, it can be guaranteed that all signals of the stochastic system are bounded under the presented ETOC method. A simulation example is carried out to illustrate the effectiveness of the proposed ETOC algorithm.
引用
收藏
页码:2917 / 2928
页数:12
相关论文
共 50 条
  • [1] Robust dynamic event-triggered control of saturated nonlinear systems using reinforcement learning
    Zheng, Wenqian
    Yang, Xiong
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2024, 34 (04) : 2659 - 2674
  • [2] Event-triggered control for stochastic nonlinear systems
    Gao, Yong-Feng
    Sun, Xi-Ming
    Wen, Changyun
    Wang, Wei
    AUTOMATICA, 2018, 95 : 534 - 538
  • [3] On Event-Triggered Control of Nonlinear Stochastic Systems
    Luo, Shixian
    Deng, Feiqi
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2020, 65 (01) : 369 - 375
  • [4] Dynamic event-triggered output feedback control for stochastic nonlinear systems
    Liu, Kun-Zhi
    Zhang, Dianfeng
    Gao, Yong-Feng
    Sun, Xi-Ming
    IFAC PAPERSONLINE, 2021, 54 (14): : 215 - 220
  • [5] Dynamic event-triggered adaptive control for uncertain stochastic nonlinear systems
    Fu, Yingying
    Li, Jing
    Li, Xiaobo
    Wu, Shuiyan
    APPLIED MATHEMATICS AND COMPUTATION, 2023, 444
  • [6] Dynamic event-triggered controller design for nonlinear systems: Reinforcement learning strategy
    Wang, Zichen
    Wang, Xin
    Pang, Ning
    NEURAL NETWORKS, 2023, 163 : 341 - 353
  • [7] Event-Triggered Impulsive Control for Nonlinear Stochastic Systems
    Hu, Zenghui
    Mu, Xiaowu
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (08) : 7805 - 7813
  • [8] Static/dynamic event-triggered learning control for constrained nonlinear systems
    Hu, Lingzhi
    Wang, Ding
    Qiao, Junfei
    NONLINEAR DYNAMICS, 2024, 112 (16) : 14159 - 14174
  • [9] Event-Triggered Containment Control for Nonlinear Multiagent Systems via Reinforcement Learning
    Wang, Zichen
    Wang, Xin
    Zhao, Chen
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2023, 70 (08) : 2904 - 2908
  • [10] Dynamic Event-Triggered Control for Nonlinear Stochastic Systems With Unknown Measurement Sensitivity
    Meng, Rui
    Hua, Changchun
    Li, Kuo
    Ning, Pengju
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2023, 70 (04) : 1710 - 1719