Dynamic Event-Triggered Reinforcement Learning Control of Stochastic Nonlinear Systems

被引:25
|
作者
Zhu, Hao-Yang [1 ]
Li, Yuan-Xin [1 ]
Tong, Shaocheng [1 ]
机构
[1] Liaoning Univ Technol, Coll Sci, Jinzhou 121001, Peoples R China
关键词
Event-triggered control (ETC); fuzzy logic systems (FLSs); Hamilton-Jacobi-Bellman equation; optimized control; reinforcement learning (RL); stochastic systems; ADAPTIVE OPTIMAL-CONTROL; MULTIAGENT SYSTEMS; LINEAR-SYSTEMS;
D O I
10.1109/TFUZZ.2023.3235417
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article investigates the event-triggered optimized tracking control problem for stochastic nonlinear systems based on reinforcement learning (RL). By using the backstepping strategy, an adaptive RL algorithm is performed under the identifier-critic-actor architecture to achieve event-triggered optimized control (ETOC). Moreover, a novel dynamically adjustable event-triggered mechanism is delicately designed, which adjusts the triggering threshold online to economize communication resources and reduce the computation burden. To overcome the difficulty that the virtual control signals are discontinuous due to the state-triggering, the virtual controllers are designed with the continuous sampling states signals, and the actual optimal controller is redesigned by using the triggered states in the last step. Furthermore, the proposed ETOC in this article has significant advantages in terms of saving network resources because the event-triggered mechanism is employed in the sensor-to-controller channel and the event-sampled states are utilized to directly activate the control actions. Finally, it can be guaranteed that all signals of the stochastic system are bounded under the presented ETOC method. A simulation example is carried out to illustrate the effectiveness of the proposed ETOC algorithm.
引用
收藏
页码:2917 / 2928
页数:12
相关论文
共 50 条
  • [21] Event-triggered sliding mode control of nonlinear dynamic systems
    Liu, Xinxin
    Su, Xiaojie
    Shi, Peng
    Shen, Chao
    Peng, Yan
    AUTOMATICA, 2020, 112
  • [22] Decentralized Event-Triggered Control for a Class of Nonlinear-Interconnected Systems Using Reinforcement Learning
    Yang, Xiong
    He, Haibo
    IEEE TRANSACTIONS ON CYBERNETICS, 2021, 51 (02) : 635 - 648
  • [23] Event-Triggered Distributed Control of Nonlinear Interconnected Systems Using Online Reinforcement Learning With Exploration
    Narayanan, Vignesh
    Jagannathan, Sarangapani
    IEEE TRANSACTIONS ON CYBERNETICS, 2018, 48 (09) : 2510 - 2519
  • [24] Event-triggered adaptive optimal tracking control for nonlinear stochastic systems with dynamic state constraints
    Wei, Yan
    Yu, Xinyi
    Feng, Yu
    Chen, Qiang
    Ou, Linlin
    Zhou, Libo
    ISA TRANSACTIONS, 2023, 139 : 60 - 70
  • [25] Dynamic event-triggered adaptive control for zero-sum games of nonlinear stochastic systems
    Liu, Pengda
    Liu, Zongmin
    Ao, Wengang
    Ming, Zhongyang
    Shi, Peng
    Transactions of the Institute of Measurement and Control, 2023,
  • [26] Event-Triggered Impulsive Control of Nonlinear Stochastic Systems With Exogenous Disturbances
    Liu, Linna
    Pan, Chenglong
    Fang, Jianyin
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2025, 35 (05) : 1654 - 1665
  • [27] Event-Triggered Active Disturbance Rejection Control for Nonlinear Stochastic Systems
    Li, Dandan
    Zuo, Zhiqiang
    Wang, Yijing
    2017 11TH ASIAN CONTROL CONFERENCE (ASCC), 2017, : 1813 - 1817
  • [28] Event-triggered predictive control of nonlinear stochastic systems with output delay
    Yang, Xuetao
    Wang, Hua
    Zhu, Quanxin
    AUTOMATICA, 2022, 140
  • [29] Event-triggered control of Itô stochastic nonlinear delayed systems with state quantization
    Sun, Yuanyuan
    Deng, Feiqi
    Yu, Peilin
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2024, 34 (05) : 3167 - 3188
  • [30] Event-Triggered Consensus Tracking Control of Stochastic Nonlinear Multiagent Systems
    Zou, Wencheng
    Ahn, Choon Ki
    Xiang, Zhengrong
    IEEE SYSTEMS JOURNAL, 2019, 13 (04): : 4051 - 4059