Safe optimal robust control of nonlinear systems with asymmetric input constraints using reinforcement learning

被引:0
|
作者
Zhang, Dehua [1 ]
Wang, Yuchen [1 ]
Jiang, Kaijun [1 ]
Liang, Linlin [2 ]
机构
[1] Henan Univ, Sch Artificial Intelligence, Zhengzhou 450000, Peoples R China
[2] Xidian Univ, Sch Cyber Engn, Xian 710126, Peoples R China
基金
中国国家自然科学基金;
关键词
Safety; Optimal robust control; Asymmetric input constraints; Adaptive dynamic programming (ADP); Nonlinear systems;
D O I
10.1007/s10489-023-05184-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
External disturbances and asymmetric input constraints may cause a major problem to the optimal control of the system. Aiming at such problem, this article presents a safe and optimal robust control method based on adaptive dynamic programming (ADP) to ensure the system operated in a safe region and with the optimal performance. Initially, a novel nonquadratic form cost function is imported for the system to address the asymmetric input constraints. Then, to ensure the safety of the system, a control barrier function (CBF) is appended to the cost function to penalize the unsafe behavior. And a damping factor is also introduced to the CBF to balance safety and optimality. Finally, one single critic network is utilized to simplify the complex computational steps, which is different from the traditional actor-critic networks to address the Hamilton-Jacobi-Bellman Equation (HJBE) for obtaining the optimal neural controller. Additionally, based on Lyapunov method, all signals in the closed-loop system are proven to be uniformly ultimately bounded (UUB). At last, the experimental results confirm the effectiveness of the designed approach.
引用
收藏
页码:1 / 13
页数:13
相关论文
共 50 条
  • [21] Safe Q-Learning for Data-Driven Nonlinear Optimal Control with Asymmetric State Constraints
    Zhao, Mingming
    Wang, Ding
    Song, Shijie
    Qiao, Junfei
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2024, 11 (12) : 2408 - 2422
  • [22] Safe Q-Learning for Data-Driven Nonlinear Optimal Control With Asymmetric State Constraints
    Mingming Zhao
    Ding Wang
    Shijie Song
    Junfei Qiao
    IEEE/CAA Journal of Automatica Sinica, 2024, 11 (12) : 2408 - 2422
  • [23] Robust control for a class of nonlinear systems with input constraints based on actor-critic learning
    Li, Dongdong
    Dong, Jiuxiang
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2024, 34 (12) : 7635 - 7654
  • [24] Optimal Control for Constrained Discrete-Time Nonlinear Systems Based on Safe Reinforcement Learning
    Zhang, Lingzhi
    Xie, Lei
    Jiang, Yi
    Li, Zhishan
    Liu, Xueqin
    Su, Hongye
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025, 36 (01) : 854 - 865
  • [25] Robust Nonlinear W∞ Optimal Control for Input Nonaffine Systems
    Cardoso, Daniel N.
    Terra, Marco H.
    Raffo, Guilherme, V
    2024 EUROPEAN CONTROL CONFERENCE, ECC 2024, 2024, : 65 - 71
  • [26] Reinforcement learning for optimal control of stochastic nonlinear systems
    Zhu, Xinji
    Wang, Yujia
    Wu, Zhe
    AICHE JOURNAL, 2025,
  • [27] Reinforcement learning for robust stabilization of nonlinear systems with asymmetric saturating actuators?
    Yang, Xiong
    Zhou, Yingjiang
    Gao, Zhongke
    NEURAL NETWORKS, 2023, 158 : 132 - 141
  • [28] Optimal control of nonlinear systems with input constraints using linear time varying approximations
    Itik, Mehmet
    NONLINEAR ANALYSIS-MODELLING AND CONTROL, 2016, 21 (03): : 400 - 412
  • [29] Event-trigger-based robust control for nonlinear constrained-input systems using reinforcement learning method
    Yang, Dongsheng
    Li, Ting
    Zhang, Huaguang
    Xie, Xiangpeng
    NEUROCOMPUTING, 2019, 340 : 158 - 170
  • [30] Robust Model Predictive Control for Nonlinear Systems With Incremental Control Input Constraints
    Zhao, Fang-Jiao
    Gao, Yong-Feng
    Wang, Xue-Fang
    Gu, Hao-Yuan
    Sun, Xi-Ming
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2025, 22 : 9983 - 9993