Safe optimal robust control of nonlinear systems with asymmetric input constraints using reinforcement learning

被引:0
|
作者
Zhang, Dehua [1 ]
Wang, Yuchen [1 ]
Jiang, Kaijun [1 ]
Liang, Linlin [2 ]
机构
[1] Henan Univ, Sch Artificial Intelligence, Zhengzhou 450000, Peoples R China
[2] Xidian Univ, Sch Cyber Engn, Xian 710126, Peoples R China
基金
中国国家自然科学基金;
关键词
Safety; Optimal robust control; Asymmetric input constraints; Adaptive dynamic programming (ADP); Nonlinear systems;
D O I
10.1007/s10489-023-05184-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
External disturbances and asymmetric input constraints may cause a major problem to the optimal control of the system. Aiming at such problem, this article presents a safe and optimal robust control method based on adaptive dynamic programming (ADP) to ensure the system operated in a safe region and with the optimal performance. Initially, a novel nonquadratic form cost function is imported for the system to address the asymmetric input constraints. Then, to ensure the safety of the system, a control barrier function (CBF) is appended to the cost function to penalize the unsafe behavior. And a damping factor is also introduced to the CBF to balance safety and optimality. Finally, one single critic network is utilized to simplify the complex computational steps, which is different from the traditional actor-critic networks to address the Hamilton-Jacobi-Bellman Equation (HJBE) for obtaining the optimal neural controller. Additionally, based on Lyapunov method, all signals in the closed-loop system are proven to be uniformly ultimately bounded (UUB). At last, the experimental results confirm the effectiveness of the designed approach.
引用
收藏
页码:1 / 13
页数:13
相关论文
共 50 条
  • [1] Safe optimal robust control of nonlinear systems with asymmetric input constraints using reinforcement learning
    Dehua Zhang
    Yuchen Wang
    Kaijun Jiang
    Linlin Liang
    Applied Intelligence, 2024, 54 : 1 - 13
  • [2] Optimal control for a class of nonlinear systems with input constraints based on reinforcement learning
    Luo A.
    Xiao W.-B.
    Zhou Q.
    Lu R.-Q.
    Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2022, 39 (01): : 154 - 164
  • [3] Critic Learning-Based Safe Optimal Control for Nonlinear Systems with Asymmetric Input Constraints and Unmatched Disturbances
    Qin, Chunbin
    Jiang, Kaijun
    Zhang, Jishi
    Zhu, Tianzeng
    ENTROPY, 2023, 25 (07)
  • [4] Safe model-based reinforcement learning for nonlinear optimal control with state and input constraints
    Kim, Yeonsoo
    Kim, Jong Woo
    AICHE JOURNAL, 2022, 68 (05)
  • [5] Safe reinforcement learning for affine nonlinear systems with state constraints and input saturation using control barrier functions
    Liu, Shihan
    Liu, Lijun
    Yu, Zhen
    NEUROCOMPUTING, 2023, 518 : 562 - 576
  • [6] Optimal neuro-control strategy for nonlinear systems with asymmetric input constraints
    Yang, Xiong
    Zhao, Bo
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2020, 7 (02) : 575 - 583
  • [7] Optimal Neuro-Control Strategy for Nonlinear Systems With Asymmetric Input Constraints
    Xiong Yang
    Bo Zhao
    IEEE/CAA Journal of Automatica Sinica, 2020, 7 (02) : 575 - 583
  • [8] Robust safe reinforcement learning control of unknown continuous-time nonlinear systems with state constraints and disturbances
    Zhang, Haoran
    Zhao, Chunhui
    Ding, Jinliang
    JOURNAL OF PROCESS CONTROL, 2023, 128
  • [9] Safe Transfer-Reinforcement-Learning-Based Optimal Control of Nonlinear Systems
    Wang, Yujia
    Xiao, Ming
    Wu, Zhe
    IEEE TRANSACTIONS ON CYBERNETICS, 2024, 54 (12) : 7272 - 7284
  • [10] Approximate Optimal Curve Path Tracking Control for Nonlinear Systems with Asymmetric Input Constraints
    Wang, Yajing
    Wang, Xiangke
    Shen, Lincheng
    DRONES, 2022, 6 (11)