Safe optimal robust control of nonlinear systems with asymmetric input constraints using reinforcement learning

被引:0
|
作者
Zhang, Dehua [1 ]
Wang, Yuchen [1 ]
Jiang, Kaijun [1 ]
Liang, Linlin [2 ]
机构
[1] Henan Univ, Sch Artificial Intelligence, Zhengzhou 450000, Peoples R China
[2] Xidian Univ, Sch Cyber Engn, Xian 710126, Peoples R China
基金
中国国家自然科学基金;
关键词
Safety; Optimal robust control; Asymmetric input constraints; Adaptive dynamic programming (ADP); Nonlinear systems;
D O I
10.1007/s10489-023-05184-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
External disturbances and asymmetric input constraints may cause a major problem to the optimal control of the system. Aiming at such problem, this article presents a safe and optimal robust control method based on adaptive dynamic programming (ADP) to ensure the system operated in a safe region and with the optimal performance. Initially, a novel nonquadratic form cost function is imported for the system to address the asymmetric input constraints. Then, to ensure the safety of the system, a control barrier function (CBF) is appended to the cost function to penalize the unsafe behavior. And a damping factor is also introduced to the CBF to balance safety and optimality. Finally, one single critic network is utilized to simplify the complex computational steps, which is different from the traditional actor-critic networks to address the Hamilton-Jacobi-Bellman Equation (HJBE) for obtaining the optimal neural controller. Additionally, based on Lyapunov method, all signals in the closed-loop system are proven to be uniformly ultimately bounded (UUB). At last, the experimental results confirm the effectiveness of the designed approach.
引用
收藏
页码:1 / 13
页数:13
相关论文
共 50 条
  • [31] Integral reinforcement learning-based optimal tracking control for uncertain nonlinear systems under input constraint and specified performance constraints
    Chang, Ru
    Liu, Zhi-Meng
    Li, Xiao-Bin
    Sun, Chang-Yin
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2024, 34 (13) : 8802 - 8824
  • [32] Safe Reinforcement Learning Using Robust Control Barrier Functions
    Emam, Yousef
    Notomista, Gennaro
    Glotfelter, Paul
    Kira, Zsolt
    Egerstedt, Magnus
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (03): : 2886 - 2893
  • [33] Robust adaptive control for a class of nonlinear systems with uncertainties and input constraints
    Madani, KM
    Eslami, M
    ACC: Proceedings of the 2005 American Control Conference, Vols 1-7, 2005, : 3725 - 3730
  • [34] Reinforcement learning-based optimal control of unknown constrained-input nonlinear systems using simulated experience
    Asl, Hamed Jabbari
    Uchibe, Eiji
    NONLINEAR DYNAMICS, 2023, 111 (17) : 16093 - 16110
  • [35] Optimal tracking control of nonlinear partially-unknown constrained-input systems using integral reinforcement learning
    Modares, Hamidreza
    Lewis, Frank L.
    AUTOMATICA, 2014, 50 (07) : 1780 - 1792
  • [36] Optimal Synchronization Control of Heterogeneous Asymmetric Input-Constrained Unknown Nonlinear MASs via Reinforcement Learning
    Xia, Lina
    Li, Qing
    Song, Ruizhuo
    Modares, Hamidreza
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2022, 9 (03) : 520 - 532
  • [37] Optimal Synchronization Control of Heterogeneous Asymmetric Input-Constrained Unknown Nonlinear MASs via Reinforcement Learning
    Lina Xia
    Qing Li
    Ruizhuo Song
    Hamidreza Modares
    IEEE/CAAJournalofAutomaticaSinica, 2022, 9 (03) : 520 - 532
  • [38] Reinforcement learning-based optimal control of unknown constrained-input nonlinear systems using simulated experience
    Hamed Jabbari Asl
    Eiji Uchibe
    Nonlinear Dynamics, 2023, 111 : 16093 - 16110
  • [39] Neural-network-based safe learning control for non-zero-sum differential games of nonlinear systems with asymmetric input constraints
    Qin, Chunbin
    Zhu, Tianzeng
    Jiang, Kaijun
    Wu, Yinliang
    Zhang, Jishi
    APPLIED INTELLIGENCE, 2024, : 7810 - 7828
  • [40] Off-policy reinforcement learning algorithm for robust optimal control of uncertain nonlinear systems
    Amirparast, Ali
    Kamal Hosseini Sani, S.
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2024, 34 (08) : 5419 - 5437