Safe optimal robust control of nonlinear systems with asymmetric input constraints using reinforcement learning

被引:0
|
作者
Zhang, Dehua [1 ]
Wang, Yuchen [1 ]
Jiang, Kaijun [1 ]
Liang, Linlin [2 ]
机构
[1] Henan Univ, Sch Artificial Intelligence, Zhengzhou 450000, Peoples R China
[2] Xidian Univ, Sch Cyber Engn, Xian 710126, Peoples R China
基金
中国国家自然科学基金;
关键词
Safety; Optimal robust control; Asymmetric input constraints; Adaptive dynamic programming (ADP); Nonlinear systems;
D O I
10.1007/s10489-023-05184-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
External disturbances and asymmetric input constraints may cause a major problem to the optimal control of the system. Aiming at such problem, this article presents a safe and optimal robust control method based on adaptive dynamic programming (ADP) to ensure the system operated in a safe region and with the optimal performance. Initially, a novel nonquadratic form cost function is imported for the system to address the asymmetric input constraints. Then, to ensure the safety of the system, a control barrier function (CBF) is appended to the cost function to penalize the unsafe behavior. And a damping factor is also introduced to the CBF to balance safety and optimality. Finally, one single critic network is utilized to simplify the complex computational steps, which is different from the traditional actor-critic networks to address the Hamilton-Jacobi-Bellman Equation (HJBE) for obtaining the optimal neural controller. Additionally, based on Lyapunov method, all signals in the closed-loop system are proven to be uniformly ultimately bounded (UUB). At last, the experimental results confirm the effectiveness of the designed approach.
引用
收藏
页码:1 / 13
页数:13
相关论文
共 50 条
  • [11] Reinforcement learning-based output feedback control of nonlinear systems with input constraints
    He, P
    Jagannathan, S
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2005, 35 (01): : 150 - 154
  • [12] Reinforcement learning-based output feedback control of nonlinear systems with input constraints
    He, P
    Jagannathan, S
    PROCEEDINGS OF THE 2004 AMERICAN CONTROL CONFERENCE, VOLS 1-6, 2004, : 2563 - 2568
  • [13] Variable gain gradient descent-based reinforcement learning for robust optimal tracking control of uncertain nonlinear system with input constraints
    Mishra, Amardeep
    Ghosh, Satadal
    NONLINEAR DYNAMICS, 2022, 107 (03) : 2195 - 2214
  • [14] Variable gain gradient descent-based reinforcement learning for robust optimal tracking control of uncertain nonlinear system with input constraints
    Amardeep Mishra
    Satadal Ghosh
    Nonlinear Dynamics, 2022, 107 : 2195 - 2214
  • [15] Reinforcement Learning-Based Adaptive Optimal Control for Nonlinear Systems With Asymmetric Hysteresis
    Zheng, Licheng
    Liu, Zhi
    Wang, Yaonan
    Chen, C. L. Philip
    Zhang, Yun
    Wu, Zongze
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (11) : 15800 - 15809
  • [16] Combining hybrid metaheuristic algorithms and reinforcement learning to improve the optimal control of nonlinear continuous-time systems with input constraints
    Amirabadi, Roya Khalili
    Fard, Omid Solaymani
    COMPUTERS & ELECTRICAL ENGINEERING, 2024, 116
  • [17] Reinforcement learning-based robust optimal tracking control for disturbed nonlinear systems
    Zhong-Xin Fan
    Lintao Tang
    Shihua Li
    Rongjie Liu
    Neural Computing and Applications, 2023, 35 : 23987 - 23996
  • [18] Reinforcement learning-based robust optimal tracking control for disturbed nonlinear systems
    Fan, Zhong-Xin
    Tang, Lintao
    Li, Shihua
    Liu, Rongjie
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (33): : 23987 - 23996
  • [19] An analytical approach to optimal control of nonlinear systems with input constraints
    Gharamaleki, Reza Mojed
    Mirzaei, Mehdi
    Rafatnia, Sadra
    Alizadeh, Behrooz
    INTERNATIONAL JOURNAL OF AUTOMATION AND CONTROL, 2020, 14 (02) : 213 - 238
  • [20] An analytical approach to optimal control of nonlinear systems with input constraints
    Gharamaleki R.M.
    Mirzaei M.
    Rafatnia S.
    Alizadeh B.
    Int. J. Autom. Control, 2020, 2 (213-238): : 213 - 238