Safe optimal robust control of nonlinear systems with asymmetric input constraints using reinforcement learning

被引:0
|
作者
Zhang, Dehua [1 ]
Wang, Yuchen [1 ]
Jiang, Kaijun [1 ]
Liang, Linlin [2 ]
机构
[1] Henan Univ, Sch Artificial Intelligence, Zhengzhou 450000, Peoples R China
[2] Xidian Univ, Sch Cyber Engn, Xian 710126, Peoples R China
基金
中国国家自然科学基金;
关键词
Safety; Optimal robust control; Asymmetric input constraints; Adaptive dynamic programming (ADP); Nonlinear systems;
D O I
10.1007/s10489-023-05184-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
External disturbances and asymmetric input constraints may cause a major problem to the optimal control of the system. Aiming at such problem, this article presents a safe and optimal robust control method based on adaptive dynamic programming (ADP) to ensure the system operated in a safe region and with the optimal performance. Initially, a novel nonquadratic form cost function is imported for the system to address the asymmetric input constraints. Then, to ensure the safety of the system, a control barrier function (CBF) is appended to the cost function to penalize the unsafe behavior. And a damping factor is also introduced to the CBF to balance safety and optimality. Finally, one single critic network is utilized to simplify the complex computational steps, which is different from the traditional actor-critic networks to address the Hamilton-Jacobi-Bellman Equation (HJBE) for obtaining the optimal neural controller. Additionally, based on Lyapunov method, all signals in the closed-loop system are proven to be uniformly ultimately bounded (UUB). At last, the experimental results confirm the effectiveness of the designed approach.
引用
收藏
页码:1 / 13
页数:13
相关论文
共 50 条
  • [41] Adaptive Dynamic Programming for Robust Event-Driven Tracking Control of Nonlinear Systems With Asymmetric Input Constraints
    Yang, Xiong
    Wei, Qinglai
    IEEE TRANSACTIONS ON CYBERNETICS, 2024, 54 (11) : 6333 - 6344
  • [42] Reinforcement learning based optimal synchronization control for multi-agent systems with input constraints using vanishing viscosity method
    Zhang, Dianfeng
    Yao, Ying
    Wu, Zhaojing
    INFORMATION SCIENCES, 2023, 637
  • [43] Reinforcement learning based optimal synchronization control for multi-agent systems with input constraints using vanishing viscosity method
    Zhang, Dianfeng
    Yao, Ying
    Wu, Zhaojing
    Information Sciences, 2023, 637
  • [44] Nonlinear Optimal Control Using Deep Reinforcement Learning
    Bucci, Michele Alessandro
    Semeraro, Onofrio
    Allauzen, Alexandre
    Cordier, Laurent
    Mathelin, Lionel
    IUTAM LAMINAR-TURBULENT TRANSITION, 2022, 38 : 279 - 290
  • [45] Robust relatively optimal trajectory tracking control for a class of uncertain nonlinear control affine systems with state and input constraints
    Nidya, M., V
    Mija, S. J.
    Jeevamma, Jacob
    NONLINEAR DYNAMICS, 2022, 110 (04) : 3513 - 3534
  • [46] Robust relatively optimal trajectory tracking control for a class of uncertain nonlinear control affine systems with state and input constraints
    M. V. Nidya
    S. J. Mija
    Jacob Jeevamma
    Nonlinear Dynamics, 2022, 110 : 3513 - 3534
  • [47] Reinforcement learning for adaptive optimal control of unknown continuous-time nonlinear systems with input constraints (vol 87, pg 553, 2014)
    Yang, Xiong
    Liu, Derong
    Wang, Ding
    INTERNATIONAL JOURNAL OF CONTROL, 2014, 87 (03) : I - I
  • [48] Optimal tracking control based on reinforcement learning value iteration algorithm for time-delayed nonlinear systems with external disturbances and input constraints
    Mohammadi, Mehdi
    Arefi, Mohammad Mehdi
    Setoodeh, Peyman
    Kaynak, Okyay
    INFORMATION SCIENCES, 2021, 554 : 84 - 98
  • [49] Improved off-policy reinforcement learning algorithm for robust control of unmodeled nonlinear system with asymmetric state constraints
    Zhang, Yong
    Mu, Chaoxu
    Feng, Yanghe
    Zhao, Zhijia
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2023, 33 (03) : 1607 - 1632
  • [50] Optimal Output Feedback Control of Nonlinear Partially-Unknown Constrained-Input Systems Using Integral Reinforcement Learning
    Ren, Ling
    Zhang, Guoshan
    Mu, Chaoxu
    NEURAL PROCESSING LETTERS, 2019, 50 (03) : 2963 - 2989