Neural network based tracking control for an elastic joint robot with input constraint via actor-critic design

被引:34
|
作者
Ouyang, Yuncheng [1 ,2 ]
Dong, Lu [3 ]
Wei, Yanling [1 ,2 ]
Sun, Changyin [1 ,2 ]
机构
[1] Southeast Univ, Sch Automat, Minist Educ, Nanjing 210096, Peoples R China
[2] Southeast Univ, Key Lab Measurement & Control Complex Syst Engn, Minist Educ, Nanjing 210096, Peoples R China
[3] Tongji Univ, Coll Elect & Informat Engn, Shanghai 201804, Peoples R China
基金
中国国家自然科学基金;
关键词
Elastic joint robot; Neural networks; Actor-critic design; Adaptive control; Input constraint; SYSTEMS;
D O I
10.1016/j.neucom.2020.05.067
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, adaptive control with actor-critic design is proposed for an elastic joint robot to cope with the tracking problems. In the critic network, a cost function is used to judge the control performance. Since it is unmeasurable and cannot be calculated, a neural network is utilized to approximate it. In the actor network, based on the critic results as the reinforcement signal, another neural network is used to cope with the system uncertainties and generate the control input. Furthermore, input constraint is imposed on the elastic joint robot to guarantee the normal operation. A high gain observer is also adopted to estimate the unmeasurable variables. With the given adaptive laws of the critic neural network and actor neural network, through the Lyapunov direct method, the stability and convergence of the closed-loop system are achieved and the tracking errors are ultimately uniformly bounded. In addition, simulations are also conducted on a two-link elastic joint robot to illustrate the feasibility and effectiveness of the proposed adaptive constrained actor-critic learning based control. (C) 2020 Published by Elsevier B.V.
引用
收藏
页码:286 / 295
页数:10
相关论文
共 50 条
  • [21] A two-layer networked learning control system using actor-critic neural network
    Du, Dajun
    Fei, Minrui
    APPLIED MATHEMATICS AND COMPUTATION, 2008, 205 (01) : 26 - 36
  • [22] Tracking control design for robot manipulator via fuzzy neural network
    Wai, RJ
    Hsieh, KY
    PROCEEDINGS OF THE 2002 IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS, VOL 1 & 2, 2002, : 1422 - 1427
  • [23] Design and Implementation of an Adaptive Cruise Control System Based on Supervised Actor-Critic Learning
    Wang, Bin
    Zhao, Dongbin
    Li, Chengdong
    Dai, Yujie
    2015 5TH INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND TECHNOLOGY (ICIST), 2015, : 243 - 248
  • [24] Reinforcement Learning of an Interpretable Fuzzy System Through a Neural Fuzzy Actor-Critic Framework for Mobile Robot Control
    Juang, Chia-Feng
    You, Zhoa-Boa
    IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2024, 32 (06) : 3655 - 3668
  • [25] Path Planning and Tracking Control for Parking via Soft Actor-Critic Under Non-Ideal Scenarios
    Tang, Xiaolin
    Yang, Yuyou
    Liu, Teng
    Lin, Xianke
    Yang, Kai
    Li, Shen
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2024, 11 (01) : 181 - 195
  • [26] Discrete-Time Lyapunov based Kinematic Control of Robot Manipulator using Actor-Critic Framework
    Kamboj, Ankur
    Prakash, Ravi
    Mohanta, Jayant Kumar
    Behera, Laxmidhar
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [27] Trajectory Tracking Control for Robotic Manipulator Based on Soft Actor-Critic and Generative Adversarial Imitation Learning
    Hu, Jintao
    Wang, Fujie
    Li, Xing
    Qin, Yi
    Guo, Fang
    Jiang, Ming
    BIOMIMETICS, 2024, 9 (12)
  • [28] Path Planning and Tracking Control for Parking via Soft Actor-Critic Under Non-Ideal Scenarios
    Xiaolin Tang
    Yuyou Yang
    Teng Liu
    Xianke Lin
    Kai Yang
    Shen Li
    IEEE/CAA Journal of Automatica Sinica, 2024, 11 (01) : 181 - 195
  • [29] Design of Observer-Based Control With Residual Generator Using Actor-Critic Reinforcement Learning
    Qian L.
    Zhao X.
    Liu P.
    Zhang Z.
    Lv Y.
    IEEE Transactions on Artificial Intelligence, 2023, 4 (04): : 734 - 743
  • [30] Adaptive Actor-Critic Design-Based Integral Sliding-Mode Control for Partially Unknown Nonlinear Systems With Input Disturbances
    Fan, Quan-Yong
    Yang, Guang-Hong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2016, 27 (01) : 165 - 177