Neural network based tracking control for an elastic joint robot with input constraint via actor-critic design

被引:34
|
作者
Ouyang, Yuncheng [1 ,2 ]
Dong, Lu [3 ]
Wei, Yanling [1 ,2 ]
Sun, Changyin [1 ,2 ]
机构
[1] Southeast Univ, Sch Automat, Minist Educ, Nanjing 210096, Peoples R China
[2] Southeast Univ, Key Lab Measurement & Control Complex Syst Engn, Minist Educ, Nanjing 210096, Peoples R China
[3] Tongji Univ, Coll Elect & Informat Engn, Shanghai 201804, Peoples R China
基金
中国国家自然科学基金;
关键词
Elastic joint robot; Neural networks; Actor-critic design; Adaptive control; Input constraint; SYSTEMS;
D O I
10.1016/j.neucom.2020.05.067
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, adaptive control with actor-critic design is proposed for an elastic joint robot to cope with the tracking problems. In the critic network, a cost function is used to judge the control performance. Since it is unmeasurable and cannot be calculated, a neural network is utilized to approximate it. In the actor network, based on the critic results as the reinforcement signal, another neural network is used to cope with the system uncertainties and generate the control input. Furthermore, input constraint is imposed on the elastic joint robot to guarantee the normal operation. A high gain observer is also adopted to estimate the unmeasurable variables. With the given adaptive laws of the critic neural network and actor neural network, through the Lyapunov direct method, the stability and convergence of the closed-loop system are achieved and the tracking errors are ultimately uniformly bounded. In addition, simulations are also conducted on a two-link elastic joint robot to illustrate the feasibility and effectiveness of the proposed adaptive constrained actor-critic learning based control. (C) 2020 Published by Elsevier B.V.
引用
收藏
页码:286 / 295
页数:10
相关论文
共 50 条
  • [1] Optimal Tracking Control for Robotic Manipulator using Actor-Critic Network
    Hu, Yong
    Cui, Lingguo
    Chai, Senchun
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 1556 - 1561
  • [2] Adaptive Neural network control of a helicopter system with optimal observer and actor-critic design
    Hager, LvS
    Uren, K. R.
    van Schoor, G.
    van Rensburg, A. Janse
    NEUROCOMPUTING, 2018, 302 : 75 - 90
  • [3] Model-Based Actor-Critic Learning for Optimal Tracking Control of Robots With Input Saturation
    Zhao, Xingwei
    Tao, Bo
    Qian, Lu
    Ding, Han
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2021, 68 (06) : 5046 - 5056
  • [4] Speed Tracking Control via Online Continuous Actor-Critic learning
    Huang, Zhenhua
    Xu, Xin
    Sun, Zhenping
    Tan, Jun
    Qian, Lilin
    PROCEEDINGS OF THE 35TH CHINESE CONTROL CONFERENCE 2016, 2016, : 3172 - 3177
  • [5] Actor-Critic Neural Network Reinforcement Learning for Walking Control of a 5-Link Bipedal Robot
    Vaghei, Yasaman
    Ghanbari, Ahmad
    Noorani, Sayyed Mohammad Reza Sayyed
    2014 SECOND RSI/ISM INTERNATIONAL CONFERENCE ON ROBOTICS AND MECHATRONICS (ICROM), 2014, : 773 - 778
  • [6] Tracking control of AUV via novel soft actor-critic and suboptimal demonstrations
    Zhang, Yue
    Zhang, Tianze
    Li, Yibin
    Zhuang, Yinghao
    OCEAN ENGINEERING, 2024, 293
  • [7] Actor-Critic Neural Network Based Finite-time Control for Uncertain Robotic Systems
    Lei, Changyi
    5TH INTERNATIONAL CONFERENCE ON INFORMATION SYSTEM AND DATA MINING (ICISDM 2021), 2021, : 34 - 40
  • [8] Development and Validation of Active Roll Control based on Actor-critic Neural Network Reinforcement Learning
    Bahr, Matthias
    Reicherts, Sebastian
    Sieberg, Philipp
    Morss, Luca
    Schramm, Dieter
    SIMULTECH: PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON SIMULATION AND MODELING METHODOLOGIES, TECHNOLOGIES AND APPLICATIONS, 2019, 2019, : 36 - 46
  • [9] Quantization-Based Adaptive Actor-Critic Tracking Control With Tracking Error Constraints
    Fan, Quan-Yong
    Yang, Guang-Hong
    Ye, Dan
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (04) : 970 - 980
  • [10] Optimized Backstepping Design for Ship Course Following Control Based on Actor-Critic Architecture With Input Saturation
    Bai, Yuming
    Cao, Yuchi
    Li, Tieshan
    IEEE ACCESS, 2019, 7 : 73516 - 73528