Optimal Tracking Control for a Class of Nonlinear Discrete-Time Systems with Time Delays Based on Heuristic Dynamic Programming

被引：162
|
作者：
Zhang, Huaguang [1 ,2 ]
Song, Ruizhuo [1 ]
Wei, Qinglai [3 ]
Zhang, Tieyan [4 ]
机构：
[1] Northeastern Univ, Sch Informat Sci & Engn, Shenyang 110004, Peoples R China
[2] Northeastern Univ, Natl Educ Minist, Key Lab Integrated Automat Proc Ind, Shenyang 110004, Peoples R China
[3] Chinese Acad Sci, Inst Automat, Key Lab Complex Syst & Intelligence Sci, Beijing 100190, Peoples R China
[4] Shenyang Inst Engn, Dept Elect Engn, Shenyang 110136, Peoples R China
来源：
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2011年 / 22卷 / 12期
基金：
中国国家自然科学基金;
关键词：
Adaptive dynamic programming; approximate dynamic programming; heuristic dynamic programming iteration; optimal control; time delays; ZERO-SUM GAMES; NEURAL-NETWORKS; MULTIPLE DELAYS; CONTROLLABILITY; DESIGNS;
D O I：
10.1109/TNN.2011.2172628
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
In this paper, a novel heuristic dynamic programming (HDP) iteration algorithm is proposed to solve the optimal tracking control problem for a class of nonlinear discrete-time systems with time delays. The novel algorithm contains state updating, control policy iteration, and performance index iteration. To get the optimal states, the states are also updated. Furthermore, the "backward iteration" is applied to state updating. Two neural networks are used to approximate the performance index function and compute the optimal control policy for facilitating the implementation of HDP iteration algorithm. At last, we present two examples to demonstrate the effectiveness of the proposed HDP iteration algorithm.
引用
收藏
页码：1851 / 1862
页数：12
相关论文
共 50 条
  • [21] Online optimal control of nonlinear discrete-time systems using approximate dynamic programming
    Dierks T.
    Jagannathan S.
    Journal of Control Theory and Applications, 2011, 9 (3): : 361 - 369
  • [22] An optimal Control regulator for nonlinear discrete-time systems with input delays
    Wang, Hai-Hong
    Hu, Nai-Ping
    Zhang, Bao-Lin
    2008 7TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION, VOLS 1-23, 2008, : 5540 - +
  • [23] Approximate Optimal Tracking Control for a Class of Discrete-time Nonlinear Systems based on GDHP Iterative Algorithm
    Tan, Xufeng
    Li, Yuan
    Liu, Yang
    2022 34TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2022, : 1932 - 1937
  • [24] Iterative GDHP-based approximate optimal tracking control for a class of discrete-time nonlinear systems
    Mu, Chaoxu
    Sun, Changyin
    Song, Aiguo
    Yu, Hualong
    NEUROCOMPUTING, 2016, 214 : 775 - 784
  • [25] A novel adaptive dynamic programming based on tracking error for nonlinear discrete-time systems
    Li, Chun
    Ding, Jinliang
    Lewis, Frank L.
    Chai, Tianyou
    AUTOMATICA, 2021, 129
  • [26] Online optimal control of unknown discrete-time nonlinear systems by using time-based adaptive dynamic programming
    Xiao, Geyang
    Zhang, Huaguang
    Luo, Yanhong
    NEUROCOMPUTING, 2015, 165 : 163 - 170
  • [27] Adaptive Dynamic Programming-based Optimal Control of Unknown Affine Nonlinear Discrete-time Systems
    Dierks, Travis
    Thumati, Balaje T.
    Jagannathan, S.
    IJCNN: 2009 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1- 6, 2009, : 1368 - 1373
  • [28] ADP based optimal tracking control for a class of linear discrete-time system with multiple delays
    Liu, Yang
    Zhang, Huaguang
    Luo, Yanhong
    Han, Jian
    JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2016, 353 (09): : 2117 - 2136
  • [29] Data-Based Adaptive Dynamic Programming for a Class of Discrete-Time Systems With Multiple Delays
    Zhang, Huaguang
    Liu, Yang
    Xiao, Geyang
    Jiang, He
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2020, 50 (02): : 432 - 441
  • [30] Approximately Optimal Control of Discrete-Time Nonlinear Switched Systems Using Globalized Dual Heuristic Programming
    Mu, Chaoxu
    Liao, Kaiju
    Ren, Ling
    Gao, Zhongke
    NEURAL PROCESSING LETTERS, 2020, 52 (02) : 1089 - 1108
12345