Optimal Tracking Control for a Class of Nonlinear Discrete-Time Systems with Time Delays Based on Heuristic Dynamic Programming

被引：162
|
作者：
Zhang, Huaguang [1 ,2 ]
Song, Ruizhuo [1 ]
Wei, Qinglai [3 ]
Zhang, Tieyan [4 ]
机构：
[1] Northeastern Univ, Sch Informat Sci & Engn, Shenyang 110004, Peoples R China
[2] Northeastern Univ, Natl Educ Minist, Key Lab Integrated Automat Proc Ind, Shenyang 110004, Peoples R China
[3] Chinese Acad Sci, Inst Automat, Key Lab Complex Syst & Intelligence Sci, Beijing 100190, Peoples R China
[4] Shenyang Inst Engn, Dept Elect Engn, Shenyang 110136, Peoples R China
来源：
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2011年 / 22卷 / 12期
基金：
中国国家自然科学基金;
关键词：
Adaptive dynamic programming; approximate dynamic programming; heuristic dynamic programming iteration; optimal control; time delays; ZERO-SUM GAMES; NEURAL-NETWORKS; MULTIPLE DELAYS; CONTROLLABILITY; DESIGNS;
D O I：
10.1109/TNN.2011.2172628
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
In this paper, a novel heuristic dynamic programming (HDP) iteration algorithm is proposed to solve the optimal tracking control problem for a class of nonlinear discrete-time systems with time delays. The novel algorithm contains state updating, control policy iteration, and performance index iteration. To get the optimal states, the states are also updated. Furthermore, the "backward iteration" is applied to state updating. Two neural networks are used to approximate the performance index function and compute the optimal control policy for facilitating the implementation of HDP iteration algorithm. At last, we present two examples to demonstrate the effectiveness of the proposed HDP iteration algorithm.
引用
收藏
页码：1851 / 1862
页数：12
相关论文
共 50 条
  • [1] An optimal control scheme for a class of discrete-time nonlinear systems with time delays using adaptive dynamic programming
    Wei Q.-L.
    Zhang H.-G.
    Liu D.-R.
    Zhao Y.
    Zidonghua Xuebao/ Acta Automatica Sinica, 2010, 36 (01): : 121 - 129
  • [2] Optimal tracking control of a class of nonlinear discrete-time switched systems using adaptive dynamic programming
    Qin, Chunbin
    Zhang, Huaguang
    Luo, Yanhong
    NEURAL COMPUTING & APPLICATIONS, 2014, 24 (3-4): : 531 - 538
  • [3] Optimal tracking control of a class of nonlinear discrete-time switched systems using adaptive dynamic programming
    Chunbin Qin
    Huaguang Zhang
    Yanhong Luo
    Neural Computing and Applications, 2014, 24 : 531 - 538
  • [4] Multi-step heuristic dynamic programming for optimal control of nonlinear discrete-time systems
    Luo, Biao
    Liu, Derong
    Huang, Tingwen
    Yang, Xiong
    Ma, Hongwen
    INFORMATION SCIENCES, 2017, 411 : 66 - 83
  • [5] The Optimal Control of Discrete-Time Delay Nonlinear System with Dual Heuristic Dynamic Programming
    Wang, Bin
    Zhao, Dongbin
    NEURAL INFORMATION PROCESSING, ICONIP 2012, PT I, 2012, 7663 : 664 - 672
  • [6] Dual iterative adaptive dynamic programming for a class of discrete-time nonlinear systems with time-delays
    Wei, Qinglai
    Wang, Ding
    Zhang, Dehua
    NEURAL COMPUTING & APPLICATIONS, 2013, 23 (7-8): : 1851 - 1863
  • [7] Dual iterative adaptive dynamic programming for a class of discrete-time nonlinear systems with time-delays
    Qinglai Wei
    Ding Wang
    Dehua Zhang
    Neural Computing and Applications, 2013, 23 : 1851 - 1863
  • [8] Finite Horizon Optimal Tracking Control for a Class of Discrete-Time Nonlinear Systems
    Wei, Qinglai
    Wang, Ding
    Liu, Derong
    ADVANCES IN NEURAL NETWORKS - ISNN 2011, PT II, 2011, 6676 : 620 - 629
  • [9] Approximate Optimal tracking Control for Nonlinear Discrete-time Switched Systems via Approximate Dynamic Programming
    Qin, Chunbin
    Huang, Yizhe
    Yang, Yabin
    Zhang, Jishi
    Liu, Xianxing
    PROCEEDINGS OF THE 2019 31ST CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2019), 2019, : 1456 - 1461
  • [10] Data-driven optimal tracking control for discrete-time systems with delays using adaptive dynamic programming
    Liu, Yang
    Zhang, Huaguang
    Yu, Rui
    Qu, Qiuxia
    JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2018, 355 (13): : 5649 - 5666
12345