Optimal control of unknown nonaffine nonlinear discrete-time systems based on adaptive dynamic programming

被引：333
|
作者：
Wang, Ding [1 ]
Liu, Derong [1 ]
Wei, Qinglai [1 ]
Zhao, Dongbin [1 ]
Jin, Ning [2 ]
机构：
[1] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
[2] Univ Illinois, Dept Elect & Comp Engn, Chicago, IL 60607 USA
来源：
AUTOMATICA | 2012年 / 48卷 / 08期
基金：
中国国家自然科学基金; 北京市自然科学基金;
关键词：
Adaptive critic designs; Adaptive dynamic programming; Approximate dynamic programming; Globalized dual heuristic programming; Intelligent control; Neural network; Optimal control; FEEDBACK-CONTROL; REINFORCEMENT; ADP;
D O I：
10.1016/j.automatica.2012.05.049
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
An intelligent-optimal control scheme for unknown nonaffine nonlinear discrete-time systems with discount factor in the cost function is developed in this paper. The iterative adaptive dynamic programming algorithm is introduced to solve the optimal control problem with convergence analysis. Then, the implementation of the iterative algorithm via globalized dual heuristic programming technique is presented by using three neural networks, which will approximate at each iteration the cost function, the control law, and the unknown nonlinear system, respectively. In addition, two simulation examples are provided to verify the effectiveness of the developed optimal control approach. (C) 2012 Elsevier Ltd. All rights reserved.
引用
收藏
页码：1825 / 1832
页数：8
相关论文
共 50 条
  • [31] MRAC for unknown discrete-time nonlinear systems based on supervised neural dynamic programming
    Fu, Hao
    Chen, Xin
    Wang, Wei
    Wu, Min
    NEUROCOMPUTING, 2020, 384 : 130 - 141
  • [32] A discrete-time multivariable neuro-adaptive control for nonlinear unknown dynamic systems
    Hwang, CL
    Lin, CH
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2000, 30 (06): : 865 - 877
  • [33] Twin Deterministic Policy Gradient Adaptive Dynamic Programming for Optimal Control of Affine Nonlinear Discrete-time Systems
    Xu, Jiahui
    Wang, Jingcheng
    Rao, Jun
    Zhong, Yanjiu
    Zhao, Shangwei
    INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2022, 20 (09) : 3098 - 3109
  • [34] Adaptive Dynamic Programming for Finite-Horizon Optimal Control of Discrete-Time Nonlinear Systems with ε-Error Bound
    Wang, Fei-Yue
    Jin, Ning
    Liu, Derong
    Wei, Qinglai
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2011, 22 (01): : 24 - 36
  • [35] Policy Optimization Adaptive Dynamic Programming for Optimal Control of Input-Affine Discrete-Time Nonlinear Systems
    Lin, Mingduo
    Zhao, Bo
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2023, 53 (07): : 4339 - 4350
  • [36] Twin Deterministic Policy Gradient Adaptive Dynamic Programming for Optimal Control of Affine Nonlinear Discrete-time Systems
    Jiahui Xu
    Jingcheng Wang
    Jun Rao
    Yanjiu Zhong
    Shangwei Zhao
    International Journal of Control, Automation and Systems, 2022, 20 : 3098 - 3109
  • [37] Optimal output tracking control of linear discrete-time systems with unknown dynamics by adaptive dynamic programming and output feedback
    Cai, Xuan
    Wang, Chaoli
    Liu, Shuxin
    Chen, Guochu
    Wang, Gang
    INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2022, 53 (16) : 3426 - 3448
  • [38] Online optimal control of nonlinear discrete-time systems using approximate dynamic programming
    Travis DIERKS
    Sarangapani JAGANNATHAN
    JournalofControlTheoryandApplications, 2011, 9 (03) : 361 - 369
  • [39] Online optimal control of nonlinear discrete-time systems using approximate dynamic programming
    Dierks T.
    Jagannathan S.
    Journal of Control Theory and Applications, 2011, 9 (3): : 361 - 369
  • [40] Optimal Tracking Control for a Class of Nonlinear Discrete-Time Systems with Time Delays Based on Heuristic Dynamic Programming
    Zhang, Huaguang
    Song, Ruizhuo
    Wei, Qinglai
    Zhang, Tieyan
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2011, 22 (12): : 1851 - 1862
12345