An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games

被引：338
|
作者：
Zhang, Huaguang [1 ]
Wei, Qinglai [2 ]
Liu, Derong [2 ]
机构：
[1] Northeastern Univ, Sch Informat Sci & Engn, Shenyang 110004, Peoples R China
[2] Chinese Acad Sci, Inst Automat, Beijing 100190, Peoples R China
来源：
AUTOMATICA | 2011年 / 47卷 / 01期
基金：
国家高技术研究发展计划(863计划); 北京市自然科学基金; 中国国家自然科学基金;
关键词：
Adaptive critic designs; Adaptive dynamic programming; Approximate dynamic programming; Neural network; Zero-sum differential games; SYSTEMS; EQUATION;
D O I：
10.1016/j.automatica.2010.10.033
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
In this paper, a new iterative adaptive dynamic programming (ADP) method is proposed to solve a class of continuous-time nonlinear two-person zero-sum differential games. The idea is to use the ADP technique to obtain the optimal control pair iteratively which makes the performance index function reach the saddle point of the zero-sum differential games. If the saddle point does not exist, the mixed optimal control pair is obtained to make the performance index function reach the mixed optimum. Stability analysis of the nonlinear systems is presented and the convergence property of the performance index function is also proved. Two simulation examples are given to illustrate the performance of the proposed method. (C) 2010 Elsevier Ltd. All rights reserved.
引用
收藏
页码：207 / 214
页数：8
相关论文
共 50 条
  • [1] Nonlinear Multi-Person Zero-Sum Differential Games Using Iterative Adaptive Dynamic Programming
    Wei Qinglai
    Liu Derong
    2011 30TH CHINESE CONTROL CONFERENCE (CCC), 2011, : 2456 - 2461
  • [2] Event-triggered adaptive dynamic programming algorithm for the nonlinear zero-sum differential games
    Cui L.-L.
    Zhang Y.
    Zhang X.
    Cui, Li-Li (cuilili8396@163.com), 2018, South China University of Technology (35): : 610 - 618
  • [3] Zero-Sum Differential Games for Nonlinear Systems Using Adaptive Dynamic Programming with Input Constraint
    Sun, Jingliang
    Liu, Chunsheng
    PROCEEDINGS OF THE 36TH CHINESE CONTROL CONFERENCE (CCC 2017), 2017, : 2501 - 2506
  • [4] Iterative Adaptive Dynamic Programming for Solving Unknown Nonlinear Zero-Sum Game Based on Online Data
    Zhu, Yuanheng
    Zhao, Dongbin
    Li, Xiangjun
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (03) : 714 - 725
  • [5] Output feedback adaptive dynamic programming for linear differential zero-sum games
    Rizvi, Syed Ali Asad
    Lin, Zongli
    Brown, Charles L.
    AUTOMATICA, 2020, 122
  • [6] Min-max adaptive dynamic programming for zero-sum differential games
    Sarbaz, Mohammad
    Sun, Wei
    INTERNATIONAL JOURNAL OF CONTROL, 2024, 97 (12) : 2886 - 2895
  • [7] Differential dynamic programming for finite-horizon zero-sum differential games of nonlinear systems
    Zhang, Bin
    Jia, Yingmin
    Zhang, Yuqi
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2023, 33 (18) : 11062 - 11084
  • [8] A Single-NN Iterative Adaptive Dynamic Programming Algorithm for Continuous-Time Nonlinear Zero-Sum Games
    Song, Ruizhuo
    Li, Junsong
    2018 37TH CHINESE CONTROL CONFERENCE (CCC), 2018, : 2848 - 2853
  • [9] Robust adaptive dynamic programming for a zero-sum differential game
    Yuan, Binbin
    Lu, Pingli
    Liu, Xiangdong
    Bian, Tao
    2015 34TH CHINESE CONTROL CONFERENCE (CCC), 2015, : 2468 - 2473
  • [10] Adaptive Dynamic Programming for Discrete-Time Zero-Sum Games
    Wei, Qinglai
    Liu, Derong
    Lin, Qiao
    Song, Ruizhuo
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (04) : 957 - 969
12345