An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games

被引:338
|
作者
Zhang, Huaguang [1 ]
Wei, Qinglai [2 ]
Liu, Derong [2 ]
机构
[1] Northeastern Univ, Sch Informat Sci & Engn, Shenyang 110004, Peoples R China
[2] Chinese Acad Sci, Inst Automat, Beijing 100190, Peoples R China
基金
国家高技术研究发展计划(863计划); 北京市自然科学基金; 中国国家自然科学基金;
关键词
Adaptive critic designs; Adaptive dynamic programming; Approximate dynamic programming; Neural network; Zero-sum differential games; SYSTEMS; EQUATION;
D O I
10.1016/j.automatica.2010.10.033
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, a new iterative adaptive dynamic programming (ADP) method is proposed to solve a class of continuous-time nonlinear two-person zero-sum differential games. The idea is to use the ADP technique to obtain the optimal control pair iteratively which makes the performance index function reach the saddle point of the zero-sum differential games. If the saddle point does not exist, the mixed optimal control pair is obtained to make the performance index function reach the mixed optimum. Stability analysis of the nonlinear systems is presented and the convergence property of the performance index function is also proved. Two simulation examples are given to illustrate the performance of the proposed method. (C) 2010 Elsevier Ltd. All rights reserved.
引用
收藏
页码:207 / 214
页数:8
相关论文
共 50 条
  • [21] Policy gradient adaptive dynamic programming for nonlinear discrete-time zero-sum games with unknown dynamics
    Mingduo Lin
    Bo Zhao
    Derong Liu
    Soft Computing, 2023, 27 : 5781 - 5795
  • [22] Policy gradient adaptive dynamic programming for nonlinear discrete-time zero-sum games with unknown dynamics
    Lin, Mingduo
    Zhao, Bo
    Liu, Derong
    SOFT COMPUTING, 2023, 27 (09) : 5781 - 5795
  • [23] A WEAK DYNAMIC PROGRAMMING PRINCIPLE FOR ZERO-SUM STOCHASTIC DIFFERENTIAL GAMES WITH UNBOUNDED CONTROLS
    Bayraktar, Erhan
    Yao, Song
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2013, 51 (03) : 2036 - 2080
  • [24] Online Iterative Adaptive Dynamic Programming Approach for Solving the Zero-Sum Game for Nonlinear Continuous-Time Systems with Partially Unknown Dynamics
    Fu, Bin
    Sun, Bo
    Guo, Hang
    Yang, Tao
    Fu, Wenxing
    PROCEEDINGS OF 2022 INTERNATIONAL CONFERENCE ON AUTONOMOUS UNMANNED SYSTEMS, ICAUS 2022, 2023, 1010 : 2833 - 2842
  • [25] Iteration Algorithm for Solving the Optimal Strategies of a Class of Nonaffine Nonlinear Quadratic Zero-sum Games
    Zhang, Xin
    Zhang, Huaguang
    Luo, Yanhong
    Dong, Meng
    2010 CHINESE CONTROL AND DECISION CONFERENCE, VOLS 1-5, 2010, : 1359 - 1364
  • [26] Zero-sum Differential Games Guidance Law Accounting for Impact-Angle-Constrained Using Adaptive Dynamic Programming
    Zhang, Xue
    Wang, Qi
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2025, 111 (01)
  • [27] Distributed Zero-Sum Differential Game for Multi-Agent Nonlinear Systems via Adaptive Dynamic Programming
    Sun, Jingliang
    Liu, Chunsheng
    2018 37TH CHINESE CONTROL CONFERENCE (CCC), 2018, : 2770 - 2775
  • [28] Convexity in zero-sum differential games
    Goebel, R
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2002, 40 (05) : 1491 - 1504
  • [29] Convexity in zero-sum differential games
    Goebel, R
    PROCEEDINGS OF THE 41ST IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-4, 2002, : 3964 - 3969
  • [30] A Note on Dynamic Zero-sum Games
    Zhang, Xiao-yan
    CCDC 2009: 21ST CHINESE CONTROL AND DECISION CONFERENCE, VOLS 1-6, PROCEEDINGS, 2009, : 4758 - 4760