An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games

被引：338
|
作者：
Zhang, Huaguang [1 ]
Wei, Qinglai [2 ]
Liu, Derong [2 ]
机构：
[1] Northeastern Univ, Sch Informat Sci & Engn, Shenyang 110004, Peoples R China
[2] Chinese Acad Sci, Inst Automat, Beijing 100190, Peoples R China
来源：
AUTOMATICA | 2011年 / 47卷 / 01期
基金：
国家高技术研究发展计划(863计划); 北京市自然科学基金; 中国国家自然科学基金;
关键词：
Adaptive critic designs; Adaptive dynamic programming; Approximate dynamic programming; Neural network; Zero-sum differential games; SYSTEMS; EQUATION;
D O I：
10.1016/j.automatica.2010.10.033
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
In this paper, a new iterative adaptive dynamic programming (ADP) method is proposed to solve a class of continuous-time nonlinear two-person zero-sum differential games. The idea is to use the ADP technique to obtain the optimal control pair iteratively which makes the performance index function reach the saddle point of the zero-sum differential games. If the saddle point does not exist, the mixed optimal control pair is obtained to make the performance index function reach the mixed optimum. Stability analysis of the nonlinear systems is presented and the convergence property of the performance index function is also proved. Two simulation examples are given to illustrate the performance of the proposed method. (C) 2010 Elsevier Ltd. All rights reserved.
引用
收藏
页码：207 / 214
页数：8
相关论文
共 50 条
  • [31] Decentralised zero-sum differential game for a class of large-scale interconnected systems via adaptive dynamic programming
    Sun, Jingliang
    Liu, Chunsheng
    INTERNATIONAL JOURNAL OF CONTROL, 2019, 92 (12) : 2917 - 2927
  • [32] Dynamic event-triggered adaptive control for zero-sum games of nonlinear stochastic systems
    Liu, Pengda
    Liu, Zongmin
    Ao, Wengang
    Ming, Zhongyang
    Shi, Peng
    Transactions of the Institute of Measurement and Control, 2023,
  • [33] Model-free Adaptive Dynamic Programming for Online optimal Solution of the Unknown Nonlinear Zero-Sum Differential Game
    Qin, Chunbin
    Zhang, Huaguang
    Luo, Yanhong
    PROCEEDINGS OF THE 2014 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2014, : 3815 - 3820
  • [34] Dynamic event-triggered adaptive control for zero-sum games of nonlinear stochastic systems
    Liu, Pengda
    Liu, Zongmin
    Ao, Wengang
    Ming, Zhongyang
    Shi, Peng
    TRANSACTIONS OF THE INSTITUTE OF MEASUREMENT AND CONTROL, 2023,
  • [35] Zero-sum differential games on the Wasserstein space
    Basar, Tamer
    Moon, Jun
    COMMUNICATIONS IN INFORMATION AND SYSTEMS, 2021, 21 (02) : 219 - 251
  • [36] Approximate Dynamic Programming for Two-Player Zero-Sum Markov Games
    Perolat, Julien
    Scherrer, Bruno
    Piot, Bilal
    Pietquin, Olivier
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 37, 2015, 37 : 1321 - 1329
  • [37] Turnpike Theory for Dynamic Zero-Sum Games
    Zaslavski, Alexander J.
    VARIATIONAL AND OPTIMAL CONTROL PROBLEMS ON UNBOUNDED DOMAIN, 2014, 619 : 225 - 247
  • [38] The Attractor of the Replicator Dynamic in Zero-Sum Games
    Biggar, Oliver
    Shames, Iman
    INTERNATIONAL CONFERENCE ON ALGORITHMIC LEARNING THEORY, VOL 237, 2024, 237
  • [39] Approximations in dynamic zero-sum games II
    Universidad Nacional de Rosario, Rosario, Argentina
    SIAM J Control Optim, 6 (2101-2117):
  • [40] New Algorithms for Solving Zero-Sum Stochastic Games
    Oliu-Barton, Miquel
    MATHEMATICS OF OPERATIONS RESEARCH, 2021, 46 (01) : 255 - 267
12345