Online Iterative Adaptive Dynamic Programming Approach for Solving the Zero-Sum Game for Nonlinear Continuous-Time Systems with Partially Unknown Dynamics

被引：1

作者：

Fu, Bin ^{[1
]}

Sun, Bo ^{[2
]}

Guo, Hang ^{[1
]}

Yang, Tao ^{[1
]}

Fu, Wenxing ^{[1
]}

机构：

[1] Northwestern Polytech Univ, Unmanned Syst Res Inst, Xian 710072, Shanxi, Peoples R China

[2] Delft Univ Technol, Fac Aerosp Engn, NL-2629 HS Delft, Netherlands

来源：

PROCEEDINGS OF 2022 INTERNATIONAL CONFERENCE ON AUTONOMOUS UNMANNED SYSTEMS, ICAUS 2022 | 2023年 / 1010卷

关键词：

Approximation dynamic programming; Zero-sum game; Integral reinforcement learning; Online learning; Value iteration; REINFORCEMENT; DESIGN;

D O I：

10.1007/978-981-99-0479-2_262

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

The current study presents an online iterative adaptive dynamic programming approach to resolve the zero-sum game (ZSG) for nonlinear continuous-time (CT) systems containing a partially unknown dynamic. The Hamilton-Jacobian-Issacs (HJI) equation is solved along the state trajectory according to the value function approximation and the policy improvement online. Relaxed dynamic programming is utilized to ensure the algorithm's convergence. Model and costate networks were established to conduct the method. Computational simulations are performed to present the efficiency of the algorithm.

引用

页码：2833 / 2842

页数：10

共 50 条

[21] A new approach to solve a class of continuous-time nonlinear quadratic zero-sum game using ADP
Wei, Qinglai
Zhang, Huaguang
PROCEEDINGS OF 2008 IEEE INTERNATIONAL CONFERENCE ON NETWORKING, SENSING AND CONTROL, VOLS 1 AND 2, 2008, : 507 - 512
[22] Continuous-time zero-sum stochastic game with stopping and control
Pal, Chandan
Saha, Subhamay
OPERATIONS RESEARCH LETTERS, 2020, 48 (06) : 715 - 719
[23] Discrete-Time Two-Player Zero-Sum Games for Nonlinear Systems Using Iterative Adaptive Dynamic Programming
Wei, Qinglai
Liu, Derong
ADVANCES IN NEURAL NETWORKS - ISNN 2016, 2016, 9719 : 269 - 276
[24] Online optimal tracking control of continuous-time linear systems with unknown dynamics by using adaptive dynamic programming
Qin, Chunbin
Zhang, Huaguang
Luo, Yanhong
INTERNATIONAL JOURNAL OF CONTROL, 2014, 87 (05) : 1000 - 1009
[25] Online adaptive optimal control for continuous-time nonlinear systems with completely unknown dynamics
Lv, Yongfeng
Na, Jing
Yang, Qinmin
Wu, Xing
Guo, Yu
INTERNATIONAL JOURNAL OF CONTROL, 2016, 89 (01) : 99 - 112
[26] Distributed Zero-Sum Differential Game for Multi-Agent Nonlinear Systems via Adaptive Dynamic Programming
Sun, Jingliang
Liu, Chunsheng
2018 37TH CHINESE CONTROL CONFERENCE (CCC), 2018, : 2770 - 2775
[27] Discrete-time Optimal Zero-sum Games for Nonlinear Systems via Adaptive Dynamic Programming
Wei, Qinglai
Song, Ruizhuo
Xu, Yancai
Liu, Derong
Lin, Qiao
2017 6TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS (DDCLS), 2017, : 357 - 364
[28] Integral Reinforcement Learning for Linear Continuous-Time Zero-Sum Games With Completely Unknown Dynamics
Li, Hongliang
Liu, Derong
Wang, Ding
IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2014, 11 (03) : 706 - 714
[29] Global Adaptive Dynamic Programming for Continuous-Time Nonlinear Systems
Jiang, Yu
Jiang, Zhong-Ping
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2015, 60 (11) : 2917 - 2929
[30] Zero-sum game optimal control for the nonlinear switched systems based on heuristic dynamic programming
Fu, Xingjian
Li, Zizheng
OPTIMAL CONTROL APPLICATIONS & METHODS, 2023, 44 (05): : 2821 - 2837

← 1 2 3 4 5 →