Optimal Consensus Control Design for Multiagent Systems With Multiple Time Delay Using Adaptive Dynamic Programming

被引:73
|
作者
Zhang, Huaguang [1 ,2 ]
Ren, He [2 ]
Mu, Yunfei [2 ]
Han, Ji [2 ]
机构
[1] Northeastern Univ, State Key Lab Synthet Automat Proc Ind, Shenyang 110819, Peoples R China
[2] Northeastern Univ, Sch Informat Sci & Engn, Shenyang 110819, Peoples R China
基金
中国国家自然科学基金;
关键词
Games; Delay effects; Delays; Consensus control; Synchronization; Optimal control; System dynamics; Adaptive dynamic programming (ADP); data-based optimal control; multiagent systems (MASs); reinforcement learning (RL); time delay; DIFFERENTIAL GRAPHICAL GAMES; OPTIMAL-CONTROL SCHEME; SYNCHRONIZATION; ALGORITHMS; OBSERVER; FEEDBACK;
D O I
10.1109/TCYB.2021.3090067
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this article, a novel data-based adaptive dynamic programming (ADP) method is presented to solve the optimal consensus tracking control problem for discrete-time (DT) multiagent systems (MASs) with multiple time delays. Necessary and sufficient conditions of the corresponding equivalent time-delay system are provided on the basis of the causal transformations. Benefitting from the construction of tracking error dynamics, the optimal tracking problem can be transformed into settling the Nash-equilibrium in the graphical game, which can be completed by solving the coupled Hamilton-Jacobi (HJ) equations. An error estimator is introduced to construct the tracking error of the MASs only using the input and output (I/O) data. Therefore, the designed data-based ADP algorithm can minimize the cost functions and ensure the consensus of MASs without the knowledge of system dynamics. Finally, a numerical example is given to demonstrate the effectiveness of the proposed method.
引用
收藏
页码:12832 / 12842
页数:11
相关论文
共 50 条
  • [1] Optimal consensus control for double-integrator multiagent systems with unknown dynamics using adaptive dynamic programming
    Zhang, Qi
    Yang, Yang
    Song, Xue
    Xie, Xiaoran
    Zhu, Naibo
    Liu, Zhi
    OPTIMAL CONTROL APPLICATIONS & METHODS, 2023, 44 (05): : 2883 - 2899
  • [2] Fuzzy approximation-based optimal consensus control for nonlinear multiagent systems via adaptive dynamic programming
    Zhao, Heng
    Wang, Huanqing
    Xu, Ning
    Zhao, Xudong
    Sharaf, Sanaa
    NEUROCOMPUTING, 2023, 553
  • [3] Event-Triggered Adaptive Dynamic Programming Consensus Tracking Control for Discrete-Time Multiagent Systems
    Zhao, Yuyang
    Dai, Xiaolin
    Gong, Dawei
    Lv, Xinzhi
    Liu, Yang
    COMPLEXITY, 2022, 2022
  • [4] Adaptive Consensus Control for a Class of Nonlinear Multiagent Time-Delay Systems Using Neural Networks
    Chen, C. L. Philip
    Wen, Guo-Xing
    Liu, Yan-Jun
    Wang, Fei-Yue
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2014, 25 (06) : 1217 - 1226
  • [5] Distributed Optimal Consensus Control for Multiagent Systems With Input Delay
    Zhang, Huaipin
    Yue, Dong
    Zhao, Wei
    Hu, Songlin
    Dou, Chunxia
    IEEE TRANSACTIONS ON CYBERNETICS, 2018, 48 (06) : 1747 - 1759
  • [6] Distributed Fault Tolerant Consensus Control of Nonlinear Multiagent Systems via Adaptive Dynamic Programming
    Zhang, Yongwei
    Zhao, Bo
    Liu, Derong
    Zhang, Shunchao
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (07) : 9041 - 9053
  • [7] Adaptive Optimal Bipartite Consensus Control for Heterogeneous Multiagent Systems
    Liang, Bingyun
    Wei, Yanling
    Yu, Wenwu
    IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2024, 11 (04): : 2263 - 2275
  • [8] H∞ optimal control of unknown linear systems by adaptive dynamic programming with applications to time-delay systems
    Jiang, Huai-Yuan
    Zhou, Bin
    Liu, Guo-Ping
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2021, 31 (12) : 5602 - 5617
  • [9] Event-Based Robust Optimal Consensus Control for Nonlinear Multiagent System With Local Adaptive Dynamic Programming
    Wang, Jie
    Zhang, Zitao
    Tian, Bailing
    Zong, Qun
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (01) : 1073 - 1086
  • [10] Model-free optimal control design for a class of linear discrete-time systems with multiple delays using adaptive dynamic programming
    Zhang, Jilie
    Zhang, Huaguang
    Luo, Yanhong
    Feng, Tao
    NEUROCOMPUTING, 2014, 135 : 163 - 170