Online optimal consensus control of unknown linear multi-agent systems via time-based adaptive dynamic programming

被引:22
|
作者
Liu, Yifan [1 ]
Li, Tieshan [1 ,2 ]
Shan, Qihe [1 ]
Yu, Renhai [1 ]
Wu, Yue [1 ]
Chen, C. L. Philip [1 ,3 ]
机构
[1] Dalian Maritime Univ, Nav Coll, Dalian 116026, Liaoning, Peoples R China
[2] Univ Elect Sci & Technol China, Sch Automat Engn, Chengdu 611731, Sichuan, Peoples R China
[3] Univ Macau, Dept Comp & Informat Sci, Fac Sci & Technol, Macau 999078, Peoples R China
基金
中国国家自然科学基金;
关键词
Linear multi-agent systems (MASs); Adaptive dynamic programming (ADP); Consensus control; Discrete-time (DT) system; NEURAL-NETWORK; SYNCHRONIZATION; ALGORITHMS; DESIGN; GAMES;
D O I
10.1016/j.neucom.2020.04.119
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper considers the online optimal consensus control problem for unknown linear discrete-time (DT) multi-agent systems (MASs). Based on time-based adaptive dynamic programming (ADP) method, the control policies are designed by utilizing the current and recorded data of unknown MASs. The critic-actor NN frameworks are employed to approximate the performance indexes and optimal control policies, respectively. The NN weights are updated once at the sampling instant to produce real-time online control. Furthermore, the control policies are proved to effectively drive the MASs to achieve consistency and satisfy the Nash equilibrium. Finally, a numerical example is implemented to shown the feasibility of the control scheme. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:137 / 144
页数:8
相关论文
共 50 条
  • [1] Optimal Consensus Control of Unknown Nonlinear Multi-Agent Systems Using Adaptive Dynamic Programming via MRAC
    Fu, Hao
    Chen, Xin
    Wang, Wei
    Li, Jinbin
    Zhang, Yaodong
    2018 37TH CHINESE CONTROL CONFERENCE (CCC), 2018, : 7141 - 7146
  • [2] Online optimal control of unknown discrete-time nonlinear systems by using time-based adaptive dynamic programming
    Xiao, Geyang
    Zhang, Huaguang
    Luo, Yanhong
    NEUROCOMPUTING, 2015, 165 : 163 - 170
  • [3] Online optimal control for dynamic positioning of vessels via time-based adaptive dynamic programming
    Xiaoyang Gao
    Tieshan Li
    Qihe Shan
    Yang Xiao
    Liang’en Yuan
    Yifan Liu
    Journal of Ambient Intelligence and Humanized Computing, 2023, 14 : 15629 - 15641
  • [4] Online optimal control for dynamic positioning of vessels via time-based adaptive dynamic programming
    Gao, Xiaoyang
    Li, Tieshan
    Shan, Qihe
    Xiao, Yang
    Yuan, Liang'en
    Liu, Yifan
    JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2019, 14 (12) : 15629 - 15641
  • [5] Internal reinforcement adaptive dynamic programming for optimal containment control of unknown continuous-time multi-agent systems
    Zhang, Jiefu
    Peng, Zhinan
    Hu, Jiangping
    Zhao, Yiyi
    Luo, Rui
    Ghosh, Bijoy Kumar
    NEUROCOMPUTING, 2020, 413 : 85 - 95
  • [6] Optimal consensus control for multi-agent systems: Multi-step policy gradient adaptive dynamic programming method
    Ji, Lianghao
    Jian, Kai
    Zhang, Cuijuan
    Yang, Shasha
    Guo, Xing
    Li, Huaqing
    IET CONTROL THEORY AND APPLICATIONS, 2023, 17 (11): : 1443 - 1457
  • [7] Optimal consensus control of linear multi-agent systems with communication time delay
    Sheng, Jie
    Ding, Zhengtao
    IET CONTROL THEORY AND APPLICATIONS, 2013, 7 (15): : 1899 - 1905
  • [8] Consensus of multi-agent linear dynamic systems via impulsive control protocols
    Jiang, Haibo
    Yu, Jianjiang
    Zhou, Caigen
    INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2011, 42 (06) : 967 - 976
  • [9] Optimal Energy Consensus Control for Linear Multi-Agent Systems
    Zhang, Han
    Hu, Xiaoming
    PROCEEDINGS OF THE 36TH CHINESE CONTROL CONFERENCE (CCC 2017), 2017, : 2663 - 2668
  • [10] Adaptive Consensus Control for Nonlinear Multi-agent Systems with Unknown Control Directions
    Wang, Qingling
    Zheng, Yajun
    Sun, Changyin
    PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 5871 - 5874