Online Distributed Learning for Aggregative Games With Feedback Delays

被引:10
|
作者
Liu, Pin [1 ,2 ]
Lu, Kaihong [3 ]
Xiao, Feng [1 ,2 ]
Wei, Bo [4 ]
Zheng, Yuanshi [5 ]
机构
[1] North China Elect Power Univ, State Key Lab Alternate Elect Power Syst Renewable, Beijing 102206, Peoples R China
[2] North China Elect Power Univ, Sch Control & Comp Engn, Beijing 102206, Peoples R China
[3] Shandong Univ Sci & Technol, Coll Elect Engn & Automat, Qingdao 266590, Peoples R China
[4] North China Elect Power Univ, Sch Control & Comp Engn, Beijing 102206, Peoples R China
[5] Xidian Univ, Sch Mechanoelect Engn, Shaanxi Key Lab Space Solar Power Stn Syst, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Delays; Games; Cost function; Heuristic algorithms; Costs; Measurement; Vehicle dynamics; Aggregative games (AGs); dynamic environments; feedback delays; generalized Nash equilibrium (GNE); NASH EQUILIBRIUM SEEKING; DEMAND-SIDE MANAGEMENT; OPTIMIZATION; ALGORITHMS; NETWORKS;
D O I
10.1109/TAC.2023.3237781
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article proposes a new aggregative game (AG) model with feedback delays. The strategies of players are selected from given strategy sets and subject to global nonlinear inequality constraints. Both cost functions and constrained functions of players are time varying, which reflects the changing nature of environments. At each time, each player only has access to its strategy set information, and the information of its current cost function and current constrained function is unknown. Due to feedback delays, the feedback information of corresponding cost functions and constrained functions is not revealed to players immediately after the selection of strategies. It would take a period of time for players to observe their feedback information. To address such an AG problem, a distributed learning algorithm is proposed with the local information from their neighbors and the delayed feedback information from environments, and it is applicable to time-varying weighted digraphs. We find that the two metrics of the algorithm grow sublinearly with respect to the learning time. A simulation example is given to illustrate the performance of the proposed algorithm.
引用
收藏
页码:6385 / 6392
页数:8
相关论文
共 50 条
  • [1] Distributed No-Regret Learning in Aggregative Games With Residual Bandit Feedback
    Liu, Wenting
    Yi, Peng
    IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2024, 11 (04): : 1734 - 1745
  • [2] Sublinear Dynamic Regrets for Aggregative Games With Feedback Delays and Communication Delays
    Liu, Pin
    Wang, Letian
    Chen, Yue
    IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2025, 12 (01): : 1071 - 1079
  • [3] Distributed Online Learning Algorithms for Aggregative Games Over Time-Varying Unbalanced Digraphs
    Zuo, Xiaolong
    Deng, Zhenhua
    2023 62ND IEEE CONFERENCE ON DECISION AND CONTROL, CDC, 2023, : 2278 - 2283
  • [4] Distributed Nash Equilibrium Seeking for Aggregative Games via Derivative Feedback
    Yawei Zhang
    Shu Liang
    Haibo Ji
    International Journal of Control, Automation and Systems, 2020, 18 : 1075 - 1082
  • [5] Distributed Nash Equilibrium Seeking for Aggregative Games via Derivative Feedback
    Zhang, Yawei
    Liang, Shu
    Ji, Haibo
    INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2020, 18 (05) : 1075 - 1082
  • [6] Distributed Online Constrained Optimization With Feedback Delays
    Wang, Cong
    Xu, Shengyuan
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (02) : 1708 - 1720
  • [7] A Deep Learning Approach for Distributed Aggregative Optimization with Users' Feedback
    Brumali, Riccardo
    Carnevale, Guido
    Notarstefano, Giuseppe
    6TH ANNUAL LEARNING FOR DYNAMICS & CONTROL CONFERENCE, 2024, 242 : 1552 - 1564
  • [8] Distributed No-Regret Learning for Stochastic Aggregative Games over Networks
    Lei, Jinlong
    Yi, Peng
    Li, Li
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 7512 - 7519
  • [9] Distributed Algorithms for Aggregative Games on Graphs
    Koshal, Jayash
    Nedic, Angelia
    Shanbhag, Uday V.
    OPERATIONS RESEARCH, 2016, 64 (03) : 680 - 704
  • [10] Statistical Privacy-Preserving Online Distributed Nash Equilibrium Tracking in Aggregative Games
    Lin, Yeming
    Liu, Kun
    Han, Dongyu
    Xia, Yuanqing
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2024, 69 (01) : 323 - 330