Exploratory LQG mean field games with entropy regularization

被引:10
|
作者
Firoozi, Dena [1 ]
Jaimungal, Sebastian [2 ]
机构
[1] HEC Montreal, Dept Decis Sci, Montreal, PQ, Canada
[2] Univ Toronto, Dept Stat Sci, Toronto, ON, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
LQG mean field games; Entropy-regularization; Exploration;
D O I
10.1016/j.automatica.2022.110177
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We study a general class of entropy-regularized multi-variate LQG mean field game (MFG) systems in continuous time with K distinct subpopulations of agents. We extend the notion of control actions to control distributions (exploratory actions), and explicitly derive the optimal control distributions for individual agents in the limiting MFG. We demonstrate that the optimal set of control distributions yields an epsilon-Nash equilibrium for the finite-population entropy-regularized MFG. Furthermore, we compare the resulting solutions with those of classical LQG MFG systems and establish the equivalence of their existence. (C)& nbsp;2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Entropy Regularization for Mean Field Games with Learning
    Guo, Xin
    Xu, Renyuan
    Zariphopoulou, Thaleia
    MATHEMATICS OF OPERATIONS RESEARCH, 2022, : 3239 - 3260
  • [2] Mean Field LQG Games with Model Uncertainty
    Huang, Jianhui
    Huang, Minyi
    2013 IEEE 52ND ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2013, : 3103 - 3108
  • [3] LQG Mean-Field Games with ergodic cost
    Bardi, Martino
    Priuli, Fabio S.
    2013 IEEE 52ND ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2013, : 2493 - 2498
  • [4] Convergence rate of LQG mean field games with common noise
    Jian, Jiamin
    Song, Qingshuo
    Ye, Jiaxuan
    MATHEMATICAL METHODS OF OPERATIONS RESEARCH, 2024, 99 (03) : 233 - 270
  • [5] LQG Graphon Mean Field Games: Graphon Invariant Subspaces
    Gao, Shuang
    Caines, Peter E.
    Huang, Minyi
    2021 60TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2021, : 5253 - 5260
  • [6] Regularization of the Policy Updates for Stabilizing Mean Field Games
    Algumaei, Talal
    Solozabal, Ruben
    Alami, Reda
    Hacid, Hakim
    Debbah, Merouane
    Takac, Martin
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2023, PT II, 2023, 13936 : 361 - 372
  • [7] Belief Estimation by Agents in Major Minor LQG Mean Field Games
    Firoozi, Dena
    Caines, Peter E.
    2019 IEEE 58TH CONFERENCE ON DECISION AND CONTROL (CDC), 2019, : 1615 - 1622
  • [8] Mean Field LQG Games with Mass Behavior Responsive to A Major Player
    Son Luu Nguyen
    Huang, Minyi
    2012 IEEE 51ST ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2012, : 5792 - 5797
  • [9] Discrete-Time LQG Mean Field Games with Unreliable Communication
    Moon, Jun
    Basar, Tamer
    2014 IEEE 53RD ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2014, : 2697 - 2702
  • [10] Optimal Network Location in Infinite Horizon LQG Graphon Mean Field Games
    Foguen-Tchuendom, Rinel
    Gao, Shuang
    Huang, Minyi
    Caines, Peter E.
    2022 IEEE 61ST CONFERENCE ON DECISION AND CONTROL (CDC), 2022, : 5558 - 5565