Exploratory LQG mean field games with entropy regularization

被引:10
|
作者
Firoozi, Dena [1 ]
Jaimungal, Sebastian [2 ]
机构
[1] HEC Montreal, Dept Decis Sci, Montreal, PQ, Canada
[2] Univ Toronto, Dept Stat Sci, Toronto, ON, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
LQG mean field games; Entropy-regularization; Exploration;
D O I
10.1016/j.automatica.2022.110177
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We study a general class of entropy-regularized multi-variate LQG mean field game (MFG) systems in continuous time with K distinct subpopulations of agents. We extend the notion of control actions to control distributions (exploratory actions), and explicitly derive the optimal control distributions for individual agents in the limiting MFG. We demonstrate that the optimal set of control distributions yields an epsilon-Nash equilibrium for the finite-population entropy-regularized MFG. Furthermore, we compare the resulting solutions with those of classical LQG MFG systems and establish the equivalence of their existence. (C)& nbsp;2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Mean field games
    Lasry, Jean-Michel
    Lions, Pierre-Louis
    JAPANESE JOURNAL OF MATHEMATICS, 2007, 2 (01): : 229 - 260
  • [22] Mean field games
    Jean-Michel Lasry
    Pierre-Louis Lions
    Japanese Journal of Mathematics, 2007, 2 : 229 - 260
  • [23] ε-Nash Equilibria for Partially Observed LQG Mean Field Games with Major Agent: Partial Observations by All Agents
    Firoozi, Dena
    Caines, Peter E.
    2015 54TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2015, : 4430 - 4437
  • [24] Solving a Class of Mean-Field LQG Problems
    Li, Yun
    Song, Qingshuo
    Wu, Fuke
    Yin, George
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2022, 67 (03) : 1597 - 1602
  • [25] Social Optima in Robust Mean Field LQG Control
    Wang, Bing-Chang
    Huang, Jianhui
    2017 11TH ASIAN CONTROL CONFERENCE (ASCC), 2017, : 2089 - 2094
  • [26] Mean field LQG social optimization: A reinforcement learning
    Xu, Zhenhui
    Wang, Bing-Chang
    Shen, Tielong
    AUTOMATICA, 2025, 171
  • [27] An entropy minimization approach to second-order variational mean-field games
    Benamou, Jean-David
    Carlier, Guillaume
    Di Marino, Simone
    Nenna, Luca
    MATHEMATICAL MODELS & METHODS IN APPLIED SCIENCES, 2019, 29 (08): : 1553 - 1583
  • [28] Mean field games with congestion
    Achdou, Yves
    Porretta, Alessio
    ANNALES DE L INSTITUT HENRI POINCARE-ANALYSE NON LINEAIRE, 2018, 35 (02): : 443 - 480
  • [29] Quadratic mean field games
    Ullmo, Denis
    Swiecicki, Igor
    Gobron, Thierry
    PHYSICS REPORTS-REVIEW SECTION OF PHYSICS LETTERS, 2019, 799 : 1 - 35
  • [30] Hypergraphon mean field games
    Cui, Kai
    KhudaBukhsh, Wasiur R.
    Koeppl, Heinz
    CHAOS, 2022, 32 (11)