Exploratory LQG mean field games with entropy regularization

被引:10
|
作者
Firoozi, Dena [1 ]
Jaimungal, Sebastian [2 ]
机构
[1] HEC Montreal, Dept Decis Sci, Montreal, PQ, Canada
[2] Univ Toronto, Dept Stat Sci, Toronto, ON, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
LQG mean field games; Entropy-regularization; Exploration;
D O I
10.1016/j.automatica.2022.110177
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We study a general class of entropy-regularized multi-variate LQG mean field game (MFG) systems in continuous time with K distinct subpopulations of agents. We extend the notion of control actions to control distributions (exploratory actions), and explicitly derive the optimal control distributions for individual agents in the limiting MFG. We demonstrate that the optimal set of control distributions yields an epsilon-Nash equilibrium for the finite-population entropy-regularized MFG. Furthermore, we compare the resulting solutions with those of classical LQG MFG systems and establish the equivalence of their existence. (C)& nbsp;2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] A singular perturbation problem for mean field games of acceleration: application to mean field games of control
    Cristian Mendico
    Journal of Evolution Equations, 2023, 23
  • [42] A singular perturbation problem for mean field games of acceleration: application to mean field games of control
    Mendico, Cristian
    JOURNAL OF EVOLUTION EQUATIONS, 2023, 23 (03)
  • [43] Fast Policy Extragradient Methods for Competitive Games with Entropy Regularization
    Cen, Shicong
    Wei, Yuting
    Chi, Yuejie
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [44] Fast Policy Extragradient Methods for Competitive Games with Entropy Regularization
    Cen, Shicong
    Wei, Yuting
    Chi, Yuejie
    JOURNAL OF MACHINE LEARNING RESEARCH, 2024, 25 : 1 - 48
  • [45] Approximately Solving Mean Field Games via Entropy-Regularized Deep Reinforcement Learning
    Cui, Kai
    Koeppl, Heinz
    24TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS (AISTATS), 2021, 130
  • [46] MEAN FIELD GAMES WITH COMMON NOISE
    Carmona, Rene
    Delarue, Francois
    Lacker, Daniel
    ANNALS OF PROBABILITY, 2016, 44 (06): : 3740 - 3803
  • [47] SET VALUES FOR MEAN FIELD GAMES
    Iseri, Melih
    Zhang, Jianfeng
    TRANSACTIONS OF THE AMERICAN MATHEMATICAL SOCIETY, 2024, 377 (10) : 7117 - 7174
  • [48] MEAN FIELD GAMES: NUMERICAL METHODS
    Achdou, Yves
    Capuzzo-Dolcetta, Italo
    SIAM JOURNAL ON NUMERICAL ANALYSIS, 2010, 48 (03) : 1136 - 1162
  • [49] Remarks on potential mean field games
    Graber, P. Jameson
    RESEARCH IN THE MATHEMATICAL SCIENCES, 2025, 12 (01)
  • [50] On the Turnpike Property for Mean Field Games
    Porretta, Alessio
    MINIMAX THEORY AND ITS APPLICATIONS, 2018, 3 (02): : 285 - 312