Alternating the population and control neural networks to solve high-dimensional stochastic mean-field games

被引:46
|
作者
Lin, Alex Tong [1 ]
Fung, Samy Wu [1 ,2 ]
Li, Wuchen [3 ]
Nurbekyan, Levon [1 ]
Osher, Stanley J. [1 ]
机构
[1] Univ Calif Los Angeles, Dept Math, Los Angeles, CA 90095 USA
[2] Colorado Sch Mines, Dept Appl Math & Stat, Golden, CO 80401 USA
[3] Univ South Carolina, Dept Math, Columbia, SC 29208 USA
关键词
mean-field games; generative adversarial networks; Hamilton-Jacobi-Bellman; optimal control; optimal transport; HAMILTON-JACOBI EQUATIONS; DIFFERENTIAL-GAMES; ALGORITHM; CURSE; LOADS;
D O I
10.1073/pnas.2024713118
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
We present APAC-Net, an alternating population and agent control neural network for solving stochastic mean-field games (MFGs). Our algorithm is geared toward high-dimensional instances of MFGs that are not approachable with existing solution methods. We achieve this in two steps. First, we take advantage of the underlying variational primal-dual structure that MFGs exhibit and phrase it as a convex-concave saddle-point problem. Second, we parameterize the value and density functions by two neural networks, respectively. By phrasing the problem in this manner, solving the MFG can be interpreted as a special case of training a generative adversarial network (GAN). We show the potential of our method on up to 100-dimensional MFG problems.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Self-Consistent Chaotic Transport in a High-Dimensional Mean-Field Hamiltonian Map Model
    Martinez-del-Rio, D.
    del-Castillo-Negrete, D.
    Olvera, A.
    Calleja, R.
    QUALITATIVE THEORY OF DYNAMICAL SYSTEMS, 2015, 14 (02) : 313 - 335
  • [42] Self-Consistent Chaotic Transport in a High-Dimensional Mean-Field Hamiltonian Map Model
    D. Martínez-del-Río
    D. del-Castillo-Negrete
    A. Olvera
    R. Calleja
    Qualitative Theory of Dynamical Systems, 2015, 14 : 313 - 335
  • [43] One-Dimensional Stationary Mean-Field Games with Local Coupling
    Gomes, Diogo A.
    Nurbekyan, Levon
    Prazeres, Mariana
    DYNAMIC GAMES AND APPLICATIONS, 2018, 8 (02) : 315 - 351
  • [44] One-Dimensional Stationary Mean-Field Games with Local Coupling
    Diogo A. Gomes
    Levon Nurbekyan
    Mariana Prazeres
    Dynamic Games and Applications, 2018, 8 : 315 - 351
  • [45] One-Dimensional Forward-Forward Mean-Field Games
    Gomes, Diogo A.
    Nurbekyan, Levon
    Sedjro, Marc
    APPLIED MATHEMATICS AND OPTIMIZATION, 2016, 74 (03): : 619 - 642
  • [46] Consensus via multi-population robust mean-field games
    Bauso, D.
    SYSTEMS & CONTROL LETTERS, 2017, 107 : 76 - 83
  • [47] Actor-Critic Learning Algorithms for Mean-Field Control with Moment Neural Networks
    Pham, Huyen
    Warin, Xavier
    METHODOLOGY AND COMPUTING IN APPLIED PROBABILITY, 2025, 27 (01)
  • [48] Mean-Field Games for Resource Sharing in Cloud-Based Networks
    Hanif, Ahmed Farhan
    Tembine, Hamidou
    Assaad, Mohamad
    Zeghlache, Djamal
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2016, 24 (01) : 624 - 637
  • [49] Incentive Feedback Stackelberg Strategy in Mean-Field Type Stochastic Difference Games
    GAO Wenhui
    LIN Yaning
    ZHANG Weihai
    Journal of Systems Science & Complexity, 2024, 37 (04) : 1425 - 1445
  • [50] Incentive Feedback Stackelberg Strategy in Mean-Field Type Stochastic Difference Games
    Gao, Wenhui
    Lin, Yaning
    Zhang, Weihai
    JOURNAL OF SYSTEMS SCIENCE & COMPLEXITY, 2024, 37 (04) : 1425 - 1445