Alternating the population and control neural networks to solve high-dimensional stochastic mean-field games

被引:46
|
作者
Lin, Alex Tong [1 ]
Fung, Samy Wu [1 ,2 ]
Li, Wuchen [3 ]
Nurbekyan, Levon [1 ]
Osher, Stanley J. [1 ]
机构
[1] Univ Calif Los Angeles, Dept Math, Los Angeles, CA 90095 USA
[2] Colorado Sch Mines, Dept Appl Math & Stat, Golden, CO 80401 USA
[3] Univ South Carolina, Dept Math, Columbia, SC 29208 USA
关键词
mean-field games; generative adversarial networks; Hamilton-Jacobi-Bellman; optimal control; optimal transport; HAMILTON-JACOBI EQUATIONS; DIFFERENTIAL-GAMES; ALGORITHM; CURSE; LOADS;
D O I
10.1073/pnas.2024713118
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
We present APAC-Net, an alternating population and agent control neural network for solving stochastic mean-field games (MFGs). Our algorithm is geared toward high-dimensional instances of MFGs that are not approachable with existing solution methods. We achieve this in two steps. First, we take advantage of the underlying variational primal-dual structure that MFGs exhibit and phrase it as a convex-concave saddle-point problem. Second, we parameterize the value and density functions by two neural networks, respectively. By phrasing the problem in this manner, solving the MFG can be interpreted as a special case of training a generative adversarial network (GAN). We show the potential of our method on up to 100-dimensional MFG problems.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] From high-dimensional & mean-field dynamics to dimensionless ODEs: A unifying approach to SGD in two-layers networks
    Arnaboldi, Luca
    Stephan, Ludovic
    Krzakala, Florent
    Loureiro, Bruno
    THIRTY SIXTH ANNUAL CONFERENCE ON LEARNING THEORY, VOL 195, 2023, 195
  • [32] Stability Via Adversarial Training of Neural Network Stochastic Control of Mean-Field Type
    Barreiro-Gomez, Julian
    Choutri, Salah Eddine
    Djehiche, Boualem
    2022 IEEE 61ST CONFERENCE ON DECISION AND CONTROL (CDC), 2022, : 7547 - 7552
  • [33] A MEAN-FIELD STOCHASTIC CONTROL PROBLEM WITH PARTIAL OBSERVATIONS
    Buckdahn, Rainer
    Li, Juan
    Ma, Jin
    ANNALS OF APPLIED PROBABILITY, 2017, 27 (05): : 3201 - 3245
  • [34] Neural Population Dynamics Modeled by Mean-Field Graphs
    Kozma, Robert
    Puljic, Marko
    NUMERICAL ANALYSIS AND APPLIED MATHEMATICS ICNAAM 2011: INTERNATIONAL CONFERENCE ON NUMERICAL ANALYSIS AND APPLIED MATHEMATICS, VOLS A-C, 2011, 1389
  • [35] Beyond dynamical mean-field theory of neural networks
    Massimiliano Muratori
    Bruno Cessac
    BMC Neuroscience, 14 (Suppl 1)
  • [36] ASYMMETRIC MEAN-FIELD NEURAL NETWORKS FOR MULTIPROCESSOR SCHEDULING
    HELLSTROM, BJ
    KANAL, LN
    NEURAL NETWORKS, 1992, 5 (04) : 671 - 686
  • [37] Stochastic Control for Mean-Field Stochastic Partial Differential Equations with Jumps
    Roxana Dumitrescu
    Bernt Øksendal
    Agnès Sulem
    Journal of Optimization Theory and Applications, 2018, 176 : 559 - 584
  • [38] Stochastic Control for Mean-Field Stochastic Partial Differential Equations with Jumps
    Dumitrescu, Roxana
    Oksendal, Bernt
    Sulem, Agnes
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2018, 176 (03) : 559 - 584
  • [39] MEAN-FIELD APPROXIMATIONS FOR STOCHASTIC POPULATION PROCESSES WITH HETEROGENEOUS INTERACTIONS
    Sridhar, Anirudh
    Kar, Soummya
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2023, 61 (06) : 3442 - 3466
  • [40] A machine learning framework for solving high-dimensional mean field game and mean field control problems
    Ruthotto, Lars
    Osher, Stanley J.
    Li, Wuchen
    Nurbekyan, Levon
    Fung, Samy Wu
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2020, 117 (17) : 9183 - 9193