RECENT DEVELOPMENTS IN MACHINE LEARNING METHODS FOR STOCHASTIC CONTROL AND GAMES

被引:0
|
作者
Hu, Ruimeng [1 ,2 ]
Lauriere, Mathieu [3 ]
机构
[1] Univ Calif Santa Barbara, Dept Math, Santa Barbara, CA 93106 USA
[2] Univ Calif Santa Barbara, Dept Stat & Appl Probabil, Santa Barbara, CA 93106 USA
[3] NYU Shanghai, Shanghai Frontiers Sci Ctr Artificial Intelligence, NYU ECNU Inst Math Sci, 567 West Yangsi Rd, Shanghai 200126, Peoples R China
来源
关键词
Stochastic optimal control; stochastic games; mean field games; ma- chine learning; deep learning; MEAN-FIELD GAMES; PARTIAL-DIFFERENTIAL-EQUATIONS; MULTILAYER FEEDFORWARD NETWORKS; DISCRETE-TIME APPROXIMATION; MARKOV DECISION-PROCESSES; SEMI-LAGRANGIAN SCHEME; DEEP NEURAL-NETWORKS; NUMERICAL-METHODS; FICTITIOUS PLAY; POLICY GRADIENT;
D O I
10.3934/naco.2024031
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
. Stochastic optimal control and games have a wide range of applications, from finance and economics to social sciences, robotics, and energy management. Many real-world applications involve complex models that have driven the development of sophisticated numerical methods. Recently, computational methods based on machine learning have been developed for solving stochastic control problems and games. In this review, we focus on deep learning methods that have unlocked the possibility of solving such problems, even in high dimensions or when the structure is very complex, beyond what traditional numerical methods can achieve. We consider mostly the continuous time and continuous space setting. Many of the new approaches build on recent neural-network-based methods for solving high-dimensional partial differential equations or backward stochastic differential equations, or on model-free reinforcement learning for Markov decision processes that have led to breakthrough results. This paper provides an introduction to these methods and summarizes the state-of-the-art works at the crossroad of machine learning and stochastic control and games.
引用
收藏
页码:435 / 525
页数:91
相关论文
共 50 条
  • [21] Recent Developments in Tuning Methods for Predictive Functional Control
    Rossiter, John Anthony
    Aftab, Muhammad Saleheen
    PROCESSES, 2022, 10 (07)
  • [22] Recent Developments in Machine Learning Applications in Landslide Susceptibility Mapping
    Lun, Na Kai
    Liew, Mohd Shahir
    Matori, Abdul Nasir
    Zawawi, Noor Amila Wan Abdullah
    13TH IMT-GT INTERNATIONAL CONFERENCE ON MATHEMATICS, STATISTICS AND THEIR APPLICATIONS (ICMSA2017), 2017, 1905
  • [23] Stochastic linear-quadratic optimal control problems - Recent developments
    Sun, Jingrui
    Yong, Jiongmin
    ANNUAL REVIEWS IN CONTROL, 2023, 56
  • [24] Machine learning methods in finance: Recent applications and prospects
    Hoang, Daniel
    Wiegratz, Kevin
    EUROPEAN FINANCIAL MANAGEMENT, 2023, 29 (05) : 1657 - 1701
  • [25] Machine learning and games
    Bowling, Michael
    Fuernkranz, Johannes
    Graepel, Thore
    Musick, Ron
    MACHINE LEARNING, 2006, 63 (03) : 211 - 215
  • [26] Machine Learning Driven Developments in Behavioral Annotation: A Recent Historical Review
    Watson, Eleanor
    Viana, Thiago
    Zhang, Shujun
    INTERNATIONAL JOURNAL OF SOCIAL ROBOTICS, 2024, 16 (07) : 1605 - 1618
  • [27] RECENT DEVELOPMENTS IN MACHINE TRANSLATION
    THURMAIR, G
    COMPUTERS AND THE HUMANITIES, 1991, 25 (2-3): : 115 - 128
  • [28] Machine Learning in Perovskite Solar Cells: Recent Developments and Future Perspectives
    Bansal, Nitin Kumar
    Mishra, Snehangshu
    Dixit, Himanshu
    Porwal, Shivam
    Singh, Paulomi
    Singh, Trilok
    ENERGY TECHNOLOGY, 2023, 11 (12)
  • [29] Machine learning in solid heterogeneous catalysis: Recent developments, challenges and perspectives
    Guan, Yani
    Chaffart, Donovan
    Liu, Guihua
    Tan, Zhaoyang
    Zhang, Dongsheng
    Wang, Yanji
    Li, Jingde
    Ricardez-Sandoval, Luis
    CHEMICAL ENGINEERING SCIENCE, 2022, 248
  • [30] Machine learning in solid heterogeneous catalysis: Recent developments, challenges and perspectives
    Guan, Yani
    Chaffart, Donovan
    Liu, Guihua
    Tan, Zhaoyang
    Zhang, Dongsheng
    Wang, Yanji
    Li, Jingde
    Ricardez-Sandoval, Luis
    Chemical Engineering Science, 2022, 248