A computational framework for neural network-based variational Monte Carlo with Forward Laplacian

被引:10
|
作者
Li, Ruichen [1 ,2 ]
Ye, Haotian [3 ]
Jiang, Du [1 ,2 ]
Wen, Xuelan [2 ]
Wang, Chuwei [4 ]
Li, Zhe [2 ]
Li, Xiang [2 ]
He, Di [1 ]
Chen, Ji [5 ]
Ren, Weiluo [2 ]
Wang, Liwei [1 ,6 ]
机构
[1] Peking Univ, Sch Intelligence Sci & Technol, Natl Key Lab Gen Artificial Intelligence, Beijing, Peoples R China
[2] ByteDance Res, Beijing, Peoples R China
[3] Peking Univ, Yuanpei Coll, Beijing, Peoples R China
[4] Peking Univ, Sch Math Sci, Beijing, Peoples R China
[5] Peking Univ, Interdisciplinary Inst Light Element Quantum Mat, Frontiers Sci Ctr Nanooptoelect, Sch Phys, Beijing, Peoples R China
[6] Peking Univ, Ctr Machine Learning Res, Beijing, Peoples R China
基金
中国国家自然科学基金; 美国国家科学基金会; 国家重点研发计划;
关键词
IRON-PERIOD; SPECTROSCOPY; DATABASE;
D O I
10.1038/s42256-024-00794-x
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Neural network-based variational Monte Carlo (NN-VMC) has emerged as a promising cutting-edge technique of ab initio quantum chemistry. However, the high computational cost of existing approaches hinders their applications in realistic chemistry problems. Here we report a development of NN-VMC that achieves a remarkable speed-up rate, thereby greatly extending the applicability of NN-VMC to larger systems. Our key design is a computational framework named Forward Laplacian, which computes the Laplacian associated with neural networks, the bottleneck of NN-VMC, through an efficient forward propagation process. We then demonstrate that Forward Laplacian can further facilitate more developments of acceleration methods across various aspects, including optimization for sparse derivative matrix and efficient network design. Empirically, our approach enables NN-VMC to investigate a broader range of systems, providing valuable references to other ab initio methods. The results demonstrate a great potential in applying deep learning methods to solve general quantum mechanical problems. Realistic quantum mechanical simulations are computationally costly to perform but can be approximated using neural network models. Li and colleagues propose a forward propagation method in lieu of traditional backpropagation to speed up these neural network-based approaches.
引用
收藏
页码:180 / 186
页数:7
相关论文
共 50 条
  • [21] Artificial neural network-based Hamiltonian Monte Carlo for high-dimensional Bayesian Inference of reaction kinetics models
    Liu, Chengcheng
    Wang, Yiru
    Tao, Chenyue
    Law, Chung K.
    Yang, Bin
    PROCEEDINGS OF THE COMBUSTION INSTITUTE, 2024, 40 (1-4)
  • [22] Seminonlinear spectral unmixing using a neural network-based forward modeling
    Karimpouli, Sadegh
    Salimi, Amir
    Ghasemzadeh, Saeid
    JOURNAL OF APPLIED REMOTE SENSING, 2016, 10
  • [23] A neural network-based framework for the reconstruction of incomplete data sets
    Gheyas, Iffat A.
    Smith, Leslie S.
    NEUROCOMPUTING, 2010, 73 (16-18) : 3039 - 3065
  • [24] A Neural Network-Based Agent Framework for Mail Server Management
    Willow, Charles C.
    INTERNATIONAL JOURNAL OF INTELLIGENT INFORMATION TECHNOLOGIES, 2005, 1 (04) : 36 - 52
  • [25] Neural Network-based Pattern Recognition in the Framework of Edge Computing
    Ning, Jing
    ROMANIAN JOURNAL OF INFORMATION SCIENCE AND TECHNOLOGY, 2024, 27 (01): : 106 - 119
  • [26] Graph Neural Network-Based Detailed Placement Optimization Framework
    Lim, Dho Ui
    Park, Heechun
    2024 25TH INTERNATIONAL SYMPOSIUM ON QUALITY ELECTRONIC DESIGN, ISQED 2024, 2024,
  • [27] Estimating buildup factor of alloys based on combination of Monte Carlo method and multilayer feed-forward neural network
    Moshkbar-Bakhshayesh, Khalil
    Mohtashami, Soroush
    Sahraeian, Mahdi
    ANNALS OF NUCLEAR ENERGY, 2021, 152
  • [28] Neural network gradient Hamiltonian Monte Carlo
    Lingge Li
    Andrew Holbrook
    Babak Shahbaba
    Pierre Baldi
    Computational Statistics, 2019, 34 : 281 - 299
  • [29] Network-Initialized Monte Carlo Based on Generative Neural Networks
    卢虹宇
    李楚豪
    陈斌斌
    李伟
    戚扬
    孟子杨
    Chinese Physics Letters, 2022, 39 (05) : 42 - 50
  • [30] Network-Initialized Monte Carlo Based on Generative Neural Networks
    Lu, Hongyu
    Li, Chuhao
    Chen, Bin-Bin
    Li, Wei
    Qi, Yang
    Meng, Zi Yang
    CHINESE PHYSICS LETTERS, 2022, 39 (05)