Deterministic Langevin Monte Carlo with Normalizing Flows for Bayesian Inference

被引:0
|
作者
Grumitt, Richard D. P. [1 ]
Dai, Biwei [2 ]
Seljak, Uros [2 ,3 ]
机构
[1] Tsinghua Univ, Dept Astron, Beijing 100084, Peoples R China
[2] Univ Calif Berkeley, Phys Dept, Berkeley, CA 94720 USA
[3] Lawrence Berkeley Natl Lab, Berkeley, CA 94720 USA
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a general purpose Bayesian inference algorithm for expensive likelihoods, replacing the stochastic term in the Langevin equation with a deterministic density gradient term. The particle density is evaluated from the current particle positions using a Normalizing Flow (NF), which is differentiable and has good generalization properties in high dimensions. We take advantage of NF preconditioning and NF based Metropolis-Hastings updates for a faster convergence. We show on various examples that the method is competitive against state of the art sampling methods.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Adaptive Monte Carlo augmented with normalizing flows
    Gabrie, Marylou
    Rotskoff, Grant M.
    Vanden-Eijnden, Eric
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2022, 119 (10)
  • [2] Improved Variational Bayesian Phylogenetic Inference with Normalizing Flows
    Zhang, Cheng
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [3] On Monte Carlo methods for Bayesian inference
    Qian, SS
    Stow, CA
    Borsuk, ME
    ECOLOGICAL MODELLING, 2003, 159 (2-3) : 269 - 277
  • [4] Deterministic Sequential Monte Carlo for Haplotype Inference
    Ahn, Soyeon
    Vikalo, Hans
    2013 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2013, : 64 - 64
  • [5] Modified Hamiltonian Monte Carlo for Bayesian inference
    Tijana Radivojević
    Elena Akhmatskaya
    Statistics and Computing, 2020, 30 : 377 - 404
  • [6] Monte Carlo Inference for Semiparametric Bayesian Regression
    Kowal, Daniel R.
    Wu, Bohan
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2024,
  • [7] Modified Hamiltonian Monte Carlo for Bayesian inference
    Radivojevic, Tijana
    Akhmatskaya, Elena
    STATISTICS AND COMPUTING, 2020, 30 (02) : 377 - 404
  • [8] A Deterministic Sequential Monte Carlo Method for Haplotype Inference
    Liang, Kuo-ching
    Wang, Xiaodong
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2008, 2 (03) : 322 - 331
  • [9] Some adaptive Monte Carlo methods for Bayesian inference
    Tierney, L
    Mira, A
    STATISTICS IN MEDICINE, 1999, 18 (17-18) : 2507 - 2515
  • [10] Reflections on Bayesian inference and Markov chain Monte Carlo
    Craiu, Radu, V
    Gustafson, Paul
    Rosenthal, Jeffrey S.
    CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 2022, 50 (04): : 1213 - 1227