Variational approximation for importance sampling

被引:0
|
作者
Xiao Su
Yuguo Chen
机构
[1] Amazon,Department of Statistics
[2] University of Illinois at Urbana-Champaign,undefined
来源
Computational Statistics | 2021年 / 36卷
关键词
-divergence; Monte Carlo; Proposal distribution; Variational inference;
D O I
暂无
中图分类号
学科分类号
摘要
We propose an importance sampling algorithm with proposal distribution obtained from variational approximation. This method combines the strength of both importance sampling and variational method. On one hand, this method avoids the bias from variational method. On the other hand, variational approximation provides a way to design the proposal distribution for the importance sampling algorithm. Theoretical justification of the proposed method is provided. Numerical results show that using variational approximation as the proposal can improve the performance of importance sampling and sequential importance sampling.
引用
收藏
页码:1901 / 1930
页数:29
相关论文
共 50 条
  • [1] Importance sampling as a variational approximation
    Nott, David J.
    Li Jialiang
    Fielding, Mark
    STATISTICS & PROBABILITY LETTERS, 2011, 81 (08) : 1052 - 1055
  • [2] Variational approximation for importance sampling
    Su, Xiao
    Chen, Yuguo
    COMPUTATIONAL STATISTICS, 2021, 36 (03) : 1901 - 1930
  • [3] Variational Importance Sampling: Initial Findings
    Hernandez-Gonzalez, Jeronimo
    Capdevila, Joan
    Cerquides, Jesus
    ARTIFICIAL INTELLIGENCE RESEARCH AND DEVELOPMENT, 2019, 319 : 95 - 104
  • [4] Stein Variational Adaptive Importance Sampling
    Han, Jun
    Liu, Qiang
    CONFERENCE ON UNCERTAINTY IN ARTIFICIAL INTELLIGENCE (UAI2017), 2017,
  • [5] Types of approximation for probabilistic cognition: Sampling and variational
    Sanborn, Adam N.
    BRAIN AND COGNITION, 2017, 112 : 98 - 101
  • [6] Optimal importance sampling for the approximation of integrals
    Hinrichs, Aicke
    JOURNAL OF COMPLEXITY, 2010, 26 (02) : 125 - 134
  • [7] Surrogate Likelihoods for Variational Annealed Importance Sampling
    Jankowiak, Martin
    Du Phan
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [8] CONDITIONALLY FACTORIZED VARIATIONAL BAYES WITH IMPORTANCE SAMPLING
    Gan, Runze
    Godsill, Simon
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 5777 - 5781
  • [9] OPTIMIZING ADAPTIVE IMPORTANCE SAMPLING BY STOCHASTIC APPROXIMATION
    Kawai, Reiichiro
    SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2018, 40 (04): : A2774 - A2800
  • [10] Importance Sampling with the Integrated Nested Laplace Approximation
    Berild, Martin Outzen
    Martino, Sara
    Gomez-Rubio, Virgilio
    Rue, Havard
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2022, 31 (04) : 1225 - 1237