Variational approximation for importance sampling

被引：0
|
作者：
Xiao Su
Yuguo Chen
机构：
[1] Amazon,Department of Statistics
[2] University of Illinois at Urbana-Champaign,undefined
来源：
Computational Statistics | 2021年 / 36卷
关键词：
-divergence; Monte Carlo; Proposal distribution; Variational inference;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
We propose an importance sampling algorithm with proposal distribution obtained from variational approximation. This method combines the strength of both importance sampling and variational method. On one hand, this method avoids the bias from variational method. On the other hand, variational approximation provides a way to design the proposal distribution for the importance sampling algorithm. Theoretical justification of the proposed method is provided. Numerical results show that using variational approximation as the proposal can improve the performance of importance sampling and sequential importance sampling.
引用
收藏
页码：1901 / 1930
页数：29
相关论文
共 50 条
  • [31] Variance Reduction in Black-box Variational Inference by Adaptive Importance Sampling
    Li, Ximing
    Li, Changchun
    Chi, Jinjin
    Ouyang, Jihong
    PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 2404 - 2410
  • [32] Stochastic approximation Monte Carlo importance sampling for approximating exact conditional probabilities
    Sooyoung Cheon
    Faming Liang
    Yuguo Chen
    Kai Yu
    Statistics and Computing, 2014, 24 : 505 - 520
  • [33] Stream Clustering: Efficient Kernel-based Approximation using Importance Sampling
    Chitta, Radha
    Jin, Rong
    Jain, Anil K.
    2015 IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOP (ICDMW), 2015, : 607 - 614
  • [34] Weighted importance sampling for off-policy learning with linear function approximation
    Mahmood, A. Rupam
    Van Hasselt, Hado
    Sutton, Richard S.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 27 (NIPS 2014), 2014, 27
  • [35] Computing VaR and CVaR using stochastic approximation and adaptive unconstrained importance sampling
    Bardou, O.
    Frikha, N.
    Pages, G.
    MONTE CARLO METHODS AND APPLICATIONS, 2009, 15 (03): : 173 - 210
  • [36] Coupling Importance Sampling and Multilevel Monte Carlo using Sample Average Approximation
    Ahmed Kebaier
    Jérôme Lelong
    Methodology and Computing in Applied Probability, 2018, 20 : 611 - 641
  • [37] OPTIMAL IMPORTANCE SAMPLING PARAMETER SEARCH FOR LEVY PROCESSES VIA STOCHASTIC APPROXIMATION
    Kawai, Reiichiro
    SIAM JOURNAL ON NUMERICAL ANALYSIS, 2008, 47 (01) : 293 - 307
  • [38] The importance of importance sampling
    Beichl, I
    Sullivan, F
    COMPUTING IN SCIENCE & ENGINEERING, 1999, 1 (02) : 71 - 73
  • [39] Coupling Importance Sampling and Multilevel Monte Carlo using Sample Average Approximation
    Kebaier, Ahmed
    Lelong, Jerome
    METHODOLOGY AND COMPUTING IN APPLIED PROBABILITY, 2018, 20 (02) : 611 - 641
  • [40] Stochastic approximation Monte Carlo importance sampling for approximating exact conditional probabilities
    Cheon, Sooyoung
    Liang, Faming
    Chen, Yuguo
    Yu, Kai
    STATISTICS AND COMPUTING, 2014, 24 (04) : 505 - 520
12345