A Variational Inference Approach to Inverse Problems with Gamma Hyperpriors

被引:5
|
作者
Agrawal, Shiv [1 ]
Kim, Hwanwoo [2 ]
Sanz-Alonso, Daniel [1 ]
Strang, Alexander [1 ]
机构
[1] Univ Chicago, Dept Stat, Chicago, IL 60637 USA
[2] Univ Chicago, Comm Computat & Appl Math, Chicago, IL 60637 USA
来源
关键词
variational inference; hierarchical inverse problems; iterative alternating scheme; sparse estimation; Bayesian shrinkage; REWEIGHTED LEAST-SQUARES;
D O I
10.1137/21M146209X
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Hierarchical models with gamma hyperpriors provide a flexible, sparsity-promoting framework to bridge L1 and L2 regularizations in Bayesian formulations to inverse problems. Despite the Bayesian motivation for these models, existing methodologies are limited to maximum a posteriori estimation. The potential to perform uncertainty quantification has not yet been realized. This paper introduces a variational iterative alternating scheme for hierarchical inverse problems with gamma hyperpriors. The proposed variational inference approach yields accurate reconstruction, provides meaningful uncertainty quantification, and is easy to implement. In addition, it lends itself naturally to conduct model selection for the choice of hyperparameters. We illustrate the performance of our methodology in several computed examples, including a deconvolution problem and sparse identification of dynamical systems from time series data.
引用
收藏
页码:1533 / 1559
页数:27
相关论文
共 50 条
  • [11] Diffusion Prior-Based Amortized Variational Inference for Noisy Inverse Problems
    Lee, Sojin
    Park, Dogyun
    Kong, Inho
    Kim, Hyunwoo J.
    COMPUTER VISION - ECCV 2024, PT LIII, 2025, 15111 : 288 - 304
  • [12] Bayesian inference approach to inverse problems in a financial mathematical model
    Ota, Yasushi
    Jiang, Yu
    Nakamura, Gen
    Uesaka, Masaaki
    INTERNATIONAL JOURNAL OF COMPUTER MATHEMATICS, 2020, 97 (10) : 1967 - 1981
  • [13] Improved Variational Inference with Inverse Autoregressive Flow
    Kingma, Diederik P.
    Salimans, Tim
    Jozefowicz, Rafal
    Chen, Xi
    Sutskever, Ilya
    Welling, Max
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [14] Bayesian inference for inverse problems
    Mohammad-Djafari, A
    BAYESIAN INFERENCE AND MAXIMUM ENTROPY METHODS IN SCIENCE AND ENGINEERING, 2002, 617 : 477 - 496
  • [15] Logical inference for inverse problems
    Rus, G.
    Chiachio, J.
    Chiachio, M.
    INVERSE PROBLEMS IN SCIENCE AND ENGINEERING, 2016, 24 (03) : 448 - 464
  • [16] Statistical inference for inverse problems
    Bissantz, Nicolai
    Holzmann, Hajo
    INVERSE PROBLEMS, 2008, 24 (03)
  • [17] Development of variational approach for direct and inverse problems of atmospheric hydrodynamics and chemistry
    Penenko, V. V.
    Tsvetova, E. A.
    Penenko, A. V.
    IZVESTIYA ATMOSPHERIC AND OCEANIC PHYSICS, 2015, 51 (03) : 311 - 319
  • [18] Variational approach to three-dimensional inverse problems of potential theory
    Amromin, EL
    Bushkovskii, VA
    TECHNICAL PHYSICS, 1997, 42 (10) : 1121 - 1127
  • [19] Development of variational approach for direct and inverse problems of atmospheric hydrodynamics and chemistry
    V. V. Penenko
    E. A. Tsvetova
    A. V. Penenko
    Izvestiya, Atmospheric and Oceanic Physics, 2015, 51 : 311 - 319
  • [20] Variational approach to three-dimensional inverse problems of potential theory
    É. L. Amromin
    V. A. Bushkovskii
    Technical Physics, 1997, 42 : 1121 - 1127