A Variational Inference Approach to Inverse Problems with Gamma Hyperpriors

被引:5
|
作者
Agrawal, Shiv [1 ]
Kim, Hwanwoo [2 ]
Sanz-Alonso, Daniel [1 ]
Strang, Alexander [1 ]
机构
[1] Univ Chicago, Dept Stat, Chicago, IL 60637 USA
[2] Univ Chicago, Comm Computat & Appl Math, Chicago, IL 60637 USA
来源
关键词
variational inference; hierarchical inverse problems; iterative alternating scheme; sparse estimation; Bayesian shrinkage; REWEIGHTED LEAST-SQUARES;
D O I
10.1137/21M146209X
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Hierarchical models with gamma hyperpriors provide a flexible, sparsity-promoting framework to bridge L1 and L2 regularizations in Bayesian formulations to inverse problems. Despite the Bayesian motivation for these models, existing methodologies are limited to maximum a posteriori estimation. The potential to perform uncertainty quantification has not yet been realized. This paper introduces a variational iterative alternating scheme for hierarchical inverse problems with gamma hyperpriors. The proposed variational inference approach yields accurate reconstruction, provides meaningful uncertainty quantification, and is easy to implement. In addition, it lends itself naturally to conduct model selection for the choice of hyperparameters. We illustrate the performance of our methodology in several computed examples, including a deconvolution problem and sparse identification of dynamical systems from time series data.
引用
收藏
页码:1533 / 1559
页数:27
相关论文
共 50 条
  • [1] A variational inference framework for inverse problems
    Maestrini, Luca
    Aykroyd, Robert G.
    Wand, Matt P.
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2025, 202
  • [2] Variational inference for computational imaging inverse problems
    Tonolini, Francesco
    Radford, Jack
    Turpin, Alex
    Faccio, Daniele
    Murray-Smith, Roderick
    Journal of Machine Learning Research, 2020, 21
  • [3] Variational Inference for Computational Imaging Inverse Problems
    Tonolini, Francesco
    Radford, Jack
    Turpin, Alex
    Faccio, Daniele
    Murray-Smith, Roderick
    JOURNAL OF MACHINE LEARNING RESEARCH, 2020, 21
  • [4] An introduction to variational inference in geophysical inverse problems
    Zhang, Xin
    Nawaz, Muhammad Atif
    Zhao, Xuebin
    Curtis, Andrew
    INVERSION OF GEOPHYSICAL DATA, 2021, 62 : 73 - 140
  • [5] VARIATIONAL APPROACH TO THE LINEARIZED INVERSE PROBLEMS
    TURCHETTI, G
    LETTERE AL NUOVO CIMENTO, 1979, 25 (11): : 337 - 342
  • [6] A New Variational Approach for Inverse Source Problems
    Hu, Qiya
    Shu, Shi
    Zou, Jun
    NUMERICAL MATHEMATICS-THEORY METHODS AND APPLICATIONS, 2019, 12 (02): : 331 - 347
  • [7] A variational approach to inverse problems for anisotropic systems
    Brown, B. M.
    Jais, M.
    Kalmbach, P. C.
    RECENT ADVANCES IN DIFFERENTIAL EQUATIONS AND MATHEMATICAL PHYSICS, 2006, 412 : 87 - 102
  • [8] Learning to solve Bayesian inverse problems: An amortized variational inference approach using Gaussian and Flow guides
    Karumuri, Sharmila
    Bilionis, Ilias
    JOURNAL OF COMPUTATIONAL PHYSICS, 2024, 511
  • [9] A Mean-Field Variational Inference Approach to Deep Image Prior for Inverse Problems in Medical Imaging
    Toelle, Malte
    Laves, Max-Heinrich
    Schlaefer, Alexander
    MEDICAL IMAGING WITH DEEP LEARNING, VOL 143, 2021, 143 : 745 - 760
  • [10] A Stochastic Collocation Approach to Bayesian Inference in Inverse Problems
    Marzouk, Youssef
    Xiu, Dongbin
    COMMUNICATIONS IN COMPUTATIONAL PHYSICS, 2009, 6 (04) : 826 - 847