A Variational Inference Approach to Inverse Problems with Gamma Hyperpriors

被引:5
|
作者
Agrawal, Shiv [1 ]
Kim, Hwanwoo [2 ]
Sanz-Alonso, Daniel [1 ]
Strang, Alexander [1 ]
机构
[1] Univ Chicago, Dept Stat, Chicago, IL 60637 USA
[2] Univ Chicago, Comm Computat & Appl Math, Chicago, IL 60637 USA
来源
关键词
variational inference; hierarchical inverse problems; iterative alternating scheme; sparse estimation; Bayesian shrinkage; REWEIGHTED LEAST-SQUARES;
D O I
10.1137/21M146209X
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Hierarchical models with gamma hyperpriors provide a flexible, sparsity-promoting framework to bridge L1 and L2 regularizations in Bayesian formulations to inverse problems. Despite the Bayesian motivation for these models, existing methodologies are limited to maximum a posteriori estimation. The potential to perform uncertainty quantification has not yet been realized. This paper introduces a variational iterative alternating scheme for hierarchical inverse problems with gamma hyperpriors. The proposed variational inference approach yields accurate reconstruction, provides meaningful uncertainty quantification, and is easy to implement. In addition, it lends itself naturally to conduct model selection for the choice of hyperparameters. We illustrate the performance of our methodology in several computed examples, including a deconvolution problem and sparse identification of dynamical systems from time series data.
引用
收藏
页码:1533 / 1559
页数:27
相关论文
共 50 条
  • [21] Bayesian Compressive Sensing With Variational Inference and Wavelet Tree Structure for Solving Inverse Scattering Problems
    Li, Yang-Yang
    Zhao, Huai-Ci
    Liu, Peng-Fei
    Wang, Guo-Gang
    IEEE TRANSACTIONS ON ANTENNAS AND PROPAGATION, 2024, 72 (11) : 8750 - 8761
  • [22] Mutual Variational Inference: An Indirect Variational Inference Approach for Unsupervised Domain Adaptation
    Chen, Jiahong
    Wang, Jing
    de Silva, Clarence W.
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (11) : 11491 - 11503
  • [23] Variational Methods for Inverse Conductivity Problems
    Carpio, A.
    Rapun, M. L.
    NUMERICAL ANALYSIS AND APPLIED MATHEMATICS ICNAAM 2011: INTERNATIONAL CONFERENCE ON NUMERICAL ANALYSIS AND APPLIED MATHEMATICS, VOLS A-C, 2011, 1389
  • [24] Bayesian Inference Tools for Inverse Problems
    Mohammad-Djafari, Ali
    BAYESIAN INFERENCE AND MAXIMUM ENTROPY METHODS IN SCIENCE AND ENGINEERING, 2013, 1553 : 163 - 170
  • [25] Fast inference for statistical inverse problems
    Taddy, Matthew A.
    Lee, Herbert K. H.
    Sanso, Bruno
    INVERSE PROBLEMS, 2009, 25 (08)
  • [26] ENSEMBLE INFERENCE IN GEOPHYSICAL INVERSE PROBLEMS
    VASCO, DW
    JOHNSON, LR
    MAJER, EL
    GEOPHYSICAL JOURNAL INTERNATIONAL, 1993, 115 (03) : 711 - 728
  • [27] SPARSE RECOVERY VIA VARIATIONAL BAYESIAN INFERENCE: COMPARING BERNOULLIS-GAUSSIANS-INVERSE GAMMA AND GAUSSIANS-INVERSE GAMMAS MODELING
    Shekaramiz, Mohammad
    Moon, Todd K.
    Gunther, Jacob H.
    2018 CONFERENCE RECORD OF 52ND ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2018, : 1969 - 1973
  • [28] The Combinatorial-Variational Approach to Solving Linear and Nonlinear Inverse Problems in Geophysics
    Stepanova, I. E.
    Kolotov, I. I.
    DOKLADY EARTH SCIENCES, 2024, 518 (01) : 1534 - 1545
  • [29] A variational Bayesian approach for inverse problems with skew-t error distributions
    Guha, Nilabja
    Wu, Xiaoqing
    Efendiev, Yalchin
    Jin, Bangti
    Mallick, Bani K.
    JOURNAL OF COMPUTATIONAL PHYSICS, 2015, 301 : 377 - 393
  • [30] Weak neural variational inference for solving Bayesian inverse problems without forward models: Applications in elastography
    Scholz, Vincent C.
    Zang, Yaohua
    Koutsourelakis, Phaedon-Stelios
    COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING, 2025, 433