A Generative Variational Model for Inverse Problems in Imaging

被引:9
|
作者
Habring, Andreas [1 ]
Holler, Martin [1 ]
机构
[1] Karl Franzens Univ Graz, Inst Math & Sci Comp, Graz, Austria
来源
关键词
inverse problems; data science; mathematical imaging; deep image prior; generative neural net-works; machine learning; REGULARIZATION;
D O I
10.1137/21M1414978
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This paper is concerned with the development, analysis, and numerical realization of a novel varia-tional model for the regularization of inverse problems in imaging. The proposed model is inspired by the architecture of generative convolutional neural networks; it aims to generate the unknown from variables in a latent space via multilayer convolutions and nonlinear penalties, and penalizes an associated cost. In contrast to conventional neural-network-based approaches, however, the con-volution kernels are learned directly from the measured data such that no training is required. The present work provides a mathematical analysis of the proposed model in a function space setting, including proofs for regularity and existence/stability of solutions, and convergence for vanishing noise. Moreover, in a discretized setting, a numerical algorithm for solving various types of inverse problems with the proposed model is derived. Numerical results are provided for applications in in -painting, denoising, deblurring under noise, superresolution, and JPEG decompression with multiple test images.
引用
收藏
页码:306 / 335
页数:30
相关论文
共 50 条
  • [1] Variational inference for computational imaging inverse problems
    Tonolini, Francesco
    Radford, Jack
    Turpin, Alex
    Faccio, Daniele
    Murray-Smith, Roderick
    Journal of Machine Learning Research, 2020, 21
  • [2] Variational Inference for Computational Imaging Inverse Problems
    Tonolini, Francesco
    Radford, Jack
    Turpin, Alex
    Faccio, Daniele
    Murray-Smith, Roderick
    JOURNAL OF MACHINE LEARNING RESEARCH, 2020, 21
  • [3] Guided Deep Generative Model-Based Spatial Regularization for Multiband Imaging Inverse Problems
    Zhao M.
    Dobigeon N.
    Chen J.
    IEEE Transactions on Image Processing, 2023, 32 : 5692 - 5704
  • [4] Model Adaptation for Inverse Problems in Imaging
    Gilton, Davis
    Ongie, Gregory
    Willett, Rebecca
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2021, 7 : 661 - 674
  • [5] A variational inference framework for inverse problems
    Maestrini, Luca
    Aykroyd, Robert G.
    Wand, Matt P.
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2025, 202
  • [6] Variational Methods for Inverse Conductivity Problems
    Carpio, A.
    Rapun, M. L.
    NUMERICAL ANALYSIS AND APPLIED MATHEMATICS ICNAAM 2011: INTERNATIONAL CONFERENCE ON NUMERICAL ANALYSIS AND APPLIED MATHEMATICS, VOLS A-C, 2011, 1389
  • [7] VARIATIONAL APPROACH TO THE LINEARIZED INVERSE PROBLEMS
    TURCHETTI, G
    LETTERE AL NUOVO CIMENTO, 1979, 25 (11): : 337 - 342
  • [8] Quantized Generative Models for Solving Inverse Problems
    Reddy, Nareddy Kartheek Kumar
    Killedar, Vinayak
    Seelamantula, Chandra Sekhar
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 1520 - 1525
  • [9] Generative Models for Inverse Imaging Problems: From mathematical foundations to physics-driven applications
    Zhao, Zhizhen
    Ye, Jong Chul
    Bresler, Yoram
    IEEE SIGNAL PROCESSING MAGAZINE, 2023, 40 (01) : 148 - 163
  • [10] Inverse problems for quasi-variational inequalities
    Khan, Akhtar A.
    Motreanu, Dumitru
    JOURNAL OF GLOBAL OPTIMIZATION, 2018, 70 (02) : 401 - 411