Blind Image Deconvolution Using Variational Deep Image Prior

被引:4
|
作者
Huo D. [1 ]
Masoumzadeh A. [1 ]
Kushol R. [1 ]
Yang Y.-H. [1 ]
机构
[1] University of Alberta, The Department of Computing Science, Edmonton, T6G 2R3, AB
基金
加拿大自然科学与工程研究理事会;
关键词
Blind image deconvolution; deep image prior; hand-crafted image prior; variational auto-encoder;
D O I
10.1109/TPAMI.2023.3283979
中图分类号
学科分类号
摘要
Conventional deconvolution methods utilize hand-crafted image priors to constrain the optimization. While deep-learning-based methods have simplified the optimization by end-to-end training, they fail to generalize well to blurs unseen in the training dataset. Thus, training image-specific models is important for higher generalization. Deep image prior (DIP) provides an approach to optimize the weights of a randomly initialized network with a single degraded image by maximum a posteriori (MAP), which shows that the architecture of a network can serve as the hand-crafted image prior. Unlike conventional hand-crafted image priors, which are obtained through statistical methods, finding a suitable network architecture is challenging due to the unclear relationship between images and their corresponding architectures. As a result, the network architecture cannot provide enough constraint for the latent sharp image. This paper proposes a new variational deep image prior (VDIP) for blind image deconvolution, which exploits additive hand-crafted image priors on latent sharp images and approximates a distribution for each pixel to avoid suboptimal solutions. Our mathematical analysis shows that the proposed method can better constrain the optimization. The experimental results further demonstrate that the generated images have better quality than that of the original DIP on benchmark datasets. © 1979-2012 IEEE.
引用
收藏
页码:11472 / 11483
页数:11
相关论文
共 50 条
  • [31] Parameter Estimation in Spike and Slab Variational Inference for Blind Image Deconvolution
    Serra, Juan G.
    Mateos, Javier
    Molina, Rafael
    Katsaggelos, Aggelos K.
    2017 25TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2017, : 1495 - 1499
  • [32] Variational Bayesian blind image deconvolution with Student-t priors
    Tzikas, Dimitris
    Likas, Aristidis
    Galatsanos, Nikolaos
    2007 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-7, 2007, : 109 - 112
  • [33] Image Restoration in Water Turbulence Using Image Registration and Blind Deconvolution
    He, Changxin
    Zhang, Zhen
    SEVENTH INTERNATIONAL CONFERENCE ON OPTICAL AND PHOTONIC ENGINEERING (ICOPEN 2019), 2019, 11205
  • [34] A deep variational Bayesian framework for blind image deblurring
    Zhao, Qian
    Wang, Hui
    Yue, Zongsheng
    Meng, Deyu
    KNOWLEDGE-BASED SYSTEMS, 2022, 249
  • [35] Deep Variational Network Toward Blind Image Restoration
    Yue, Zongsheng
    Yong, Hongwei
    Zhao, Qian
    Zhang, Lei
    Meng, Deyu
    Wong, Kwan-Yee K.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (11) : 7011 - 7026
  • [36] Blind deconvolution of infrared image
    Zhong, S
    Shen, ZK
    MULTISPECTRAL AND HYPERSPECTRAL IMAGE ACQUISITION AND PROCESSING, 2001, 4548 : 275 - 279
  • [37] PET Image Reconstruction Using Deep Image Prior
    Gong, Kuang
    Catana, Ciprian
    Qi, Jinyi
    Li, Quanzheng
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (07) : 1655 - 1665
  • [38] Dual Image Deblurring Using Deep Image Prior
    Shin, Chang Jong
    Lee, Tae Bok
    Heo, Yong Seok
    ELECTRONICS, 2021, 10 (17)
  • [39] Blind image deconvolution revisited
    Kundur, D
    Hatzinakos, D
    IEEE SIGNAL PROCESSING MAGAZINE, 1996, 13 (06) : 61 - 63
  • [40] Compressive Blind Image Deconvolution
    Amizic, Bruno
    Spinoulas, Leonidas
    Molina, Rafael
    Katsaggelos, Aggelos K.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (10) : 3994 - 4006