Deep Model-Based Super-Resolution with Non-uniform Blur

被引:6
|
作者
Laroche, Charles [1 ,2 ]
Almansa, Andres [3 ,4 ]
Tassano, Matias [5 ]
机构
[1] GoPro, San Mateo, CA 94402 USA
[2] MAP5, Paris, France
[3] CNRS, Paris, France
[4] Univ Paris Cite, Paris, France
[5] Meta Inc, San Jose, CA USA
关键词
CONVOLUTIONAL NETWORK; IMAGE;
D O I
10.1109/WACV56688.2023.00184
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a state-of-the-art method for super-resolution with non-uniform blur. Single-image super-resolution methods seek to restore a high-resolution image from blurred, subsampled, and noisy measurements. Despite their impressive performance, existing techniques usually assume a uniform blur kernel. Hence, these techniques do not generalize well to the more general case of non-uniform blur. Instead, in this paper, we address the more realistic and computationally challenging case of spatially-varying blur. To this end, we first propose a fast deep plug-and-play algorithm, based on linearized ADMM splitting techniques, which can solve the super-resolution problem with spatially-varying blur. Second, we unfold our iterative algorithm into a single network and train it end-to-end. In this way, we overcome the intricacy of manually tuning the parameters involved in the optimization scheme. Our algorithm presents remarkable performance and generalizes well after a single training to a large family of spatially-varying blur kernels, noise levels and scale factors.
引用
收藏
页码:1797 / 1808
页数:12
相关论文
共 50 条
  • [31] Blur estimation in iterative super-resolution restoration algorithms
    Ozkan, Kemal
    Seke, Erol
    Canbek, Selcuk
    2006 IEEE 14TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS, VOLS 1 AND 2, 2006, : 469 - +
  • [32] Blind Single-Image Super-Resolution Reconstruction Based on Motion Blur
    Qin, Fengqing
    Li, Zhong
    Zhu, Lihong
    You, Yingde
    Cao, Lilan
    ADVANCED RESEARCH ON AUTOMATION, COMMUNICATION, ARCHITECTONICS AND MATERIALS, PTS 1 AND 2, 2011, 225-226 (1-2): : 895 - 899
  • [33] Super-Resolution of Radargrams With a Generative Deep Learning Model
    Donini, Elena
    Bruzzone, Lorenzo
    Bovolo, Francesca
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 17
  • [34] Blind Super-resolution Image Reconstruction Based On Novel Blur Type Identification
    Huang, Liqing
    Xia, Youshen
    2017 10TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI), 2017,
  • [35] Deep Burst Super-Resolution
    Bhat, Goutam
    Danelljan, Martin
    Van Gool, Luc
    Timofte, Radu
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 9205 - 9214
  • [36] A new method for design of super resolution AWG with non-uniform array
    Gholipour, A
    Dana, RF
    2005 International Conference on Wireless and Optical Communications Networks, 2005, : 428 - 431
  • [37] Single Image Super-Resolution Based on Deep Learning Features and Dictionary Model
    Zhao, Liling
    Sun, Quansen
    Zhang, Zelin
    IEEE ACCESS, 2017, 5 : 17126 - 17135
  • [38] Super-resolution reconstruction of a digital elevation model based on a deep residual network
    Jiao, Donglai
    Wang, Dajiang
    Lv, Haiyang
    Peng, Yang
    OPEN GEOSCIENCES, 2020, 12 (01) : 1369 - 1382
  • [39] Model-based super-resolution reconstruction for pseudo-continuous Arterial Spin Labeling
    Beirinckx, Quinten
    Bladt, Piet
    van der Plas, Merlijn C. E.
    van Osch, Matthias J. P.
    Jeurissen, Ben
    den Dekker, Arnold J.
    Sijbers, Jan
    NEUROIMAGE, 2024, 286
  • [40] Model-based super-resolution time-delay estimation with sample rate consideration
    Fereidoony, Foad
    Sebt, Mohammad Ali
    Chamaani, Somayyeh
    Mirtaheri, Syed Abdullah
    IET SIGNAL PROCESSING, 2016, 10 (04) : 376 - 384