Deep learning-based blind image super-resolution with iterative kernel reconstruction and noise estimation

被引:15
|
作者
Ates, Hasan F. [1 ]
Yildirim, Suleyman [2 ]
Gunturk, Bahadir K. [3 ]
机构
[1] Ozyegin Univ, Fac Engn, Istanbul, Turkiye
[2] Koc Univ, Coll Engn, Istanbul, Turkiye
[3] Istanbul Medipol Univ, Sch Engn & Nat Sci, Istanbul, Turkiye
关键词
Super-resolution; Blind; Iterative; Deep network; NETWORKS;
D O I
10.1016/j.cviu.2023.103718
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Blind single image super-resolution (SISR) is a challenging task in image processing due to the ill-posed nature of the inverse problem. Complex degradations present in real life images make it difficult to solve this problem using naive deep learning approaches, where models are often trained on synthetically generated image pairs. Most of the effort so far has been focused on solving the inverse problem under some constraints, such as for a limited space of blur kernels and/or assuming noise-free input images. Yet, there is a gap in the literature to provide a well-generalized deep learning-based solution that performs well on images with unknown and highly complex degradations. In this paper, we propose IKR-Net (Iterative Kernel Reconstruction Network) for blind SISR. In the proposed approach, kernel and noise estimation and high-resolution image reconstruction are carried out iteratively using dedicated deep models. The iterative refinement provides significant improvement in both the reconstructed image and the estimated blur kernel even for noisy inputs. IKR-Net provides a generalized solution that can handle any type of blur and level of noise in the input low-resolution image. IKR-Net achieves state-of-the-art results in blind SISR, especially for noisy images with motion blur.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] Learning-based nonparametric image super-resolution
    Rajaram, Shyamsundar
    Das Gupta, Mithun
    Petrovic, Nemanja
    Huang, Thomas S.
    EURASIP JOURNAL ON APPLIED SIGNAL PROCESSING, 2006, 2006 (1) : 1 - 11
  • [32] A review of single image super-resolution reconstruction based on deep learning
    Ming Yu
    Jiecong Shi
    Cuihong Xue
    Xiaoke Hao
    Gang Yan
    Multimedia Tools and Applications, 2024, 83 : 55921 - 55962
  • [33] Local Learning-Based Image Super-Resolution
    Lu, Xiaoqiang
    Yuan, Haoliang
    Yuan, Yuan
    Yan, Pingkun
    Li, Luoqing
    Li, Xuelong
    2011 IEEE 13TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2011,
  • [34] An efficient blur kernel estimation method for blind image Super-Resolution
    Xu, Yimin
    Gao, Nanxi
    Chao, Fei
    Ji, Rongrong
    PATTERN RECOGNITION, 2024, 154
  • [35] Blurred Image Blind Super-resolution Network via Kernel Estimation
    Li G.-P.
    Lu Y.
    Wang Z.-J.
    Wu Z.-W.
    Wang S.-Z.
    Zidonghua Xuebao/Acta Automatica Sinica, 2023, 49 (10): : 2109 - 2121
  • [36] KERNEL ESTIMATION NETWORK FOR BLIND SUPER-RESOLUTION
    Cao, Xiang
    Shen, Haibo
    Zhang, Liangqi
    Luo, Yihao
    Wang, Tianjiang
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 1695 - 1699
  • [37] EDKE: Encoder-Decoder based Kernel Estimation for Blind Image Super-resolution
    Zhu, Mingyan
    Dai, Tao
    Xia, Shu-Tao
    Hu, Maowei
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [38] REFERENCE-BASED BLIND SUPER-RESOLUTION KERNEL ESTIMATION
    Yamac, Mehmet
    Nawaz, Aakif
    Ataman, Baran
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 4123 - 4127
  • [39] Blind super-resolution using a learning-based approach
    Bégin, I
    Ferrie, FP
    PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 2, 2004, : 85 - 89
  • [40] Deep Learning-Based Single Image Super-Resolution: An Investigation for Dense Scene Reconstruction with UAS Photogrammetry
    Pashaei, Mohammad
    Starek, Michael J.
    Kamangir, Hamid
    Berryhill, Jacob
    REMOTE SENSING, 2020, 12 (11)