Deep learning-based blind image super-resolution with iterative kernel reconstruction and noise estimation

被引:15
|
作者
Ates, Hasan F. [1 ]
Yildirim, Suleyman [2 ]
Gunturk, Bahadir K. [3 ]
机构
[1] Ozyegin Univ, Fac Engn, Istanbul, Turkiye
[2] Koc Univ, Coll Engn, Istanbul, Turkiye
[3] Istanbul Medipol Univ, Sch Engn & Nat Sci, Istanbul, Turkiye
关键词
Super-resolution; Blind; Iterative; Deep network; NETWORKS;
D O I
10.1016/j.cviu.2023.103718
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Blind single image super-resolution (SISR) is a challenging task in image processing due to the ill-posed nature of the inverse problem. Complex degradations present in real life images make it difficult to solve this problem using naive deep learning approaches, where models are often trained on synthetically generated image pairs. Most of the effort so far has been focused on solving the inverse problem under some constraints, such as for a limited space of blur kernels and/or assuming noise-free input images. Yet, there is a gap in the literature to provide a well-generalized deep learning-based solution that performs well on images with unknown and highly complex degradations. In this paper, we propose IKR-Net (Iterative Kernel Reconstruction Network) for blind SISR. In the proposed approach, kernel and noise estimation and high-resolution image reconstruction are carried out iteratively using dedicated deep models. The iterative refinement provides significant improvement in both the reconstructed image and the estimated blur kernel even for noisy inputs. IKR-Net provides a generalized solution that can handle any type of blur and level of noise in the input low-resolution image. IKR-Net achieves state-of-the-art results in blind SISR, especially for noisy images with motion blur.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] Deep learning-based magnetic resonance image super-resolution: a survey
    Ji Z.
    Zou B.
    Kui X.
    Liu J.
    Zhao W.
    Zhu C.
    Dai P.
    Dai Y.
    Neural Computing and Applications, 2024, 36 (21) : 12725 - 12752
  • [22] A Review of Single Image Super-Resolution Reconstruction Based on Deep Learning
    Wu J.
    Ye X.-J.
    Huang F.
    Chen L.-Q.
    Wang Z.-F.
    Liu W.-X.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2022, 50 (09): : 2265 - 2294
  • [23] Endoscopic Image Deblurring and Super-Resolution Reconstruction Based on Deep Learning
    Yang, Xirui
    Chen, Yue
    Tao, Rui
    Zhang, Yue
    Liu, Zhiwen
    Shi, Yonggang
    2020 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND COMPUTER ENGINEERING (ICAICE 2020), 2020, : 168 - 172
  • [24] Super-Resolution Reconstruction of Magnetic Resonance Image Based on Deep Learning
    Pan Mengxue
    Qu Ning
    Xia Yeru
    Yang Deyong
    Wang Hongyu
    Liu Wenlong
    LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (22)
  • [25] Image super-resolution reconstruction based on sparse representation and deep learning
    Zhang, Jing
    Shao, Minhao
    Yu, Lulu
    Li, Yunsong
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2020, 87
  • [26] A comprehensive review of deep learning-based single image super-resolution
    Bashir, Syed Muhammad Arsalan
    Wang, Yi
    Khan, Mahrukh
    Niu, Yilong
    PEERJ COMPUTER SCIENCE, 2021,
  • [27] A review of single image super-resolution reconstruction based on deep learning
    Yu, Ming
    Shi, Jiecong
    Xue, Cuihong
    Hao, Xiaoke
    Yan, Gang
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (18) : 55921 - 55962
  • [28] Image Super-resolution Reconstruction based on Deep Learning and Sparse Representation
    Lei, Qian
    Zhang, Zhao-hui
    Hao, Cun-ming
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON COMPUTER NETWORKS AND COMMUNICATION TECHNOLOGY (CNCT 2016), 2016, 54 : 546 - 555
  • [29] Image super-resolution reconstruction based on deep dictionary learning and A+
    Yi Huang
    Weixin Bian
    Biao Jie
    Zhiqiang Zhu
    Wenhu Li
    Signal, Image and Video Processing, 2024, 18 : 2629 - 2641
  • [30] Learning-Based Nonparametric Image Super-Resolution
    Shyamsundar Rajaram
    Mithun Das Gupta
    Nemanja Petrovic
    Thomas S. Huang
    EURASIP Journal on Advances in Signal Processing, 2006