Deep Unpaired Blind Image Super-Resolution Using Self-supervised Learning and Exemplar Distillation

被引:6
|
作者
Dong, Jiangxin [1 ]
Bai, Haoran [1 ]
Tang, Jinhui [1 ]
Pan, Jinshan [1 ]
机构
[1] Nanjing Univ Sci & Technol, Nanjing 210094, Peoples R China
基金
中国国家自然科学基金;
关键词
Blind image super-resolution; Unpaired learning; Deep learning; Knowledge distillation; Self-supervised learning;
D O I
10.1007/s11263-023-01957-w
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Existing deep blind image super-resolution (SR) methods usually depend on the paired training data, which is difficult to obtain in real applications. In this paper, we propose an effective unpaired learning method to solve the blind image SR problem. The proposed method first estimates the blur kernel and intermediate high-resolution (HR) image from the low-resolution (LR) input image in a self-supervised learning manner. With the estimated blur kernels and intermediate HR images, we develop an effective variational model based on the image formation of SR to improve the quality of the intermediate HR images. To better learn the LR-to-HR mapping, we further develop an exemplar distillation module that is able to explore useful information from exemplar HR images to constrain the deep models learned from the self-supervised learning module for the final HR image restoration. We jointly train the proposed method and show that it performs favorably against state-of-the-art methods on benchmark datasets and real-world images.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Deep Unpaired Blind Image Super-Resolution Using Self-supervised Learning and Exemplar Distillation (Dec, 10.1007/s11263-023-01957-w, 2023)
    Dong, Jiangxin
    Bai, Haoran
    Tang, Jinhui
    Pan, Jinshan
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (10) : 4819 - 4821
  • [2] Self-Supervised Deep Blind Video Super-Resolution
    Bai, Haoran
    Pan, Jinshan
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (07) : 4641 - 4653
  • [3] Self-supervised blind image super-resolution via alternately optimization
    Li, Yinong
    Yu, Jing
    Xiao, Chuangbai
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (05)
  • [4] Hyperspectral image super resolution using deep internal and self-supervised learning
    Liu, Zhe
    Han, Xian-Hua
    CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2024, 9 (01) : 128 - 141
  • [5] Self-supervised memory learning for scene text image super-resolution
    Guo, Kehua
    Zhu, Xiangyuan
    Schaefer, Gerald
    Ding, Rui
    Fang, Hui
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 258
  • [6] Self-Supervised Burst Super-Resolution
    Bhat, Goutam
    Gharbi, Michael
    Chen, Jiawen
    Van Gool, Luc
    Xia, Zhihao
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 10571 - 10580
  • [7] Self-Supervised Learning for Rolling Shutter Temporal Super-Resolution
    Fan, Bin
    Guo, Ying
    Dai, Yuchao
    Xu, Chao
    Shi, Boxin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (01) : 769 - 782
  • [8] Improving correlation based super-resolution microscopy images through image fusion by self-supervised deep learning
    Beck, Lior M.
    Shocher, Assaf
    Rossman, Uri
    Halfon, Ariel
    Irani, Michal
    Dron, Dan
    OPTICS EXPRESS, 2024, 32 (16): : 28195 - 28205
  • [9] Self-Supervised Cross-Scale Nonlocal Attention Network for Blind Image Super-Resolution
    Li, Yinong
    Yu, Jing
    Xiao, Chuangbai
    2024 IEEE 21ST INTERNATIONAL CONFERENCE ON MOBILE AD-HOC AND SMART SYSTEMS, MASS 2024, 2024, : 527 - 531
  • [10] STRESS: Super-Resolution for Dynamic Fetal MRI Using Self-supervised Learning
    Xu, Junshen
    Turk, Esra Abaci
    Grant, P. Ellen
    Golland, Polina
    Adalsteinsson, Elfar
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT VII, 2021, 12907 : 197 - 206