Arbitrary-scale Super-resolution via Deep Learning: A Comprehensive Survey

被引:5
|
作者
Liu, Hongying [1 ]
Li, Zekun [2 ]
Shang, Fanhua [3 ]
Liu, Yuanyuan [2 ]
Wan, Liang [1 ,3 ]
Feng, Wei [3 ]
Timofte, Radu [4 ,5 ]
机构
[1] Tianjin Univ, Med Coll, Tianjin 300072, Peoples R China
[2] Xidian Univ, Sch Artificial Intelligence, Key Lab Intelligent Percept & Image Understanding, Minist Educ, Xian 710071, Peoples R China
[3] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300350, Peoples R China
[4] Swiss Fed Inst Technol, Zurich, Switzerland
[5] Univ Wurzburg, CAIDAS & IFI, Comp Vis Lab, Wurzburg, Germany
关键词
Image super-resolution; Video super-resolution; Arbitrary scale; Deep learning; SINGLE IMAGE SUPERRESOLUTION; NETWORK; VIDEO;
D O I
10.1016/j.inffus.2023.102015
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Super -resolution (SR) is an essential class of low-level vision tasks, which aims to improve the resolution of images or videos in computer vision. In recent years, significant progress has been made in image and video super -resolution techniques based on deep learning. Nevertheless, most of the methods only consider SR with a few integer scale factors, which limits the application of the SR techniques to real -world problems. Recently, the methods to achieve arbitrary -scale super -resolution via a single model have attracted much attention. However, there is no work to thoroughly analyze the arbitrary -scale methods based on deep learning. In this work, we present a comprehensive and systematic review of 45 existing deep learning -based methods for arbitrary -scale image and video SR. We first classify the existing SR methods according to the resolved scale factors. Furthermore, we propose an in-depth taxonomy for state-of-the-art methods based on the core problem of how to achieve arbitrary -scale super -resolution, i.e., how to perform arbitrary -scale upsampling. Moreover, the performance of existing arbitrary -scale SR methods is compared, and their advantages and limitations are analyzed. We also provide some guidance for the selection of these methods in different real -world applications. Finally, we briefly discuss the future directions of arbitrary -scale super -resolution, which shows some inspirations for the progress of subsequent works on arbitrary -scale image and video super -resolution tasks. The repository of this work is available at https://github.com/Weepingchestnut/Arbitrary-Scale-SR.
引用
收藏
页数:26
相关论文
共 50 条
  • [21] Arbitrary-Scale Hyperspectral Image Super-Resolution From a Fusion Perspective With Spatial Priors
    Chen, Guochao
    Nie, Jiangtao
    Wei, Wei
    Zhang, Lei
    Zhang, Yanning
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [22] An Image Arbitrary-Scale Super-Resolution Network Using Frequency-domain Information
    Fang, Jing
    Yu, Yinbo
    Wang, Zhongyuan
    Ding, Xin
    Hu, Ruimin
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (03)
  • [23] A Survey of Deep Learning Video Super-Resolution
    Baniya, Arbind Agrahari
    Lee, Tsz-Kwan
    Eklund, Peter W.
    Aryal, Sunil
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (04): : 2655 - 2676
  • [24] Deep Learning for Image Super-Resolution: A Survey
    Wang, Zhihao
    Chen, Jian
    Hoi, Steven C. H.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (10) : 3365 - 3387
  • [25] CycleINR: Cycle Implicit Neural Representation for Arbitrary-Scale Volumetric Super-Resolution of Medical Data
    Fang, Wei
    Tang, Yuxing
    Guo, Heng
    Yuan, Mingze
    Mok, Tony C.W.
    Yan, Ke
    Yao, Jiawen
    Chen, Xin
    Liu, Zaiyi
    Lu, Le
    Zhang, Ling
    Xu, Minfeng
    arXiv,
  • [26] Super-resolution: a comprehensive survey
    Kamal Nasrollahi
    Thomas B. Moeslund
    Machine Vision and Applications, 2014, 25 : 1423 - 1468
  • [27] Super-resolution: a comprehensive survey
    Nasrollahi, Kamal
    Moeslund, Thomas B.
    MACHINE VISION AND APPLICATIONS, 2014, 25 (06) : 1423 - 1468
  • [28] CiaoSR: Continuous Implicit Attention-in-Attention Network for Arbitrary-Scale Image Super-Resolution
    Cao, Jiezhang
    Wang, Qin
    Xian, Yongqin
    Li, Yawei
    Ni, Bingbing
    Pi, Zhiming
    Zhang, Kai
    Zhang, Yulun
    Timofte, Radu
    Van Gool, Luc
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 1796 - 1807
  • [29] Learning A Single Network for Scale-Arbitrary Super-Resolution
    Wang, Longguang
    Wang, Yingqian
    Lin, Zaiping
    Yang, Jungang
    An, Wei
    Guo, Yulan
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 4781 - 4790
  • [30] Arbitrary-scale super-resolution reconstruction of remote sensing images based on meta-learning and residual dense attention mechanism
    Wei, Xiaoyuan
    Meng, Gang
    Zhang, Haopeng
    Jiang, Zhiguo
    National Remote Sensing Bulletin, 2024, 28 (07) : 1735 - 1745