Spatial-Frequency Fusion for Arbitrary-Scale Ultra-High-Definition Image Super-Resolution

被引:0
|
作者
Yang, Cuixin [1 ]
Xiao, Jun [1 ]
Lam, Kin-Man [1 ]
机构
[1] Hong Kong Polytech Univ, Dept Elect & Elect Engn, Hong Kong, Peoples R China
关键词
Super-resolution; ultra-high-definition; frequency domain; arbitrary-scale;
D O I
10.1117/12.3018885
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Ultra-high-definition (UHD) image super-resolution (SR) has attracted increasing attention due to the popularity of modern devices, such as smartphones, which support the capture of UHD images, e.g. 4K and 8K images. However, existing UHD SR methods process the image in the spatial domain only. This limitation hinders their ability to effectively utilize the rich details and fine-grained textures in local areas of UHD images. To address this issue, our proposed method comprehensively exploits the global and local features of UHD images by combining spatial and frequency features. Additionally, previous UHD image SR methods can only handle a fixed scaling factor, but real-world applications very often require upscaling low-resolution images with different scales. Therefore, we employ an arbitrary-scale strategy in the SR training process, enabling super-resolution of UHD images at any scale with a single trained model. Experimental results demonstrate the effectiveness and superiority of our proposed method.
引用
收藏
页数:6
相关论文
共 50 条
  • [31] Residual scale attention network for arbitrary scale image super-resolution
    Fu, Ying
    Chen, Jian
    Zhang, Tao
    Lin, Yonggang
    NEUROCOMPUTING, 2021, 427 : 201 - 211
  • [32] CycleINR: Cycle Implicit Neural Representation for Arbitrary-Scale Volumetric Super-Resolution of Medical Data
    Fang, Wei
    Tang, Yuxing
    Guo, Heng
    Yuan, Mingze
    Mok, Tony C.W.
    Yan, Ke
    Yao, Jiawen
    Chen, Xin
    Liu, Zaiyi
    Lu, Le
    Zhang, Ling
    Xu, Minfeng
    arXiv,
  • [33] Deep Fourier-based Arbitrary-scale Super-resolution for Real-time Rendering
    Zhang, Haonan
    Guo, Jie
    Zhang, Jiawei
    Qin, Haoyu
    Feng, Zesen
    Yang, Ming
    Guo, Yanwen
    PROCEEDINGS OF SIGGRAPH 2024 CONFERENCE PAPERS, 2024,
  • [34] Deep Arbitrary-Scale Unfolding Network for Color-Guided Depth Map Super-Resolution
    Zhang, Jialong
    Zhao, Lijun
    Zhang, Jinjing
    Chen, Bintao
    Wang, Anhong
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT X, 2024, 14434 : 225 - 236
  • [35] High Frequency Super-Resolution for Image Enhancement
    Lee, Oh-Young
    Park, Sae-Jin
    Kim, Jae-Woo
    Kim, Jong-Ok
    18TH IEEE INTERNATIONAL SYMPOSIUM ON CONSUMER ELECTRONICS (ISCE 2014), 2014,
  • [36] Towards Efficient and Scale-Robust Ultra-High-Definition Image Demoireing
    Yu, Xin
    Dai, Peng
    Li, Wenbo
    Ma, Lan
    Shen, Jiajun
    Li, Jia
    Qi, Xiaojuan
    COMPUTER VISION - ECCV 2022, PT XVIII, 2022, 13678 : 646 - 662
  • [37] SR-RDFAN-LOG: Arbitrary-scale logging image super-resolution reconstruction based on residual dense feature aggregation
    Rong, Yi
    Jia, Mingbin
    Zhan, Yufei
    Zhou, Luoyu
    GEOENERGY SCIENCE AND ENGINEERING, 2024, 240
  • [38] Super-resolution imaging using the spatial-frequency filtered intensity fluctuation correlation
    Jane Sprigg
    Tao Peng
    Yanhua Shih
    Scientific Reports, 6
  • [39] Super-resolution imaging using the spatial-frequency filtered intensity fluctuation correlation
    Sprigg, Jane
    Peng, Tao
    Shih, Yanhua
    SCIENTIFIC REPORTS, 2016, 6
  • [40] ASDN: A Deep Convolutional Network for Arbitrary Scale Image Super-Resolution
    Shen, Jialiang
    Wang, Yucheng
    Zhang, Jian
    MOBILE NETWORKS & APPLICATIONS, 2021, 26 (01): : 13 - 26