UNCERTAINTY AWARE IMPLICIT IMAGE FUNCTION FOR ARBITRARY-SCALE SUPER-RESOLUTION

被引:0
|
作者
Jena, Swastik [1 ]
Panda, Saptarshi [2 ]
Balabantaray, Bunil Kumar [1 ]
Nayak, Rajashree [3 ]
机构
[1] Natl Inst Technol Meghalaya, Dept Comp Sci & Engn, Shillong, Meghalaya, India
[2] Natl Inst Technol Meghalaya, Dept Civil Engn, Shillong, Meghalaya, India
[3] JIS Inst Adv Studies & Res, Ctr Data Sci, Kolkata, India
关键词
SISR; INR; Self-supervised learning; Model uncertainty;
D O I
10.1109/ICIP49359.2023.10222673
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The most integral step in computer vision and image processing tasks is the representation of images. Recently, continuous image parameterization using Implicit Neural Representations (INR) has shown a great advantage over discrete representations due to their spatial invariance. This property immediately finds application in the context of single-image super-resolution (SISR) at an arbitrary scale. However, most super-resolution models, including the INR-based Local Implicit Image Function (LIIF), produce only a single output, failing to address the ill-posedness of SISR. Moreover, these models tend to optimize a mean-squared-error (MSE) based loss function which causes blurring and structural distortion in regions exhibiting a high degree of variance (details). Our work proposes a novel uncertainty-aware self-supervised methodology (U-LIIF) that extends on LIIF, to reduce the blurriness and deals with the ill-posedness of SISR. Our U-LIIF does not require any re-training and yields diversified high-resolution images by leveraging model uncertainty. The efficacy of the proposed method is validated by substantial experiments on various benchmark datasets.
引用
收藏
页码:2440 / 2444
页数:5
相关论文
共 50 条
  • [21] MambaSR: Arbitrary-Scale Super-Resolution Integrating Mamba with Fast Fourier Convolution Blocks
    Yan, Jin
    Chen, Zongren
    Pei, Zhiyuan
    Lu, Xiaoping
    Zheng, Hua
    MATHEMATICS, 2024, 12 (15)
  • [22] SAVSR: Arbitrary-Scale Video Super-Resolution via a Learned Scale-Adaptive Network
    Li, Zekun
    Liu, Hongying
    Shang, Fanhua
    Liu, Yuanyuan
    Wan, Liang
    Feng, Wei
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 4, 2024, : 3288 - 3296
  • [23] Residual scale attention network for arbitrary scale image super-resolution
    Fu, Ying
    Chen, Jian
    Zhang, Tao
    Lin, Yonggang
    NEUROCOMPUTING, 2021, 427 : 201 - 211
  • [24] Deep Fourier-based Arbitrary-scale Super-resolution for Real-time Rendering
    Zhang, Haonan
    Guo, Jie
    Zhang, Jiawei
    Qin, Haoyu
    Feng, Zesen
    Yang, Ming
    Guo, Yanwen
    PROCEEDINGS OF SIGGRAPH 2024 CONFERENCE PAPERS, 2024,
  • [25] Deep Arbitrary-Scale Unfolding Network for Color-Guided Depth Map Super-Resolution
    Zhang, Jialong
    Zhao, Lijun
    Zhang, Jinjing
    Chen, Bintao
    Wang, Anhong
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT X, 2024, 14434 : 225 - 236
  • [26] Joint Implicit Image Function for Guided Depth Super-Resolution
    Tang, Jiaxiang
    Chen, Xiaokang
    Zeng, Gang
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 4390 - 4399
  • [27] SR-RDFAN-LOG: Arbitrary-scale logging image super-resolution reconstruction based on residual dense feature aggregation
    Rong, Yi
    Jia, Mingbin
    Zhan, Yufei
    Zhou, Luoyu
    GEOENERGY SCIENCE AND ENGINEERING, 2024, 240
  • [28] Arbitrary-Scale Image Synthesis
    Ntavelis, Evangelos
    Shahbazi, Mohamad
    Kastanis, Iason
    Timofte, Radu
    Danelljan, Martin
    Van Gool, Luc
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 11523 - 11532
  • [29] ASDN: A Deep Convolutional Network for Arbitrary Scale Image Super-Resolution
    Shen, Jialiang
    Wang, Yucheng
    Zhang, Jian
    MOBILE NETWORKS & APPLICATIONS, 2021, 26 (01): : 13 - 26
  • [30] ASDN: A Deep Convolutional Network for Arbitrary Scale Image Super-Resolution
    Jialiang Shen
    Yucheng Wang
    Jian Zhang
    Mobile Networks and Applications, 2021, 26 : 13 - 26