UNCERTAINTY AWARE IMPLICIT IMAGE FUNCTION FOR ARBITRARY-SCALE SUPER-RESOLUTION

被引:0
|
作者
Jena, Swastik [1 ]
Panda, Saptarshi [2 ]
Balabantaray, Bunil Kumar [1 ]
Nayak, Rajashree [3 ]
机构
[1] Natl Inst Technol Meghalaya, Dept Comp Sci & Engn, Shillong, Meghalaya, India
[2] Natl Inst Technol Meghalaya, Dept Civil Engn, Shillong, Meghalaya, India
[3] JIS Inst Adv Studies & Res, Ctr Data Sci, Kolkata, India
关键词
SISR; INR; Self-supervised learning; Model uncertainty;
D O I
10.1109/ICIP49359.2023.10222673
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The most integral step in computer vision and image processing tasks is the representation of images. Recently, continuous image parameterization using Implicit Neural Representations (INR) has shown a great advantage over discrete representations due to their spatial invariance. This property immediately finds application in the context of single-image super-resolution (SISR) at an arbitrary scale. However, most super-resolution models, including the INR-based Local Implicit Image Function (LIIF), produce only a single output, failing to address the ill-posedness of SISR. Moreover, these models tend to optimize a mean-squared-error (MSE) based loss function which causes blurring and structural distortion in regions exhibiting a high degree of variance (details). Our work proposes a novel uncertainty-aware self-supervised methodology (U-LIIF) that extends on LIIF, to reduce the blurriness and deals with the ill-posedness of SISR. Our U-LIIF does not require any re-training and yields diversified high-resolution images by leveraging model uncertainty. The efficacy of the proposed method is validated by substantial experiments on various benchmark datasets.
引用
收藏
页码:2440 / 2444
页数:5
相关论文
共 50 条
  • [41] Arbitrary Scale Super-Resolution for Brain MRI Images
    Tan, Chuan
    Zhu, Jin
    Lio, Pietro
    ARTIFICIAL INTELLIGENCE APPLICATIONS AND INNOVATIONS, AIAI 2020, PT I, 2020, 583 : 165 - 176
  • [42] Arbitrary-scale super-resolution reconstruction of remote sensing images based on meta-learning and residual dense attention mechanism
    Wei, Xiaoyuan
    Meng, Gang
    Zhang, Haopeng
    Jiang, Zhiguo
    National Remote Sensing Bulletin, 2024, 28 (07) : 1735 - 1745
  • [43] Scale-Aware Backprojection Transformer for Single Remote Sensing Image Super-Resolution
    Hao, Jinglei
    Li, Wukai
    Lu, Yuting
    Jin, Yang
    Zhao, Yongqiang
    Wang, Shunzhou
    Wang, Binglu
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [44] Permutation Invariance and Uncertainty in Multitemporal Image Super-Resolution
    Valsesia, Diego
    Magli, Enrico
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [45] Implicit Neural Representation Learning for Hyperspectral Image Super-Resolution
    Zhang, Kaiwei
    Zhu, Dandan
    Min, Xiongkuo
    Zhai, Guangtao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [46] Implicit Neural Representation Learning for Hyperspectral Image Super-Resolution
    Zhang, Kaiwei
    Zhu, Dandan
    Min, Xiongkuo
    Zhai, Guangtao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [47] ImpRes: implicit residual diffusion models for image super-resolution
    Zhang, Shiyun
    Deng, Xing
    Shao, Haijian
    Jiang, Yingtao
    VISUAL COMPUTER, 2024,
  • [48] Arbitrary Back-Projection Networks for Image Super-Resolution
    Ma, Tingsong
    Tian, Wenhong
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE AND APPLICATIONS, 2020, 19 (04)
  • [49] SRWarp: Generalized Image Super-Resolution under Arbitrary Transformation
    Son, Sanghyun
    Lee, Kyoung Mu
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 7778 - 7787
  • [50] DEPTH MAP INPAINTING AND SUPER-RESOLUTION WITH ARBITRARY SCALE FACTORS
    Truong, Anh Minh
    Veelaert, Peter
    Philips, Wilfried
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 488 - 497