UNCERTAINTY AWARE IMPLICIT IMAGE FUNCTION FOR ARBITRARY-SCALE SUPER-RESOLUTION

被引:0
|
作者
Jena, Swastik [1 ]
Panda, Saptarshi [2 ]
Balabantaray, Bunil Kumar [1 ]
Nayak, Rajashree [3 ]
机构
[1] Natl Inst Technol Meghalaya, Dept Comp Sci & Engn, Shillong, Meghalaya, India
[2] Natl Inst Technol Meghalaya, Dept Civil Engn, Shillong, Meghalaya, India
[3] JIS Inst Adv Studies & Res, Ctr Data Sci, Kolkata, India
关键词
SISR; INR; Self-supervised learning; Model uncertainty;
D O I
10.1109/ICIP49359.2023.10222673
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The most integral step in computer vision and image processing tasks is the representation of images. Recently, continuous image parameterization using Implicit Neural Representations (INR) has shown a great advantage over discrete representations due to their spatial invariance. This property immediately finds application in the context of single-image super-resolution (SISR) at an arbitrary scale. However, most super-resolution models, including the INR-based Local Implicit Image Function (LIIF), produce only a single output, failing to address the ill-posedness of SISR. Moreover, these models tend to optimize a mean-squared-error (MSE) based loss function which causes blurring and structural distortion in regions exhibiting a high degree of variance (details). Our work proposes a novel uncertainty-aware self-supervised methodology (U-LIIF) that extends on LIIF, to reduce the blurriness and deals with the ill-posedness of SISR. Our U-LIIF does not require any re-training and yields diversified high-resolution images by leveraging model uncertainty. The efficacy of the proposed method is validated by substantial experiments on various benchmark datasets.
引用
收藏
页码:2440 / 2444
页数:5
相关论文
共 50 条
  • [31] Cross Transformer Network for Scale-Arbitrary Image Super-Resolution
    He, Dehong
    Wu, Song
    Liu, Jinpeng
    Xiao, Guoqiang
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT II, 2022, 13369 : 633 - 644
  • [32] OPE-SR: Orthogonal Position Encoding for Designing a Parameter-free Upsampling Module in Arbitrary-scale Image Super-Resolution
    Song, Gaochao
    Sun, Qian
    Zhang, Luo
    Su, Ran
    Shi, Jianfeng
    He, Ying
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 10009 - 10020
  • [33] Scale-Aware Distillation Network for Lightweight Image Super-Resolution
    Lu, Haowei
    Lu, Yao
    Li, Gongping
    Sun, Yanbei
    Wang, Shunzhou
    Li, Yugang
    PATTERN RECOGNITION AND COMPUTER VISION,, PT III, 2021, 13021 : 128 - 139
  • [34] Arbitrary Scale Super-Resolution for Medical Images
    Zhu, Jin
    Tan, Chuan
    Yang, Junwei
    Yang, Guang
    Lio, Pietro
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2021, 31 (10)
  • [35] Resolution-Aware Network for Image Super-Resolution
    Wang, Yifan
    Wang, Lijun
    Wang, Hongyu
    Li, Peihua
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (05) : 1259 - 1269
  • [36] Memory-Efficient Discrete Cosine Transform Domain Weight Modulation Transformer for Arbitrary-Scale Super-Resolution
    Kim, Min Hyuk
    Yoo, Seok Bong
    MATHEMATICS, 2023, 11 (18)
  • [37] A Novel Learnable Interpolation Approach for Scale-Arbitrary Image Super-Resolution
    Chao, Jiahao
    Zhou, Zhou
    Gao, Hongfan
    Gong, Jiali
    Zeng, Zhenbing
    Yang, Zhengfeng
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 564 - 572
  • [38] Spectral Bayesian Uncertainty for Image Super-resolution
    Liu, Tao
    Cheng, Jun
    Tan, Shan
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 18166 - 18175
  • [39] Image super-resolution reconstruction based on implicit image functions
    Lin, Hai
    Yang, JunJie
    IET IMAGE PROCESSING, 2024, 18 (10) : 2690 - 2701
  • [40] Image Super-Resolution with Implicit Texture Pattern Modulation
    Hao, Shuai
    Yang, Jialin
    Jia, Xu
    He, You
    Lu, Huchuan
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 1247 - 1252