CVGSR: Stereo image Super-Resolution with Cross-View guidance *

被引:3
|
作者
Chen, Wenfei [1 ]
Ni, Shijia [2 ]
Shao, Feng [2 ]
机构
[1] Ningbo Inst Intelligent Equipment Technol Co Ltd, Ningbo 315200, Peoples R China
[2] Ningbo Univ, Fac Informat Sci & Engn, Ningbo 315211, Zhejiang, Peoples R China
关键词
Stereo image super-resolution; Cross-view interaction; Transformer; PARALLAX ATTENTION; NETWORK; MODULE;
D O I
10.1016/j.displa.2024.102736
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The ability to capture the complementary information of stereo images is critical to the development of stereo image super -resolution. Most existing studies have attempted to integrate reliable stereo correspondence along the polar directions through parallax attention and various fusion strategies. However, most of these approaches ignore the large parallax differences in stereo images, resulting in poor performance of convolutional -based parallax attention in capturing the long-range dependencies between images. In this paper, we propose a novel cross -view guided stereo image super -resolution network (CVGSR) for reconstructing high -resolution stereo image pairs with rich texture details by fully exploiting the complementary nature of stereo image pairs. Specifically, we first deploy a cross -view interaction module (CVIM) to explore intra/cross-view dependencies from local to global to compensate for the incomplete compatibility of information between the left and right views. This module uses a progressive cross -guiding strategy to better merge features from occluded and non -occluded regions. Based on this, an efficient attention Transformer (EAT) is improved to activate more input information and further mine the cross -view complementarity. Furthermore, we design a texture loss to optimize the visual perceptual quality of reconstructed images with sharp boundaries and rich texture details. Extensive experiments on four stereo image datasets demonstrate that the proposed CVGSR achieves a competitive and excellent performance.
引用
收藏
页数:12
相关论文
共 50 条
  • [11] A Stereo Attention Module for Stereo Image Super-Resolution
    Ying, Xinyi
    Wang, Yingqian
    Wang, Longguang
    Sheng, Weidong
    An, Wei
    Guo, Yulan
    IEEE SIGNAL PROCESSING LETTERS, 2020, 27 : 496 - 500
  • [12] Single Image Super-Resolution with Gradient Guidance
    Man, Wang
    Du, Xiaofeng
    2021 INTERNATIONAL CONFERENCE ON COMPUTER, CONTROL AND ROBOTICS (ICCCR 2021), 2021, : 304 - 309
  • [13] Cross-View Recurrence-Based Self-Supervised Super-Resolution of Light Field
    Sheng, Hao
    Wang, Sizhe
    Yang, Da
    Cong, Ruixuan
    Cui, Zhenglong
    Chen, Rongshan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (12) : 7252 - 7266
  • [14] Perception-Oriented Stereo Image Super-Resolution
    Ma, Chenxi
    Yan, Bo
    Tan, Weimin
    Jiang, Xuhao
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 2420 - 2428
  • [15] Steformer: Efficient Stereo Image Super-Resolution With Transformer
    Lin, Jianxin
    Yin, Lianying
    Wang, Yijun
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 8396 - 8407
  • [16] Learning Parallax Attention for Stereo Image Super-Resolution
    Wang, Longguang
    Wang, Yingqian
    Liang, Zhengfa
    Lin, Zaiping
    Yang, Jungang
    An, Wei
    Guo, Yulan
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 12242 - 12251
  • [17] NAFSSR: Stereo Image Super-Resolution Using NAFNet
    Chu, Xiaojie
    Chen, Liangyu
    Yu, Wenqing
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 1238 - 1247
  • [18] Symmetric Parallax Attention for Stereo Image Super-Resolution
    Wang, Yingqian
    Ying, Xinyi
    Wang, Longguang
    Yang, Jungang
    An, Wei
    Guo, Yulan
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 766 - 775
  • [19] Stereoscopic Image Super-Resolution with Stereo Consistent Feature
    Song, Wonil
    Choi, Sungil
    Jeong, Somi
    Sohn, Kwanghoon
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 12031 - 12038
  • [20] Joint Feature Aggregation for Stereo Image Super-resolution
    Ai, Zekun
    Luo, Xiaotong
    Qu, Yanyun
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 480 - 485