CVGSR: Stereo image Super-Resolution with Cross-View guidance *

被引:3
|
作者
Chen, Wenfei [1 ]
Ni, Shijia [2 ]
Shao, Feng [2 ]
机构
[1] Ningbo Inst Intelligent Equipment Technol Co Ltd, Ningbo 315200, Peoples R China
[2] Ningbo Univ, Fac Informat Sci & Engn, Ningbo 315211, Zhejiang, Peoples R China
关键词
Stereo image super-resolution; Cross-view interaction; Transformer; PARALLAX ATTENTION; NETWORK; MODULE;
D O I
10.1016/j.displa.2024.102736
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The ability to capture the complementary information of stereo images is critical to the development of stereo image super -resolution. Most existing studies have attempted to integrate reliable stereo correspondence along the polar directions through parallax attention and various fusion strategies. However, most of these approaches ignore the large parallax differences in stereo images, resulting in poor performance of convolutional -based parallax attention in capturing the long-range dependencies between images. In this paper, we propose a novel cross -view guided stereo image super -resolution network (CVGSR) for reconstructing high -resolution stereo image pairs with rich texture details by fully exploiting the complementary nature of stereo image pairs. Specifically, we first deploy a cross -view interaction module (CVIM) to explore intra/cross-view dependencies from local to global to compensate for the incomplete compatibility of information between the left and right views. This module uses a progressive cross -guiding strategy to better merge features from occluded and non -occluded regions. Based on this, an efficient attention Transformer (EAT) is improved to activate more input information and further mine the cross -view complementarity. Furthermore, we design a texture loss to optimize the visual perceptual quality of reconstructed images with sharp boundaries and rich texture details. Extensive experiments on four stereo image datasets demonstrate that the proposed CVGSR achieves a competitive and excellent performance.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] A Disparity Feature Alignment Module for Stereo Image Super-Resolution
    Dan, Jiawang
    Qu, Zhaowei
    Wang, Xiaoru
    Gu, Jiahang
    IEEE Signal Processing Letters, 2021, 28 : 1285 - 1289
  • [32] Disparity-constrained stereo endoscopic image super-resolution
    Tianyi Zhang
    Yun Gu
    Xiaolin Huang
    Jie Yang
    Guang-Zhong Yang
    International Journal of Computer Assisted Radiology and Surgery, 2022, 17 : 867 - 875
  • [33] Decoupled Cross-Scale Cross-View Interaction for Stereo Image Enhancement in The Dark
    Zheng, Huan
    Zhang, Zhao
    Fan, Jicong
    Hong, Richang
    Yang, Yi
    Yan, Shuicheng
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 1475 - 1484
  • [34] Cross-View Image Translation Based on Local and Global Information Guidance
    Shen, Yan
    Luo, Meng
    Chen, Yun
    Shao, Xiaotao
    Wang, Zhongli
    Hao, Xiaoli
    Hou, Ya-Li
    IEEE ACCESS, 2021, 9 : 12955 - 12967
  • [35] Cross-View Image Geolocalization
    Lin, Tsung-Yi
    Belongie, Serge
    Hays, James
    2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, : 891 - 898
  • [36] DGRN: Image super-resolution with dual gradient regression guidance
    Yang, HeLiang
    Zhang, YongJun
    Cui, ZhongWei
    Xu, YuJie
    Yang, YiTong
    COMPUTERS & GRAPHICS-UK, 2023, 110 : 141 - 150
  • [37] Disparity-based Stereo Image Compression with Aligned Cross-View Priors
    Zhai, Yongqi
    Tang, Luyang
    Ma, Yi
    Peng, Rui
    Wang, Ronggang
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 2351 - 2360
  • [38] VIDEO SUPER-RESOLUTION FOR MIXED RESOLUTION STEREO
    Jain, Ankit K.
    Nguyen, Truong Q.
    2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013), 2013, : 962 - 966
  • [39] NLSIT: A NON-LOCAL STEREO INTERACTION TRANSFORMER FOR STEREO IMAGE SUPER-RESOLUTION
    Cao, Huiyun
    Huang, Wenqi
    Yang, Wenming
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 3965 - 3969
  • [40] Progressive Stereo Image Dehazing Network via Cross-View Region Interaction
    Wang, Junhu
    Wei, Yanyan
    Zhang, Zhao
    Fan, Jicong
    Zhao, Yang
    Yang, Yi
    Wang, Meng
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 7490 - 7502