CVGSR: Stereo image Super-Resolution with Cross-View guidance *

被引:3
|
作者
Chen, Wenfei [1 ]
Ni, Shijia [2 ]
Shao, Feng [2 ]
机构
[1] Ningbo Inst Intelligent Equipment Technol Co Ltd, Ningbo 315200, Peoples R China
[2] Ningbo Univ, Fac Informat Sci & Engn, Ningbo 315211, Zhejiang, Peoples R China
关键词
Stereo image super-resolution; Cross-view interaction; Transformer; PARALLAX ATTENTION; NETWORK; MODULE;
D O I
10.1016/j.displa.2024.102736
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The ability to capture the complementary information of stereo images is critical to the development of stereo image super -resolution. Most existing studies have attempted to integrate reliable stereo correspondence along the polar directions through parallax attention and various fusion strategies. However, most of these approaches ignore the large parallax differences in stereo images, resulting in poor performance of convolutional -based parallax attention in capturing the long-range dependencies between images. In this paper, we propose a novel cross -view guided stereo image super -resolution network (CVGSR) for reconstructing high -resolution stereo image pairs with rich texture details by fully exploiting the complementary nature of stereo image pairs. Specifically, we first deploy a cross -view interaction module (CVIM) to explore intra/cross-view dependencies from local to global to compensate for the incomplete compatibility of information between the left and right views. This module uses a progressive cross -guiding strategy to better merge features from occluded and non -occluded regions. Based on this, an efficient attention Transformer (EAT) is improved to activate more input information and further mine the cross -view complementarity. Furthermore, we design a texture loss to optimize the visual perceptual quality of reconstructed images with sharp boundaries and rich texture details. Extensive experiments on four stereo image datasets demonstrate that the proposed CVGSR achieves a competitive and excellent performance.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] CVGSR: Stereo image super-resolution with cross-view guidance (vol 83, 102736, 2024)
    Chen, Wenfei
    Ni, Shijia
    Shao, Feng
    DISPLAYS, 2024, 85
  • [2] Hybrid Cross-View Attention Network for Lightweight Stereo Image Super-Resolution
    Yang, Yuqiang
    Zhang, Zhiming
    Du, Yao
    Yang, Jingjing
    Bao, Long
    Sun, Heng
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW, 2024, : 6055 - 6064
  • [3] Strong-Weak Cross-View Interaction Network for Stereo Image Super-Resolution
    He, Kun
    Li, Changyu
    Shao, Jie
    PROCEEDINGS OF THE 2023 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2023, 2023, : 550 - 554
  • [4] Cross View Capture for Stereo Image Super-Resolution
    Zhu, Xiangyuan
    Guo, Kehua
    Fang, Hui
    Chen, Liang
    Ren, Sheng
    Hu, Bin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 3074 - 3086
  • [5] Cross-View Attention Interaction Fusion Algorithm for Stereo Super-Resolution
    Zhang, Yaru
    Liu, Jiantao
    Zhang, Tong
    Zhao, Zhibiao
    APPLIED SCIENCES-BASEL, 2023, 13 (12):
  • [6] Coarse-to-Fine Cross-View Interaction Based Accurate Stereo Image Super-Resolution Network
    Liu, Anqi
    Li, Sumei
    Chang, Yongli
    Zhang, Wenlin
    Hou, Yonghong
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 7321 - 7334
  • [7] CVIformer: Cross-View Interactive Transformer for Efficient Stereoscopic Image Super-Resolution
    Zhang, Dongyang
    Liang, Shuang
    He, Tao
    Shao, Jie
    Qin, Ke
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024,
  • [8] Two-stage Parallax Correction and Multi-stage Cross-view Fusion Network Based Stereo Image Super-Resolution
    Zheng, Yijian
    Li, Sumei
    2021 INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2021,
  • [9] Cross Parallax Attention Network for Stereo Image Super-Resolution
    Chen, Canqiang
    Qing, Chunmei
    Xu, Xiangmin
    Dickinson, Patrick
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 202 - 216
  • [10] Stereo Image Super-Resolution: A Survey
    Wang Yingqian
    Wang Longguang
    Liang Zhengyu
    An Wei
    Yang Jungang
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (18)