CVGSR: Stereo image Super-Resolution with Cross-View guidance *

被引:3
|
作者
Chen, Wenfei [1 ]
Ni, Shijia [2 ]
Shao, Feng [2 ]
机构
[1] Ningbo Inst Intelligent Equipment Technol Co Ltd, Ningbo 315200, Peoples R China
[2] Ningbo Univ, Fac Informat Sci & Engn, Ningbo 315211, Zhejiang, Peoples R China
关键词
Stereo image super-resolution; Cross-view interaction; Transformer; PARALLAX ATTENTION; NETWORK; MODULE;
D O I
10.1016/j.displa.2024.102736
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The ability to capture the complementary information of stereo images is critical to the development of stereo image super -resolution. Most existing studies have attempted to integrate reliable stereo correspondence along the polar directions through parallax attention and various fusion strategies. However, most of these approaches ignore the large parallax differences in stereo images, resulting in poor performance of convolutional -based parallax attention in capturing the long-range dependencies between images. In this paper, we propose a novel cross -view guided stereo image super -resolution network (CVGSR) for reconstructing high -resolution stereo image pairs with rich texture details by fully exploiting the complementary nature of stereo image pairs. Specifically, we first deploy a cross -view interaction module (CVIM) to explore intra/cross-view dependencies from local to global to compensate for the incomplete compatibility of information between the left and right views. This module uses a progressive cross -guiding strategy to better merge features from occluded and non -occluded regions. Based on this, an efficient attention Transformer (EAT) is improved to activate more input information and further mine the cross -view complementarity. Furthermore, we design a texture loss to optimize the visual perceptual quality of reconstructed images with sharp boundaries and rich texture details. Extensive experiments on four stereo image datasets demonstrate that the proposed CVGSR achieves a competitive and excellent performance.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Deep Bilateral Learning for Stereo Image Super-Resolution
    Xu, Qingyu
    Wang, Longguang
    Wang, Yingqian
    Sheng, Weidong
    Deng, Xinpu
    IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 613 - 617
  • [22] Improving Multi-View Stereo via Super-Resolution
    Lomurno, Eugenio
    Romanoni, Andrea
    Matteucci, Matteo
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT II, 2022, 13232 : 102 - 113
  • [23] Super-Resolution Reconstruction for Stereoscopic Omnidirectional Display Systems via Dynamic Convolutions and Cross-View Transformer
    Chai, Xiongli
    Shao, Feng
    Chen, Hangwei
    Mu, Baoyang
    Ho, Yo-Sung
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [24] Hyperspectral Image Super-Resolution with Optimized RGB Guidance
    Fu, Ying
    Zhang, Tao
    Zheng, Yinqiang
    Zhang, Debing
    Huang, Hua
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 11653 - 11662
  • [25] Cross-MPI: Cross-scale Stereo for Image Super-Resolution using Multiplane Images
    Zhou, Yuemei
    Wu, Gaochang
    Fu, Ying
    Li, Kun
    Liu, Yebin
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 14837 - 14846
  • [26] Jointly Texture Enhanced and Stereo Captured Network for Stereo Image Super-Resolution
    Jin, Kangjun
    Wang, Xuejin
    Shao, Feng
    PATTERN RECOGNITION LETTERS, 2023, 167 : 141 - 148
  • [27] Disparity-constrained stereo endoscopic image super-resolution
    Zhang, Tianyi
    Gu, Yun
    Huang, Xiaolin
    Yang, Jie
    Yang, Guang-Zhong
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2022, 17 (05) : 867 - 875
  • [28] Stereo digital image correlation using binocular super-resolution
    Yin, Zhuoyi
    Yuan, Fang
    Tong, Zixiang
    He, Xiaoyuan
    Yang, Fujun
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2025, 36 (01)
  • [29] A Disparity Feature Alignment Module for Stereo Image Super-Resolution
    Dan, Jiawang
    Qu, Zhaowei
    Wang, Xiaoru
    Gu, Jiahang
    IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 1285 - 1289
  • [30] Learning accurate and enriched features for stereo image super-resolution
    Gao, Hu
    Dang, Depeng
    PATTERN RECOGNITION, 2025, 159