CVGSR: Stereo image Super-Resolution with Cross-View guidance *

被引:3
|
作者
Chen, Wenfei [1 ]
Ni, Shijia [2 ]
Shao, Feng [2 ]
机构
[1] Ningbo Inst Intelligent Equipment Technol Co Ltd, Ningbo 315200, Peoples R China
[2] Ningbo Univ, Fac Informat Sci & Engn, Ningbo 315211, Zhejiang, Peoples R China
关键词
Stereo image super-resolution; Cross-view interaction; Transformer; PARALLAX ATTENTION; NETWORK; MODULE;
D O I
10.1016/j.displa.2024.102736
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The ability to capture the complementary information of stereo images is critical to the development of stereo image super -resolution. Most existing studies have attempted to integrate reliable stereo correspondence along the polar directions through parallax attention and various fusion strategies. However, most of these approaches ignore the large parallax differences in stereo images, resulting in poor performance of convolutional -based parallax attention in capturing the long-range dependencies between images. In this paper, we propose a novel cross -view guided stereo image super -resolution network (CVGSR) for reconstructing high -resolution stereo image pairs with rich texture details by fully exploiting the complementary nature of stereo image pairs. Specifically, we first deploy a cross -view interaction module (CVIM) to explore intra/cross-view dependencies from local to global to compensate for the incomplete compatibility of information between the left and right views. This module uses a progressive cross -guiding strategy to better merge features from occluded and non -occluded regions. Based on this, an efficient attention Transformer (EAT) is improved to activate more input information and further mine the cross -view complementarity. Furthermore, we design a texture loss to optimize the visual perceptual quality of reconstructed images with sharp boundaries and rich texture details. Extensive experiments on four stereo image datasets demonstrate that the proposed CVGSR achieves a competitive and excellent performance.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Adaptive Modulation and Rectangular Convolutional Network for Stereo Image Super-Resolution
    Wang, Xiumei
    Li, Tianmeng
    Hui, Zheng
    Cheng, Peitao
    PATTERN RECOGNITION LETTERS, 2022, 161 : 122 - 129
  • [42] Lightweight Stereo Image Super-Resolution Using modified Parallax Attention
    Govind, Smriti
    Pradeep, R.
    JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2025,
  • [43] Multi-orientation depthwise extraction for stereo image super-resolution
    Xiangyang Fan
    Renjia Ye
    Feifan Cai
    Jinhua Liu
    Yuhang Li
    Liting Huang
    Youdong Ding
    Signal, Image and Video Processing, 2023, 17 : 4087 - 4095
  • [44] NTIRE 2022 Challenge on Stereo Image Super-Resolution: Methods and Results
    Wang, Longguang
    Guo, Yulan
    Wang, Yingqian
    Li, Juncheng
    Gu, Shuhang
    Timofte, Radu
    Chen, Liangyu
    Chu, Xiaojie
    Yu, Wenqing
    Jin, Kai
    Wei, Zeqiang
    Guo, Sha
    Yang, Angulia
    Zhou, Xiuzhuang
    Guo, Guodong
    Dai, Bin
    Peng, Feiyue
    Xiao, Huaxin
    Yan, Shen
    Liu, Yuxiang
    Cai, Hanxiao
    Cao, Pu
    Nie, Yang
    Yang, Lu
    Song, Qing
    Hu, Xiaotao
    Xu, Jun
    Xu, Mai
    Jing, Junpeng
    Deng, Xin
    Xing, Qunliang
    Qiao, Minglang
    Guan, Zhenyu
    Guo, Wenlong
    Peng, Chenxu
    Chen, Zan
    Chen, Junyang
    Li, Hao
    Chen, Junbin
    Li, Weijie
    Yang, Zhijing
    Li, Gen
    Li, Aijin
    Sun, Lei
    Zhang, Dafeng
    Liu, Shizhuo
    Zhang, Jiangtao
    Qu, Yanyun
    Yang, Hao-Hsiang
    Huang, Zhi-Kai
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 905 - 918
  • [45] Efficient Hybrid Feature Interaction Network for Stereo Image Super-Resolution
    Song, Jianwen
    Sowmya, Arcot
    Sun, Changming
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 10094 - 10105
  • [46] Multi-orientation depthwise extraction for stereo image super-resolution
    Fan, Xiangyang
    Ye, Renjia
    Cai, Feifan
    Liu, Jinhua
    Li, Yuhang
    Huang, Liting
    Ding, Youdong
    SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (08) : 4087 - 4095
  • [47] TBNet: Stereo Image Super-Resolution with Multi-Scale Attention
    Zhu, Jiyang
    Han, Xue
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2023, 32 (18)
  • [48] A multi-scale feature cross-dimensional interaction network for stereo image super-resolution
    Zhang, Jingcheng
    Zhu, Yu
    Peng, Shengjun
    Niu, Axi
    Yan, Qingsen
    Sun, Jinqiu
    Zhang, Yanning
    MULTIMEDIA SYSTEMS, 2025, 31 (02)
  • [49] Dual cross knowledge distillation for image super-resolution
    Fang, Hangxiang
    Long, Yongwen
    Hu, Xinyi
    Ou, Yangtao
    Huang, Yuanjia
    Hu, Haoji
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 95
  • [50] Hyperspectral Image Super-Resolution with RGB Image Super-Resolution as an Auxiliary Task
    Li, Ke
    Dai, Dengxin
    van Gool, Luc
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 4039 - 4048