Adaptive Kernel Convolutional Stereo Matching Recurrent Network

被引:0
|
作者
Wang, Jiamian [1 ,2 ]
Sun, Haijiang [1 ]
Jia, Ping [1 ,2 ]
机构
[1] Chinese Acad Sci, Changchun Inst Opt, Fine Mech & Phys, Changchun 130033, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
基金
中国国家自然科学基金;
关键词
stereo matching; GRU; adaptive; matching attention;
D O I
10.3390/s24227386
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
For binocular stereo matching techniques, the most advanced method currently is using an iterative structure based on GRUs. Methods in this class have shown high performance on both high-resolution images and standard benchmarks. However, simply replacing cost aggregation with a GRU iterative method leads to the original cost volume for disparity calculation lacking non-local geometric and contextual information. Based on this, this paper proposes a new GRU iteration-based adaptive kernel convolution deep recurrent network architecture for stereo matching. This paper proposes a kernel convolution-based adaptive multi-scale pyramid pooling (KAP) module that fully considers the spatial correlation between pixels and adds new matching attention (MAR) to refine the matching cost volume before inputting it into the iterative network for iterative updates, enhancing the pixel-level representation ability of the image and improving the overall generalization ability of the network. At present, the AKC-Stereo network proposed in this paper has a higher improvement than the basic network. On the Sceneflow dataset, the EPE of AKC-Stereo reaches 0.45, which is 0.02 higher than the basic network. On the KITTI 2015 dataset, the AKC-Stereo network outperforms the base network by 5.6% on the D1-all metric.
引用
收藏
页数:16
相关论文
共 50 条
  • [41] Binocular stereo matching of real scenes based on a convolutional neural network and computer graphics
    Kou, Liaoyu
    Yang, Kai
    Luo, Lin
    Zhang, Yu
    Li, Jinlong
    Wang, Yong
    Xie, Liming
    OPTICS EXPRESS, 2021, 29 (17) : 26876 - 26893
  • [42] Adaptive Matching of Kernel Means
    Cheng, Miao
    You, Xinge
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 2498 - 2505
  • [43] Adaptive Deconvolution-Based Stereo Matching Net for Local Stereo Matching
    Ma, Xin
    Zhang, Zhicheng
    Wang, Danfeng
    Luo, Yu
    Yuan, Hui
    APPLIED SCIENCES-BASEL, 2022, 12 (04):
  • [44] Pyramid Stereo Matching Network
    Chang, Jia-Ren
    Chen, Yong-Sheng
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 5410 - 5418
  • [45] Attention Stereo Matching Network
    Zhang, Doudou
    Cai, Jing
    Xue, Yanbing
    Gao, Zan
    Zhang, Hua
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 4973 - 4980
  • [46] Adaptive epipolar distance transform and adaptive matching cost for stereo matching
    Zhang, Yakun
    Li, Haibin
    Zhang, Wenming
    JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2021, 38 (08) : 1170 - 1177
  • [47] Stereo Object Matching Network
    Choe, Jaesung
    Joo, Kyungdon
    Rameau, Francois
    Kweon, In So
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 12918 - 12924
  • [48] Intrusion Detection Model for IoT Using Recurrent Kernel Convolutional Neural Network
    Kumar, C. U. Om
    Marappan, Suguna
    Murugeshan, Bhavadharini
    Beaulah, V. Mercy Rajaselvi
    WIRELESS PERSONAL COMMUNICATIONS, 2023, 129 (02) : 783 - 812
  • [49] Intrusion Detection Model for IoT Using Recurrent Kernel Convolutional Neural Network
    C. U. Om Kumar
    Suguna Marappan
    Bhavadharini Murugeshan
    P. Mercy Rajaselvi Beaulah
    Wireless Personal Communications, 2023, 129 : 783 - 812
  • [50] Adaptive Modulation and Rectangular Convolutional Network for Stereo Image Super-Resolution
    Wang, Xiumei
    Li, Tianmeng
    Hui, Zheng
    Cheng, Peitao
    PATTERN RECOGNITION LETTERS, 2022, 161 : 122 - 129