Adaptive Kernel Convolutional Stereo Matching Recurrent Network

被引:0
|
作者
Wang, Jiamian [1 ,2 ]
Sun, Haijiang [1 ]
Jia, Ping [1 ,2 ]
机构
[1] Chinese Acad Sci, Changchun Inst Opt, Fine Mech & Phys, Changchun 130033, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
基金
中国国家自然科学基金;
关键词
stereo matching; GRU; adaptive; matching attention;
D O I
10.3390/s24227386
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
For binocular stereo matching techniques, the most advanced method currently is using an iterative structure based on GRUs. Methods in this class have shown high performance on both high-resolution images and standard benchmarks. However, simply replacing cost aggregation with a GRU iterative method leads to the original cost volume for disparity calculation lacking non-local geometric and contextual information. Based on this, this paper proposes a new GRU iteration-based adaptive kernel convolution deep recurrent network architecture for stereo matching. This paper proposes a kernel convolution-based adaptive multi-scale pyramid pooling (KAP) module that fully considers the spatial correlation between pixels and adds new matching attention (MAR) to refine the matching cost volume before inputting it into the iterative network for iterative updates, enhancing the pixel-level representation ability of the image and improving the overall generalization ability of the network. At present, the AKC-Stereo network proposed in this paper has a higher improvement than the basic network. On the Sceneflow dataset, the EPE of AKC-Stereo reaches 0.45, which is 0.02 higher than the basic network. On the KITTI 2015 dataset, the AKC-Stereo network outperforms the base network by 5.6% on the D1-all metric.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] Adaptive Graph Convolutional Recurrent Network for Traffic Forecasting
    Bai, Lei
    Yao, Lina
    Li, Can
    Wang, Xianzhi
    Wang, Can
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS (NEURIPS 2020), 2020, 33
  • [22] Detecting ground control points via convolutional neural network for stereo matching
    Zhong, Zhun
    Su, Songzhi
    Cao, Donglin
    Li, Shaozi
    Lv, Zhihan
    MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (18) : 18473 - 18488
  • [23] Novel shrinking residual convolutional neural network for efficient accurate stereo matching
    Lei, Junfeng
    Dong, Yuxuan
    Zhao, Tao
    Xiao, Jinsheng
    Chen, Yunhua
    Li, Bijun
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2020, 72
  • [24] Convolutional neural network based deep conditional random fields for stereo matching
    Wang, Zhi
    Zhu, Shiqiang
    Li, Yuehua
    Cui, Zhengzhe
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2016, 40 : 739 - 750
  • [25] Detecting ground control points via convolutional neural network for stereo matching
    Zhun Zhong
    Songzhi Su
    Donglin Cao
    Shaozi Li
    Zhihan Lv
    Multimedia Tools and Applications, 2017, 76 : 18473 - 18488
  • [26] Stereo Matching Algorithm Based on Three-Dimensional Convolutional Neural Network
    Wang Yufeng
    Wang Hongwei
    Yu Guang
    Yang Mingquan
    Yuan Yuwei
    Quan Jicheng
    ACTA OPTICA SINICA, 2019, 39 (11)
  • [27] Neural adaptive stereo matching
    Binaghi, E
    Gallo, I
    Marino, G
    Raspanti, M
    PATTERN RECOGNITION LETTERS, 2004, 25 (15) : 1743 - 1758
  • [28] Sequential Multi-Kernel Convolutional Recurrent Network for Sentiment Classification
    Oluwasanmi, Ariyo
    Akeem, Shokanbi
    Jehoaida, Jackson
    Aftab, Muhammad Umar
    Hundera, Negalign
    Kumeda, Bulbula
    Baagere, Edward
    Qin, Zhiguang
    PROCEEDINGS OF 2019 IEEE 10TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS 2019), 2019, : 129 - 133
  • [29] RomniStereo: Recurrent Omnidirectional Stereo Matching
    Jiang, Hualie
    Xu, Rui
    Tan, Minglang
    Jiang, Wenjie
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (03) : 2511 - 2518
  • [30] Recurrent convolutional model based on gated spiking neural P system for stereo matching networks
    Guo, Chenggang
    Peng, Hong
    Wang, Jun
    APPLIED INTELLIGENCE, 2023, 53 (24) : 29570 - 29584