Depth estimation using an improved stereo network

被引:1
|
作者
Xu, Wanpeng [1 ]
Zou, Ling [3 ]
Wu, Lingda [1 ]
Qi, Yue [2 ]
Qian, Zhaoyong [1 ]
机构
[1] Space Engn Univ, Sci & Technol Complex Elect Syst Simulat Lab, Beijing 101416, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518055, Peoples R China
[3] Beijing Film Acad, Digital Media Sch, Beijing 100088, Peoples R China
基金
中国国家自然科学基金;
关键词
Monocular depth estimation; Self-supervised; Image reconstruction; TP391; 4;
D O I
10.1631/FITEE.2000676
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Self-supervised depth estimation approaches present excellent results that are comparable to those of the fully supervised approaches, by employing view synthesis between the target and reference images in the training data. ResNet, which serves as a backbone network, has some structural deficiencies when applied to downstream fields, because its original purpose was to cope with classification problems. The low-texture area also deteriorates the performance. To address these problems, we propose a set of improvements that lead to superior predictions. First, we boost the information flow in the network and improve the ability to learn spatial structures by improving the network structures. Second, we use a binary mask to remove the pixels in low-texture areas between the target and reference images to more accurately reconstruct the image. Finally, we input the target and reference images randomly to expand the dataset and pre-train it on ImageNet, so that the model obtains a favorable general feature representation. We demonstrate state-of-the-art performance on an Eigen split of the KITTI driving dataset using stereo pairs.
引用
收藏
页码:777 / 789
页数:13
相关论文
共 50 条
  • [1] Depth estimation using an improved stereo network (vol 23, pg 777, 2022)
    Xu, Wanpeng
    Zou, Ling
    Wu, Lingda
    Qi, Yue
    Qian, Zhaoyong
    FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2023,
  • [2] Improved Stereo Depth Estimation Using Smoothness and Geometrical Attention
    Zarei, Seyedeh-Parisa
    Soltanian-Zadeh, Hamid
    Kalhor, Ahmad
    PROCEEDINGS OF THE 13TH IRANIAN/3RD INTERNATIONAL MACHINE VISION AND IMAGE PROCESSING CONFERENCE, MVIP, 2024, : 11 - 14
  • [3] Depth estimation using an improved stereo network基于改进立体网络的深度估计
    Wanpeng Xu
    Ling Zou
    Lingda Wu
    Yue Qi
    Zhaoyong Qian
    Frontiers of Information Technology & Electronic Engineering, 2022, 23 : 777 - 789
  • [4] Improved depth map estimation in Stereo Vision
    Fradi, Hajer
    Dugelay, Jean-Luc
    STEREOSCOPIC DISPLAYS AND APPLICATIONS XXII, 2011, 7863
  • [5] ADAPTIVE RESISTIVE NETWORK FOR STEREO DEPTH ESTIMATION
    RAFFO, L
    ELECTRONICS LETTERS, 1995, 31 (22) : 1909 - 1910
  • [6] Dual-stream stereo network for depth estimation
    Yangyang Zhong
    Tong Jia
    Kaiqi Xi
    Wenhao Li
    Dongyue Chen
    The Visual Computer, 2023, 39 : 5343 - 5357
  • [7] Dual-stream stereo network for depth estimation
    Zhong, Yangyang
    Jia, Tong
    Xi, Kaiqi
    Li, Wenhao
    Chen, Dongyue
    VISUAL COMPUTER, 2023, 39 (11): : 5343 - 5357
  • [8] An Improved Depth Estimation using Stereo Matching and Disparity Refinement Based on Deep Learning
    Deepa
    Jyothi, K.
    Udupa, Abhishek A.
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (11) : 552 - 559
  • [9] Depth Estimation using Monocular and Stereo Cues
    Saxena, Ashutosh
    Schulte, Jamie
    Ng, Andrew Y.
    20TH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2007, : 2197 - 2203
  • [10] Stereo Image Warping for Improved Depth Estimation of Road Surfaces
    Einecke, Nils
    Eggert, Julian
    2013 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2013, : 189 - 194