Depth-Guided Aggregation for Real-Time Binocular Depth Estimation Network

被引:0
|
作者
Fu, Dongxin [1 ]
Zheng, Shaowu [1 ]
Xie, Pengcheng [1 ]
Li, Weihua [1 ]
机构
[1] South China Univ Technol, Guangzhou, Peoples R China
关键词
Costs; Estimation; Feature extraction; Three-dimensional displays; Convolution; Real-time systems; Data mining; Cameras;
D O I
10.1109/MMUL.2024.3395695
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Using binocular cameras to obtain depth information of target pixels offers a cost-effective and natural alternative to lidar systems. However, most of the current binocular depth estimation networks have difficulty achieving a better balance between speed and accuracy in real-world situations, and their prediction accuracy for long-range depth is often limited. In this article, we introduce the end-to-end real-time depth estimation network (RTDENet), which efficiently utilizes multiscale cost volumes for improved performance. We propose an efficient and flexible cost aggregation module that supplements residual information with high-resolution cost volumes. By replacing some computationally demanding 3-D convolutional layers with depth-guided excitation, we maintain accuracy while effectively controlling model computation. Alongside the distance-sensitive loss function, RTDENet achieves a global difference of 2.41 m and an inference time of 27 ms on the KITTI Stereo dataset. This balance of speed and accuracy outperforms other state-of-the-art algorithms in depth estimation tasks.
引用
收藏
页码:36 / 47
页数:12
相关论文
共 50 条
  • [1] A real-time semi-dense depth-guided depth completion network
    Xu, JieJie
    Zhu, Yisheng
    Wang, Wenqing
    Liu, Guangcan
    VISUAL COMPUTER, 2024, 40 (01): : 87 - 97
  • [2] A real-time semi-dense depth-guided depth completion network
    JieJie Xu
    Yisheng Zhu
    Wenqing Wang
    Guangcan Liu
    The Visual Computer, 2024, 40 : 87 - 97
  • [3] DenseLiDAR: A Real-Time Pseudo Dense Depth Guided Depth Completion Network
    Gu, Jiaqi
    Xiang, Zhiyu
    Ye, Yuwen
    Wang, Lingxuan
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (02) : 1808 - 1815
  • [4] Depth-Guided Progressive Network for Object Detection
    Ma, Jia-Wei
    Liang, Min
    Chen, Song-Lu
    Chen, Feng
    Tian, Shu
    Qin, Jingyan
    Yin, Xu-Cheng
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (10) : 19523 - 19533
  • [5] MVDepthNet: Real-time Multiview Depth Estimation Neural Network
    Wang, Kaixuan
    Shen, Shaojie
    2018 INTERNATIONAL CONFERENCE ON 3D VISION (3DV), 2018, : 248 - 257
  • [6] OptiDepthNet: A Real-Time Unsupervised Monocular Depth Estimation Network
    Feng Wei
    XingHui Yin
    Jie Shen
    HuiBin Wang
    Wireless Personal Communications, 2023, 128 : 2831 - 2846
  • [7] OptiDepthNet: A Real-Time Unsupervised Monocular Depth Estimation Network
    Wei, Feng
    Yin, XingHui
    Shen, Jie
    Wang, HuiBin
    WIRELESS PERSONAL COMMUNICATIONS, 2023, 128 (04) : 2831 - 2846
  • [8] Single-Image Real-Time Rain Removal Based on Depth-Guided Non-Local Features
    Hu, Xiaowei
    Zhu, Lei
    Wang, Tianyu
    Fu, Chi-Wing
    Heng, Pheng-Ann
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 1759 - 1770
  • [9] Depth-Guided Deep Video Inpainting
    Li, Shibo
    Zhu, Shuyuan
    Ge, Yao
    Zeng, Bing
    Imran, Muhammad Ali
    Abbasi, Qammer H.
    Cooper, Jonathan
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 5860 - 5871
  • [10] Depth-Guided Bilateral Grid Feature Fusion Network for Dehazing
    Li, Xinyu
    Qiao, Zhi
    Wan, Gang
    Zhu, Sisi
    Zhao, Zhongxin
    Fan, Xinnan
    Shi, Pengfei
    Wan, Jin
    SENSORS, 2024, 24 (11)