Dyna-DM: Dynamic Object-aware Self-supervised Monocular Depth Maps

被引:4
|
作者
Saunders, Kieran [1 ]
Vogiatzis, George [2 ]
Manso, Luis J. [1 ]
机构
[1] Aston Univ, Dept Comp Sci, Birmingham, England
[2] Loughborough Univ, Dept Comp Sci, Loughborough, Leics, England
基金
英国工程与自然科学研究理事会;
关键词
Computer vision; Autonomous vehicles; 3D/stereo scene analysis; Vision and Scene Understanding;
D O I
10.1109/ICARSC58346.2023.10129564
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Self-supervised monocular depth estimation has been a subject of intense study in recent years, because of its applications in robotics and autonomous driving. Much of the recent work focuses on improving depth estimation by increasing architecture complexity. This paper shows that state-of-the-art performance can also be achieved by improving the learning process rather than increasing model complexity. More specifically, we propose (i) disregarding small potentially dynamic objects when training, and (ii) employing an appearance-based approach to separately estimate object pose for truly dynamic objects. We demonstrate that these simplifications reduce GPU memory usage by 29% and result in qualitatively and quantitatively improved depth maps.
引用
收藏
页码:10 / 16
页数:7
相关论文
共 50 条
  • [1] OBJECT-AWARE SELF-SUPERVISED MULTI-LABEL LEARNING
    Xu Kaixin
    Liu Liyang
    Zhao Ziyuan
    Zeng, Zeng
    Veeravalli, Bharadwaj
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 361 - 365
  • [2] Spatial-Aware Dynamic Lightweight Self-Supervised Monocular Depth Estimation
    Song, Linna
    Shi, Dianxi
    Xia, Jianqiang
    Ouyang, Qianying
    Qiao, Ziteng
    Jin, Songchang
    Yang, Shaowu
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (01): : 883 - 890
  • [3] Frequency-Aware Self-Supervised Monocular Depth Estimation
    Chen, Xingyu
    Li, Thomas H.
    Zhang, Ruonan
    Li, Ge
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 5797 - 5806
  • [4] Object-Aware Monocular Depth Prediction With Instance Convolutions
    Simsar, Enis
    Ornek, Evin Pnar
    Manhardt, Fabian
    Dhamo, Helisa
    Navab, Nassir
    Tombari, Federico
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02) : 5389 - 5396
  • [5] Self-Supervised Monocular Depth Hints
    Watson, Jamie
    Firman, Michael
    Brostow, Gabriel J.
    Turmukhambetov, Daniyar
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 2162 - 2171
  • [6] Self-Supervised Monocular Depth Underwater
    Amitai, Shlomi
    Klein, Itzik
    Treibitz, Tali
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 1098 - 1104
  • [7] Realtime Object-aware Monocular Depth Estimation in Onboard Systems
    Lee, Sangil
    Lee, Chungkeun
    Kim, Haram
    Kim, H. Jin
    INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2021, 19 (09) : 3179 - 3189
  • [8] Realtime Object-aware Monocular Depth Estimation in Onboard Systems
    Sangil Lee
    Chungkeun Lee
    Haram Kim
    H. Jin Kim
    International Journal of Control, Automation and Systems, 2021, 19 : 3179 - 3189
  • [9] Confidence-aware self-supervised learning for dense monocular depth estimation in dynamic laparoscopic scene
    Hirohata, Yasuhide
    Sogabe, Maina
    Miyazaki, Tetsuro
    Kawase, Toshihiro
    Kawashima, Kenji
    SCIENTIFIC REPORTS, 2023, 13 (01):
  • [10] Confidence-aware self-supervised learning for dense monocular depth estimation in dynamic laparoscopic scene
    Yasuhide Hirohata
    Maina Sogabe
    Tetsuro Miyazaki
    Toshihiro Kawase
    Kenji Kawashima
    Scientific Reports, 13 (1)