Real-time large-scale dense RGB-D SLAM with volumetric fusion

被引:304
|
作者
Whelan, Thomas [1 ]
Kaess, Michael [2 ]
Johannsson, Hordur [3 ]
Fallon, Maurice [3 ]
Leonard, John J. [3 ]
McDonald, John [1 ]
机构
[1] Natl Univ Ireland, Dept Comp Sci, Maynooth, Kildare, Ireland
[2] Carnegie Mellon Univ, Inst Robot, Pittsburgh, PA 15213 USA
[3] MIT, Cambridge, MA 02139 USA
来源
基金
爱尔兰科学基金会; 美国国家科学基金会;
关键词
Volumetric fusion; camera pose estimation; dense methods; large scale; real time; RGB-D; SLAM; GPU;
D O I
10.1177/0278364914551008
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
We present a new simultaneous localization and mapping (SLAM) system capable of producing high-quality globally consistent surface reconstructions over hundreds of meters in real time with only a low-cost commodity RGB-D sensor. By using a fused volumetric surface reconstruction we achieve a much higher quality map over what would be achieved using raw RGB-D point clouds. In this paper we highlight three key techniques associated with applying a volumetric fusion-based mapping system to the SLAM problem in real time. First, the use of a GPU-based 3D cyclical buffer trick to efficiently extend dense every-frame volumetric fusion of depth maps to function over an unbounded spatial region. Second, overcoming camera pose estimation limitations in a wide variety of environments by combining both dense geometric and photometric camera pose constraints. Third, efficiently updating the dense map according to place recognition and subsequent loop closure constraints by the use of an as-rigid-as-possible' space deformation. We present results on a wide variety of aspects of the system and show through evaluation on de facto standard RGB-D benchmarks that our system performs strongly in terms of trajectory estimation, map quality and computational performance in comparison to other state-of-the-art systems.
引用
收藏
页码:598 / 626
页数:29
相关论文
共 50 条
  • [1] RGB-D Fusion: Real-time Robust Tracking and Dense Mapping with RGB-D Data Fusion
    Lee, Seong-Oh
    Lim, Hwasup
    Kim, Hyoung-Gon
    Ahn, Sang Chul
    2014 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2014), 2014, : 2749 - 2754
  • [2] Dense Omnidirectional RGB-D Mapping of Large-scale Outdoor Environments for Real-time Localization and Autonomous Navigation
    Meilland, Maxime
    Comport, Andrew I.
    Rives, Patrick
    JOURNAL OF FIELD ROBOTICS, 2015, 32 (04) : 474 - 503
  • [3] SlamDunk: Affordable Real-Time RGB-D SLAM
    Fioraio, Nicola
    Di Stefano, Luigi
    COMPUTER VISION - ECCV 2014 WORKSHOPS, PT I, 2015, 8925 : 401 - 414
  • [4] Real-time SLAM algorithm based on RGB-D data
    Fu, Mengyin
    Lü, Xianwei
    Liu, Tong
    Yang, Yi
    Li, Xinghe
    Li, Yu
    Jiqiren/Robot, 2015, 37 (06): : 683 - 692
  • [5] Point-line feature fusion based field real-time RGB-D SLAM
    Li, Qingyu
    Wang, Xin
    Wu, Tian
    Yang, Huijun
    COMPUTERS & GRAPHICS-UK, 2022, 107 : 10 - 19
  • [6] Towards Real-time Semantic RGB-D SLAM in Dynamic Environments
    Ji, Tete
    Wang, Chen
    Xie, Lihua
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 11175 - 11181
  • [7] Real-Time Global Registration for Globally Consistent RGB-D SLAM
    Han, Lei
    Xu, Lan
    Bobkov, Dmytro
    Steinbach, Eckehard
    Fang, Lu
    IEEE TRANSACTIONS ON ROBOTICS, 2019, 35 (02) : 498 - 508
  • [8] Real-time SLAM Using an RGB-D Camera For Mobile Robots
    Hao, Chung Kuo
    Mayer, N. Michael
    2013 CACS INTERNATIONAL AUTOMATIC CONTROL CONFERENCE (CACS), 2013, : 356 - +
  • [9] Real-time Variational Stereo Reconstruction with Applications to Large-Scale Dense SLAM
    Kuschk, Georg
    Bozic, Aljaz
    Cremers, Daniel
    2017 28TH IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV 2017), 2017, : 1348 - 1355
  • [10] Real-time depth enhancement by fusion for RGB-D cameras
    Garcia, Frederic
    Aouada, Djamila
    Solignac, Thomas
    Mirbach, Bruno
    Ottersten, Bjoern
    IET COMPUTER VISION, 2013, 7 (05) : 335 - 345