Real-time large-scale dense RGB-D SLAM with volumetric fusion

被引:304
|
作者
Whelan, Thomas [1 ]
Kaess, Michael [2 ]
Johannsson, Hordur [3 ]
Fallon, Maurice [3 ]
Leonard, John J. [3 ]
McDonald, John [1 ]
机构
[1] Natl Univ Ireland, Dept Comp Sci, Maynooth, Kildare, Ireland
[2] Carnegie Mellon Univ, Inst Robot, Pittsburgh, PA 15213 USA
[3] MIT, Cambridge, MA 02139 USA
来源
基金
爱尔兰科学基金会; 美国国家科学基金会;
关键词
Volumetric fusion; camera pose estimation; dense methods; large scale; real time; RGB-D; SLAM; GPU;
D O I
10.1177/0278364914551008
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
We present a new simultaneous localization and mapping (SLAM) system capable of producing high-quality globally consistent surface reconstructions over hundreds of meters in real time with only a low-cost commodity RGB-D sensor. By using a fused volumetric surface reconstruction we achieve a much higher quality map over what would be achieved using raw RGB-D point clouds. In this paper we highlight three key techniques associated with applying a volumetric fusion-based mapping system to the SLAM problem in real time. First, the use of a GPU-based 3D cyclical buffer trick to efficiently extend dense every-frame volumetric fusion of depth maps to function over an unbounded spatial region. Second, overcoming camera pose estimation limitations in a wide variety of environments by combining both dense geometric and photometric camera pose constraints. Third, efficiently updating the dense map according to place recognition and subsequent loop closure constraints by the use of an as-rigid-as-possible' space deformation. We present results on a wide variety of aspects of the system and show through evaluation on de facto standard RGB-D benchmarks that our system performs strongly in terms of trajectory estimation, map quality and computational performance in comparison to other state-of-the-art systems.
引用
收藏
页码:598 / 626
页数:29
相关论文
共 50 条
  • [21] REAL-TIME SLAM FROM RGB-D DATA ON A LEGGED ROBOT: AN EXPERIMENTAL STUDY
    Belter, Dominik
    Kostusiak, Aleksander
    Nowicki, Michal
    Skrzypczynski, Piotr
    ADVANCES IN COOPERATIVE ROBOTICS, 2017, : 320 - 328
  • [22] Large-Scale Autonomous Flight With Real-Time Semantic SLAM Under Dense Forest Canopy
    Liu, Xu
    Nardari, Guilherme, V
    Ojeda, Fernando Cladera
    Tao, Yuezhan
    Zhou, Alex
    Donnelly, Thomas
    Qu, Chao
    Chen, Steven W.
    Romero, Roseli A. F.
    Taylor, Camillo J.
    Kumar, Vijay
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02) : 5512 - 5519
  • [23] Benchmarking Implicit Neural Representation and Geometric Rendering in Real-Time RGB-D SLAM
    Hua, Tongyan
    Wang, Lin
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 21346 - 21356
  • [24] A Robust Fusion Method For RGB-D SLAM
    Liu, Tong
    Mang, Xiaowei
    Wei, Ziang
    Yuan, Zejian
    2013 CHINESE AUTOMATION CONGRESS (CAC), 2013, : 474 - 481
  • [25] Dense RGB-D SLAM with Planes Detection and Mapping
    Pan, Liang
    Wang, Pengfei
    Cao, Jiawei
    Chew, Chee-Meng
    45TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY (IECON 2019), 2019, : 5192 - 5197
  • [26] Real-Time Large-Scale Dense Mapping with Surfels
    Fu, Xingyin
    Zhu, Feng
    Wu, Qingxiao
    Sun, Yunlei
    Lu, Rongrong
    Yang, Ruigang
    SENSORS, 2018, 18 (05)
  • [27] roboSLAM: Dense RGB-D SLAM for Humanoid Robots
    Hourdakis, Emmanouil
    Piperakis, Stylianos
    Trahanias, Panos
    2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 2224 - 2231
  • [28] Real-Time RGB-D Camera Relocalization
    Glocker, Ben
    Izadi, Shahram
    Shotton, Jamie
    Criminisi, Antonio
    2013 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR) - SCIENCE AND TECHNOLOGY, 2013, : 173 - 179
  • [29] KinectScenes: Robust Real-time RGB-D Fusion for Animal Behavioural Monitoring
    Jeya, Logan
    Zelek, John
    2016 13TH CONFERENCE ON COMPUTER AND ROBOT VISION (CRV), 2016, : 383 - 390
  • [30] KINECT-BASED REAL-TIME RGB-D IMAGE FUSION METHOD
    Guo, Wei
    Du, Tangwu
    Zhu, Xinyan
    Hu, Tao
    XXII ISPRS CONGRESS, TECHNICAL COMMISSION III, 2012, 39-B3 : 275 - 279