Real-time large-scale dense RGB-D SLAM with volumetric fusion

被引:304
|
作者
Whelan, Thomas [1 ]
Kaess, Michael [2 ]
Johannsson, Hordur [3 ]
Fallon, Maurice [3 ]
Leonard, John J. [3 ]
McDonald, John [1 ]
机构
[1] Natl Univ Ireland, Dept Comp Sci, Maynooth, Kildare, Ireland
[2] Carnegie Mellon Univ, Inst Robot, Pittsburgh, PA 15213 USA
[3] MIT, Cambridge, MA 02139 USA
来源
基金
爱尔兰科学基金会; 美国国家科学基金会;
关键词
Volumetric fusion; camera pose estimation; dense methods; large scale; real time; RGB-D; SLAM; GPU;
D O I
10.1177/0278364914551008
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
We present a new simultaneous localization and mapping (SLAM) system capable of producing high-quality globally consistent surface reconstructions over hundreds of meters in real time with only a low-cost commodity RGB-D sensor. By using a fused volumetric surface reconstruction we achieve a much higher quality map over what would be achieved using raw RGB-D point clouds. In this paper we highlight three key techniques associated with applying a volumetric fusion-based mapping system to the SLAM problem in real time. First, the use of a GPU-based 3D cyclical buffer trick to efficiently extend dense every-frame volumetric fusion of depth maps to function over an unbounded spatial region. Second, overcoming camera pose estimation limitations in a wide variety of environments by combining both dense geometric and photometric camera pose constraints. Third, efficiently updating the dense map according to place recognition and subsequent loop closure constraints by the use of an as-rigid-as-possible' space deformation. We present results on a wide variety of aspects of the system and show through evaluation on de facto standard RGB-D benchmarks that our system performs strongly in terms of trajectory estimation, map quality and computational performance in comparison to other state-of-the-art systems.
引用
收藏
页码:598 / 626
页数:29
相关论文
共 50 条
  • [41] Real-time hierarchical stereo Visual SLAM in large-scale environments
    Schleicher, David
    Bergasa, Luis M.
    Ocana, Manuel
    Barea, Rafael
    Lopez, Elena
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2010, 58 (08) : 991 - 1002
  • [42] RGB-D dense SLAM with keyframe-based method
    Fu, Xingyin
    Zhu, Feng
    Wu, Qingxiao
    Sun, Yunlei
    THREE-DIMENSIONAL IMAGE ACQUISITION AND DISPLAY TECHNOLOGY AND APPLICATIONS, 2018, 10845
  • [43] PoseFusion: Dense RGB-D SLAM in Dynamic Human Environments
    Zhang, Tianwei
    Nakamura, Yoshihiko
    PROCEEDINGS OF THE 2018 INTERNATIONAL SYMPOSIUM ON EXPERIMENTAL ROBOTICS, 2020, 11 : 772 - 780
  • [44] Image feature-based real-time RGB-D 3D SLAM with GPU acceleration
    Myung, H. (hmyung@kaist.ac.kr), 1600, Institute of Control, Robotics and Systems (19):
  • [45] Real-Time Large-Scale Dense 3D Reconstruction with Loop Closure
    Kaehler, Olaf
    Prisacariu, Victor A.
    Murray, David W.
    COMPUTER VISION - ECCV 2016, PT VIII, 2016, 9912 : 500 - 516
  • [46] Real-time motion removal based on point correlations for RGB-D SLAM in indoor dynamic environments
    Kesai Wang
    Xifan Yao
    Nanfeng Ma
    Xuan Jing
    Neural Computing and Applications, 2023, 35 : 8707 - 8722
  • [47] Dense real-time mapping of object-class semantics from RGB-D video
    Jörg Stückler
    Benedikt Waldvogel
    Hannes Schulz
    Sven Behnke
    Journal of Real-Time Image Processing, 2015, 10 : 599 - 609
  • [48] Real-time motion removal based on point correlations for RGB-D SLAM in indoor dynamic environments
    Wang, Kesai
    Yao, Xifan
    Ma, Nanfeng
    Jing, Xuan
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (12): : 8707 - 8722
  • [49] Dense real-time mapping of object-class semantics from RGB-D video
    Stueckler, Joerg
    Waldvogel, Benedikt
    Schulz, Hannes
    Behnke, Sven
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2015, 10 (04) : 599 - 609
  • [50] A Robust and Real-Time RGB-D SLAM Method with Dynamic Point Recognition and Depth Segmentation Optimization
    Chen, Shuaixin
    Gan, Baolin
    Zhang, Congxuan
    Chen, Zhen
    Lu, Ke
    Lu, Feng
    PATTERN RECOGNITION AND COMPUTER VISION, PT IX, PRCV 2024, 2025, 15039 : 247 - 261