Robust and efficient cpu-based rgb-d scene reconstruction

被引:0
|
作者
Li J. [1 ,2 ]
Gao W. [1 ,2 ]
Li H. [1 ,2 ]
Tang F. [1 ,2 ]
Wu Y. [1 ,2 ]
机构
[1] National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing
[2] School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing
来源
Gao, Wei (wgao@nlpr.ia.ac.cn) | 2018年 / MDPI AG卷 / 18期
基金
中国国家自然科学基金;
关键词
3D reconstruction; Camera tracking; Simultaneous localization and mapping (SLAM); Volumetric integration;
D O I
10.3390/S18113652
中图分类号
学科分类号
摘要
3D scene reconstruction is an important topic in computer vision. A complete scene is reconstructed from views acquired along the camera trajectory, each view containing a small part of the scene. Tracking in textureless scenes is well known to be a Gordian knot of camera tracking, and how to obtain accurate 3D models quickly is a major challenge for existing systems. For the application of robotics, we propose a robust CPU-based approach to reconstruct indoor scenes efficiently with a consumer RGB-D camera. The proposed approach bridges feature-based camera tracking and volumetric-based data integration together and has a good reconstruction performance in terms of both robustness and efficiency. The key points in our approach include: (i) a robust and fast camera tracking method combining points and edges, which improves tracking stability in textureless scenes; (ii) an efficient data fusion strategy to select camera views and integrate RGB-D images on multiple scales, which enhances the efficiency of volumetric integration; (iii) a novel RGB-D scene reconstruction system, which can be quickly implemented on a standard CPU. Experimental results demonstrate that our approach reconstructs scenes with higher robustness and efficiency compared to state-of-the-art reconstruction systems. © 2018 by the authors. Licensee MDPI, Basel, Switzerland.
引用
收藏
相关论文
共 50 条
  • [21] Efficient Multi-Task Scene Analysis with RGB-D Transformers
    Fischedick, Soehnke Benedikt
    Seichter, Daniel
    Schmidt, Robin
    Rabes, Leonard
    Gross, Horst-Michael
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [22] Robust and Efficient Velocity Estimation for MAVs With an RGB-D Camera
    Ji, Tete
    Xie, Lihua
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (04) : 8917 - 8924
  • [23] A Flexible Scene Representation for 3D Reconstruction Using an RGB-D Camera
    Thomas, Diego
    Sugimoto, Akihiro
    2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 2800 - 2807
  • [24] Geometry-Aware ICP for Scene Reconstruction from RGB-D Camera
    Bo Ren
    Jia-Cheng Wu
    Ya-Lei Lv
    Ming-Ming Cheng
    Shao-Ping Lu
    Journal of Computer Science and Technology, 2019, 34 : 581 - 593
  • [25] Survey on Semantic Scene Completion Based on RGB-D Images
    Zhang K.
    An B.-Z.
    Li J.
    Yuan X.
    Zhao C.-X.
    Ruan Jian Xue Bao/Journal of Software, 2023, 34 (01): : 444 - 462
  • [26] Geometry-Aware ICP for Scene Reconstruction from RGB-D Camera
    Ren, Bo
    Wu, Jia-Cheng
    Lv, Ya-Lei
    Cheng, Ming-Ming
    Lu, Shao-Ping
    JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2019, 34 (03) : 581 - 593
  • [27] Indoor Scene Reconstruction Using a Rotating Device and Multiple RGB-D Cameras
    Zhu, Zunjie
    Wei, Yuxin
    Lu, Rongfeng
    Xu, Chenghao
    Le, Xiang
    Zheng, Bolun
    Yan, Chenggang
    Xu, Feng
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73
  • [28] Robust Upper Limb Kinematic Reconstruction Using a RGB-D Camera
    Gioi, Salvatore Maria Li
    Loianno, Giuseppe
    Cordella, Francesca
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (04) : 3831 - 3837
  • [29] Robust Object Tracking based on RGB-D Camera
    Qi, Wenjing
    Yang, Yinfei
    Yi, Meng
    Li, Yunfeng
    Pizlo, Zygmunt
    Latecki, Longin Jan
    2014 11TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), 2014, : 2873 - 2878
  • [30] Motion Segmentation based Robust RGB-D SLAM
    Wang, Youbing
    Huang, Shoudong
    2014 11TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), 2014, : 3122 - 3127