3D Indoor Scene Reconstruction and Change Detection for Robotic Sensing and Navigation

被引:5
|
作者
Liu, Ruixu [1 ]
Asari, Vijayan K. [1 ]
机构
[1] Univ Dayton, 300 Coll Pk, Dayton, OH 45469 USA
关键词
3D reconstruction; point-cloud; ICP; bag-of-word; ORB; Octomap; change detection;
D O I
10.1117/12.2262831
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
A new methodology for 3D change detection which can support effective robot sensing and navigation in a reconstructed indoor environment is presented in this paper. We register the RGB-D images acquired with an untracked camera into a globally consistent and accurate point-cloud model. This paper introduces a robust system that detects camera position for multiple RGB video frames by using both photo-metric error and feature based method. It utilizes the iterative closest point (ICP) algorithm to establish geometric constraints between the point-cloud as they become aligned. For the change detection part, a bag-of-word (DBoW) model is used to match the current frame with the previous key frames based on RGB images with Oriented FAST and Rotated BRIEF (ORB) feature. Then combine the key-frame translation and ICP to align the current point-cloud with reconstructed 3D scene to localize the robot position. Meanwhile, camera position and orientation are used to aid robot navigation. After preprocessing the data, we create an Octomap Model to detect the scene change measurements. The experimental evaluations performed to evaluate the capability of our algorithm show that the robot's location and orientation are accurately determined and provide promising results for change detection indicating all the object changes with very limited false alarm rate.
引用
收藏
页数:7
相关论文
共 50 条
  • [21] A Survey of 3D Indoor Scene Synthesis
    Zhang, Song-Hai
    Zhang, Shao-Kui
    Liang, Yuan
    Hall, Peter
    JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2019, 34 (03) : 594 - 608
  • [22] Active vision for 3D indoor scene reconstruction using a 3D camera on a pan-tilt mechanism
    Hrzica, Mateja
    Cupec, Robert
    Petrovic, Ivan
    ADVANCED ROBOTICS, 2021, 35 (3-4) : 153 - 167
  • [23] 3D Indoor Crime Scene Reconstruction from Micro UAV Photogrammetry Technique
    Sazaly, Alysa Nur
    Ariff, Mohd Farid Mohd
    Razali, Ahmad Firdaus
    ENGINEERING TECHNOLOGY & APPLIED SCIENCE RESEARCH, 2023, 13 (06) : 12020 - 12025
  • [24] Indoor 3D scene reconstruction for mobile robots using Microsoft kinect sensor
    Li Jiang-Wei
    Zheng Ding-Fu
    Guan Zhi-Hong
    Chen Chao-Yang
    Jiang Xiao-Wei
    Zhang Xian-He
    PROCEEDINGS OF THE 35TH CHINESE CONTROL CONFERENCE 2016, 2016, : 6324 - 6328
  • [25] Autonomous Indoor Passageway Finding Using 3D Scene Reconstruction with Stereo Vision
    Hsiao, Fu-Yuen
    Lee, Po-Yi
    JOURNAL OF AERONAUTICS ASTRONAUTICS AND AVIATION, 2020, 52 (04): : 361 - 370
  • [26] Autonomous Indoor Passageway Finding using 3D Scene Reconstruction with Stereo Vision
    Hsiao, Fu-Yuen
    Lee, Po-Yi
    2017 COMPUTING CONFERENCE, 2017, : 279 - 285
  • [27] Oblique photogrammetry based scene 3D reconstruction with structure sensing functions
    Xiao X.
    Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2019, 48 (06): : 802
  • [28] BUILDING CHANGE DETECTION BASED ON 3D RECONSTRUCTION
    Chen, Baohua
    Deng, Lei
    Duan, Yueqi
    Huang, Siyuan
    Zhou, Jie
    2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 4126 - 4130
  • [29] 3D reconstruction of indoor environments
    Sequeira, V
    Goncalves, JGM
    Ribeiro, MI
    INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, PROCEEDINGS - VOL II, 1996, : 405 - 408
  • [30] Reconstruction of 3D indoor model by scalable sensing using mobile robot
    Fujimoto, K.
    Beniyama, F.
    Moriya, T.
    Nakayama, Y.
    THREE-DIMENSIONAL IMAGE CAPTURE AND APPLICATIONS 2008, 2008, 6805