3D Indoor Scene Reconstruction and Change Detection for Robotic Sensing and Navigation

被引:5
|
作者
Liu, Ruixu [1 ]
Asari, Vijayan K. [1 ]
机构
[1] Univ Dayton, 300 Coll Pk, Dayton, OH 45469 USA
关键词
3D reconstruction; point-cloud; ICP; bag-of-word; ORB; Octomap; change detection;
D O I
10.1117/12.2262831
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
A new methodology for 3D change detection which can support effective robot sensing and navigation in a reconstructed indoor environment is presented in this paper. We register the RGB-D images acquired with an untracked camera into a globally consistent and accurate point-cloud model. This paper introduces a robust system that detects camera position for multiple RGB video frames by using both photo-metric error and feature based method. It utilizes the iterative closest point (ICP) algorithm to establish geometric constraints between the point-cloud as they become aligned. For the change detection part, a bag-of-word (DBoW) model is used to match the current frame with the previous key frames based on RGB images with Oriented FAST and Rotated BRIEF (ORB) feature. Then combine the key-frame translation and ICP to align the current point-cloud with reconstructed 3D scene to localize the robot position. Meanwhile, camera position and orientation are used to aid robot navigation. After preprocessing the data, we create an Octomap Model to detect the scene change measurements. The experimental evaluations performed to evaluate the capability of our algorithm show that the robot's location and orientation are accurately determined and provide promising results for change detection indicating all the object changes with very limited false alarm rate.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] 3D Change Detection in Staggered Voxels Model for Robotic Sensing and Navigation
    Liu, Ruixu
    Hampshire, Brandon
    Asari, Vijiayan K.
    MOBILE MULTIMEDIA/IMAGE PROCESSING, SECURITY, AND APPLICATIONS 2016, 2016, 9869
  • [2] 3D Scene Reconstruction and Object Recognition for Indoor Scene
    Shen, Yangping
    Manabe, Yoshitsugu
    Yata, Noriko
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGE TECHNOLOGY (IWAIT) 2019, 2019, 11049
  • [3] 3D Scene Reconstruction for Robotic Bridge Inspection
    Lattanzi, David
    Miller, Gregory R.
    JOURNAL OF INFRASTRUCTURE SYSTEMS, 2015, 21 (02)
  • [4] Neural 3D Scene Reconstruction With Indoor Planar Priors
    Zhou, Xiaowei
    Guo, Haoyu
    Peng, Sida
    Xiao, Yuxi
    Lin, Haotong
    Wang, Qianqian
    Zhang, Guofeng
    Bao, Hujun
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (09) : 6355 - 6366
  • [5] 3D Scene Reconstruction for Aiding Unmanned Vehicle Navigation
    Diskin, Yakov
    Asari, Vijayan K.
    2013 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC 2013), 2013, : 243 - 248
  • [6] Optic flow aided navigation and 3D scene reconstruction
    Rollason, Malcolm
    ELECTRO-OPTICAL REMOTE SENSING, PHOTONIC TECHNOLOGIES, AND APPLICATIONS VII; AND MILITARY APPLICATIONS IN HYPERSPECTRAL IMAGING AND HIGH SPATIAL RESOLUTION SENSING, 2013, 8897
  • [7] Extracting Plucker Line and Their Relations for 3D Reconstruction of Indoor Scene
    Sun, Huihui
    Yu, Xinguo
    Sun, Chao
    IMAGE AND VIDEO TECHNOLOGY (PSIVT 2017), 2018, 10799 : 396 - 409
  • [8] Indoor scene reconstruction from a sparse set of 3D shots
    Bobenrieth, Cedric
    Seo, Hyewon
    Habibi, Arash
    Cordier, Frederic
    CGI'17: PROCEEDINGS OF THE COMPUTER GRAPHICS INTERNATIONAL CONFERENCE, 2017,
  • [9] 3D Nominal Scene Reconstruction for Object Localization and UAS Navigation
    Han, Xuyang
    Srigrarom, Sutthiphong
    INTELLIGENT AUTONOMOUS SYSTEMS 16, IAS-16, 2022, 412 : 71 - 84
  • [10] Indoor Scene Recognition in 3D
    Huang, Shengyu
    Usvyatsov, Mikhail
    Schindler, Konrad
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 8041 - 8048