Indoor 3D Object Model Obtained using Data Fusion from Laser Sensor and Digital Camera on a Mobile Robot

被引:0
|
作者
Solea, Razvan [1 ]
Veliche, George [1 ]
Cernega, Daniela-Cristina [1 ]
Teaca, Madalina-Roxana [1 ]
机构
[1] Dunarea de Jos Univ Galati, Fac Automat Control Comp Elect & Elect Engn, Galati 800008, Romania
关键词
BUILDING RECONSTRUCTION;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes a framework to build a 3D model for an indoor object from partial data using a mobile robot. The purpose of the paper is to obtain photorealistic 3D models for objects from raw mobile laser scanning data and digital camera information (to improve the appearance information). The proposed method integrates and analyses the relationships between the visual data and raw mobile laser scanning data. This method is capable to recover the complete density range and the shape of the investigated object. In order to obtain 3D mapping using the laser sensor system (called Lidar), this is positioned to a vertical scan orientation and the tilt actuator provides a rotation movement to the Lidar in order to perform a 3D scan. In this paper, the mobile system acquires 3D Lidar Data only while it is stationary. A 3D map of an object is created by acquiring overlapping scans from multiple locations and viewpoints using local co-ordinates for each scan and merging the scan into a single global co-ordinate system. Video registration is used to texture the scan points in order to provide photo realistic 3D maps. Some techniques are also implemented to improve the resolution of the Lidar Scan with video data. Experiments on real-world data are given to illustrate the suitability of this approach.
引用
收藏
页数:6
相关论文
共 50 条
  • [41] SparseFusion3D: Sparse Sensor Fusion for 3D Object Detection by Radar and Camera in Environmental Perception
    Yu, Zedong
    Wan, Weibing
    Ren, Maiyu
    Zheng, Xiuyuan
    Fang, Zhijun
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2024, 9 (01): : 1524 - 1536
  • [42] Real-time building of a 3D Model of an Indoor Environment with a Mobile Robot
    Jeon, Eunchul
    Jo, Sungho
    2011 11TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS), 2011, : 818 - 823
  • [43] 3D indoor environment modeling by a mobile robot with omnidirectional stereo and laser range finder
    Ikeda, Suguru
    Miura, Jun
    2006 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, VOLS 1-12, 2006, : 3435 - +
  • [44] 3D metrology using a collaborative robot with a laser triangulation sensor
    de Sousa, Gil Boye
    Olabi, Adel
    Palos, Jorge
    Gibaru, Olivier
    27TH INTERNATIONAL CONFERENCE ON FLEXIBLE AUTOMATION AND INTELLIGENT MANUFACTURING, FAIM2017, 2017, 11 : 132 - 140
  • [45] CO2 laser radar 3D vision sensor for a mobile robot
    Yamada, O.
    Takahashi, H.
    Kimura, M.
    Naitoh, H.
    Sano, R.
    Advanced Robotics, 1993, 7 (03) : 251 - 260
  • [46] Mobile robot self-localization in complex indoor environments using monocular vision and 3D model
    Kitanov, Andreja
    Bisevac, Sanjin
    Petrovic, Ivan
    2007 IEEE/ASME INTERNATIONAL CONFERENCE ON ADVANCED INTELLIGENT MECHATRONICS, VOLS 1-3, 2007, : 963 - 968
  • [47] 3D Imaging of indoor environments with mobile photo-camera
    Trufasu, A. O.
    Cuta, A. N.
    Trufasu, A.
    JOURNAL OF OPTOELECTRONICS AND ADVANCED MATERIALS, 2011, 13 (7-8): : 1015 - 1019
  • [48] 3D LiDAR and Color Camera Data Fusion
    Ding, Yuqi
    Liu, Jiaming
    Ye, Jinwei
    Xiang, Weidong
    Wu, Hsiao-Chun
    Busch, Costas
    2020 IEEE INTERNATIONAL SYMPOSIUM ON BROADBAND MULTIMEDIA SYSTEMS AND BROADCASTING (BMSB), 2020,
  • [49] Real-time 3D Recognition of Manipulated Object by Robot Hand Using 3D Sensor
    Minowa, Ryo
    Namiki, Akio
    2015 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2015, : 1798 - 1803
  • [50] An Object Localization System Using Monocular Camera and Two-Axis-Controlled Laser Ranging Sensor for Mobile Robot
    Ge, Hongchang
    Wang, Tao
    Zhang, Yunce
    Zhu, Shiqiang
    IEEE ACCESS, 2021, 9 : 79214 - 79224