DE-RGBD SLAM: enhancing static feature point selection in RGB-D visual SLAM using depth information

被引:0
|
作者
Wu, Moudong [1 ,2 ]
Zheng, Qingchun [1 ,2 ]
Ma, Wenpeng [1 ,2 ]
Zhu, Peihao [1 ,2 ]
Yang, Bin [1 ,2 ]
机构
[1] Tianjin Univ Technol, Sch Mech Engn, Tianjin Key Lab Adv Mechatron Syst Design & Intell, Tianjin 300384, Peoples R China
[2] Tianjin Univ Technol, Natl Demonstrat Ctr Expt Mech & Elect Engn Educ, Tianjin 300384, Peoples R China
基金
中国国家自然科学基金;
关键词
simultaneous localization and mapping (SLAM); depth information; dynamic environments; feature selection; multi-view geometry; SIFT; ORB;
D O I
10.1088/1361-6501/ada056
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Feature point extraction plays a key role in visual simultaneous localization and mapping (SLAM) systems. And it remains a major challenge to accurately select static feature points in a complex dynamic environment. To address this issue, this paper proposes an RGB-D SLAM method, referred to as DE-RGBD SLAM, which optimizes feature selection by integrating depth information and effectively utilizes depth data and multi-view geometric information to achieve localization and navigation for mobile robots in dynamic environments. Firstly, the method analyzes prominent feature regions in the image based on color and depth information captured by an RGB-D camera. It sets adaptive FAST corner detection thresholds according to the grayscale information of these regions while masking other areas. Next, the method obtains in-depth information on the detected feature points in the current frame. It combines their pixel coordinates in the image coordinate system to determine the presence of redundant feature points. Notably, the method can detect some dynamic feature points between consecutive frames. Subsequently, in the camera coordinate system, the method compares the depth information of feature points in the depth image with the epipolar depth estimates derived from the essential matrix to determine whether the features are static and eliminate dynamic feature points. This approach significantly enhances the reliability of static feature points. Finally, the accuracy and robustness of the proposed method are validated through experiments conducted on the public TUM dataset and real-world scenarios compared to state-of-the-art visual SLAM systems.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Online Depth Calibration for RGB-D Cameras using Visual SLAM
    Quenzel, Jan
    Rosu, Radu Alexandru
    Houben, Sebastian
    Behnke, Sven
    2017 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2017, : 2227 - 2234
  • [2] RGB-D SLAM in Dynamic Environments Using Static Point Weighting
    Li, Shile
    Lee, Dongheui
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2017, 2 (04): : 2263 - 2270
  • [3] UPLP-SLAM: Unified point-line-plane feature fusion for RGB-D visual SLAM
    Yang, Haozhi
    Yuan, Jing
    Gao, Yuanxi
    Sun, Xingyu
    Zhang, Xuebo
    INFORMATION FUSION, 2023, 96 : 51 - 65
  • [4] Visual SLAM with RGB-D Cameras
    Jin, Qiongyao
    Liu, Yungang
    Man, Yongchao
    Li, Fengzhong
    PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 4072 - 4077
  • [5] Visual SLAM using Multiple RGB-D Cameras
    Yang, Shaowu
    Yi, Xiaodong
    Wang, Zhiyuan
    Wang, Yanzhen
    Yang, Xuejun
    2015 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2015, : 1389 - 1395
  • [6] RGB-D SLAM with Deep Depth Completion
    Serhatoglu, Ali Osman
    Guclu, Oguzhan
    Can, Ahmet Burak
    ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, ICAISC 2022, PT II, 2023, 13589 : 59 - 67
  • [7] Dense Visual SLAM for RGB-D Cameras
    Kerl, Christian
    Sturm, Juergen
    Cremers, Daniel
    2013 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2013, : 2100 - 2106
  • [8] RGB-D SLAM in Dynamic Environments Using Point Correlations
    Dai, Weichen
    Zhang, Yu
    Li, Ping
    Fang, Zheng
    Scherer, Sebastian
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (01) : 373 - 389
  • [9] RGB-D SLAM Combining Visual Odometry and Extended Information Filter
    Zhang, Heng
    Liu, Yanli
    Tan, Jindong
    Xiong, Naixue
    SENSORS, 2015, 15 (08) : 18742 - 18766
  • [10] 3D Visual SLAM using RGB-D Camera
    Krerngkamjornkit, Rapee
    Simic, Milan
    SMART DIGITAL FUTURES 2014, 2014, 262 : 533 - 544