DE-RGBD SLAM: enhancing static feature point selection in RGB-D visual SLAM using depth information

被引:0
|
作者
Wu, Moudong [1 ,2 ]
Zheng, Qingchun [1 ,2 ]
Ma, Wenpeng [1 ,2 ]
Zhu, Peihao [1 ,2 ]
Yang, Bin [1 ,2 ]
机构
[1] Tianjin Univ Technol, Sch Mech Engn, Tianjin Key Lab Adv Mechatron Syst Design & Intell, Tianjin 300384, Peoples R China
[2] Tianjin Univ Technol, Natl Demonstrat Ctr Expt Mech & Elect Engn Educ, Tianjin 300384, Peoples R China
基金
中国国家自然科学基金;
关键词
simultaneous localization and mapping (SLAM); depth information; dynamic environments; feature selection; multi-view geometry; SIFT; ORB;
D O I
10.1088/1361-6501/ada056
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Feature point extraction plays a key role in visual simultaneous localization and mapping (SLAM) systems. And it remains a major challenge to accurately select static feature points in a complex dynamic environment. To address this issue, this paper proposes an RGB-D SLAM method, referred to as DE-RGBD SLAM, which optimizes feature selection by integrating depth information and effectively utilizes depth data and multi-view geometric information to achieve localization and navigation for mobile robots in dynamic environments. Firstly, the method analyzes prominent feature regions in the image based on color and depth information captured by an RGB-D camera. It sets adaptive FAST corner detection thresholds according to the grayscale information of these regions while masking other areas. Next, the method obtains in-depth information on the detected feature points in the current frame. It combines their pixel coordinates in the image coordinate system to determine the presence of redundant feature points. Notably, the method can detect some dynamic feature points between consecutive frames. Subsequently, in the camera coordinate system, the method compares the depth information of feature points in the depth image with the epipolar depth estimates derived from the essential matrix to determine whether the features are static and eliminate dynamic feature points. This approach significantly enhances the reliability of static feature points. Finally, the accuracy and robustness of the proposed method are validated through experiments conducted on the public TUM dataset and real-world scenarios compared to state-of-the-art visual SLAM systems.
引用
收藏
页数:17
相关论文
共 50 条
  • [31] Live Structural Modeling using RGB-D SLAM
    Olivier, Nicolas
    Uchiyama, Hideaki
    Mishima, Masashi
    Thomas, Diego
    Taniguchi, Rin-ichiro
    Roberto, Rafael
    Lima, Joao Paulo
    Teichrieb, Veronica
    2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2018, : 6352 - 6358
  • [32] A RGB-D SLAM Optimal Method for Fusing Monocular Information
    Ma S.-J.
    Wang Y.-L.
    Jin T.-Z.
    Bai X.-H.
    Dongbei Daxue Xuebao/Journal of Northeastern University, 2020, 41 (06): : 841 - 845and851
  • [33] SID-SLAM: Semi-Direct Information-Driven RGB-D SLAM
    Fontan, Alejandro
    Giubilato, Riccardo
    Maza, Laura Oliva
    Civera, Javier
    Triebel, Rudolph
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (10) : 6387 - 6394
  • [34] Robust RGB-D SLAM in Dynamic Environments using Geometry and Semantic Information
    Xiao, Yao
    Zou, Junjie
    Jin, Ronghe
    Mei, Tiancan
    2024 IEEE 18TH INTERNATIONAL CONFERENCE ON CONTROL & AUTOMATION, ICCA 2024, 2024, : 731 - 736
  • [35] Dynamic RGB-D SLAM Based on Static Probability and Observation Number
    Liu, Yu
    Wu, Yilin
    Pan, Wenzhao
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70 (70)
  • [36] Fast Depth Edge Detection and Edge Based RGB-D SLAM
    Bose, Laurie
    Richards, Arthur
    2016 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2016, : 1323 - 1330
  • [37] FND-SLAM: A SLAM System Using Feature Points and NeRF in Dynamic Environments Based on RGB-D Sensors
    Yang, Xianben
    Wang, Tao
    Wang, Yangyang
    Lang, Congyan
    Jin, Yi
    Li, Yidong
    IEEE SENSORS JOURNAL, 2025, 25 (05) : 8598 - 8610
  • [38] SG-SLAM: A Real-Time RGB-D Visual SLAM Toward Dynamic Scenes With Semantic and Geometric Information
    Cheng, Shuhong
    Sun, Changhe
    Zhang, Shijun
    Zhang, Dianfan
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [39] SG-SLAM: A Real-Time RGB-D Visual SLAM Toward Dynamic Scenes With Semantic and Geometric Information
    Cheng, Shuhong
    Sun, Changhe
    Zhang, Shijun
    Zhang, Dianfan
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [40] SG-SLAM: A Real-Time RGB-D Visual SLAM Toward Dynamic Scenes With Semantic and Geometric Information
    Cheng, Shuhong
    Sun, Changhe
    Zhang, Shijun
    Zhang, Dianfan
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72