DE-RGBD SLAM: enhancing static feature point selection in RGB-D visual SLAM using depth information

被引:0
|
作者
Wu, Moudong [1 ,2 ]
Zheng, Qingchun [1 ,2 ]
Ma, Wenpeng [1 ,2 ]
Zhu, Peihao [1 ,2 ]
Yang, Bin [1 ,2 ]
机构
[1] Tianjin Univ Technol, Sch Mech Engn, Tianjin Key Lab Adv Mechatron Syst Design & Intell, Tianjin 300384, Peoples R China
[2] Tianjin Univ Technol, Natl Demonstrat Ctr Expt Mech & Elect Engn Educ, Tianjin 300384, Peoples R China
基金
中国国家自然科学基金;
关键词
simultaneous localization and mapping (SLAM); depth information; dynamic environments; feature selection; multi-view geometry; SIFT; ORB;
D O I
10.1088/1361-6501/ada056
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Feature point extraction plays a key role in visual simultaneous localization and mapping (SLAM) systems. And it remains a major challenge to accurately select static feature points in a complex dynamic environment. To address this issue, this paper proposes an RGB-D SLAM method, referred to as DE-RGBD SLAM, which optimizes feature selection by integrating depth information and effectively utilizes depth data and multi-view geometric information to achieve localization and navigation for mobile robots in dynamic environments. Firstly, the method analyzes prominent feature regions in the image based on color and depth information captured by an RGB-D camera. It sets adaptive FAST corner detection thresholds according to the grayscale information of these regions while masking other areas. Next, the method obtains in-depth information on the detected feature points in the current frame. It combines their pixel coordinates in the image coordinate system to determine the presence of redundant feature points. Notably, the method can detect some dynamic feature points between consecutive frames. Subsequently, in the camera coordinate system, the method compares the depth information of feature points in the depth image with the epipolar depth estimates derived from the essential matrix to determine whether the features are static and eliminate dynamic feature points. This approach significantly enhances the reliability of static feature points. Finally, the accuracy and robustness of the proposed method are validated through experiments conducted on the public TUM dataset and real-world scenarios compared to state-of-the-art visual SLAM systems.
引用
收藏
页数:17
相关论文
共 50 条
  • [41] Dynamic RGB-D SLAM algorithm based on reprojection depth difference cumulative map and static probability
    Lin K.
    Liang X.-W.
    Cai J.-Y.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2022, 56 (06): : 1062 - 1070
  • [42] PLPD-SLAM: Point-Line-Plane-based RGB-D SLAM for Dynamic Environments
    Dong, Juan
    Lu, Maobin
    Xu, Yong
    Deng, Fang
    Chen, Jie
    2024 IEEE 18TH INTERNATIONAL CONFERENCE ON CONTROL & AUTOMATION, ICCA 2024, 2024, : 719 - 724
  • [43] VIP-SLAM: An Efficient Tightly-Coupled RGB-D Visual Inertial Planar SLAM
    Chen, Danpeng
    Wang, Shuai
    Xie, Weijian
    Zhai, Shangjin
    Wang, Nan
    Bao, Hujun
    Zhang, Guofeng
    2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2022), 2022, : 5615 - 5621
  • [44] D-FUSION SLAM: A VSLAM SYSTEM OPTIMIZED BY INTEGRATING DEPTH INFORMATION AND RGBD FEATURE POINTS
    Zheng, Qingchun
    Wu, Moudong
    Zhu, Peihao
    Yang, Bin
    Li, Shubo
    UNIVERSITY POLITEHNICA OF BUCHAREST SCIENTIFIC BULLETIN SERIES C-ELECTRICAL ENGINEERING AND COMPUTER SCIENCE, 2025, 87 (01): : 121 - 138
  • [45] RGB-D Based Visual SLAM Algorithm for Indoor Crowd Environment
    Jianfeng Li
    Juan Dai
    Zhong Su
    Cui Zhu
    Journal of Intelligent & Robotic Systems, 2024, 110
  • [46] Fusion of Inertial and Visual Measurements for RGB-D SLAM on Mobile Devices
    Brunetto, Nicholas
    Salti, Samuele
    Fioraio, Nicola
    Cavallari, Tommaso
    Di Stefano, Luigi
    2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOP (ICCVW), 2015, : 148 - 156
  • [47] RGB-D Based Visual SLAM Algorithm for Indoor Crowd Environment
    Li, Jianfeng
    Dai, Juan
    Su, Zhong
    Zhu, Cui
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2024, 110 (01)
  • [48] Visual-Inertial RGB-D SLAM for Mobile Augmented Reality
    Williem
    Ivan, Andre
    Seok, Hochang
    Lim, Jongwoo
    Yoon, Kuk-Jin
    Cho, Ikhwan
    Park, In Kyu
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2017, PT II, 2018, 10736 : 928 - 938
  • [49] An ORB Based Visual SLAM System by RGB-D Camera of LeTV
    Fan, Yang
    Ming, Li
    2017 9TH INTERNATIONAL CONFERENCE ON ADVANCED INFOCOMM TECHNOLOGY (ICAIT 2017), 2017, : 406 - 410
  • [50] Optimization Algorithm of RGB-D SLAM Visual Odometry based on Triangulation
    Dong J.
    Jiang Y.
    Han Z.
    Dong, Jingwei (djw@hrbust.edu.cn), 1600, Totem Publishers Ltd (16): : 438 - 445