PR-SLAM: Parallel Real-Time Dynamic SLAM Method Based on Semantic Segmentation

被引:6
|
作者
Zhang, Hongyu [1 ]
Peng, Jiansheng [1 ,2 ]
Yang, Qing [1 ]
机构
[1] Guangxi Univ Sci & Technol, Coll Automat, Liuzhou 545000, Peoples R China
[2] Hechi Univ, Dept Artificial Intelligence & Mfg, Hechi 547000, Peoples R China
基金
中国国家自然科学基金;
关键词
Simultaneous localization and mapping; Real-time systems; Indoor environment; Geometric modeling; Autonomous systems; Semantic segmentation; Autonomous robots; Algorithm design and analysis; Semantic SLAM; semantic segmentation; real-time; indoor dynamic scene; autonomous exploration; robustness and accuracy; dynamic probability update strategy; geometric approach; ROBUST;
D O I
10.1109/ACCESS.2024.3373308
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
SLAM (Simultaneous Localization and Mapping) is the core technology enabling autonomous exploration by mobile robots in unknown environments. While there have been numerous impressive SLAM systems developed, many of them are primarily based on the assumption of static environments, limiting their applicability in real-world settings. In order to enhance the robustness and accuracy of systems in dynamic real-world scenarios, we have introduced a parallelized real-time SLAM system called PR-SLAM, building upon the foundation of ORB-SLAM3. This algorithm introduces a dynamic probability update strategy within the semantic segmentation thread, completely decoupling the semantic segmentation thread from the tracking thread. Theoretically, the processing time per frame is solely dependent on the runtime of the tracking thread. Furthermore, we employ a geometric approach based on reprojection error to compensate for semantic gaps generated during semantic segmentation model inference. We have also designed a semantic optimization thread based on the dynamic probability of map points to optimize camera poses during semantic gaps. Finally, to reduce semantic gaps, we have performed lightweight modifications to SOLOV2. Comparative experiments were conducted against the state-of-the-art SLAM systems using the TUM dataset. The results indicate significant improvements in both accuracy and real-time performance for PR-SLAM. When compared to ORB-SLAM3, PR-SLAM achieved a remarkable 97.83% improvement in absolute trajectory accuracy and demonstrated an impressive 86.71% increase in runtime speed compared to DynaSLAM.
引用
收藏
页码:36498 / 36514
页数:17
相关论文
共 50 条
  • [21] Dynamic Scene Semantics SLAM Based on Semantic Segmentation
    Han, Shuangquan
    Xi, Zhihong
    IEEE ACCESS, 2020, 8 : 43563 - 43570
  • [22] DYS-SLAM: A real-time RGBD SLAM combined with optical flow and semantic information in a dynamic environment
    Fang, Yuhua
    Xie, Zhijun
    Chen, Kewei
    Huang, Guangyan
    Zarei, Roozbeh
    Xie, Yuntao
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 45 (06) : 10349 - 10367
  • [23] KSF-SLAM: A Key Segmentation Frame Based Semantic SLAM in Dynamic Environments
    Yao Zhao
    Zhi Xiong
    Shuailin Zhou
    Zheng Peng
    Pascual Campoy
    Ling Zhang
    Journal of Intelligent & Robotic Systems, 2022, 105
  • [24] KSF-SLAM: A Key Segmentation Frame Based Semantic SLAM in Dynamic Environments
    Zhao, Yao
    Xiong, Zhi
    Zhou, Shuailin
    Peng, Zheng
    Campoy, Pascual
    Zhang, Ling
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2022, 105 (01)
  • [25] A real-time semantic visual SLAM for dynamic environment based on deep learning and dynamic probabilistic propagation
    Liang Chen
    Zhi Ling
    Yu Gao
    Rongchuan Sun
    Sheng Jin
    Complex & Intelligent Systems, 2023, 9 : 5653 - 5677
  • [26] A real-time semantic visual SLAM for dynamic environment based on deep learning and dynamic probabilistic propagation
    Chen, Liang
    Ling, Zhi
    Gao, Yu
    Sun, Rongchuan
    Jin, Sheng
    COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (05) : 5653 - 5677
  • [27] Towards Real-time Semantic RGB-D SLAM in Dynamic Environments
    Ji, Tete
    Wang, Chen
    Xie, Lihua
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 11175 - 11181
  • [28] Real-Time Dynamic SLAM Algorithm Based on Deep Learning
    Su, Peng
    Luo, Suyun
    Huang, Xiaoci
    IEEE ACCESS, 2022, 10 : 87754 - 87766
  • [29] SOLO-SLAM: A Parallel Semantic SLAM Algorithm for Dynamic Scenes
    Sun, Liuxin
    Wei, Junyu
    Su, Shaojing
    Wu, Peng
    SENSORS, 2022, 22 (18)
  • [30] A Real-Time Visual SLAM in Dynamic Scene With Segmentation, Prediction and Geometric Constraint
    Qian, Xiaojian
    Jia, Yongxing
    Geng, Ming
    2023 5th International Symposium on Robotics and Intelligent Manufacturing Technology, ISRIMT 2023, 2023, : 246 - 252