PR-SLAM: Parallel Real-Time Dynamic SLAM Method Based on Semantic Segmentation

被引:6
|
作者
Zhang, Hongyu [1 ]
Peng, Jiansheng [1 ,2 ]
Yang, Qing [1 ]
机构
[1] Guangxi Univ Sci & Technol, Coll Automat, Liuzhou 545000, Peoples R China
[2] Hechi Univ, Dept Artificial Intelligence & Mfg, Hechi 547000, Peoples R China
基金
中国国家自然科学基金;
关键词
Simultaneous localization and mapping; Real-time systems; Indoor environment; Geometric modeling; Autonomous systems; Semantic segmentation; Autonomous robots; Algorithm design and analysis; Semantic SLAM; semantic segmentation; real-time; indoor dynamic scene; autonomous exploration; robustness and accuracy; dynamic probability update strategy; geometric approach; ROBUST;
D O I
10.1109/ACCESS.2024.3373308
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
SLAM (Simultaneous Localization and Mapping) is the core technology enabling autonomous exploration by mobile robots in unknown environments. While there have been numerous impressive SLAM systems developed, many of them are primarily based on the assumption of static environments, limiting their applicability in real-world settings. In order to enhance the robustness and accuracy of systems in dynamic real-world scenarios, we have introduced a parallelized real-time SLAM system called PR-SLAM, building upon the foundation of ORB-SLAM3. This algorithm introduces a dynamic probability update strategy within the semantic segmentation thread, completely decoupling the semantic segmentation thread from the tracking thread. Theoretically, the processing time per frame is solely dependent on the runtime of the tracking thread. Furthermore, we employ a geometric approach based on reprojection error to compensate for semantic gaps generated during semantic segmentation model inference. We have also designed a semantic optimization thread based on the dynamic probability of map points to optimize camera poses during semantic gaps. Finally, to reduce semantic gaps, we have performed lightweight modifications to SOLOV2. Comparative experiments were conducted against the state-of-the-art SLAM systems using the TUM dataset. The results indicate significant improvements in both accuracy and real-time performance for PR-SLAM. When compared to ORB-SLAM3, PR-SLAM achieved a remarkable 97.83% improvement in absolute trajectory accuracy and demonstrated an impressive 86.71% increase in runtime speed compared to DynaSLAM.
引用
收藏
页码:36498 / 36514
页数:17
相关论文
共 50 条
  • [1] YLS-SLAM: a real-time dynamic visual SLAM based on semantic segmentation
    Feng, Dan
    Yin, Zhenyu
    Wang, Xiaohui
    Zhang, Feiqing
    Wang, Zisong
    INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2025, 52 (01): : 106 - 115
  • [2] RDS-SLAM: Real-Time Dynamic SLAM Using Semantic Segmentation Methods
    Liu, Yubao
    Miura, Jun
    Liu, Yubao (yubao.liu.ra@tut.jp), 1600, Institute of Electrical and Electronics Engineers Inc. (09): : 23772 - 23785
  • [3] RDS-SLAM: Real-Time Dynamic SLAM Using Semantic Segmentation Methods
    Liu, Yubao
    Jun, Miura
    IEEE ACCESS, 2021, 9 : 23772 - 23785
  • [4] UDS-SLAM: real-time robust visual SLAM based on semantic segmentation in dynamic scenes
    Liu, Jun
    Dong, Junyuan
    Hu, Mingming
    Lu, Xu
    INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2024, 51 (02): : 206 - 218
  • [5] DRV-SLAM: An Adaptive Real-Time Semantic Visual SLAM Based on Instance Segmentation Toward Dynamic Environments
    Ji, Qiang
    Zhang, Zikang
    Chen, Yifu
    Zheng, Enhui
    IEEE ACCESS, 2024, 12 : 43827 - 43837
  • [6] RVD-SLAM: A Real-Time Visual SLAM Toward Dynamic Environments Based on Sparsely Semantic Segmentation and Outlier Prior
    Zhou, Yao
    Tao, Fazhan
    Fu, Zhumu
    Zhu, Longlong
    Ma, Haoxiang
    IEEE SENSORS JOURNAL, 2023, 23 (24) : 30773 - 30785
  • [7] GenPa-SLAM: Using a General Panoptic Segmentation for a Real-Time Semantic Landmark SLAM
    Beer, Lukas
    Luettel, Thorsten
    Wuensche, Hans-Joachim
    2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, : 873 - 879
  • [8] VIS-SLAM: A Real-Time Dynamic SLAM Algorithm Based on the Fusion of Visual, Inertial, and Semantic Information
    Wang, Yinglong
    Liu, Xiaoxiong
    Zhao, Minkun
    Xu, Xinlong
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2024, 13 (05)
  • [9] RSV-SLAM: Toward Real-Time Semantic Visual SLAM in Indoor Dynamic Environments
    Habibpour, Mobin
    Nemati, Alireza
    Meghdari, Ali
    Taheri, Alireza
    Nazari, Shima
    INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 2, INTELLISYS 2023, 2024, 823 : 832 - 844
  • [10] SIG-SLAM: Semantic Information-Guided Real-Time SLAM for Dynamic Scenes
    Li, Xingyuan
    Guan, Shengxiao
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 1539 - 1544