PR-SLAM: Parallel Real-Time Dynamic SLAM Method Based on Semantic Segmentation

被引:6
|
作者
Zhang, Hongyu [1 ]
Peng, Jiansheng [1 ,2 ]
Yang, Qing [1 ]
机构
[1] Guangxi Univ Sci & Technol, Coll Automat, Liuzhou 545000, Peoples R China
[2] Hechi Univ, Dept Artificial Intelligence & Mfg, Hechi 547000, Peoples R China
基金
中国国家自然科学基金;
关键词
Simultaneous localization and mapping; Real-time systems; Indoor environment; Geometric modeling; Autonomous systems; Semantic segmentation; Autonomous robots; Algorithm design and analysis; Semantic SLAM; semantic segmentation; real-time; indoor dynamic scene; autonomous exploration; robustness and accuracy; dynamic probability update strategy; geometric approach; ROBUST;
D O I
10.1109/ACCESS.2024.3373308
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
SLAM (Simultaneous Localization and Mapping) is the core technology enabling autonomous exploration by mobile robots in unknown environments. While there have been numerous impressive SLAM systems developed, many of them are primarily based on the assumption of static environments, limiting their applicability in real-world settings. In order to enhance the robustness and accuracy of systems in dynamic real-world scenarios, we have introduced a parallelized real-time SLAM system called PR-SLAM, building upon the foundation of ORB-SLAM3. This algorithm introduces a dynamic probability update strategy within the semantic segmentation thread, completely decoupling the semantic segmentation thread from the tracking thread. Theoretically, the processing time per frame is solely dependent on the runtime of the tracking thread. Furthermore, we employ a geometric approach based on reprojection error to compensate for semantic gaps generated during semantic segmentation model inference. We have also designed a semantic optimization thread based on the dynamic probability of map points to optimize camera poses during semantic gaps. Finally, to reduce semantic gaps, we have performed lightweight modifications to SOLOV2. Comparative experiments were conducted against the state-of-the-art SLAM systems using the TUM dataset. The results indicate significant improvements in both accuracy and real-time performance for PR-SLAM. When compared to ORB-SLAM3, PR-SLAM achieved a remarkable 97.83% improvement in absolute trajectory accuracy and demonstrated an impressive 86.71% increase in runtime speed compared to DynaSLAM.
引用
收藏
页码:36498 / 36514
页数:17
相关论文
共 50 条
  • [31] Real-Time and Scalable Incremental Segmentation on Dense SLAM
    Tateno, Keisuke
    Tombari, Federico
    Navab, Nassir
    2015 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2015, : 4465 - 4472
  • [32] RDMO-SLAM: Real-Time Visual SLAM for Dynamic Environments Using Semantic Label Prediction With Optical Flow
    Liu, Yubao
    Miura, Jun
    IEEE ACCESS, 2021, 9 : 106981 - 106997
  • [33] DMS-SLAM: semantic visual SLAM based on deep mask segmentation in dynamic environments
    Gao, Shuyuan
    Zhang, Minhui
    Gao, Xicheng
    Zhang, Dawei
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2025, 36 (04)
  • [34] Monocular SLAM System in Dynamic Scenes Based on Semantic Segmentation
    Sheng, Chao
    Pan, Shuguo
    Zeng, Pan
    Huang, Lixiao
    Zhao, Tao
    IMAGE AND GRAPHICS, ICIG 2019, PT III, 2019, 11903 : 593 - 603
  • [35] Real-Time SLAM Based on Dynamic Feature Point Elimination in Dynamic Environment
    Gao, Ruizhen
    Li, Ziheng
    Li, Junfu
    Li, Baihua
    Zhang, Jingjun
    Liu, Jun
    IEEE ACCESS, 2023, 11 : 113952 - 113964
  • [36] SG-SLAM: A Real-Time RGB-D Visual SLAM Toward Dynamic Scenes With Semantic and Geometric Information
    Cheng, Shuhong
    Sun, Changhe
    Zhang, Shijun
    Zhang, Dianfan
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [37] A Low-Rank CNN Architecture for Real-Time Semantic Segmentation in Visual SLAM Applications
    Falaschetti, Laura
    Manoni, Lorenzo
    Turchetti, Claudio
    IEEE OPEN JOURNAL OF CIRCUITS AND SYSTEMS, 2022, 3 : 115 - 133
  • [38] SG-SLAM: A Real-Time RGB-D Visual SLAM Toward Dynamic Scenes With Semantic and Geometric Information
    Cheng, Shuhong
    Sun, Changhe
    Zhang, Shijun
    Zhang, Dianfan
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [39] SG-SLAM: A Real-Time RGB-D Visual SLAM Toward Dynamic Scenes With Semantic and Geometric Information
    Cheng, Shuhong
    Sun, Changhe
    Zhang, Shijun
    Zhang, Dianfan
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [40] CD-SLAM: A Real-Time Stereo Visual-Inertial SLAM for Complex Dynamic Environments With Semantic and Geometric Information
    Wen, Shuhuan
    Tao, Sheng
    Liu, Xin
    Babiarz, Artur
    Yu, F. Richard
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 8