PR-SLAM: Parallel Real-Time Dynamic SLAM Method Based on Semantic Segmentation

被引:6
|
作者
Zhang, Hongyu [1 ]
Peng, Jiansheng [1 ,2 ]
Yang, Qing [1 ]
机构
[1] Guangxi Univ Sci & Technol, Coll Automat, Liuzhou 545000, Peoples R China
[2] Hechi Univ, Dept Artificial Intelligence & Mfg, Hechi 547000, Peoples R China
基金
中国国家自然科学基金;
关键词
Simultaneous localization and mapping; Real-time systems; Indoor environment; Geometric modeling; Autonomous systems; Semantic segmentation; Autonomous robots; Algorithm design and analysis; Semantic SLAM; semantic segmentation; real-time; indoor dynamic scene; autonomous exploration; robustness and accuracy; dynamic probability update strategy; geometric approach; ROBUST;
D O I
10.1109/ACCESS.2024.3373308
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
SLAM (Simultaneous Localization and Mapping) is the core technology enabling autonomous exploration by mobile robots in unknown environments. While there have been numerous impressive SLAM systems developed, many of them are primarily based on the assumption of static environments, limiting their applicability in real-world settings. In order to enhance the robustness and accuracy of systems in dynamic real-world scenarios, we have introduced a parallelized real-time SLAM system called PR-SLAM, building upon the foundation of ORB-SLAM3. This algorithm introduces a dynamic probability update strategy within the semantic segmentation thread, completely decoupling the semantic segmentation thread from the tracking thread. Theoretically, the processing time per frame is solely dependent on the runtime of the tracking thread. Furthermore, we employ a geometric approach based on reprojection error to compensate for semantic gaps generated during semantic segmentation model inference. We have also designed a semantic optimization thread based on the dynamic probability of map points to optimize camera poses during semantic gaps. Finally, to reduce semantic gaps, we have performed lightweight modifications to SOLOV2. Comparative experiments were conducted against the state-of-the-art SLAM systems using the TUM dataset. The results indicate significant improvements in both accuracy and real-time performance for PR-SLAM. When compared to ORB-SLAM3, PR-SLAM achieved a remarkable 97.83% improvement in absolute trajectory accuracy and demonstrated an impressive 86.71% increase in runtime speed compared to DynaSLAM.
引用
收藏
页码:36498 / 36514
页数:17
相关论文
共 50 条
  • [41] A real-time semantic visual SLAM approach with points and objects
    Guan, Peiyu
    Cao, Zhiqiang
    Chen, Erkui
    Liang, Shuang
    Tan, Min
    Yu, Junzhi
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2020, 17 (01)
  • [42] AGAM-SLAM: An Adaptive Dynamic Scene Semantic SLAM Method Based on GAM
    Cai, Dupeng
    Hu, Zhuhua
    Li, Ruoqing
    Qi, Hao
    Xiang, Yunfeng
    Zhao, Yaochi
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, ICIC 2023, PT V, 2023, 14090 : 27 - 39
  • [43] A Comparative Study of Recent Real Time Semantic Segmentation Algorithms for Visual Semantic SLAM
    Javed, Zeeshan
    Kim, Gon-Woo
    2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP 2020), 2020, : 474 - 476
  • [44] Vision-based SLAM in real-time
    Davison, Andrew J.
    Pattern Recognition and Image Analysis, Pt 1, Proceedings, 2007, 4477 : 9 - 12
  • [45] CFP-SLAM: A Real-time Visual SLAM Based on Coarse-to-Fine Probability in Dynamic Environments
    Hu, Xinggang
    Zhang, Yunzhou
    Cao, Zhenzhong
    Ma, Rong
    Wu, Yanmin
    Deng, Zhiqiang
    Sun, Wenkai
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 4399 - 4406
  • [46] Real-time SLAM relocalisation
    Williams, Brian
    Klein, Georg
    Reid, Ian
    2007 IEEE 11TH INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOLS 1-6, 2007, : 2244 - 2251
  • [47] Strong-SLAM: real-time RGB-D visual SLAM in dynamic environments based on StrongSORT
    Huang, Wei
    Zou, Chunlong
    Yun, Juntong
    Jiang, Du
    Huang, Li
    Liu, Ying
    Jiang, Guo Zhang
    Xie, Yuanmin
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2024, 35 (12)
  • [48] Parallel implementation for real-time visual SLAM systems based on heterogeneous computing
    Liu, Han
    Dong, Yanchao
    Hou, Chengbin
    Liu, Yuhao
    Lv, Tingting
    Shu, Zhanyi
    Xu, Sixiong
    INTELLIGENCE & ROBOTICS, 2024, 4 (03):
  • [49] A Robust and Real-Time RGB-D SLAM Method with Dynamic Point Recognition and Depth Segmentation Optimization
    Chen, Shuaixin
    Gan, Baolin
    Zhang, Congxuan
    Chen, Zhen
    Lu, Ke
    Lu, Feng
    PATTERN RECOGNITION AND COMPUTER VISION, PT IX, PRCV 2024, 2025, 15039 : 247 - 261
  • [50] Semantic SLAM Based on Compensated Segmentation and Geometric Constraints in Dynamic Environments
    Fang, Baofu
    Zhou, Shuai
    Wang, Hao
    Proceedings of 2022 6th Asian Conference on Artificial Intelligence Technology, ACAIT 2022, 2022,