DFS-SLAM: A Visual SLAM Algorithm for Deep Fusion of Semantic Information

被引:1
|
作者
Jiao, Songming [1 ,2 ]
Li, Yan [2 ]
Shan, Zhengwen [2 ]
机构
[1] Hebei Technol Innovat Ctr Simulat & Optimized Cont, Baoding 071003, Peoples R China
[2] Univ North China Elect Power Univ, Sch Control & Comp Engn, Automat Dept, Baoding 071003, Peoples R China
来源
关键词
Semantics; Simultaneous localization and mapping; Dynamics; Vehicle dynamics; Heuristic algorithms; Accuracy; Semantic segmentation; Cameras; Optimization; Robots; SLAM; localization; recognition; deep learning for visual perception; SIMULTANEOUS LOCALIZATION; ROBUST;
D O I
10.1109/LRA.2024.3498773
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
In order to solve issues such as low accuracy, poor robustness and tracking loss in dynamic environments in traditional Simultaneous Localization and Mapping (SLAM) techniques, a semantic SLAM system named DFS-SLAM (Deep Fusion Semantics SLAM) is proposed. The algorithmic framework of DFS-SLAM is heavily inspired by ORB-SLAM2 and is robust in dynamic environments. In this letter, The DFS-SLAM proposed in this letter deeply integrates the semantic segmentation network and geometric method to effectively reduce the impact of dynamic objects on map construction. Meanwhile, a static point optimization method is proposed to improve the camera posture by using the semantic information of static objects, which effectively compensates for the loss of features after eliminating dynamic objects. The validation results on the TUM dataset show that DFS-SLAM has high accuracy and robustness in dynamic environments. In highly dynamic environments, DFS-SLAM shows a significant improvement in mapping accuracy compared to the ORB-SLAM2 algorithm. In most scenarios, it outperforms similar semantic SLAM algorithms such as DS-SLAM and DynaSLAM in accuracy as well.
引用
收藏
页码:11794 / 11801
页数:8
相关论文
共 50 条
  • [31] An Overview on Visual SLAM: From Tradition to Semantic
    Chen, Weifeng
    Shang, Guangtao
    Ji, Aihong
    Zhou, Chengjun
    Wang, Xiyang
    Xu, Chonghui
    Li, Zhenxiong
    Hu, Kai
    REMOTE SENSING, 2022, 14 (13)
  • [32] Edge Assisted Mobile Semantic Visual SLAM
    Xu, Jingao
    Cao, Hao
    Li, Danyang
    Huang, Kehong
    Qian, Chen
    Shangguan, Longfei
    Yang, Zheng
    IEEE INFOCOM 2020 - IEEE CONFERENCE ON COMPUTER COMMUNICATIONS, 2020, : 1828 - 1837
  • [33] Object Semantic Annotation Based on Visual SLAM
    Xu Mengcong
    Ma Li
    2021 ASIA-PACIFIC CONFERENCE ON COMMUNICATIONS TECHNOLOGY AND COMPUTER SCIENCE (ACCTCS 2021), 2021, : 197 - 201
  • [34] ADS-SLAM: a semantic SLAM based on adaptive motion compensation and semantic information for dynamic environments
    Dai, Jun
    Yang, Minghao
    Li, Yanqin
    Zhao, Junwei
    Hanajima, Naohiko
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2025, 36 (01)
  • [35] An Adaptive Visual Dynamic-SLAM Method Based on Fusing the Semantic Information
    Jiao, Jichao
    Wang, Chenxu
    Li, Ning
    Deng, Zhongliang
    Xu, Wei
    IEEE SENSORS JOURNAL, 2022, 22 (18) : 17414 - 17420
  • [36] Semantic -based Dynamic Object Separation Algorithm for Visual SLAM in Dynamic Environment
    Luo, Qingliang
    Wang, Shuting
    Xie, Yuanlong
    Yan, Yiming
    Li, Hu
    2022 IEEE 17TH CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA), 2022, : 937 - 942
  • [37] An Improved Hector SLAM Algorithm based on Information Fusion for Mobile Robot
    Yu, Naigong
    Zhang, Bo
    PROCEEDINGS OF 2018 5TH IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND INTELLIGENCE SYSTEMS (CCIS), 2018, : 279 - 284
  • [38] Multisensor Fusion SLAM Research Based on Improved RBPF-SLAM Algorithm
    Li, Nan
    Zhou, Feng
    Yao, Kaiwen
    Hu, Xinli
    Wang, Rugang
    JOURNAL OF SENSORS, 2023, 2023
  • [39] SGD-SLAM: a visual SLAM system with a dynamic feature rejection strategy combining semantic and geometric information for dynamic environments
    Chen, Yuqian
    Lu, Tongwei
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2025, 36 (02)
  • [40] A real-time visual SLAM based on semantic information and geometric information in dynamic environment
    Sun, Hongli
    Fan, Qingwu
    Zhang, Huiqing
    Liu, Jiajing
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2024, 21 (05)