DFS-SLAM: A Visual SLAM Algorithm for Deep Fusion of Semantic Information

被引:1
|
作者
Jiao, Songming [1 ,2 ]
Li, Yan [2 ]
Shan, Zhengwen [2 ]
机构
[1] Hebei Technol Innovat Ctr Simulat & Optimized Cont, Baoding 071003, Peoples R China
[2] Univ North China Elect Power Univ, Sch Control & Comp Engn, Automat Dept, Baoding 071003, Peoples R China
来源
关键词
Semantics; Simultaneous localization and mapping; Dynamics; Vehicle dynamics; Heuristic algorithms; Accuracy; Semantic segmentation; Cameras; Optimization; Robots; SLAM; localization; recognition; deep learning for visual perception; SIMULTANEOUS LOCALIZATION; ROBUST;
D O I
10.1109/LRA.2024.3498773
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
In order to solve issues such as low accuracy, poor robustness and tracking loss in dynamic environments in traditional Simultaneous Localization and Mapping (SLAM) techniques, a semantic SLAM system named DFS-SLAM (Deep Fusion Semantics SLAM) is proposed. The algorithmic framework of DFS-SLAM is heavily inspired by ORB-SLAM2 and is robust in dynamic environments. In this letter, The DFS-SLAM proposed in this letter deeply integrates the semantic segmentation network and geometric method to effectively reduce the impact of dynamic objects on map construction. Meanwhile, a static point optimization method is proposed to improve the camera posture by using the semantic information of static objects, which effectively compensates for the loss of features after eliminating dynamic objects. The validation results on the TUM dataset show that DFS-SLAM has high accuracy and robustness in dynamic environments. In highly dynamic environments, DFS-SLAM shows a significant improvement in mapping accuracy compared to the ORB-SLAM2 algorithm. In most scenarios, it outperforms similar semantic SLAM algorithms such as DS-SLAM and DynaSLAM in accuracy as well.
引用
收藏
页码:11794 / 11801
页数:8
相关论文
共 50 条
  • [21] Research on SLAM based on LiDAR/visual fusion (LV-SLAM)
    Chen, Shoubin
    Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2023, 52 (01):
  • [22] Visual SLAM algorithm in dynamic environment based on deep learning
    Yu, Yingjie
    Chen, Shuai
    Yang, Xinpeng
    Xu, Changzhen
    Zhang, Sen
    Xiao, Wendong
    INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2025, 52 (01): : 28 - 35
  • [23] ESD-SLAM: An efficient semantic visual SLAM towards dynamic environments
    Xu, Yan
    Wang, Yanyun
    Huang, Jiani
    Qin, Hong
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2022, 42 (06) : 5155 - 5164
  • [24] VPS-SLAM: Visual Planar Semantic SLAM for Aerial Robotic Systems
    Bavle, Hriday
    De La Puente, Paloma
    How, Jonathan P.
    Campoy, Pascual
    IEEE ACCESS, 2020, 8 : 60704 - 60718
  • [25] A Research on the Fusion of Semantic Segment Network and SLAM
    Chen, Zhuo
    Zhang, Weimin
    Li, Fangxing
    Shi, Yongliang
    Wang, Yang
    Nie, Fuyu
    Zhu, Chi
    Huang, Qiang
    2019 IEEE INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND ITS SOCIAL IMPACTS (ARSO), 2019, : 304 - 309
  • [26] FFD-SLAM: A Real-Time Visual SLAM Toward Dynamic Scenes with Semantic and Optical Flow Information
    Zhang, Hao
    Wang, Yu
    Zhong, Tianjie
    Dong, Fangyan
    Chen, Kewei
    JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2024, 28 (03) : 586 - 594
  • [27] DFD-SLAM: Visual SLAM with Deep Features in Dynamic Environment
    Qian, Wei
    Peng, Jiansheng
    Zhang, Hongyu
    APPLIED SCIENCES-BASEL, 2024, 14 (11):
  • [28] SLAM algorithm based on fusion of visual semantics and laser point cloud
    Tong G.-F.
    Yang Y.-H.
    Peng H.
    Meng X.-Z.
    Yin Q.-J.
    Kongzhi yu Juece/Control and Decision, 2024, 39 (01): : 103 - 111
  • [29] A Stereo Visual-Inertial SLAM Algorithm with Point-Line Fusion and Semantic Optimization for Forest Environments
    Liu, Bo
    Liu, Hongwei
    Xing, Yanqiu
    Gong, Weishu
    Yang, Shuhang
    Yang, Hong
    Pan, Kai
    Li, Yuanxin
    Hou, Yifei
    Jia, Shiqing
    FORESTS, 2025, 16 (02):
  • [30] Edge Assisted Mobile Semantic Visual SLAM
    Cao, Hao
    Xu, Jingao
    Li, Danyang
    Shangguan, Longfei
    Liu, Yunhao
    Yang, Zheng
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (12) : 6985 - 6999