Visual SLAM Based on Semantic Segmentation and Geometric Constraints for Dynamic Indoor Environments

被引:18
|
作者
Yang, Shiqiang [1 ]
Zhao, Cheng [1 ]
Wu, Zhengkun [2 ]
Wang, Yan [1 ]
Wang, Guodong [1 ]
Li, Dexin [1 ]
机构
[1] Xian Univ Technol, Sch Mech & Precis Instrument Engn, Xian 710048, Peoples R China
[2] China Aerosp Sci & Ind Corp 210, Res Inst 6, Xian 710048, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Semantics; Heuristic algorithms; Simultaneous localization and mapping; Information filters; Filtering algorithms; Data mining; Visual SLAM; ORB-SLAM2; dynamic feature filtering; semantic map;
D O I
10.1109/ACCESS.2022.3185766
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Simultaneous localization and mapping (SLAM), a core technology of mobile robots and autonomous driving, has received more and more attention in recent years. However, most of the existing visual SLAM algorithms do not consider the impact of dynamic objects on the visual SLAM system, resulting in significant system positioning errors and high map redundancy. Based on the ORB-SLAM2 algorithm, this paper combines semantic information and a geometric constraint algorithm based on feature point homogenization to improve the positioning accuracy of the SLAM system. Aiming at the problem that the feature points extracted by the ORB-SLAM2 algorithm are easily concentrated, and the extraction rate is low in the weak texture area, a feature point homogenization algorithm based on quadtree and adaptive threshold is proposed to improve the uniformity of feature point extraction. In addition, in view of the impact of dynamic targets on the SLAM system, the dynamic information in the scene is filtered out through the semantic segmentation network and the motion consistency detection algorithm, and the static feature points obtained after filtering are used to estimate the camera pose. Then, a semantic map is constructed after filtering out the dynamic point cloud according to the semantic information. Finally, the test results on Oxford and TUM datasets show that the uniformity of feature points extracted by the improved algorithm is increased by 56.3%. The positioning error of visual SLAM is reduced by 68.8% on average, and the constructed semantic map has rich semantic information and less redundancy.
引用
收藏
页码:69636 / 69649
页数:14
相关论文
共 50 条
  • [41] Semantic stereo visual SLAM toward outdoor dynamic environments based on ORB-SLAM2
    Li, Yawen
    Song, Guangming
    Hao, Shuang
    Mao, Juzheng
    Song, Aiguo
    INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2023, 50 (03): : 542 - 554
  • [42] Visual SLAM System Design based on Semantic Segmentation
    Wang, Jiwu
    Liu, Yafan
    ICAROB 2019: PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON ARTIFICIAL LIFE AND ROBOTICS, 2019, : 316 - 319
  • [43] SIA-SLAM: a robust visual SLAM associated with semantic information in dynamic environments
    Liu, Qiang
    Yuan, Jie
    Kuang, Benfa
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (18) : 53531 - 53547
  • [44] SIA-SLAM: a robust visual SLAM associated with semantic information in dynamic environments
    Qiang Liu
    Jie Yuan
    Benfa Kuang
    Multimedia Tools and Applications, 2024, 83 : 53531 - 53547
  • [45] UDS-SLAM: real-time robust visual SLAM based on semantic segmentation in dynamic scenes
    Liu, Jun
    Dong, Junyuan
    Hu, Mingming
    Lu, Xu
    INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2024, 51 (02): : 206 - 218
  • [46] Dynamic Scene Semantics SLAM Based on Semantic Segmentation
    Han, Shuangquan
    Xi, Zhihong
    IEEE ACCESS, 2020, 8 : 43563 - 43570
  • [47] DAM-SLAM: depth attention module in a semantic visual SLAM based on objects interaction for dynamic environments
    Beghdadi Ayman
    Mallem Malik
    Beji Lotfi
    Applied Intelligence, 2023, 53 : 25802 - 25815
  • [48] DAM-SLAM: depth attention module in a semantic visual SLAM based on objects interaction for dynamic environments
    Ayman, Beghdadi
    Malik, Mallem
    Lotfi, Beji
    APPLIED INTELLIGENCE, 2023, 53 (21) : 25802 - 25815
  • [49] Semantic Visual SLAM in Populated Environments
    Riazuelo, L.
    Montano, L.
    Montiel, J. M. M.
    2017 EUROPEAN CONFERENCE ON MOBILE ROBOTS (ECMR), 2017,
  • [50] CD-SLAM: A Real-Time Stereo Visual-Inertial SLAM for Complex Dynamic Environments With Semantic and Geometric Information
    Wen, Shuhuan
    Tao, Sheng
    Liu, Xin
    Babiarz, Artur
    Yu, F. Richard
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 8