Visual SLAM Based on Semantic Segmentation and Geometric Constraints for Dynamic Indoor Environments

被引:18
|
作者
Yang, Shiqiang [1 ]
Zhao, Cheng [1 ]
Wu, Zhengkun [2 ]
Wang, Yan [1 ]
Wang, Guodong [1 ]
Li, Dexin [1 ]
机构
[1] Xian Univ Technol, Sch Mech & Precis Instrument Engn, Xian 710048, Peoples R China
[2] China Aerosp Sci & Ind Corp 210, Res Inst 6, Xian 710048, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Semantics; Heuristic algorithms; Simultaneous localization and mapping; Information filters; Filtering algorithms; Data mining; Visual SLAM; ORB-SLAM2; dynamic feature filtering; semantic map;
D O I
10.1109/ACCESS.2022.3185766
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Simultaneous localization and mapping (SLAM), a core technology of mobile robots and autonomous driving, has received more and more attention in recent years. However, most of the existing visual SLAM algorithms do not consider the impact of dynamic objects on the visual SLAM system, resulting in significant system positioning errors and high map redundancy. Based on the ORB-SLAM2 algorithm, this paper combines semantic information and a geometric constraint algorithm based on feature point homogenization to improve the positioning accuracy of the SLAM system. Aiming at the problem that the feature points extracted by the ORB-SLAM2 algorithm are easily concentrated, and the extraction rate is low in the weak texture area, a feature point homogenization algorithm based on quadtree and adaptive threshold is proposed to improve the uniformity of feature point extraction. In addition, in view of the impact of dynamic targets on the SLAM system, the dynamic information in the scene is filtered out through the semantic segmentation network and the motion consistency detection algorithm, and the static feature points obtained after filtering are used to estimate the camera pose. Then, a semantic map is constructed after filtering out the dynamic point cloud according to the semantic information. Finally, the test results on Oxford and TUM datasets show that the uniformity of feature points extracted by the improved algorithm is increased by 56.3%. The positioning error of visual SLAM is reduced by 68.8% on average, and the constructed semantic map has rich semantic information and less redundancy.
引用
收藏
页码:69636 / 69649
页数:14
相关论文
共 50 条
  • [21] DRV-SLAM: An Adaptive Real-Time Semantic Visual SLAM Based on Instance Segmentation Toward Dynamic Environments
    Ji, Qiang
    Zhang, Zikang
    Chen, Yifu
    Zheng, Enhui
    IEEE ACCESS, 2024, 12 : 43827 - 43837
  • [22] Robust Visual SLAM Algorithm for Dynamic Indoor Environments
    Fang, Lijin
    Wang, Keqi
    Wan, Yingcai
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 4169 - 4174
  • [23] SGD-SLAM: a visual SLAM system with a dynamic feature rejection strategy combining semantic and geometric information for dynamic environments
    Chen, Yuqian
    Lu, Tongwei
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2025, 36 (02)
  • [24] DS-SLAM: A Semantic Visual SLAM towards Dynamic Environments
    Yu, Chao
    Liu, Zuxin
    Liu, Xin-Jun
    Xie, Fugui
    Yang, Yi
    Wei, Qi
    Fei, Qiao
    2018 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2018, : 1168 - 1174
  • [25] OMS-SLAM: dynamic scene visual SLAM based on object detection with multiple geometric feature constraints and statistical threshold segmentation
    Tang, Jialiang
    Feng, Zhengyong
    Liao, Peng
    Chen, Liheng
    Xiao, Xiaomei
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2024, 35 (10)
  • [26] A Semantic Enhancement of Unified Geometric Representations for Improving Indoor Visual SLAM
    Asmanis, Ioannis
    Mermigkas, Panagiotis
    Chalvatzaki, Georgia
    Peters, Jan
    Maragos, Petros
    2022 19TH INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS (UR), 2022, : 288 - 294
  • [27] Semantic Segmentation based Dense RGB-D SLAM in Dynamic Environments
    Zhang, Jianbo
    Liu, Yanjie
    Chen, Junguo
    Ma, Liulong
    Jin, Dong
    Chen, Jiao
    2019 3RD INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE, AUTOMATION AND CONTROL TECHNOLOGIES (AIACT 2019), 2019, 1267
  • [28] YLS-SLAM: a real-time dynamic visual SLAM based on semantic segmentation
    Feng, Dan
    Yin, Zhenyu
    Wang, Xiaohui
    Zhang, Feiqing
    Wang, Zisong
    INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2025, 52 (01): : 106 - 115
  • [29] RVD-SLAM: A Real-Time Visual SLAM Toward Dynamic Environments Based on Sparsely Semantic Segmentation and Outlier Prior
    Zhou, Yao
    Tao, Fazhan
    Fu, Zhumu
    Zhu, Longlong
    Ma, Haoxiang
    IEEE SENSORS JOURNAL, 2023, 23 (24) : 30773 - 30785
  • [30] FCH-SLAM: A SLAM Method for Dynamic Environments using Semantic Segmentation
    Wang, Youwei, I
    Mikawa, Masahiko
    Fujisawa, Makoto
    2022 2ND INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND ROBOTICS (ICIPROB), 2022,