Semantic Loopback Detection Method Based on Instance Segmentation and Visual SLAM in Autonomous Driving

被引:2
|
作者
Huang, Li [1 ]
Zhu, Zhe [1 ]
Yun, Juntong [2 ,3 ,4 ]
Xu, Manman [2 ,3 ,4 ]
Liu, Ying [2 ,4 ]
Sun, Ying [2 ,3 ,4 ]
Hu, Jun [2 ,3 ,4 ]
Li, Fazeng [2 ,3 ,4 ]
机构
[1] Wuhan Univ Sci & Technol, Coll Comp Sci & Technol, Hubei Prov Key Lab Intelligent Informat Proc & Rea, Wuhan 430081, Peoples R China
[2] Wuhan Univ Sci & Technol, Precis Mfg Res Inst, Res Ctr Biomimet Robot & Intelligent Measurement &, Key Lab Met Equipment & Control Technol,Minist Edu, Wuhan 430081, Peoples R China
[3] Wuhan Univ Sci & Technol, Hubei Key Lab Mech Transmiss & Mfg Engn, Wuhan 430081, Peoples R China
[4] Hubei Longzhong Lab, Xiangyang 441000, Peoples R China
基金
中国国家自然科学基金;
关键词
Visual SLAM; image segmentation; semantic information; data association; loopback detection; autonomous driving; IMAGE; PERCEPTION;
D O I
10.1109/TITS.2023.3315231
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Autonomous driving has gradually become a research hotspot in recent years, but the robustness of loopback detection in complex environments such as dynamic and weak textures needs to be improved. A semantic loopback detection method is proposed based on instance segmentation and visual SLAM to make sufficient use of semantic information in autonomous driving. The proposed method combines image segmentation and visual SLAM (Simultaneous Localization and Mapping) to construct a semantic SLAM system. What's more, a data association method that combines semantic and geometric information is proposed to improve the traditional loopback detection method by using semantic information to increase the accuracy of loopback detection. The result of experiment on the TUM public dataset shows that the loopback detection accuracy of the improved loopback detection method is higher than that of the bag-of-words method in all four datasets, and our proposed algorithm can effectively improve the accuracy of loopback detection of the SLAM system in general.
引用
收藏
页码:3118 / 3127
页数:10
相关论文
共 50 条
  • [41] Visual SLAM Based on Semantic Segmentation and Geometric Constraints for Dynamic Indoor Environments
    Yang, Shiqiang
    Zhao, Cheng
    Wu, Zhengkun
    Wang, Yan
    Wang, Guodong
    Li, Dexin
    IEEE ACCESS, 2022, 10 : 69636 - 69649
  • [42] Object Detection-based Semantic Map Building for A Semantic Visual SLAM System
    Truong, Phuc H.
    You, Sujeong
    Ji, Sanghoon
    2020 20TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS), 2020, : 1198 - 1201
  • [43] BASeg: Boundary aware semantic segmentation for autonomous driving
    Xiao, Xiaoyang
    Zhao, Yuqian
    Zhang, Fan
    Luo, Biao
    Yu, Lingli
    Chen, Baifan
    Yang, Chunhua
    NEURAL NETWORKS, 2023, 157 : 460 - 470
  • [44] Autonomous driving semantic segmentation with convolution neural networks
    Wang Z.-Y.
    Ni X.-Y.
    Shang Z.-D.
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2019, 27 (11): : 2429 - 2438
  • [45] Lightweight semantic segmentation network for autonomous driving scenarios
    Liu B.
    Cai H.
    Yang S.
    Li H.
    Wang Y.
    Chen X.
    Xi'an Dianzi Keji Daxue Xuebao/Journal of Xidian University, 2023, 50 (01): : 118 - 128
  • [46] Lightweight Semantic Segmentation of Road Scenes for Autonomous Driving
    Li, Shunxin
    Wu, Tong
    Computer Engineering and Applications, 2023, 59 (19) : 177 - 183
  • [47] Automated Evaluation of Semantic Segmentation Robustness for Autonomous Driving
    Zhou, Wei
    Berrio, Julie Stephany
    Worrall, Stewart
    Nebot, Eduardo
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 21 (05) : 1951 - 1963
  • [48] Fishyscapes: A benchmark for safe semantic segmentation in autonomous driving
    Blum, Hermann
    Sarlin, Paul-Edouard
    Nieto, Juan
    Siegwart, Roland
    Cadena, Cesar
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 2403 - 2412
  • [49] Adaptive Instance Distillation for Object Detection in Autonomous Driving
    Lan, Qizhen
    Tian, Qing
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 4559 - 4565
  • [50] SIIS-SLAM: A Vision SLAM Based on Sequential Image Instance Segmentation
    Lv, Kefeng
    Zhang, Yongsheng
    Yu, Ying
    Wang, Ziquan
    Min, Jie
    IEEE ACCESS, 2023, 11 : 17430 - 17440