Semantic Loopback Detection Method Based on Instance Segmentation and Visual SLAM in Autonomous Driving

被引:2
|
作者
Huang, Li [1 ]
Zhu, Zhe [1 ]
Yun, Juntong [2 ,3 ,4 ]
Xu, Manman [2 ,3 ,4 ]
Liu, Ying [2 ,4 ]
Sun, Ying [2 ,3 ,4 ]
Hu, Jun [2 ,3 ,4 ]
Li, Fazeng [2 ,3 ,4 ]
机构
[1] Wuhan Univ Sci & Technol, Coll Comp Sci & Technol, Hubei Prov Key Lab Intelligent Informat Proc & Rea, Wuhan 430081, Peoples R China
[2] Wuhan Univ Sci & Technol, Precis Mfg Res Inst, Res Ctr Biomimet Robot & Intelligent Measurement &, Key Lab Met Equipment & Control Technol,Minist Edu, Wuhan 430081, Peoples R China
[3] Wuhan Univ Sci & Technol, Hubei Key Lab Mech Transmiss & Mfg Engn, Wuhan 430081, Peoples R China
[4] Hubei Longzhong Lab, Xiangyang 441000, Peoples R China
基金
中国国家自然科学基金;
关键词
Visual SLAM; image segmentation; semantic information; data association; loopback detection; autonomous driving; IMAGE; PERCEPTION;
D O I
10.1109/TITS.2023.3315231
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Autonomous driving has gradually become a research hotspot in recent years, but the robustness of loopback detection in complex environments such as dynamic and weak textures needs to be improved. A semantic loopback detection method is proposed based on instance segmentation and visual SLAM to make sufficient use of semantic information in autonomous driving. The proposed method combines image segmentation and visual SLAM (Simultaneous Localization and Mapping) to construct a semantic SLAM system. What's more, a data association method that combines semantic and geometric information is proposed to improve the traditional loopback detection method by using semantic information to increase the accuracy of loopback detection. The result of experiment on the TUM public dataset shows that the loopback detection accuracy of the improved loopback detection method is higher than that of the bag-of-words method in all four datasets, and our proposed algorithm can effectively improve the accuracy of loopback detection of the SLAM system in general.
引用
收藏
页码:3118 / 3127
页数:10
相关论文
共 50 条
  • [21] Image Based Localization Using Semantic Segmentation for Autonomous Driving
    Cinaroglu, Ibrahim
    Bastanlar, Yalin
    2019 27TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2019,
  • [22] Real-time Object Detection and Semantic Segmentation for Autonomous Driving
    Li, Baojun
    Liu, Shun
    Xu, Weichao
    Qiu, Wei
    MIPPR 2017: AUTOMATIC TARGET RECOGNITION AND NAVIGATION, 2018, 10608
  • [23] Instance, Scale, and Teacher Adaptive Knowledge Distillation for Visual Detection in Autonomous Driving
    Lan, Qizhen
    Tian, Qing
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (03): : 2358 - 2370
  • [24] YLS-SLAM: a real-time dynamic visual SLAM based on semantic segmentation
    Feng, Dan
    Yin, Zhenyu
    Wang, Xiaohui
    Zhang, Feiqing
    Wang, Zisong
    INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2025, 52 (01): : 106 - 115
  • [25] DMS-SLAM: semantic visual SLAM based on deep mask segmentation in dynamic environments
    Gao, Shuyuan
    Zhang, Minhui
    Gao, Xicheng
    Zhang, Dawei
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2025, 36 (04)
  • [26] Road surface semantic segmentation for autonomous driving
    Zhao, Huaqi
    Wang, Su
    Peng, Xiang
    Pan, Jeng-Shyang
    Wang, Rui
    Liu, Xiaomin
    PEERJ COMPUTER SCIENCE, 2024, 10
  • [27] Safety Metrics for Semantic Segmentation in Autonomous Driving
    Cheng, Chih-Hong
    Knoll, Alois
    Liao, Hsuan-Cheng
    THIRD IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE TESTING (AITEST 2021), 2021, : 57 - 64
  • [28] A review of visual SLAM methods for autonomous driving vehicles
    Cheng, Jun
    Zhang, Liyan
    Chen, Qihong
    Hu, Xinrong
    Cai, Jingcao
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 114
  • [29] Street-Map Based Validation of Semantic Segmentation in Autonomous Driving
    von Rueden, Laura
    Wirtz, Tim
    Hueger, Fabian
    Schneider, Jan David
    Piatkowski, Nico
    Bauckhage, Christian
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 10203 - 10210
  • [30] Ensemble-based Knowledge Distillation for Semantic Segmentation in Autonomous Driving
    Dragan, Iulia
    Groza, Adrian
    2022 IEEE 18TH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTER COMMUNICATION AND PROCESSING, ICCP, 2022, : 295 - 302