Semantic Loopback Detection Method Based on Instance Segmentation and Visual SLAM in Autonomous Driving

被引:2
|
作者
Huang, Li [1 ]
Zhu, Zhe [1 ]
Yun, Juntong [2 ,3 ,4 ]
Xu, Manman [2 ,3 ,4 ]
Liu, Ying [2 ,4 ]
Sun, Ying [2 ,3 ,4 ]
Hu, Jun [2 ,3 ,4 ]
Li, Fazeng [2 ,3 ,4 ]
机构
[1] Wuhan Univ Sci & Technol, Coll Comp Sci & Technol, Hubei Prov Key Lab Intelligent Informat Proc & Rea, Wuhan 430081, Peoples R China
[2] Wuhan Univ Sci & Technol, Precis Mfg Res Inst, Res Ctr Biomimet Robot & Intelligent Measurement &, Key Lab Met Equipment & Control Technol,Minist Edu, Wuhan 430081, Peoples R China
[3] Wuhan Univ Sci & Technol, Hubei Key Lab Mech Transmiss & Mfg Engn, Wuhan 430081, Peoples R China
[4] Hubei Longzhong Lab, Xiangyang 441000, Peoples R China
基金
中国国家自然科学基金;
关键词
Visual SLAM; image segmentation; semantic information; data association; loopback detection; autonomous driving; IMAGE; PERCEPTION;
D O I
10.1109/TITS.2023.3315231
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Autonomous driving has gradually become a research hotspot in recent years, but the robustness of loopback detection in complex environments such as dynamic and weak textures needs to be improved. A semantic loopback detection method is proposed based on instance segmentation and visual SLAM to make sufficient use of semantic information in autonomous driving. The proposed method combines image segmentation and visual SLAM (Simultaneous Localization and Mapping) to construct a semantic SLAM system. What's more, a data association method that combines semantic and geometric information is proposed to improve the traditional loopback detection method by using semantic information to increase the accuracy of loopback detection. The result of experiment on the TUM public dataset shows that the loopback detection accuracy of the improved loopback detection method is higher than that of the bag-of-words method in all four datasets, and our proposed algorithm can effectively improve the accuracy of loopback detection of the SLAM system in general.
引用
收藏
页码:3118 / 3127
页数:10
相关论文
共 50 条
  • [1] Semantic Instance Segmentation for Autonomous Driving
    De Brabandere, Bert
    Neven, Davy
    Van Gool, Luc
    2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 478 - 480
  • [2] Instance recognition and semantic mapping based on visual SLAM
    Wu H.
    Chi J.
    Tian G.
    Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition), 2019, 47 (09): : 48 - 54
  • [3] Visual SLAM based on instance segmentation in dynamic scenes
    Yan, Zhe
    Chu, Shuchun
    Deng, Liwei
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2021, 32 (09)
  • [4] Visual SLAM Method Based on Optical Flow and Instance Segmentation for Dynamic Scenes
    Xu Chen
    Zhou Yijun
    Luo Chen
    ACTA OPTICA SINICA, 2022, 42 (14)
  • [5] Efficient Automatic Driving Instance Segmentation Method Based on Detection
    Chen Y.
    Wang H.
    Cai Y.
    Chen L.
    Li Y.
    Qiche Gongcheng/Automotive Engineering, 2023, 45 (04): : 541 - 550
  • [6] DRV-SLAM: An Adaptive Real-Time Semantic Visual SLAM Based on Instance Segmentation Toward Dynamic Environments
    Ji, Qiang
    Zhang, Zikang
    Chen, Yifu
    Zheng, Enhui
    IEEE ACCESS, 2024, 12 : 43827 - 43837
  • [7] Visual SLAM System Design based on Semantic Segmentation
    Wang, Jiwu
    Liu, Yafan
    ICAROB 2019: PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON ARTIFICIAL LIFE AND ROBOTICS, 2019, : 316 - 319
  • [8] A Real-Time Semantic Segmentation Method Based on Transformer for Autonomous Driving
    Hao, Weiyu
    Wang, Jingyi
    Lu, Huimin
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 81 (03): : 4419 - 4433
  • [9] Dynamic SLAM Visual Odometry Based on Instance Segmentation: A Comprehensive Review
    Peng, Jiansheng
    Yang, Qing
    Chen, Dunhua
    Yang, Chengjun
    Xu, Yong
    Qin, Yong
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 78 (01): : 167 - 196
  • [10] Autonomous Driving Control Based on the Technique of Semantic Segmentation
    Tsai, Jichiang
    Chang, Che-Cheng
    Li, Tzu
    SENSORS, 2023, 23 (02)