SG-LPR: Semantic-Guided LiDAR-Based Place Recognition

被引:1
|
作者
Jiang, Weizhong [1 ]
Xue, Hanzhang [1 ,2 ]
Si, Shubin [1 ,3 ]
Min, Chen [4 ]
Xiao, Liang [1 ]
Nie, Yiming [1 ]
Dai, Bin [1 ]
机构
[1] Def Innovat Inst, Unmanned Syst Technol Res Ctr, Beijing 100071, Peoples R China
[2] Natl Univ Def Technol, Test Ctr, Xian 710106, Peoples R China
[3] Harbin Engn Univ, Coll Intelligent Syst Sci & Engn, Harbin 150001, Peoples R China
[4] Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China
关键词
LiDAR-based place recognition; semantic-guided; auxiliary task; swin transformer; U-Net; SCAN CONTEXT;
D O I
10.3390/electronics13224532
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Place recognition plays a crucial role in tasks such as loop closure detection and re-localization in robotic navigation. As a high-level representation within scenes, semantics enables models to effectively distinguish geometrically similar places, therefore enhancing their robustness to environmental changes. Unlike most existing semantic-based LiDAR place recognition (LPR) methods that adopt a multi-stage and relatively segregated data-processing and storage pipeline, we propose a novel end-to-end LPR model guided by semantic information-SG-LPR. This model introduces a semantic segmentation auxiliary task to guide the model in autonomously capturing high-level semantic information from the scene, implicitly integrating these features into the main LPR task, thus providing a unified framework of "segmentation-while-describing" and avoiding additional intermediate data-processing and storage steps. Moreover, the semantic segmentation auxiliary task operates only during model training, therefore not adding any time overhead during the testing phase. The model also combines the advantages of Swin Transformer and U-Net to address the shortcomings of current semantic-based LPR methods in capturing global contextual information and extracting fine-grained features. Extensive experiments conducted on multiple sequences from the KITTI and NCLT datasets validate the effectiveness, robustness, and generalization ability of our proposed method. Our approach achieves notable performance improvements over state-of-the-art methods.
引用
收藏
页数:21
相关论文
共 50 条
  • [21] FEATURE SELECTION FOR LIDAR-BASED GAIT RECOGNITION
    Galai, Bence
    Benedek, Csaba
    2015 INTERNATIONAL WORKSHOP ON COMPUTATIONAL INTELLIGENCE FOR MULTIMEDIA UNDERSTANDING (IWCIM), 2015,
  • [22] On the Calibration of Uncertainty Estimation in LiDAR-based Semantic Segmentation
    Dreissig, Mariella
    Piewak, Florian
    Boedecker, Joschka
    2023 IEEE 26TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, ITSC, 2023, : 4798 - 4805
  • [23] BEVPlace: Learning LiDAR-based Place Recognition using Bird's Eye View Images
    Luo, Lun
    Zheng, Shuhang
    Li, Yixuan
    Fan, Yongzhi
    Yu, Beinan
    Cao, Si-Yuan
    Li, Junwei
    Shen, Hui-Liang
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 8666 - 8675
  • [24] Patchlpr: a multi-level feature fusion transformer network for LiDAR-based place recognition
    Sun, Yang
    Guo, Jianhua
    Wang, Haiyang
    Zhang, Yuhang
    Zheng, Jiushuai
    Tian, Bin
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (SUPPL 1) : 157 - 165
  • [25] 3-D LiDAR-Based Place Recognition Techniques: A Review of the Past Ten Years
    Du, Zhiheng
    Ji, Shunping
    Khoshelham, Kourosh
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 1
  • [26] OverlapTransformer: An Efficient and Yaw-Angle-Invariant Transformer Network for LiDAR-Based Place Recognition
    Ma, Junyi
    Zhang, Jun
    Xu, Jintao
    Ai, Rui
    Gu, Weihao
    Chen, Xieyuanli
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (03) : 6958 - 6965
  • [27] BVMatch: Lidar-Based Place Recognition Using Bird's-Eye View Images
    Luo, Lun
    Cao, Si-Yuan
    Han, Bin
    Shen, Hui-Liang
    Li, Junwei
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (03) : 6076 - 6083
  • [28] Semantic-Guided Information Alignment Network for Fine-Grained Image Recognition
    Wang, Shijie
    Wang, Zhihui
    Li, Haojie
    Chang, Jianlong
    Ouyang, Wanli
    Tian, Qi
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (11) : 6558 - 6570
  • [29] ASMGCN: Attention-Based Semantic-Guided Multistream Graph Convolution Network for Skeleton Action Recognition
    Zhang, Moyan
    Quan, Zhenzhen
    Wang, Wei
    Chen, Zhe
    Guo, Xiaoshan
    Li, Yujun
    IEEE SENSORS JOURNAL, 2024, 24 (12) : 20064 - 20075
  • [30] Lidar-based road terrain recognition for passenger vehicles
    Wang, Shifeng
    Kodagoda, Sarath
    Shi, Lei
    Xu, Ning
    INTERNATIONAL JOURNAL OF VEHICLE DESIGN, 2017, 74 (02) : 153 - 165