Patchlpr: a multi-level feature fusion transformer network for LiDAR-based place recognition

被引:0
|
作者
Sun, Yang [1 ,2 ]
Guo, Jianhua [1 ,3 ]
Wang, Haiyang [4 ]
Zhang, Yuhang [1 ,3 ]
Zheng, Jiushuai [1 ,3 ]
Tian, Bin [5 ]
机构
[1] Hebei Univ Engn, Coll Mech & Equipment Engn, Handan 056038, Peoples R China
[2] Key Lab Intelligent Ind Equipment Technol Hebei Pr, Handan, Hebei, Peoples R China
[3] Handan Key Lab Intelligent Vehicles, Handan, Hebei, Peoples R China
[4] Jizhong Energy Fengfeng Grp Co Ltd, 16 Unicom South Rd, Handan, Hebei, Peoples R China
[5] Chinese Acad Sci, Inst Automat, Beijing, Peoples R China
关键词
SLAM; LiDAR Place recognition; Deep learning; Patch; VISION; DEEP;
D O I
10.1007/s11760-024-03138-9
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
LiDAR-based place recognition plays a crucial role in autonomous vehicles, enabling the identification of locations in GPS-invalid environments that were previously accessed. Localization in place recognition can be achieved by searching for nearest neighbors in the database. Two common types of place recognition features are local descriptors and global descriptors. Local descriptors typically compactly represent regions or points, while global descriptors provide an overarching view of the data. Despite the significant progress made in recent years by both types of descriptors, any representation inevitably involves information loss. To overcome this limitation, we have developed PatchLPR, a Transformer network employing multi-level feature fusion for robust place recognition. PatchLPR integrates global and local feature information, focusing on meaningful regions on the feature map to generate an environmental representation. We propose a patch feature extraction module based on the Vision Transformer to fully leverage the information and correlations of different features. We evaluated our approach on the KITTI dataset and a self-collected dataset covering over 4.2 km. The experimental results demonstrate that our method effectively utilizes multi-level features to enhance place recognition performance.
引用
收藏
页码:157 / 165
页数:9
相关论文
共 50 条
  • [41] Expression invariant face recognition based on multi-level feature fusion and transfer learning technique
    Kumar, P. M. Ashok
    Raj, L. Arun
    Sagayam, K. Martin
    Ram, N. Sree
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (26) : 37183 - 37201
  • [42] A Multi-Level Feature Fusion Network for Remote Sensing Image Segmentation
    Dong, Sijun
    Chen, Zhengchao
    SENSORS, 2021, 21 (04) : 1 - 18
  • [43] A Single LiDAR-Based Feature Fusion Indoor Localization Algorithm
    Wang, Yun-Ting
    Peng, Chao-Chung
    Ravankar, Ankit A.
    Ravankar, Abhijeet
    SENSORS, 2018, 18 (04)
  • [44] A Micro-expression Recognition Method Based on Multi-level Information Fusion Network
    Chen, Yan
    Wu, Le-Chen
    Wang, Cong
    Zidonghua Xuebao/Acta Automatica Sinica, 2024, 50 (07): : 1445 - 1457
  • [45] A Multi-level Acoustic Feature Extraction Framework for Transformer Based End-to-End Speech Recognition
    Li, Jin
    Su, Rongfeng
    Xie, Xurong
    Yan, Nan
    Wang, Lan
    INTERSPEECH 2022, 2022, : 3173 - 3177
  • [46] Head Pose Estimation Based on Multi-Level Feature Fusion
    Yan, Chunman
    Zhang, Xiao
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2024, 38 (02)
  • [47] Multi-level feature fusion networks for smoke recognition in remote sensing imagery
    Wang, Yupeng
    Wang, Yongli
    Khan, Zaki Ahmad
    Huang, Anqi
    Sang, Jianghui
    NEURAL NETWORKS, 2025, 184
  • [48] Face recognition based on pose-variant image synthesis and multi-level multi-feature fusion
    Li, Congcong
    Su, Guangda
    Shang, Yan
    Li, Yingchun
    Xiang, Yan
    ANALYSIS AND MODELING OF FACES AND GESTURES, PROCEEDINGS, 2007, 4778 : 261 - 275
  • [49] Multi-level Fault Diagnosis of Power Transformer Based on Fusion Technology
    Li Zhi-bin
    Li Qi-ben
    ENERGY DEVELOPMENT, PTS 1-4, 2014, 860-863 : 1925 - +
  • [50] Lightweight Multi-level Information Fusion Network for Facial Expression Recognition
    Zhang, Yuan
    Tian, Xiang
    Zhang, Ziyang
    Xu, Xiangmin
    MULTIMEDIA MODELING, MMM 2023, PT II, 2023, 13834 : 151 - 163