Neighborhood Multi-Compound Transformer for Point Cloud Registration

被引:2
|
作者
Wang, Yong [1 ]
Zhou, Pengbo [2 ]
Geng, Guohua [1 ]
An, Li [1 ]
Li, Kang [1 ]
Li, Ruoxue [1 ]
机构
[1] Northwest Univ, Sch Informat Sci & Technol, Xian 710127, Peoples R China
[2] Beijing Normal Univ, Sch Arts & Commun, Beijing 100875, Peoples R China
基金
中国国家自然科学基金;
关键词
Computer vision; point cloud registration; multi-compound transformer; neighborhood position encoding;
D O I
10.1109/TCSVT.2024.3383071
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Point cloud registration is a critical issue in 3D reconstruction and computer vision, particularly challenging in cases of low overlap and different datasets, where algorithm generalization and robustness are pressing challenges. In this paper, we propose a point cloud registration algorithm called Neighborhood Multi-compound Transformer (NMCT). To capture local information, we introduce Neighborhood Position Encoding for the first time. By employing a nearest neighbor approach to select spatial points, this encoding enhances the algorithm's ability to extract relevant local feature information and local coordinate information from dispersed points within the point cloud. Furthermore, NMCT utilizes the Multi-compound Transformer as the interaction module for point cloud information. In this module, the Spatial Transformer phase engages in local-global fusion learning based on Neighborhood Position Encoding, facilitating the extraction of internal features within the point cloud. The Temporal Transformer phase, based on Neighborhood Position Encoding, performs local position-local feature interaction, achieving local and global interaction between two point cloud. The combination of these two phases enables NMCT to better address the complexity and diversity of point cloud data. The algorithm is extensively tested on different datasets (3DMatch, ModelNet, KITTI, MVP-RG), demonstrating outstanding generalization and robustness.
引用
收藏
页码:8469 / 8480
页数:12
相关论文
共 50 条
  • [1] Multi-compound Transformer for Accurate Biomedical Image Segmentation
    Ji, Yuanfeng
    Zhang, Ruimao
    Wang, Huijie
    Li, Zhen
    Wu, Lingyun
    Zhang, Shaoting
    Luo, Ping
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT I, 2021, 12901 : 326 - 336
  • [2] MULTI-COMPOUND LAYERS IN MULTISENSORS
    AVGUSTIMOV, VL
    BIDNYK, DI
    TISHCHENKO, GD
    BYSTRAYA, LA
    KOSTENKO, SP
    SENSORS AND ACTUATORS B-CHEMICAL, 1992, 8 (01) : 13 - 19
  • [3] Point cloud registration using neighborhood point information description and matching
    Lin S.
    Zhang Q.
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2022, 30 (08): : 984 - 997
  • [4] Point Cloud Registration Based on Neighborhood Characteristic Point Extraction and Matching
    Li Xin-chun
    Yan Zhen-yu
    Lin Sen
    Jia Di
    ACTA PHOTONICA SINICA, 2020, 49 (04)
  • [5] MATR: Multicompound Adaptive Transformer for Point Cloud Registration
    Wang, Yong
    Zhou, Pengbo
    Geng, Guohua
    An, Li
    Zhou, Mingquan
    Li, Kang
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (11) : 12903 - 12912
  • [6] Low-Overlap Point Cloud Registration With Transformer
    Wang, Yong
    Zhou, Pengbo
    Geng, Guohua
    An, Li
    Zhang, Qi
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 1469 - 1473
  • [7] Geometric Transformer for Fast and Robust Point Cloud Registration
    Qin, Zheng
    Yu, Hao
    Wang, Changjian
    Guo, Yulan
    Peng, Yuxing
    Xu, Kai
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 11133 - 11142
  • [8] End-to-end point cloud registration with transformer
    Wang, Yong
    Zhou, Pengbo
    Geng, Guohua
    An, Li
    Zhang, Qi
    ARTIFICIAL INTELLIGENCE REVIEW, 2024, 58 (01)
  • [9] GETr: A Geometric Equivariant Transformer for Point Cloud Registration
    Yu, Chang
    Zhang, Sanguo
    Shen, Li-Yong
    COMPUTER GRAPHICS FORUM, 2024, 43 (07)
  • [10] Point cloud registration algorithm based on neighborhood features of multi-scale normal vectors
    Department of Automation, Harbin Engineering University, Harbin, China
    Guangdianzi Jiguang, 4 (780-787):