Neighborhood Multi-Compound Transformer for Point Cloud Registration

被引:2
|
作者
Wang, Yong [1 ]
Zhou, Pengbo [2 ]
Geng, Guohua [1 ]
An, Li [1 ]
Li, Kang [1 ]
Li, Ruoxue [1 ]
机构
[1] Northwest Univ, Sch Informat Sci & Technol, Xian 710127, Peoples R China
[2] Beijing Normal Univ, Sch Arts & Commun, Beijing 100875, Peoples R China
基金
中国国家自然科学基金;
关键词
Computer vision; point cloud registration; multi-compound transformer; neighborhood position encoding;
D O I
10.1109/TCSVT.2024.3383071
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Point cloud registration is a critical issue in 3D reconstruction and computer vision, particularly challenging in cases of low overlap and different datasets, where algorithm generalization and robustness are pressing challenges. In this paper, we propose a point cloud registration algorithm called Neighborhood Multi-compound Transformer (NMCT). To capture local information, we introduce Neighborhood Position Encoding for the first time. By employing a nearest neighbor approach to select spatial points, this encoding enhances the algorithm's ability to extract relevant local feature information and local coordinate information from dispersed points within the point cloud. Furthermore, NMCT utilizes the Multi-compound Transformer as the interaction module for point cloud information. In this module, the Spatial Transformer phase engages in local-global fusion learning based on Neighborhood Position Encoding, facilitating the extraction of internal features within the point cloud. The Temporal Transformer phase, based on Neighborhood Position Encoding, performs local position-local feature interaction, achieving local and global interaction between two point cloud. The combination of these two phases enables NMCT to better address the complexity and diversity of point cloud data. The algorithm is extensively tested on different datasets (3DMatch, ModelNet, KITTI, MVP-RG), demonstrating outstanding generalization and robustness.
引用
收藏
页码:8469 / 8480
页数:12
相关论文
共 50 条
  • [21] Diffusion Transformer for point cloud registration: digital modeling of cultural heritage
    An, Li
    Zhou, Pengbo
    Zhou, Mingquan
    Wang, Yong
    Geng, Guohua
    HERITAGE SCIENCE, 2024, 12 (01):
  • [22] Spatial deformable transformer for 3D point cloud registration
    Xiong, Fengguang
    Kong, Yu
    Xie, Shuaikang
    Kuang, Liqun
    Han, Xie
    SCIENTIFIC REPORTS, 2024, 14 (01)
  • [23] RITNet: A Rotation Invariant Transformer based Network for Point Cloud Registration
    Yang, Min
    Li, Yaochen
    Wang, Su
    Yang, Shaohan
    Liu, Hujun
    2022 IEEE 34TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, ICTAI, 2022, : 616 - 621
  • [24] Spatial deformable transformer for 3D point cloud registration
    Fengguang Xiong
    Yu Kong
    Shuaikang Xie
    Liqun Kuang
    Xie Han
    Scientific Reports, 14
  • [25] MNAT-Net: Multi-Scale Neighborhood Aggregation Transformer Network for Point Cloud Classification and Segmentation
    Wang, Xuchu
    Yuan, Yue
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (08) : 9153 - 9167
  • [26] MNAT-Net: Multi-Scale Neighborhood Aggregation Transformer Network for Point Cloud Classification and Segmentation
    Wang, Xuchu
    Yuan, Yue
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (08) : 9153 - 9167
  • [27] Point Cloud Registration Algorithm Based on Adaptive Neighborhood Eigenvalue Loading Ratio
    Liao, Zhongping
    Peng, Tao
    Tang, Ruiqi
    Hao, Zhiguo
    APPLIED SCIENCES-BASEL, 2024, 14 (11):
  • [28] A Multi-organ Point Cloud Registration Algorithm for Abdominal CT Registration
    Joutard, Samuel
    Pheiffer, Thomas
    Audigier, Chloe
    Wohlfahrt, Patrick
    Dorent, Reuben
    Piat, Sebastien
    Vercauteren, Tom
    Modat, Marc
    Mansi, Tommaso
    BIOMEDICAL IMAGE REGISTRATION (WBIR 2022), 2022, 13386 : 75 - 84
  • [29] Full Transformer Framework for Robust Point Cloud Registration With Deep Information Interaction
    Chen, Guangyan
    Wang, Meiling
    Zhang, Qingxiang
    Yuan, Li
    Yue, Yufeng
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (10) : 13368 - 13382
  • [30] Enhancing point cloud registration with transformer: cultural heritage protection of the Terracotta Warriors
    Wang, Yong
    Zhou, Pengbo
    Geng, Guohua
    An, Li
    Zhou, Mingquan
    HERITAGE SCIENCE, 2024, 12 (01):