Neighborhood Multi-Compound Transformer for Point Cloud Registration

被引:2
|
作者
Wang, Yong [1 ]
Zhou, Pengbo [2 ]
Geng, Guohua [1 ]
An, Li [1 ]
Li, Kang [1 ]
Li, Ruoxue [1 ]
机构
[1] Northwest Univ, Sch Informat Sci & Technol, Xian 710127, Peoples R China
[2] Beijing Normal Univ, Sch Arts & Commun, Beijing 100875, Peoples R China
基金
中国国家自然科学基金;
关键词
Computer vision; point cloud registration; multi-compound transformer; neighborhood position encoding;
D O I
10.1109/TCSVT.2024.3383071
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Point cloud registration is a critical issue in 3D reconstruction and computer vision, particularly challenging in cases of low overlap and different datasets, where algorithm generalization and robustness are pressing challenges. In this paper, we propose a point cloud registration algorithm called Neighborhood Multi-compound Transformer (NMCT). To capture local information, we introduce Neighborhood Position Encoding for the first time. By employing a nearest neighbor approach to select spatial points, this encoding enhances the algorithm's ability to extract relevant local feature information and local coordinate information from dispersed points within the point cloud. Furthermore, NMCT utilizes the Multi-compound Transformer as the interaction module for point cloud information. In this module, the Spatial Transformer phase engages in local-global fusion learning based on Neighborhood Position Encoding, facilitating the extraction of internal features within the point cloud. The Temporal Transformer phase, based on Neighborhood Position Encoding, performs local position-local feature interaction, achieving local and global interaction between two point cloud. The combination of these two phases enables NMCT to better address the complexity and diversity of point cloud data. The algorithm is extensively tested on different datasets (3DMatch, ModelNet, KITTI, MVP-RG), demonstrating outstanding generalization and robustness.
引用
收藏
页码:8469 / 8480
页数:12
相关论文
共 50 条
  • [31] GTGMM: geometry transformer and Gaussian Mixture Models for robust point cloud registration
    Zhang, Haibo
    Hai, Linqi
    Sun, Haoran
    Wang, Xu
    Li, Ruoxue
    Geng, Guohua
    Zhou, Mingquan
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (33) : 79757 - 79783
  • [32] Diversity-oriented multi-compound synthesis optimization
    Briem, Hans
    Glaeser, Lukas
    Mogk, Georg
    Schaudt, Oliver
    REACTION CHEMISTRY & ENGINEERING, 2024, 9 (09): : 2483 - 2488
  • [33] A new method for multi-view point cloud registration
    Cai, Runbin
    Pan, Guorong
    Tongji Daxue Xuebao/Journal of Tongji University, 2006, 34 (07): : 913 - 918
  • [34] Survey on multi-view point cloud registration algorithm
    Yang, Jiaqi
    Zhang, Shikun
    Fan, Shichao
    Cao, Zhiguo
    Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition), 2022, 50 (11): : 16 - 34
  • [35] One-Nearest Neighborhood Guides Inlier Estimation for Unsupervised Point Cloud Registration
    Yuan, Yongzhe
    Wu, Yue
    Gong, Maoguo
    Miao, Qiguang
    Qin, A. K.
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,
  • [36] Research on registration algorithm based on neighborhood features for 3D point cloud
    Liu, Yongshan
    Gu, Xiaoying
    ICIC Express Letters, 2015, 9 (11): : 2957 - 2964
  • [37] Homologous point transformer for multi-modality prostate image registration
    Ruchti, Alexander
    Neuwirth, Alexander
    Lowman, Allison K.
    Duenweg, Savannah R.
    LaViolette, Peter S.
    Bukowy, John D.
    PEERJ COMPUTER SCIENCE, 2022, 8
  • [38] Homologous point transformer for multi-modality prostate image registration
    Ruchti, Alexander
    Neuwirth, Alexander
    Lowman, Allison K.
    Duenweg, Savannah R.
    LaViolette, Peter S.
    Bukowy, John D.
    PeerJ Computer Science, 2022, 8
  • [39] PARTIAL REGRESSION OF A SOLID TUMOR WITH MULTI-COMPOUND CHEMOTHERAPY
    SHAPIRO, DM
    FUGMANN, RA
    DIETRICH, LS
    CANCER RESEARCH, 1957, 17 (11) : 1067 - 1070
  • [40] Understanding of black salve toxicity by multi-compound cytotoxicity assays
    Croaker, Andrew
    Davis, Arie
    Carroll, Anthony
    Liu, Lei
    Myers, Stephen P.
    BMC COMPLEMENTARY MEDICINE AND THERAPIES, 2022, 22 (01)