Neighborhood Multi-Compound Transformer for Point Cloud Registration

被引:2
|
作者
Wang, Yong [1 ]
Zhou, Pengbo [2 ]
Geng, Guohua [1 ]
An, Li [1 ]
Li, Kang [1 ]
Li, Ruoxue [1 ]
机构
[1] Northwest Univ, Sch Informat Sci & Technol, Xian 710127, Peoples R China
[2] Beijing Normal Univ, Sch Arts & Commun, Beijing 100875, Peoples R China
基金
中国国家自然科学基金;
关键词
Computer vision; point cloud registration; multi-compound transformer; neighborhood position encoding;
D O I
10.1109/TCSVT.2024.3383071
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Point cloud registration is a critical issue in 3D reconstruction and computer vision, particularly challenging in cases of low overlap and different datasets, where algorithm generalization and robustness are pressing challenges. In this paper, we propose a point cloud registration algorithm called Neighborhood Multi-compound Transformer (NMCT). To capture local information, we introduce Neighborhood Position Encoding for the first time. By employing a nearest neighbor approach to select spatial points, this encoding enhances the algorithm's ability to extract relevant local feature information and local coordinate information from dispersed points within the point cloud. Furthermore, NMCT utilizes the Multi-compound Transformer as the interaction module for point cloud information. In this module, the Spatial Transformer phase engages in local-global fusion learning based on Neighborhood Position Encoding, facilitating the extraction of internal features within the point cloud. The Temporal Transformer phase, based on Neighborhood Position Encoding, performs local position-local feature interaction, achieving local and global interaction between two point cloud. The combination of these two phases enables NMCT to better address the complexity and diversity of point cloud data. The algorithm is extensively tested on different datasets (3DMatch, ModelNet, KITTI, MVP-RG), demonstrating outstanding generalization and robustness.
引用
收藏
页码:8469 / 8480
页数:12
相关论文
共 50 条
  • [41] Integrative database for multi-compound drug discovery in complementary medicine
    Sunyong YOO
    Jaejoon CHOI
    Moonshik SHIN
    Suhyun HA
    Kyungrin NOH
    Hojung NAM
    Doheon LEE
    中国药理学与毒理学杂志, 2015, 29(S1) (S1) : 98 - 98
  • [42] Point Cloud Registration Based on Multi-Scale Feature and Point Distance Constraint
    Zhang Xuchun
    Zhou Hongjun
    Zheng Jinjin
    Jin Yi
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (24)
  • [43] The potential of multi-compound nanoparticles to bypass drug resistance in cancer
    Da Silva, C. G.
    Peters, Godefridus J.
    Ossendorp, Ferry
    Cruz, Luis J.
    CANCER CHEMOTHERAPY AND PHARMACOLOGY, 2017, 80 (05) : 881 - 894
  • [44] The potential of multi-compound nanoparticles to bypass drug resistance in cancer
    C. G. Da Silva
    Godefridus J. Peters
    Ferry Ossendorp
    Luis J. Cruz
    Cancer Chemotherapy and Pharmacology, 2017, 80 : 881 - 894
  • [45] PCT: Point cloud transformer
    Meng-Hao Guo
    Jun-Xiong Cai
    Zheng-Ning Liu
    Tai-Jiang Mu
    Ralph R.Martin
    Shi-Min Hu
    Computational Visual Media, 2021, 7 (02) : 187 - 199
  • [46] PCT: Point cloud transformer
    Guo, Meng-Hao
    Cai, Jun-Xiong
    Liu, Zheng-Ning
    Mu, Tai-Jiang
    Martin, Ralph R.
    Hu, Shi-Min
    COMPUTATIONAL VISUAL MEDIA, 2021, 7 (02) : 187 - 199
  • [47] Voting Multi-scale Features for Robust Point Cloud Registration
    Guan, Haining
    Zhang, Peng
    Gao, Qing
    Lv, Jinhu
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 6380 - 6385
  • [48] PCT: Point cloud transformer
    Meng-Hao Guo
    Jun-Xiong Cai
    Zheng-Ning Liu
    Tai-Jiang Mu
    Ralph R. Martin
    Shi-Min Hu
    Computational Visual Media, 2021, 7 : 187 - 199
  • [49] Multi-spectral registration fusion based on laser point cloud
    Yuan, Hanjie
    He, Yong
    Dong, Limeng
    Chen, Liang
    Zhang, Yu
    Yao, Jianan
    Tan, Qi
    2022 IEEE INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING, BIG DATA AND ALGORITHMS (EEBDA), 2022, : 50 - 53
  • [50] Multi-scale point cloud registration based on topological structure
    Dong, Tianzhen
    Zhao, Yuepeng
    Zhang, Qing
    Xue, Bin
    Li, Jinghua
    Li, Wenju
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2022,