3D UNSUPERVISED REGION-AWARE REGISTRATION TRANSFORMER

被引:0
|
作者
Hao, Yu [1 ]
Fang, Yi [1 ,2 ]
机构
[1] NYU Abu Dhabi, NYU Multimedia & Visual Comp Lab, Abu Dhabi, U Arab Emirates
[2] NYU Abu Dhabi, NYUAD Ctr Artificial Intelligence & Robot, Abu Dhabi, U Arab Emirates
关键词
3D registration; unsupervised registration;
D O I
10.1109/ICIP49359.2023.10222489
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper concerns the research problem of point cloud registration to find the rigid transformation to optimally align the source point set with the target one. Learning robust point cloud registration models with deep neural networks has emerged as a powerful paradigm, offering promising performance in predicting the global geometric transformation for a pair of point sets. Existing methods first leverage an encoder to regress the global shape descriptor, which is then decoded into a shape-conditioned transformation via concatenation-based conditioning. However, different regions of a 3D shape vary in their geometric structures which makes it more sense that we have a region-conditioned transformation instead of the shape-conditioned one. In this paper, we define our 3D registration function through the introduction of a new design of 3D region partition module that is able to divide the input shape to different regions with a self-supervised 3D shape reconstruction loss without the need for ground truth labels. We further propose the 3D shape transformer module to efficiently and effectively capture short- and long-range geometric dependencies for regions on the 3D shape Consequently, the region-aware decoder module is proposed to predict the transformations for different regions respectively. The global geometric transformation from the source point set to the target one is then formed by the weighted fusion of region-aware transformation. Compared to the state-of-the-art approaches, our experiments show that our 3D-URRT achieves superior registration performance over various benchmark datasets (e.g. ModelNet40).
引用
收藏
页码:2780 / 2784
页数:5
相关论文
共 50 条
  • [31] Region-aware Contrastive Learning for Semantic Segmentation
    Hu, Hanzhe
    Cui, Jinshi
    Wang, Liwei
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 16271 - 16281
  • [32] Continual learning via region-aware memory
    Kai Zhao
    Zhenyong Fu
    Jian Yang
    Applied Intelligence, 2023, 53 : 8389 - 8401
  • [33] Self-supervised region-aware segmentation of COVID-19 CT images using 3D GAN and contrastive learning
    Shabani, Siyavash
    Homayounfar, Morteza
    Vardhanabhuti, Varut
    Mahani, Mohammad-Ali Nikouei
    Koohi-Moghadam, Mohamad
    COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 149
  • [34] A CNN-transformer-based unsupervised aware hierarchical network for medical image registration
    Fang, Bo
    Wang, Lisheng
    Electronics Letters, 2024, 60 (24)
  • [35] Region-Aware Quantum Network for Crowd Counting
    Zhai, Wenzhe
    Xing, Xianglei
    Jeon, Gwanggil
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2024, 70 (03) : 5536 - 5544
  • [36] Continual learning via region-aware memory
    Zhao, Kai
    Fu, Zhenyong
    Yang, Jian
    APPLIED INTELLIGENCE, 2023, 53 (07) : 8389 - 8401
  • [37] Robust consensus-aware network for 3D point registration
    Yang, Fan
    Chen, Zhi
    Sun, Kun
    Liu, Liman
    Tao, Wenbing
    NEUROCOMPUTING, 2022, 514 : 464 - 476
  • [38] Mask-Aware 3D axial transformer for video inpainting
    Sun, Hongyi
    Li, Wanhua
    Lu, Jiwen
    Zhou, Jie
    PATTERN RECOGNITION, 2025, 164
  • [39] A NEW UNSUPERVISED LEARNING METHOD FOR 3D DEFORMABLE MEDICAL IMAGE REGISTRATION
    Zhu, Yongpei
    Zhou, Zicong
    Liao, Guojun
    Yuan, Kehong
    2021 IEEE 18TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2021, : 908 - 912
  • [40] Probabilistic Multilayer Regularization Network for Unsupervised 3D Brain Image Registration
    Liu, Lihao
    Hu, Xiaowei
    Zhu, Lei
    Heng, Pheng-Ann
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT II, 2019, 11765 : 346 - 354