3D UNSUPERVISED REGION-AWARE REGISTRATION TRANSFORMER

被引:0
|
作者
Hao, Yu [1 ]
Fang, Yi [1 ,2 ]
机构
[1] NYU Abu Dhabi, NYU Multimedia & Visual Comp Lab, Abu Dhabi, U Arab Emirates
[2] NYU Abu Dhabi, NYUAD Ctr Artificial Intelligence & Robot, Abu Dhabi, U Arab Emirates
关键词
3D registration; unsupervised registration;
D O I
10.1109/ICIP49359.2023.10222489
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper concerns the research problem of point cloud registration to find the rigid transformation to optimally align the source point set with the target one. Learning robust point cloud registration models with deep neural networks has emerged as a powerful paradigm, offering promising performance in predicting the global geometric transformation for a pair of point sets. Existing methods first leverage an encoder to regress the global shape descriptor, which is then decoded into a shape-conditioned transformation via concatenation-based conditioning. However, different regions of a 3D shape vary in their geometric structures which makes it more sense that we have a region-conditioned transformation instead of the shape-conditioned one. In this paper, we define our 3D registration function through the introduction of a new design of 3D region partition module that is able to divide the input shape to different regions with a self-supervised 3D shape reconstruction loss without the need for ground truth labels. We further propose the 3D shape transformer module to efficiently and effectively capture short- and long-range geometric dependencies for regions on the 3D shape Consequently, the region-aware decoder module is proposed to predict the transformations for different regions respectively. The global geometric transformation from the source point set to the target one is then formed by the weighted fusion of region-aware transformation. Compared to the state-of-the-art approaches, our experiments show that our 3D-URRT achieves superior registration performance over various benchmark datasets (e.g. ModelNet40).
引用
收藏
页码:2780 / 2784
页数:5
相关论文
共 50 条
  • [41] 3D-TexSeg: Unsupervised Segmentation of 3D Texture Using Mutual Transformer Learning
    Ganapathi, Iyyakutti Iyappan
    Dharejo, Fayaz Ali
    Javed, Sajid
    Ali, Syed Sadaf
    Werghi, Naoufel
    2024 INTERNATIONAL CONFERENCE IN 3D VISION, 3DV 2024, 2024, : 506 - 515
  • [42] Region-aware Adaptive Instance Normalization for Image Harmonization
    Ling, Jun
    Xue, Han
    Song, Li
    Xie, Rong
    Gu, Xiao
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 9357 - 9366
  • [43] Region-aware POI Recommendation with Semantic Spatial Graph
    Tang, Jiakai
    Jin, Jiahui
    Miao, Zijia
    Zhang, Binjie
    An, Qi
    Zhang, Jinghui
    PROCEEDINGS OF THE 2021 IEEE 24TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN (CSCWD), 2021, : 214 - 219
  • [44] Region-Aware Image Captioning via Interaction Learning
    Liu, An-An
    Zhai, Yingchen
    Xu, Ning
    Nie, Weizhi
    Li, Wenhui
    Zhang, Yongdong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (06) : 3685 - 3696
  • [45] Fast and Robust Optical-to-SAR Remote Sensing Image Registration Using Region-Aware Phase Descriptor
    Ye, Yibin
    Wang, Qinwei
    Zhao, Hong
    Teng, Xichao
    Bian, Yijie
    Li, Zhang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 12
  • [46] Region-Aware Portrait Retouching With Sparse Interactive Guidance
    Zeng, Huimin
    Huang, Jie
    Li, Jiacheng
    Xiong, Zhiwei
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 127 - 140
  • [47] HRANet: Hierarchical region-aware network for crowd counting
    Jinyang Xie
    Lingyu Gu
    Zhonghui Li
    Lei Lyu
    Applied Intelligence, 2022, 52 : 12191 - 12205
  • [48] Unsupervised Geometry-Aware Representation for 3D Human Pose Estimation
    Rhodin, Helge
    Salzmann, Mathieu
    Fua, Pascal
    COMPUTER VISION - ECCV 2018, PT X, 2018, 11214 : 765 - 782
  • [49] A deformable patch-based transformer for 3D medical image registration
    Deng, Liwei
    Zhi, Qiang
    Huang, Sijuan
    Yang, Xin
    Wang, Jing
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2023, 18 (12) : 2295 - 2306
  • [50] A deformable patch-based transformer for 3D medical image registration
    Liwei Deng
    Qiang Zhi
    Sijuan Huang
    Xin Yang
    Jing Wang
    International Journal of Computer Assisted Radiology and Surgery, 2023, 18 : 2295 - 2306