3D UNSUPERVISED REGION-AWARE REGISTRATION TRANSFORMER

被引:0
|
作者
Hao, Yu [1 ]
Fang, Yi [1 ,2 ]
机构
[1] NYU Abu Dhabi, NYU Multimedia & Visual Comp Lab, Abu Dhabi, U Arab Emirates
[2] NYU Abu Dhabi, NYUAD Ctr Artificial Intelligence & Robot, Abu Dhabi, U Arab Emirates
关键词
3D registration; unsupervised registration;
D O I
10.1109/ICIP49359.2023.10222489
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper concerns the research problem of point cloud registration to find the rigid transformation to optimally align the source point set with the target one. Learning robust point cloud registration models with deep neural networks has emerged as a powerful paradigm, offering promising performance in predicting the global geometric transformation for a pair of point sets. Existing methods first leverage an encoder to regress the global shape descriptor, which is then decoded into a shape-conditioned transformation via concatenation-based conditioning. However, different regions of a 3D shape vary in their geometric structures which makes it more sense that we have a region-conditioned transformation instead of the shape-conditioned one. In this paper, we define our 3D registration function through the introduction of a new design of 3D region partition module that is able to divide the input shape to different regions with a self-supervised 3D shape reconstruction loss without the need for ground truth labels. We further propose the 3D shape transformer module to efficiently and effectively capture short- and long-range geometric dependencies for regions on the 3D shape Consequently, the region-aware decoder module is proposed to predict the transformations for different regions respectively. The global geometric transformation from the source point set to the target one is then formed by the weighted fusion of region-aware transformation. Compared to the state-of-the-art approaches, our experiments show that our 3D-URRT achieves superior registration performance over various benchmark datasets (e.g. ModelNet40).
引用
收藏
页码:2780 / 2784
页数:5
相关论文
共 50 条
  • [21] Target region-aware tone reproduction
    Hsiao, Dun-Yu
    Liao, Hong-Yuan Mark
    PROCEEDINGS OF 2008 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS 1-10, 2008, : 276 - 279
  • [22] Spatial deformable transformer for 3D point cloud registration
    Xiong, Fengguang
    Kong, Yu
    Xie, Shuaikang
    Kuang, Liqun
    Han, Xie
    SCIENTIFIC REPORTS, 2024, 14 (01)
  • [23] Spatial deformable transformer for 3D point cloud registration
    Fengguang Xiong
    Yu Kong
    Shuaikang Xie
    Liqun Kuang
    Xie Han
    Scientific Reports, 14
  • [24] RAMON: Region-Aware Memory Controller
    Marino, Mario D.
    Li, Kuan-Ching
    IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2018, 26 (04) : 697 - 710
  • [25] Unsupervised deformable image registration network for 3D medical images
    Yingjun Ma
    Dongmei Niu
    Jinshuo Zhang
    Xiuyang Zhao
    Bo Yang
    Caiming Zhang
    Applied Intelligence, 2022, 52 : 766 - 779
  • [26] FAIM - A ConvNet Method for Unsupervised 3D Medical Image Registration
    Kuang, Dongyang
    Schmah, Tanya
    MACHINE LEARNING IN MEDICAL IMAGING (MLMI 2019), 2019, 11861 : 646 - 654
  • [27] An Unsupervised Learning Approach to 3D Rectal MRI Volume Registration
    Ho, Chi-Jui
    Duong, Soan T. M.
    Wang, Yiqian
    Nguyen, Chanh D. Tr.
    Bui, Bieu Q.
    Truong, Steven Q. H.
    Nguyen, Truong Q.
    An, Cheolhong
    IEEE ACCESS, 2022, 10 : 87650 - 87660
  • [28] Unsupervised deformable image registration network for 3D medical images
    Ma, Yingjun
    Niu, Dongmei
    Zhang, Jinshuo
    Zhao, Xiuyang
    Yang, Bo
    Zhang, Caiming
    APPLIED INTELLIGENCE, 2022, 52 (01) : 766 - 779
  • [29] Unsupervised Learning with Alternating Matching Features for 3D Image Registration
    Liu, Lin
    Fan, Xinxin
    Liu, Xuan
    He, Wenfeng
    Liang, Xiaokun
    MEDICAL IMAGING 2024: IMAGE PROCESSING, 2024, 12926
  • [30] Registration of Human Point Set using Automatic Key Point Detection and Region-aware Features
    Maharjan, Amar
    Yuan, Xiaohui
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 2264 - 2272