IC-CViT: Inverse-Consistent Convolutional Vision Transformer for Diffeomorphic Image Registration

被引:0
|
作者
Xu, Tao [1 ]
Jiang, Ting [1 ]
Li, Xiaoning [1 ,2 ,3 ]
机构
[1] Sichuan Normal Univ, Coll Comp Sci, Chengdu, Peoples R China
[2] Visual Comp & Virtual Real Key Lab Sichuan Prov, Chengdu, Peoples R China
[3] Sichuan 2011 Collaborat Innovat Ctr Educ Big Data, Chengdu, Peoples R China
来源
2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN | 2023年
关键词
Diffeomorphic registration; Inverse-consistent; Convolutional neural networks; Vision Transformer; 3D brain MRI;
D O I
10.1109/IJCNN54540.2023.10191209
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Diffeomorphic registration plays a crucial role in medical image analysis due to the invertible and one-to-one mapping transformation. In recent years, with the development of deep learning technology, convolutional neural networks (CNNs) have been a broad focus of research in medical image registration, and CNN-based methods have made great progress. However, the results of most existing methods generally are not necessarily diffeomorphic, generating implausibly bijective mappings between images due to the interpolation and discrete representation. Furthermore, the performances of CNNs may be limited by a lack of precise comprehension of global and long-range cross-image spatial relevance. Vision Transformer (ViT) is capable of enhancing the long-distance information interaction ability to identify the semantically anatomically correspondences of medical images. Compared with CNN, ViT has weak local feature extraction ability due to less inductive bias, especially in small-scale training datasets, meaning that the samples between adjacent pixels cannot be exploited adequately. To address the above challenges, we propose a novel Inverse-Consistent Convolutional Vision Transformer (IC-CViT) network for diffeomorphic image registration. Specifically, image pairs can explicitly conduct bi-directional registration through the predicted deformation filed, generated within the diffeomorphic mappings space and restricted by the proposed inverse consistent loss term. We verify our method on two 3D brain MRI scan datasets including OASIS and LPBA40. Comprehensive results demonstrate that IC-CViT achieves state-of-the-art registration accuracy while maintaining desired diffeomorphic properties.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] CvTMorph: Improving Local Feature Extraction in Medical Image Registration for Respiratory Motion Modeling with Convolutional Vision Transformer
    Chen, Peizhi
    Zou, Xupeng
    Gou, Yifan
    CURRENT MEDICAL IMAGING, 2024, 20
  • [22] Motion Compensated Magnetic Resonance Reconstruction Using Inverse-Consistent Deformable Registration: Application to Real-Time Cine Imaging
    Xue, Hui
    Ding, Yu
    Guetter, Christoph
    Jolly, Marie-Pierre
    Guehring, Jens
    Zuehlsdorff, Sven
    Simonetti, Orlando P.
    MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, MICCAI 2011, PT I, 2011, 6891 : 564 - +
  • [23] Affine Medical Image Registration with Coarse-to-Fine Vision Transformer
    Mok, Tony C. W.
    Chung, Albert C. S.
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 20803 - 20812
  • [24] Deep Convolutional Inverse Graphics Network Based Deformable Image Registration
    Kearney, V.
    Haaf, S.
    Sudhyadhom, A.
    Valdes, G.
    Solberg, T.
    MEDICAL PHYSICS, 2018, 45 (06) : E131 - E131
  • [25] Robust inverse-consistent affine CT-MR registration in MRI-assisted and MRI-alone prostate radiation therapy
    Rivest-Henault, David
    Dowson, Nicholas
    Jason, Peter B.
    Fripp, Jurgen
    Dowling, Jason A.
    MEDICAL IMAGE ANALYSIS, 2015, 23 (01) : 56 - 69
  • [26] Pure large kernel convolutional neural network transformer for medical image registration
    Fang, Zhao
    Cao, Wenming
    INTELLIGENT DATA ANALYSIS, 2024, 28 (03) : 769 - 790
  • [27] A MULTIPLE DECODER CNN FOR INVERSE CONSISTENT 3D IMAGE REGISTRATION
    Nazib, Abdullah
    Fookes, Clinton
    Salvado, Olivier
    Perrin, Dimitri
    2021 IEEE 18TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2021, : 904 - 907
  • [28] PIViT: Large Deformation Image Registration with Pyramid-Iterative Vision Transformer
    Ma, Tai
    Dai, Xinru
    Zhang, Suwei
    Wen, Ying
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT X, 2023, 14229 : 602 - 612
  • [29] Ctnet: rethinking convolutional neural networks and vision transformer for medical image segmentation
    Zhang, Zhixin
    Jiang, Shuhao
    Pan, Xuhua
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (03) : 2265 - 2275
  • [30] CAEVT: Convolutional Autoencoder Meets Lightweight Vision Transformer for Hyperspectral Image Classification
    Zhang, Zhiwen
    Li, Teng
    Tang, Xuebin
    Hu, Xiang
    Peng, Yuanxi
    SENSORS, 2022, 22 (10)