IC-CViT: Inverse-Consistent Convolutional Vision Transformer for Diffeomorphic Image Registration

被引:0
|
作者
Xu, Tao [1 ]
Jiang, Ting [1 ]
Li, Xiaoning [1 ,2 ,3 ]
机构
[1] Sichuan Normal Univ, Coll Comp Sci, Chengdu, Peoples R China
[2] Visual Comp & Virtual Real Key Lab Sichuan Prov, Chengdu, Peoples R China
[3] Sichuan 2011 Collaborat Innovat Ctr Educ Big Data, Chengdu, Peoples R China
来源
2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN | 2023年
关键词
Diffeomorphic registration; Inverse-consistent; Convolutional neural networks; Vision Transformer; 3D brain MRI;
D O I
10.1109/IJCNN54540.2023.10191209
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Diffeomorphic registration plays a crucial role in medical image analysis due to the invertible and one-to-one mapping transformation. In recent years, with the development of deep learning technology, convolutional neural networks (CNNs) have been a broad focus of research in medical image registration, and CNN-based methods have made great progress. However, the results of most existing methods generally are not necessarily diffeomorphic, generating implausibly bijective mappings between images due to the interpolation and discrete representation. Furthermore, the performances of CNNs may be limited by a lack of precise comprehension of global and long-range cross-image spatial relevance. Vision Transformer (ViT) is capable of enhancing the long-distance information interaction ability to identify the semantically anatomically correspondences of medical images. Compared with CNN, ViT has weak local feature extraction ability due to less inductive bias, especially in small-scale training datasets, meaning that the samples between adjacent pixels cannot be exploited adequately. To address the above challenges, we propose a novel Inverse-Consistent Convolutional Vision Transformer (IC-CViT) network for diffeomorphic image registration. Specifically, image pairs can explicitly conduct bi-directional registration through the predicted deformation filed, generated within the diffeomorphic mappings space and restricted by the proposed inverse consistent loss term. We verify our method on two 3D brain MRI scan datasets including OASIS and LPBA40. Comprehensive results demonstrate that IC-CViT achieves state-of-the-art registration accuracy while maintaining desired diffeomorphic properties.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] Ctnet: rethinking convolutional neural networks and vision transformer for medical image segmentation
    Zhixin Zhang
    Shuhao Jiang
    Xuhua Pan
    Signal, Image and Video Processing, 2024, 18 : 2265 - 2275
  • [32] Image Retrieval Using Convolutional Autoencoder, InfoGAN, and Vision Transformer Unsupervised Models
    Sabry, Eman S.
    Elagooz, Salah S.
    Abd El-Samie, Fathi E.
    El-Shafai, Walid
    El-Bahnasawy, Nirmeen A.
    El-Banby, Ghada M.
    Algarni, Abeer D.
    Soliman, Naglaa F.
    Ramadan, Rabie A.
    IEEE ACCESS, 2023, 11 : 20445 - 20477
  • [33] Hyperspectral Image Classification Using Groupwise Separable Convolutional Vision Transformer Network
    Zhao, Zhuoyi
    Xu, Xiang
    Li, Shutao
    Plaza, Antonio
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 17
  • [34] A Novel Inverse-Consistent Feature-Based Non-Rigid Registration Method That Improves the Mapping of Organs with Large-Scale Deformations
    Bondar, M.
    Hoogeman, M.
    Osorio, E. Vasquez
    Dhawtal, G.
    Mens, J.
    Heijmen, B.
    MEDICAL PHYSICS, 2009, 36 (06) : 2822 - +
  • [35] CVTStego-Net: A convolutional vision transformer architecture for spatial image steganalysis
    Bravo-Ortiz, Mario Alejandro
    Mercado-Ruiz, Esteban
    Villa-Pulgarin, Juan Pablo
    Hormaza-Cardona, Carlos Angel
    Quinones-Arredondo, Sebastian
    Arteaga-Arteaga, Harold Brayan
    Orozco-Arias, Simon
    Cardona-Morales, Oscar
    Tabares-Soto, Reinel
    JOURNAL OF INFORMATION SECURITY AND APPLICATIONS, 2024, 81
  • [36] Deformable 3D medical image registration with convolutional neural network and transformer
    Deng, Liwei
    Zou, Yanchao
    Huang, Sijuan
    Yang, Xin
    Wang, Jing
    JOURNAL OF INSTRUMENTATION, 2023, 18 (04)
  • [37] Tracking lung tissue motion and expansion/compression with inverse consistent image registration and spirometry
    Christensen, Gary E.
    Song, Joo Hyun
    Lu, Wei
    El Naqa, Issarn
    Low, Daniel A.
    MEDICAL PHYSICS, 2007, 34 (06) : 2155 - 2163
  • [38] Inverse consistent image registration of MR brain scans: Handedness in normal adult males
    Geng, XJ
    Kumar, D
    Christensen, GE
    Vannier, MW
    BIOMEDICAL IMAGE REGISTRATION, 2003, 2717 : 71 - 80
  • [39] UVCGAN: UNet Vision Transformer cycle-consistent GAN for unpaired image-to-image translation
    Torbunov, Dmitrii
    Huang, Yi
    Yu, Haiwang
    Huang, Jin
    Yoo, Shinjae
    Lin, Meifeng
    Viren, Brett
    Ren, Yihui
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 702 - 712
  • [40] Causal Fusion of Convolutional Neural Network and Vision Transformer for Image Anomaly Detection and Localization
    Zhang, Shuo
    Hu, Xiongpeng
    Liu, Jing
    2024 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME 2024, 2024,