IC-CViT: Inverse-Consistent Convolutional Vision Transformer for Diffeomorphic Image Registration

被引:0
|
作者
Xu, Tao [1 ]
Jiang, Ting [1 ]
Li, Xiaoning [1 ,2 ,3 ]
机构
[1] Sichuan Normal Univ, Coll Comp Sci, Chengdu, Peoples R China
[2] Visual Comp & Virtual Real Key Lab Sichuan Prov, Chengdu, Peoples R China
[3] Sichuan 2011 Collaborat Innovat Ctr Educ Big Data, Chengdu, Peoples R China
关键词
Diffeomorphic registration; Inverse-consistent; Convolutional neural networks; Vision Transformer; 3D brain MRI;
D O I
10.1109/IJCNN54540.2023.10191209
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Diffeomorphic registration plays a crucial role in medical image analysis due to the invertible and one-to-one mapping transformation. In recent years, with the development of deep learning technology, convolutional neural networks (CNNs) have been a broad focus of research in medical image registration, and CNN-based methods have made great progress. However, the results of most existing methods generally are not necessarily diffeomorphic, generating implausibly bijective mappings between images due to the interpolation and discrete representation. Furthermore, the performances of CNNs may be limited by a lack of precise comprehension of global and long-range cross-image spatial relevance. Vision Transformer (ViT) is capable of enhancing the long-distance information interaction ability to identify the semantically anatomically correspondences of medical images. Compared with CNN, ViT has weak local feature extraction ability due to less inductive bias, especially in small-scale training datasets, meaning that the samples between adjacent pixels cannot be exploited adequately. To address the above challenges, we propose a novel Inverse-Consistent Convolutional Vision Transformer (IC-CViT) network for diffeomorphic image registration. Specifically, image pairs can explicitly conduct bi-directional registration through the predicted deformation filed, generated within the diffeomorphic mappings space and restricted by the proposed inverse consistent loss term. We verify our method on two 3D brain MRI scan datasets including OASIS and LPBA40. Comprehensive results demonstrate that IC-CViT achieves state-of-the-art registration accuracy while maintaining desired diffeomorphic properties.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] IConDiffNet: an unsupervised inverse-consistent diffeomorphic network for medical image registration
    Liao, Rui
    Williamson, Jeffrey F.
    Xia, Tianyu
    Ge, Tao
    O'Sullivan, Joseph A.
    PHYSICS IN MEDICINE AND BIOLOGY, 2025, 70 (05):
  • [2] An Efficient Inverse-Consistent Diffeomorphic Image Registration Method for Prostate Adaptive Radiotherapy
    Han, Xiao
    Hibbard, Lyndon S.
    Willcut, Virgil
    PROSTATE CANCER IMAGING: COMPUTER-AIDED DIAGNOSIS, PROGNOSIS, AND INTERVENTION, 2010, 6367 : 34 - 41
  • [3] Transitive inverse-consistent manifold registration
    Geng, XJ
    Kumar, D
    Christensen, GE
    INFORMATION PROCESSING IN MEDICAL IMAGING, PROCEEDINGS, 2005, 3565 : 468 - 479
  • [4] Stepwise Inverse Consistent Euler's Scheme for Diffeomorphic Image Registration
    Pai, Akshay
    Sommer, Stefan
    Darkner, Sune
    Sorensen, Lauge
    Sporring, Jon
    Nielsen, Mads
    BIOMEDICAL IMAGE REGISTRATION (WBIR 2014), 2014, 8545 : 223 - 230
  • [5] Symmetric pyramid network for medical image inverse consistent diffeomorphic registration
    Zhang, Liutong
    Ning, Guochen
    Zhou, Lei
    Liao, Hongen
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2023, 104
  • [6] Multi-Modal Robust Inverse-Consistent Linear Registration
    Wachinger, Christian
    Golland, Polina
    Magnain, Caroline
    Fischl, Bruce
    Reuter, Martin
    HUMAN BRAIN MAPPING, 2015, 36 (04) : 1365 - 1380
  • [7] EFFICIENT SYMMETRIC AND INVERSE-CONSISTENT DEFORMABLE REGISTRATION THROUGH INTERLEAVED OPTIMIZATION
    Guetter, Christoph
    Xue, Hui
    Chefd'hotel, Christophe
    Guehring, Jens
    2011 8TH IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING: FROM NANO TO MACRO, 2011, : 590 - 593
  • [8] Fast Symmetric Diffeomorphic Image Registration with Convolutional Neural Networks
    Mok, Tony C. W.
    Chung, Albert C. S.
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 4643 - 4652
  • [9] CT colonography: inverse-consistent symmetric registration of prone and supine inner colon surfaces
    Roth, Holger R.
    McClelland, Jamie R.
    Modat, Marc
    Hampshire, Thomas E.
    Boone, Darren J.
    Helbren, Emma
    Plumb, Andrew
    Hu, Mingxing
    Ourselin, Sebastien
    Halligan, Steve
    Hawkes, David J.
    MEDICAL IMAGING 2013: IMAGE PROCESSING, 2013, 8669
  • [10] IMAGE STEGANALYSIS WITH CONVOLUTIONAL VISION TRANSFORMER
    Luo, Ge
    Wei, Ping
    Zhu, Shuwen
    Zhang, Xinpeng
    Qian, Zhenxing
    Li, Sheng
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 3089 - 3093