IC-CViT: Inverse-Consistent Convolutional Vision Transformer for Diffeomorphic Image Registration

被引:0
|
作者
Xu, Tao [1 ]
Jiang, Ting [1 ]
Li, Xiaoning [1 ,2 ,3 ]
机构
[1] Sichuan Normal Univ, Coll Comp Sci, Chengdu, Peoples R China
[2] Visual Comp & Virtual Real Key Lab Sichuan Prov, Chengdu, Peoples R China
[3] Sichuan 2011 Collaborat Innovat Ctr Educ Big Data, Chengdu, Peoples R China
来源
2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN | 2023年
关键词
Diffeomorphic registration; Inverse-consistent; Convolutional neural networks; Vision Transformer; 3D brain MRI;
D O I
10.1109/IJCNN54540.2023.10191209
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Diffeomorphic registration plays a crucial role in medical image analysis due to the invertible and one-to-one mapping transformation. In recent years, with the development of deep learning technology, convolutional neural networks (CNNs) have been a broad focus of research in medical image registration, and CNN-based methods have made great progress. However, the results of most existing methods generally are not necessarily diffeomorphic, generating implausibly bijective mappings between images due to the interpolation and discrete representation. Furthermore, the performances of CNNs may be limited by a lack of precise comprehension of global and long-range cross-image spatial relevance. Vision Transformer (ViT) is capable of enhancing the long-distance information interaction ability to identify the semantically anatomically correspondences of medical images. Compared with CNN, ViT has weak local feature extraction ability due to less inductive bias, especially in small-scale training datasets, meaning that the samples between adjacent pixels cannot be exploited adequately. To address the above challenges, we propose a novel Inverse-Consistent Convolutional Vision Transformer (IC-CViT) network for diffeomorphic image registration. Specifically, image pairs can explicitly conduct bi-directional registration through the predicted deformation filed, generated within the diffeomorphic mappings space and restricted by the proposed inverse consistent loss term. We verify our method on two 3D brain MRI scan datasets including OASIS and LPBA40. Comprehensive results demonstrate that IC-CViT achieves state-of-the-art registration accuracy while maintaining desired diffeomorphic properties.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Fundus Image Classification Research Based on Ensemble Convolutional Neural Network and Vision Transformer
    Yuan Yuan
    Chen Minghui
    Ke Shuting
    Wang Teng
    He Longxi
    Lu Linjie
    Sun Hao
    Liu Jiannan
    CHINESE JOURNAL OF LASERS-ZHONGGUO JIGUANG, 2022, 49 (20):
  • [42] A 3-D Convolutional Vision Transformer for PolSAR Image Classification and Change Detection
    Wang, Lei
    Gui, Rong
    Hong, Hanyu
    Hu, Jun
    Ma, Lei
    Shi, Yu
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 11503 - 11520
  • [43] Inverse consistent non-rigid image registration based on robust point set matching
    Yang, Xuan
    Pei, Jihong
    Shi, Jingli
    BIOMEDICAL ENGINEERING ONLINE, 2014, 13
  • [44] A FAST INVERSE CONSISTENT DEFORMABLE IMAGE REGISTRATION METHOD BASED ON SYMMETRIC OPTICAL FLOW COMPUTATION
    Yang, Deshan
    Li, Hua
    Low, Daniel A.
    Deasy, Joseph O.
    El Naqa, Issam
    2008 42ND ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS AND COMPUTERS, VOLS 1-4, 2008, : 1931 - 1935
  • [45] Inverse consistent non-rigid image registration based on robust point set matching
    Xuan Yang
    Jihong Pei
    Jingli Shi
    BioMedical Engineering OnLine, 13
  • [46] A fast inverse consistent deformable image registration method based on symmetric optical flow computation
    Yang, Deshan
    Li, Hua
    Low, Daniel A.
    Deasy, Joseph O.
    El Naqa, Issam
    PHYSICS IN MEDICINE AND BIOLOGY, 2008, 53 (21): : 6143 - 6165
  • [47] MDReg-Net: Multi-resolution diffeomorphic image registration using fully convolutional networks with deep self-supervision
    Li, Hongming
    Fan, Yong
    HUMAN BRAIN MAPPING, 2022, 43 (07) : 2218 - 2231
  • [48] Inverse consistent mapping in 3D deformable image registration: Its construction and statistical properties
    Leow, A
    Huang, SC
    Geng, A
    Becker, J
    Davis, S
    Toga, A
    Thompson, P
    INFORMATION PROCESSING IN MEDICAL IMAGING, PROCEEDINGS, 2005, 3565 : 493 - 503
  • [49] Accurate inverse consistent non-rigid image registration and its application on automatic re-contouring
    Zeng, Qingguo
    Chen, Yunmei
    BIOINFORMATICS RESEARCH AND APPLICATIONS, 2008, 4983 : 293 - 304
  • [50] Semi-Supervised Convolutional Vision Transformer with Bi-Level Uncertainty Estimation for Medical Image Segmentation
    Huang, Huimin
    Huang, Yawen
    Xie, Shiao
    Lin, Lanfen
    Tong Ruofeng
    Chen, Yen-Wei
    Li, Yuexiang
    Zheng, Yefeng
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 5214 - 5222