Deep magnetic resonance fingerprinting based on Local and Global Vision Transformer

被引:2
|
作者
Li, Peng [1 ]
Hu, Yue [1 ]
机构
[1] Harbin Inst Technol, Sch Elect & Informat Engn, Harbin, Peoples R China
关键词
Magnetic resonance fingerprinting; Vision Transformer; Deep learning;
D O I
10.1016/j.media.2024.103198
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To mitigate systematic errors in magnetic resonance fingerprinting (MRF), the precomputed dictionary is usually computed with minimal granularity across the entire range of tissue parameters. However, the dictionary grows exponentially with the number of parameters increase, posing significant challenges to the computational efficiency and matching accuracy of pattern-matching algorithms. Existing works, primarily based on convolutional neural networks (CNN), focus solely on local information to reconstruct multiple parameter maps, lacking in-depth investigations on the MRF mechanism. These methods may not exploit long-distance redundancies and the contextual information within voxel fingerprints introduced by the Bloch equation dynamics, leading to limited reconstruction speed and accuracy. To overcome these limitations, we propose a novel end-to-end neural network called the Local and Global Vision Transformer (LG-ViT) for MRF parameter reconstruction. Our proposed LG-ViT employs a multi-stage architecture that effectively reduces the computational overhead associated with the high-dimensional MRF data and the transformer model. Specifically, a local Transformer encoder is proposed to capture contextual information embedded within voxel fingerprints and local correlations introduced by the interconnected human tissues. Additionally, a global Transformer encoder is proposed to leverage long-distance dependencies arising from shared characteristics among different tissues across various spatial regions. By incorporating MRF physics-based data priors and effectively capturing local and global correlations, our proposed LG-ViT can achieve fast and accurate MRF parameter reconstruction. Experiments on both simulation and in vivo data demonstrate that the proposed method enables faster and more accurate MRF parameter reconstruction compared to state-of-the-art deep learning-based methods.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Magnetic Resonance Fingerprinting of the Pediatric Brain
    Hung, Sheng-Che
    Chen, Yong
    Yap, Pew-Thian
    Lin, Weili
    MAGNETIC RESONANCE IMAGING CLINICS OF NORTH AMERICA, 2021, 29 (04) : 605 - 616
  • [42] Magnetic resonance fingerprinting in multiple sclerosis
    Ontaneda, Daniel
    Gulani, Vikas
    Deshmane, Anagha
    Shah, Amisha
    Guruprakash, Deepti K.
    Jiang, Yun
    Ma, Dan
    Fisher, Elizabeth
    Rudick, Richard A.
    Raza, Praneeta
    Kilbane, Meghan
    Cohen, Jeffrey A.
    Sakaie, Ken
    Lowe, Mark J.
    Griswold, Mark A.
    Nakamura, Kunio
    MULTIPLE SCLEROSIS AND RELATED DISORDERS, 2023, 79
  • [43] Facial Expression Recognition Based on Vision Transformer with Hybrid Local Attention
    Tian, Yuan
    Zhu, Jingxuan
    Yao, Huang
    Chen, Di
    APPLIED SCIENCES-BASEL, 2024, 14 (15):
  • [44] Low Rank Magnetic Resonance Fingerprinting
    Mazor, Gal
    Weizman, Lior
    Tal, Assaf
    Eldar, Yonina C.
    2016 38TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2016, : 439 - 442
  • [45] Remote Sensing Scene Classification Based on Local Selection Vision Transformer
    Yang Kai
    Lu Xiaoqiang
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (22)
  • [46] High Resolution SAR Image Classification Using Global-Local Network Structure Based on Vision Transformer and CNN
    Liu, Xingyu
    Wu, Yan
    Liang, Wenkai
    Cao, Yice
    Li, Ming
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [47] A deep fusion-based vision transformer for breast cancer classification
    Fiaz, Ahsan
    Raza, Basit
    Faheem, Muhammad
    Raza, Aadil
    HEALTHCARE TECHNOLOGY LETTERS, 2024, 11 (06) : 471 - 484
  • [48] Vision transformer based deep learning of topological indicators in Majorana nanowires
    Taylor, Jacob R.
    Das Sarma, Sankar
    PHYSICAL REVIEW B, 2025, 111 (10)
  • [49] A deep fusion-based vision transformer for breast cancer classification
    Fiaz, Ahsan
    Raza, Basit
    Faheem, Muhammad
    Raza, Aadil
    HEALTHCARE TECHNOLOGY LETTERS, 2024,
  • [50] An efficient vision transformer for Alzheimer's disease classification using magnetic resonance images
    Lu, Si-Yuan
    Zhang, Yu-Dong
    Yao, Yu-Dong
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 101