Deep magnetic resonance fingerprinting based on Local and Global Vision Transformer

被引:2
|
作者
Li, Peng [1 ]
Hu, Yue [1 ]
机构
[1] Harbin Inst Technol, Sch Elect & Informat Engn, Harbin, Peoples R China
关键词
Magnetic resonance fingerprinting; Vision Transformer; Deep learning;
D O I
10.1016/j.media.2024.103198
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To mitigate systematic errors in magnetic resonance fingerprinting (MRF), the precomputed dictionary is usually computed with minimal granularity across the entire range of tissue parameters. However, the dictionary grows exponentially with the number of parameters increase, posing significant challenges to the computational efficiency and matching accuracy of pattern-matching algorithms. Existing works, primarily based on convolutional neural networks (CNN), focus solely on local information to reconstruct multiple parameter maps, lacking in-depth investigations on the MRF mechanism. These methods may not exploit long-distance redundancies and the contextual information within voxel fingerprints introduced by the Bloch equation dynamics, leading to limited reconstruction speed and accuracy. To overcome these limitations, we propose a novel end-to-end neural network called the Local and Global Vision Transformer (LG-ViT) for MRF parameter reconstruction. Our proposed LG-ViT employs a multi-stage architecture that effectively reduces the computational overhead associated with the high-dimensional MRF data and the transformer model. Specifically, a local Transformer encoder is proposed to capture contextual information embedded within voxel fingerprints and local correlations introduced by the interconnected human tissues. Additionally, a global Transformer encoder is proposed to leverage long-distance dependencies arising from shared characteristics among different tissues across various spatial regions. By incorporating MRF physics-based data priors and effectively capturing local and global correlations, our proposed LG-ViT can achieve fast and accurate MRF parameter reconstruction. Experiments on both simulation and in vivo data demonstrate that the proposed method enables faster and more accurate MRF parameter reconstruction compared to state-of-the-art deep learning-based methods.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Local and global bifurcations in magnetic resonance force microscopy
    E. Hacker
    O. Gottlieb
    Nonlinear Dynamics, 2020, 99 : 201 - 225
  • [32] MODEL-BASED ITERATIVE RECONSTRUCTION FOR MAGNETIC RESONANCE FINGERPRINTING
    Zhao, Bo
    2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 3392 - 3396
  • [33] DEPTHFORMER: MULTISCALE VISION TRANSFORMER FOR MONOCULAR DEPTH ESTIMATION WITH GLOBAL LOCAL INFORMATION FUSION
    Agarwal, Ashutosh
    Arora, Chetan
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 3873 - 3877
  • [34] Light-Weight Vision Transformer with Parallel Local and Global Self-Attention
    Ebert, Nikolas
    Reichardt, Laurenz
    Stricker, Didier
    Wasenmueller, Oliver
    2023 IEEE 26TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, ITSC, 2023, : 452 - 459
  • [35] PLG-ViT: Vision Transformer with Parallel Local and Global Self-Attention
    Ebert, Nikolas
    Stricker, Didier
    Wasenmueller, Oliver
    SENSORS, 2023, 23 (07)
  • [36] Global and Local Feature Interaction with Vision Transformer for Few-shot Image Classification
    Sun, Mingze
    Ma, Weizhi
    Liu, Yang
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 4530 - 4534
  • [37] Note: Development of a triple resonance pulse transformer based on magnetic core transformer
    Li, Mingjia
    Liang, Chuan
    Zhou, Lin
    Zhang, Faqiang
    Wang, Wenchuan
    REVIEW OF SCIENTIFIC INSTRUMENTS, 2018, 89 (09):
  • [38] Magnetization transfer in magnetic resonance fingerprinting
    Hilbert, Tom
    Xia, Ding
    Block, Kai Tobias
    Yu, Zidan
    Lattanzi, Riccardo
    Sodickson, Daniel K.
    Kober, Tobias
    Cloos, Martijn A.
    MAGNETIC RESONANCE IN MEDICINE, 2020, 84 (01) : 128 - 141
  • [39] Magnetic resonance fingerprinting: a technical review
    Mehta, Bhairav Bipin
    Coppo, Simone
    McGivney, Debra Frances
    Hamilton, Jesse Ian
    Chen, Yong
    Jiang, Yun
    Ma, Dan
    Seiberlich, Nicole
    Gulani, Vikas
    Griswold, Mark Alan
    MAGNETIC RESONANCE IN MEDICINE, 2019, 81 (01) : 25 - 46
  • [40] Robust Image Fingerprinting Algorithm Based on Local and Global Content Dependencies
    Li, Yuenan
    Zhang, Wei
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 336 - 340