Deep magnetic resonance fingerprinting based on Local and Global Vision Transformer

被引:2
|
作者
Li, Peng [1 ]
Hu, Yue [1 ]
机构
[1] Harbin Inst Technol, Sch Elect & Informat Engn, Harbin, Peoples R China
关键词
Magnetic resonance fingerprinting; Vision Transformer; Deep learning;
D O I
10.1016/j.media.2024.103198
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To mitigate systematic errors in magnetic resonance fingerprinting (MRF), the precomputed dictionary is usually computed with minimal granularity across the entire range of tissue parameters. However, the dictionary grows exponentially with the number of parameters increase, posing significant challenges to the computational efficiency and matching accuracy of pattern-matching algorithms. Existing works, primarily based on convolutional neural networks (CNN), focus solely on local information to reconstruct multiple parameter maps, lacking in-depth investigations on the MRF mechanism. These methods may not exploit long-distance redundancies and the contextual information within voxel fingerprints introduced by the Bloch equation dynamics, leading to limited reconstruction speed and accuracy. To overcome these limitations, we propose a novel end-to-end neural network called the Local and Global Vision Transformer (LG-ViT) for MRF parameter reconstruction. Our proposed LG-ViT employs a multi-stage architecture that effectively reduces the computational overhead associated with the high-dimensional MRF data and the transformer model. Specifically, a local Transformer encoder is proposed to capture contextual information embedded within voxel fingerprints and local correlations introduced by the interconnected human tissues. Additionally, a global Transformer encoder is proposed to leverage long-distance dependencies arising from shared characteristics among different tissues across various spatial regions. By incorporating MRF physics-based data priors and effectively capturing local and global correlations, our proposed LG-ViT can achieve fast and accurate MRF parameter reconstruction. Experiments on both simulation and in vivo data demonstrate that the proposed method enables faster and more accurate MRF parameter reconstruction compared to state-of-the-art deep learning-based methods.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] DEEP MAGNETIC RESONANCE FINGERPRINTING BASED ON LOCAL AND GLOBAL VISION TRANSFORMER
    Li, Peng
    Hu, Yue
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [2] DEEP UNROLLING FOR MAGNETIC RESONANCE FINGERPRINTING
    Chen, Dongdong
    Davies, Mike E.
    Golbabaee, Mohammad
    2022 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (IEEE ISBI 2022), 2022,
  • [3] Aggregating Global Features into Local Vision Transformer
    Patel, Krushi
    Bur, Andres M.
    Li, Fengjun
    Wang, Guanghui
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 1141 - 1147
  • [4] GEOMETRY OF DEEP LEARNING FOR MAGNETIC RESONANCE FINGERPRINTING
    Golbabaee, Mohammad
    Chen, Dongdong
    Gomez, Pedro A.
    Menzel, Marion I.
    Davies, Mike E.
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 7825 - 7829
  • [5] HYDRA: Hybrid deep magnetic resonance fingerprinting
    Song, Pingfan
    Eldar, Yonina C.
    Mazor, Gal
    Rodrigues, Miguel R. D.
    MEDICAL PHYSICS, 2019, 46 (11) : 4951 - 4969
  • [6] Local Pyramid Vision Transformer: Millimeter-Wave Radar Gesture Recognition Based on Transformer with Integrated Local and Global Awareness
    Wang, Zhaocheng
    Hu, Guangxuan
    Zhao, Shuo
    Wang, Ruonan
    Kang, Hailong
    Luo, Feng
    Remote Sensing, 2024, 16 (23)
  • [7] Global deep learning optimization of chemical exchange saturation transfer magnetic resonance fingerprinting acquisition schedule
    Cohen, Ouri
    Otazo, Ricardo
    NMR IN BIOMEDICINE, 2023, 36 (10)
  • [8] Quantitative molecular imaging using deep magnetic resonance fingerprinting
    Vladimirov, Nikita
    Cohen, Ouri
    Heo, Hye-Young
    Zaiss, Moritz
    Farrar, Christian T.
    Perlman, Or
    NATURE PROTOCOLS, 2025,
  • [9] Magnetic resonance fingerprinting
    Ma, Dan
    Gulani, Vikas
    Seiberlich, Nicole
    Liu, Kecheng
    Sunshine, Jeffrey L.
    Duerk, Jeffrey L.
    Griswold, Mark A.
    NATURE, 2013, 495 (7440) : 187 - 192
  • [10] Magnetic resonance fingerprinting
    Dan Ma
    Vikas Gulani
    Nicole Seiberlich
    Kecheng Liu
    Jeffrey L. Sunshine
    Jeffrey L. Duerk
    Mark A. Griswold
    Nature, 2013, 495 : 187 - 192