Deep magnetic resonance fingerprinting based on Local and Global Vision Transformer

被引:2
|
作者
Li, Peng [1 ]
Hu, Yue [1 ]
机构
[1] Harbin Inst Technol, Sch Elect & Informat Engn, Harbin, Peoples R China
关键词
Magnetic resonance fingerprinting; Vision Transformer; Deep learning;
D O I
10.1016/j.media.2024.103198
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To mitigate systematic errors in magnetic resonance fingerprinting (MRF), the precomputed dictionary is usually computed with minimal granularity across the entire range of tissue parameters. However, the dictionary grows exponentially with the number of parameters increase, posing significant challenges to the computational efficiency and matching accuracy of pattern-matching algorithms. Existing works, primarily based on convolutional neural networks (CNN), focus solely on local information to reconstruct multiple parameter maps, lacking in-depth investigations on the MRF mechanism. These methods may not exploit long-distance redundancies and the contextual information within voxel fingerprints introduced by the Bloch equation dynamics, leading to limited reconstruction speed and accuracy. To overcome these limitations, we propose a novel end-to-end neural network called the Local and Global Vision Transformer (LG-ViT) for MRF parameter reconstruction. Our proposed LG-ViT employs a multi-stage architecture that effectively reduces the computational overhead associated with the high-dimensional MRF data and the transformer model. Specifically, a local Transformer encoder is proposed to capture contextual information embedded within voxel fingerprints and local correlations introduced by the interconnected human tissues. Additionally, a global Transformer encoder is proposed to leverage long-distance dependencies arising from shared characteristics among different tissues across various spatial regions. By incorporating MRF physics-based data priors and effectively capturing local and global correlations, our proposed LG-ViT can achieve fast and accurate MRF parameter reconstruction. Experiments on both simulation and in vivo data demonstrate that the proposed method enables faster and more accurate MRF parameter reconstruction compared to state-of-the-art deep learning-based methods.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Tailored magnetic resonance fingerprinting
    Poojar, Pavan
    Qian, Enlin
    Fernandes, Tiago T.
    Fung, Maggie
    Quarterman, Patrick
    Jambawalikar, Sachin R.
    Lignelli, Angela
    Geethanath, Sairam
    Nunes, Rita G.
    MAGNETIC RESONANCE IMAGING, 2023, 99 : 81 - 90
  • [22] ASiT: Local-Global Audio Spectrogram Vision Transformer for Event Classification
    Ahmed, Sara Atito Ali
    Awais, Muhammad
    Wang, Wenwu
    Plumbley, Mark D.
    Kittler, Josef
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2024, 32 : 3684 - 3693
  • [23] Magnetic resonance field fingerprinting
    Koerzdoerfer, Gregor
    Jiang, Yun
    Speier, Peter
    Pang, Jianing
    Ma, Dan
    Pfeuffer, Josef
    Hensel, Bernhard
    Gulani, Vikas
    Griswold, Mark
    Nittka, Mathias
    MAGNETIC RESONANCE IN MEDICINE, 2019, 81 (04) : 2347 - 2359
  • [24] Magnetic resonance fingerprinting: an overview
    Charit Tippareddy
    Walter Zhao
    Jeffrey L. Sunshine
    Mark Griswold
    Dan Ma
    Chaitra Badve
    European Journal of Nuclear Medicine and Molecular Imaging, 2021, 48 : 4189 - 4200
  • [25] Magnetic resonance fingerprinting: an overview
    Tippareddy, Charit
    Zhao, Walter
    Sunshine, Jeffrey L.
    Griswold, Mark
    Ma, Dan
    Badve, Chaitra
    EUROPEAN JOURNAL OF NUCLEAR MEDICINE AND MOLECULAR IMAGING, 2021, 48 (13) : 4189 - 4200
  • [26] HashFormer: Vision Transformer Based Deep Hashing for Image Retrieval
    Li, Tao
    Zhang, Zheng
    Pei, Lishen
    Gan, Yan
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 827 - 831
  • [27] T2 MAGNETIC RESONANCE FINGERPRINTING IN GLOBAL AND FOCAL KNEE CARTILAGE
    Sitarcikova, Diana
    Janacova, Veronika
    Hristoska, Barbara
    Gologan, Malina
    Cloos, Martijn A.
    Trattnig, Siegfried
    Juras, Vladimir
    OSTEOARTHRITIS AND CARTILAGE, 2024, 32 : S345 - S346
  • [28] Circumventing the curse of dimensionality in magnetic resonance fingerprinting through a deep learning approach
    Barbieri, Marco
    Lee, Philip K.
    Brizi, Leonardo
    Giampieri, Enrico
    Solera, Francesco
    Castellani, Gastone
    Hargreaves, Brian A.
    Testa, Claudia
    Lodi, Raffaele
    Remondini, Daniel
    NMR IN BIOMEDICINE, 2022, 35 (04)
  • [29] Physics-Based Decoding Improves Magnetic Resonance Fingerprinting
    Heo, Juyeon
    Song, Pingfan
    Liu, Weiyang
    Weller, Adrian
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT II, 2023, 14221 : 446 - 456
  • [30] Local and global bifurcations in magnetic resonance force microscopy
    Hacker, E.
    Gottlieb, O.
    NONLINEAR DYNAMICS, 2020, 99 (01) : 201 - 225