Denoising Knowledge Transfer Model for Zero-Shot MRI Reconstruction

被引:0
|
作者
Hou, Ruizhi [1 ]
Li, Fang [2 ,3 ]
机构
[1] Xian Univ Sci & Technol, Coll Comp Sci & Technol, Shaanxi 710054, Peoples R China
[2] East China Normal Univ, Sch Math Sci, Key Lab MEA, Minist Educ, Shanghai 200241, Peoples R China
[3] East China Normal Univ, Shanghai Key Lab PMMP, Shanghai 200241, Peoples R China
基金
上海市自然科学基金;
关键词
Image reconstruction; Training; Noise reduction; Zero shot learning; Magnetic resonance imaging; Hands; Ensemble learning; Computational modeling; Uncertainty; Training data; Diffusion model; ensemble learning; MRI reconstruction; plug-and-play; zero-shot learning; IMAGE; REGULARIZATION; PRIORS; SENSE; PLUG;
D O I
10.1109/TCI.2025.3525960
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Though fully-supervised deep learning methods have made remarkable achievements in accelerated magnetic resonance imaging (MRI) reconstruction, the fully-sampled or high-quality data is unavailable in many scenarios. Zero-shot learning enables training on under-sampled data. However, the limited information in under-sampled data inhibits the neural network from realizing its full potential. This paper proposes a novel learning framework to enhance the diversity of the learned prior in zero-shot learning and improve the reconstruction quality. It consists of three stages: multi-weighted zero-shot ensemble learning, denoising knowledge transfer, and model-guided reconstruction. In the first stage, the ensemble models are trained using a multi-weighted loss function in k-space, yielding results with higher quality and diversity. In the second stage, we propose to use the deep denoiser to distill the knowledge in the ensemble models. Additionally, the denoiser is initialized using weights pre-trained on nature images, combining external knowledge with the information from under-sampled data. In the third stage, the denoiser is plugged into the iteration algorithm to produce the final reconstructed image. Extensive experiments demonstrate that our proposed framework surpasses existing zero-shot methods and can flexibly adapt to different datasets. In multi-coil reconstruction, our proposed zero-shot learning framework outperforms the state-of-the-art denoising-based methods.
引用
收藏
页码:52 / 64
页数:13
相关论文
共 50 条
  • [1] Relational Knowledge Transfer for Zero-Shot Learning
    Wang, Donghui
    Li, Yanan
    Lin, Yuetan
    Zhuang, Yueting
    THIRTIETH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2016, : 2145 - 2151
  • [2] Zero-shot Learning via Recurrent Knowledge Transfer
    Zhao, Bo
    Sun, Xinwei
    Hong, Xiaopeng
    Yao, Yuan
    Wang, Yizhou
    2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, : 1308 - 1317
  • [3] Zero-Shot Task Transfer
    Pal, Arghya
    Balasubramanian, Vineeth N.
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 2184 - 2193
  • [4] Zero-shot Knowledge Transfer via Adversarial Belief Matching
    Micaelli, Paul
    Storkey, Amos
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [5] Unsupervised MRI Reconstruction via Zero-Shot Learned Adversarial Transformers
    Korkmaz, Yilmaz
    Dar, Salman U. H.
    Yurt, Mahmut
    Ozbey, Muzaffer
    Cukur, Tolga
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022, 41 (07) : 1747 - 1763
  • [6] MRI-based model for MCI conversion using deep zero-shot transfer learning
    Fujia Ren
    Chenhui Yang
    Y. A. Nanehkaran
    The Journal of Supercomputing, 2023, 79 : 1182 - 1200
  • [7] MRI-based model for MCI conversion using deep zero-shot transfer learning
    Ren, Fujia
    Yang, Chenhui
    Nanehkaran, Y. A.
    JOURNAL OF SUPERCOMPUTING, 2023, 79 (02): : 1182 - 1200
  • [8] Zero-shot Video Classification with Appropriate Web and Task Knowledge Transfer
    Zhuo, Junbao
    Zhu, Yan
    Cui, Shuhao
    Wang, Shuhui
    Ma, Bin
    Huang, Qingming
    Wei, Xiaoming
    Wei, Xiaolin
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 5761 - 5772
  • [9] Zero-shot Model Diagnosis
    Luo, Jinqi
    Wang, Zhaoning
    Wu, Chen Henry
    Huang, Dong
    De la Torre, Fernando
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 11631 - 11640
  • [10] Zero-shot Transfer Learning within a Heterogeneous Graph via Knowledge Transfer Networks
    Yoon, Minji
    Palowitch, John
    Zelle, Dustin
    Hu, Ziniu
    Salakhutdinov, Ruslan
    Perozzi, Bryan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,