Denoising Knowledge Transfer Model for Zero-Shot MRI Reconstruction

被引:0
|
作者
Hou, Ruizhi [1 ]
Li, Fang [2 ,3 ]
机构
[1] Xian Univ Sci & Technol, Coll Comp Sci & Technol, Shaanxi 710054, Peoples R China
[2] East China Normal Univ, Sch Math Sci, Key Lab MEA, Minist Educ, Shanghai 200241, Peoples R China
[3] East China Normal Univ, Shanghai Key Lab PMMP, Shanghai 200241, Peoples R China
基金
上海市自然科学基金;
关键词
Image reconstruction; Training; Noise reduction; Zero shot learning; Magnetic resonance imaging; Hands; Ensemble learning; Computational modeling; Uncertainty; Training data; Diffusion model; ensemble learning; MRI reconstruction; plug-and-play; zero-shot learning; IMAGE; REGULARIZATION; PRIORS; SENSE; PLUG;
D O I
10.1109/TCI.2025.3525960
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Though fully-supervised deep learning methods have made remarkable achievements in accelerated magnetic resonance imaging (MRI) reconstruction, the fully-sampled or high-quality data is unavailable in many scenarios. Zero-shot learning enables training on under-sampled data. However, the limited information in under-sampled data inhibits the neural network from realizing its full potential. This paper proposes a novel learning framework to enhance the diversity of the learned prior in zero-shot learning and improve the reconstruction quality. It consists of three stages: multi-weighted zero-shot ensemble learning, denoising knowledge transfer, and model-guided reconstruction. In the first stage, the ensemble models are trained using a multi-weighted loss function in k-space, yielding results with higher quality and diversity. In the second stage, we propose to use the deep denoiser to distill the knowledge in the ensemble models. Additionally, the denoiser is initialized using weights pre-trained on nature images, combining external knowledge with the information from under-sampled data. In the third stage, the denoiser is plugged into the iteration algorithm to produce the final reconstructed image. Extensive experiments demonstrate that our proposed framework surpasses existing zero-shot methods and can flexibly adapt to different datasets. In multi-coil reconstruction, our proposed zero-shot learning framework outperforms the state-of-the-art denoising-based methods.
引用
收藏
页码:52 / 64
页数:13
相关论文
共 50 条
  • [21] Zero-Shot Low-Field MRI Enhancement via Denoising Diffusion Driven Neural Representation
    Lin, Xiyue
    Du, Chenhe
    Wu, Qing
    Tian, Xuanyu
    Yu, Jingyi
    Zhang, Yuyao
    Wei, Hongjiang
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT VII, 2024, 15007 : 775 - 785
  • [22] Hypernetworks for Zero-Shot Transfer in Reinforcement Learning
    Rezaei-Shoshtari, Sahand
    Morissette, Charlotte
    Hogan, Francois R.
    Dudek, Gregory
    Meger, David
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 8, 2023, : 9579 - 9587
  • [23] Zero-Shot Transfer Learning for Event Extraction
    Huang, Lifu
    Ji, Heng
    Cho, Kyunghyun
    Dagan, Ido
    Riedel, Sebastian
    Voss, Clare R.
    PROCEEDINGS OF THE 56TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL), VOL 1, 2018, : 2160 - 2170
  • [24] Combined scaling for zero-shot transfer learning
    Pham, Hieu
    Dai, Zihang
    Ghiasi, Golnaz
    Kawaguchi, Kenji
    Liu, Hanxiao
    Yu, Adams Wei
    Yu, Jiahui
    Chen, Yi-Ting
    Luong, Minh-Thang
    Wu, Yonghui
    Tan, Mingxing
    V. Le, Quoc
    NEUROCOMPUTING, 2023, 555
  • [25] Transfer Increment for Generalized Zero-Shot Learning
    Feng, Liangjun
    Zhao, Chunhui
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (06) : 2506 - 2520
  • [26] Zero-Shot Cross-Lingual Knowledge Transfer in VQA via Multimodal Distillation
    Weng, Yu
    Dong, Jun
    He, Wenbin
    Chaomurilige
    Liu, Xuan
    Liu, Zheng
    Gao, Honghao
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, : 1 - 11
  • [27] Adaptive Conditional Denoising Diffusion Model With Hybrid Affinity Regularizer for Generalized Zero-Shot Learning
    Gao, Mengyu
    Dong, Qiulei
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (07) : 5641 - 5652
  • [28] A generative adversarial network with “zero-shot” learning for positron image denoising
    Mingwei Zhu
    Min Zhao
    Min Yao
    Ruipeng Guo
    Scientific Reports, 13
  • [29] Benchmarking knowledge-driven zero-shot learning
    Geng, Yuxia
    Chen, Jiaoyan
    Zhuang, Xiang
    Chen, Zhuo
    Pan, Jeff Z.
    Li, Juan
    Yuan, Zonggang
    Chen, Huajun
    JOURNAL OF WEB SEMANTICS, 2023, 75
  • [30] Improving Zero-Shot Learning Baselines with Commonsense Knowledge
    Abhinaba Roy
    Deepanway Ghosal
    Erik Cambria
    Navonil Majumder
    Rada Mihalcea
    Soujanya Poria
    Cognitive Computation, 2022, 14 : 2212 - 2222