Diffusion models in medical imaging: A comprehensive survey

被引:137
|
作者
Kazerouni, Amirhossein [1 ]
Aghdam, Ehsan Khodapanah [2 ]
Heidari, Moein [1 ]
Azad, Reza [3 ]
Fayyaz, Mohsen [4 ]
Hacihaliloglu, Ilker [5 ,6 ]
Merhof, Dorit [7 ,8 ]
机构
[1] Iran Univ Sci & Technol, Sch Elect Engn, Tehran, Iran
[2] Shahid Beheshti Univ, Dept Elect Engn, Tehran, Iran
[3] Rhein Westfal TH Aachen, Fac Elect Engn & Informat Technol, Aachen, Germany
[4] Microsoft, Berlin, Germany
[5] Univ British Columbia, Dept Radiol, Vancouver, BC, Canada
[6] Univ British Columbia, Dept Med, Vancouver, BC, Canada
[7] Univ Regensburg, Fac Informat & Data Sci, Regensburg, Germany
[8] Fraunhofer Inst Digital Med MEVIS, Bremen, Germany
关键词
Generative models; Diffusion models; Denoising diffusion models; Noise conditioned score networks; Score-based models; MR; SUPERRESOLUTION; TRANSFORMER; RESOURCE;
D O I
10.1016/j.media.2023.102846
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Denoising diffusion models, a class of generative models, have garnered immense interest lately in various deep-learning problems. A diffusion probabilistic model defines a forward diffusion stage where the input data is gradually perturbed over several steps by adding Gaussian noise and then learns to reverse the diffusion process to retrieve the desired noise-free data from noisy data samples. Diffusion models are widely appreciated for their strong mode coverage and quality of the generated samples in spite of their known computational burdens. Capitalizing on the advances in computer vision, the field of medical imaging has also observed a growing interest in diffusion models. With the aim of helping the researcher navigate this profusion, this survey intends to provide a comprehensive overview of diffusion models in the discipline of medical imaging. Specifically, we start with an introduction to the solid theoretical foundation and fundamental concepts behind diffusion models and the three generic diffusion modeling frameworks, namely, diffusion probabilistic models, noise-conditioned score networks, and stochastic differential equations. Then, we provide a systematic taxonomy of diffusion models in the medical domain and propose a multi-perspective categorization based on their application, imaging modality, organ of interest, and algorithms. To this end, we cover extensive applications of diffusion models in the medical domain, including image-to-image translation, reconstruction, registration, classification, segmentation, denoising, 2/3D generation, anomaly detection, and other medically-related challenges. Furthermore, we emphasize the practical use case of some selected approaches, and then we discuss the limitations of the diffusion models in the medical domain and propose several directions to fulfill the demands of this field. Finally, we gather the overviewed studies with their available open-source implementations at our GitHub.1 We aim to update the relevant latest papers within it regularly.
引用
收藏
页数:22
相关论文
共 50 条
  • [1] Diffusion Models: A Comprehensive Survey of Methods and Applications
    Yang, Ling
    Zhang, Zhilong
    Song, Yang
    Hong, Shenda
    Xu, Runsheng
    Zhao, Yue
    Zhang, Wentao
    Cui, Bin
    Yang, Ming-Hsuan
    ACM COMPUTING SURVEYS, 2024, 56 (04)
  • [2] Diffusion Models for Medical Image Computing: A Survey
    Shi, Yaqing
    Abulizi, Abudukelimu
    Wang, Hao
    Feng, Ke
    Abudukelimu, Nihemaiti
    Su, Youli
    Abudukelimu, Halidanmu
    TSINGHUA SCIENCE AND TECHNOLOGY, 2025, 30 (01): : 357 - 383
  • [3] Comprehensive exploration of diffusion models in image generation: a survey
    Chen, Hang
    Xiang, Qian
    Hu, Jiaxin
    Ye, Meilin
    Yu, Chao
    Cheng, Hao
    Zhang, Lei
    ARTIFICIAL INTELLIGENCE REVIEW, 2025, 58 (04)
  • [4] A Comprehensive Survey of Recent Transformers in Image, Video and Diffusion Models
    Le, Dinh Phu Cuong
    Wang, Dong
    Le, Viet-Tuan
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 80 (01): : 37 - 60
  • [5] Non-imaging Medical Data Synthesis for Trustworthy AI: A Comprehensive Survey
    Xing, Xiaodan
    Wu, Huanjun
    Wang, Lichao
    Stenson, Iain
    Yong, May
    Del Ser, Javier
    Walsh, Simon
    Yang, Guang
    ACM COMPUTING SURVEYS, 2024, 56 (07) : 1 - 35
  • [6] Comprehensive Survey of OLAP Models
    Kaur, Harkiran
    Kaur, Gursimran
    HARMONY SEARCH AND NATURE INSPIRED OPTIMIZATION ALGORITHMS, 2019, 741 : 415 - 422
  • [7] A Survey on Generative Diffusion Models
    Cao, Hanqun
    Tan, Cheng
    Gao, Zhangyang
    Xu, Yilun
    Chen, Guangyong
    Heng, Pheng-Ann
    Li, Stan Z.
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (07) : 2814 - 2830
  • [8] Diffusion Models in Vision: A Survey
    Croitoru, Florinel-Alin
    Hondru, Vlad
    Ionescu, Radu Tudor
    Shah, Mubarak
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (09) : 10850 - 10869
  • [9] A Survey on Video Diffusion Models
    Xing, Zhen
    Feng, Qijun
    Chen, Haoran
    Dai, Qi
    Hu, Hang
    Xu, Hang
    Wu, Zuxuan
    Jiang, Yu-gang
    ACM COMPUTING SURVEYS, 2025, 57 (02)
  • [10] Lightweight diffusion models: a survey
    Song, Wei
    Ma, Wen
    Zhang, Ming
    Zhang, Yanghao
    Zhao, Xiaobing
    ARTIFICIAL INTELLIGENCE REVIEW, 2024, 57 (06)