Conditional Diffusion Models for Semantic 3D Brain MRI Synthesis

被引:5
|
作者
Dorjsembe, Zolnamar [1 ]
Pao, Hsing-Kuo [1 ]
Odonchimed, Sodtavilan [2 ]
Xiao, Furen [3 ]
机构
[1] Natl Taiwan Univ Sci & Technol, Dept Comp Sci & Informat Engn, Taipei 106, Taiwan
[2] Univ Tokyo, Fac Engn, Tokyo 1138654, Japan
[3] Natl Taiwan Univ, Inst Med Device & Imaging, Coll Med, Taipei 100, Taiwan
关键词
Three-dimensional displays; Brain modeling; Biomedical imaging; Solid modeling; Image segmentation; Magnetic resonance imaging; Adaptation models; Conditional diffusion models; semantic image synthesis; generative models; anonymization; data augmentation;
D O I
10.1109/JBHI.2024.3385504
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Artificial intelligence (AI) in healthcare, especially in medical imaging, faces challenges due to data scarcity and privacy concerns. Addressing these, we introduce Med-DDPM, a diffusion model designed for 3D semantic brain MRI synthesis. This model effectively tackles data scarcity and privacy issues by integrating semantic conditioning. This involves the channel-wise concatenation of a conditioning image to the model input, enabling control in image generation. Med-DDPM demonstrates superior stability and performance compared to existing 3D brain imaging synthesis methods. It generates diverse, anatomically coherent images with high visual fidelity. In terms of dice score in the tumor segmentation task, Med-DDPM achieves 0.6207, close to the 0.6531 dice score of real images, and outperforms baseline models. Combined with real images, it further increases segmentation accuracy to 0.6675, showing the potential of the proposed method for data augmentation. This model represents the first use of a diffusion model in 3D semantic brain MRI synthesis, producing high-quality images. Its semantic conditioning feature also shows potential for image anonymization in biomedical imaging, addressing data and privacy issues.
引用
收藏
页码:4084 / 4093
页数:10
相关论文
共 50 条
  • [21] Brain MRI motion artifact reduction using 3D conditional generative adversarial networks on simulated motion
    Ghaffari, Mina
    Pawar, Kamlesh
    Oliver, Ruth
    2021 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA 2021), 2021, : 253 - 259
  • [22] Controllable 3D Face Generation with Conditional Style Code Diffusion
    Shen, Xiaolong
    Ma, Jianxin
    Zhou, Chang
    Yang, Zongxin
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 5, 2024, : 4811 - 4819
  • [23] Registration of 3D Fetal Brain US and MRI
    Kuklisova-Murgasova, Maria
    Cifor, Amalia
    Napolitano, Raffaele
    Papageorghiou, Aris
    Quaghebeur, Gerardine
    Noble, J. Alison
    Schnabel, Julia A.
    MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION - MICCAI 2012, PT II, 2012, 7511 : 667 - 674
  • [24] 3D VISUALIZATION AND SEGMENTATION OF BRAIN MRI DATA
    Levinski, Konstantin
    Sourin, Alexei
    Zagorodnov, Vitali
    GRAPP 2009: PROCEEDINGS OF THE FOURTH INTERNATIONAL CONFERENCE ON COMPUTER GRAPHICS THEORY AND APPLICATIONS, 2009, : 111 - +
  • [25] Quantitative 3D sodium MRI of brain tumors
    Ouwerkerk, R
    Pomper, MG
    Bottomley, PA
    RADIOLOGY, 2001, 221 : 294 - 294
  • [26] On Differentially Private 3D Medical Image Synthesis with Controllable Latent Diffusion Models
    Daum, Deniz
    Osuala, Richard
    Riess, Anneliese
    Kaissis, Georgios
    Schnabel, Julia A.
    Di Folco, Maxime
    DEEP GENERATIVE MODELS, DGM4MICCAI 2024, 2025, 15224 : 139 - 149
  • [27] Investigating Data Memorization in 3D Latent Diffusion Models for Medical Image Synthesis
    Dar, Salman Ul Hassan
    Ghanaat, Arman
    Kahmann, Jannik
    Ayx, Isabelle
    Papavassiliu, Theano
    Schoenberg, Stefan O.
    Engelhardt, Sandy
    DEEP GENERATIVE MODELS, DGM4MICCAI 2023, 2024, 14533 : 56 - 65
  • [28] Semantic Segmentation of Individual Muscle Groups in 3D Thigh MRI
    Okorie, Azubuike
    Makrogiannis, Sokratis
    Spencer, Richard
    Kalyani, Rita
    Ferrucci, Luigi
    MEDICAL IMAGING 2023, 2023, 12464
  • [29] X3D Ontology for Querying 3D Models on the Semantic Web
    Brutzman, Don
    Flotynski, Jakub
    PROCEEDINGS OF THE 25TH ACM CONFERENCE ON 3D WEB TECHNOLOGY, WEB3D 2020, 2020,
  • [30] Semantic 3D models: surveying and drawing the virtual city
    Unali, Maurizio
    HERITAGE, ARCHITECTURE, LANDESIGN: FOCUS ON CONSERVATION, REGENERATION, INNOVATION, 2013, (39): : 719 - 723