Conditional Diffusion Models for Semantic 3D Brain MRI Synthesis

被引:5
|
作者
Dorjsembe, Zolnamar [1 ]
Pao, Hsing-Kuo [1 ]
Odonchimed, Sodtavilan [2 ]
Xiao, Furen [3 ]
机构
[1] Natl Taiwan Univ Sci & Technol, Dept Comp Sci & Informat Engn, Taipei 106, Taiwan
[2] Univ Tokyo, Fac Engn, Tokyo 1138654, Japan
[3] Natl Taiwan Univ, Inst Med Device & Imaging, Coll Med, Taipei 100, Taiwan
关键词
Three-dimensional displays; Brain modeling; Biomedical imaging; Solid modeling; Image segmentation; Magnetic resonance imaging; Adaptation models; Conditional diffusion models; semantic image synthesis; generative models; anonymization; data augmentation;
D O I
10.1109/JBHI.2024.3385504
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Artificial intelligence (AI) in healthcare, especially in medical imaging, faces challenges due to data scarcity and privacy concerns. Addressing these, we introduce Med-DDPM, a diffusion model designed for 3D semantic brain MRI synthesis. This model effectively tackles data scarcity and privacy issues by integrating semantic conditioning. This involves the channel-wise concatenation of a conditioning image to the model input, enabling control in image generation. Med-DDPM demonstrates superior stability and performance compared to existing 3D brain imaging synthesis methods. It generates diverse, anatomically coherent images with high visual fidelity. In terms of dice score in the tumor segmentation task, Med-DDPM achieves 0.6207, close to the 0.6531 dice score of real images, and outperforms baseline models. Combined with real images, it further increases segmentation accuracy to 0.6675, showing the potential of the proposed method for data augmentation. This model represents the first use of a diffusion model in 3D semantic brain MRI synthesis, producing high-quality images. Its semantic conditioning feature also shows potential for image anonymization in biomedical imaging, addressing data and privacy issues.
引用
收藏
页码:4084 / 4093
页数:10
相关论文
共 50 条
  • [1] Make-A-Volume: Leveraging Latent Diffusion Models for Cross-Modality 3D Brain MRI Synthesis
    Zhu, Lingting
    Xue, Zeyue
    Jin, Zhenchao
    Liu, Xian
    He, Jingzhen
    Liu, Ziwei
    Yu, Lequan
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT X, 2023, 14229 : 592 - 601
  • [2] Anisotropic Diffusion based Brain MRI Segmentation and 3D Reconstruction
    M. Arfan Jaffar
    Sultan Zia
    Ghaznafar Latif
    Anwar M. Mirza
    Irfan Mehmood
    Naveed Ejaz
    Sung Wook Baik
    International Journal of Computational Intelligence Systems, 2012, 5 : 494 - 504
  • [3] Anisotropic Diffusion based Brain MRI Segmentation and 3D Reconstruction
    Jaffar, M. Arfan
    Zia, Sultan
    Latif, Ghaznafar
    Mirza, Anwar M.
    Mehmood, Irfan
    Ejaz, Naveed
    Baik, Sung Wook
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2012, 5 (03) : 494 - 504
  • [4] DiffESM: Conditional Emulation of Temperature and Precipitation in Earth System Models With 3D Diffusion Models
    Bassetti, Seth
    Hutchinson, Brian
    Tebaldi, Claudia
    Kravitz, Ben
    JOURNAL OF ADVANCES IN MODELING EARTH SYSTEMS, 2024, 16 (10)
  • [5] Denoising Diffusion Models for 3D Healthy Brain Tissue Inpainting
    Durrer, Alicia
    Wolleb, Julia
    Bieder, Florentin
    Friedrich, Paul
    Melie-Garcia, Lester
    Pineda, Mario Alberto Ocampo
    Bercea, Cosmin I.
    Hamamci, Ibrahim Ethem
    Wiestler, Benedikt
    Piraud, Marie
    Yaldizli, Oezguer
    Granziera, Cristina
    Menze, Bjoern
    Cattin, Philippe C.
    Kofler, Florian
    DEEP GENERATIVE MODELS, DGM4MICCAI 2024, 2025, 15224 : 87 - 97
  • [6] 3D Semantic Models for Dental Education
    Colombo Dias, Diego Roberto
    Ferreira Brega, Jose Remo
    Guimaraes, Marcelo de Paiva
    Modesto, Fabio
    Gnecco, Bruno Barberi
    Pereira Lauris, Jose Roberto
    ENTERPRISE INFORMATION SYSTEMS, PT 3, 2011, 221 : 89 - +
  • [7] Hidden Markov models-based 3D MRI brain segmentation
    Ibrahim, M.
    John, N.
    Kabuka, M.
    Younis, A.
    IMAGE AND VISION COMPUTING, 2006, 24 (10) : 1065 - 1079
  • [8] In vivo isotropic 3D diffusion tensor mapping of the rat brain using diffusion-weighted 3D MP-RAGE MRI
    Numano, T
    Homma, K
    Iwasaki, N
    Hyodo, K
    Nitta, N
    Hirose, T
    MAGNETIC RESONANCE IMAGING, 2006, 24 (03) : 287 - 293
  • [9] Open-Vocabulary 3D Semantic Segmentation with Text-to-Image Diffusion Models
    Zhu, Xiaoyu
    Zhou, Hao
    Xing, Pengfei
    Zhao, Long
    Xu, Hao
    Liang, Junwei
    Hauptmann, Alexander
    Liu, Ting
    Gallagher, Andrew
    COMPUTER VISION - ECCV 2024, PT XXIX, 2025, 15087 : 357 - 375
  • [10] 3D MRI segmentation of brain structures
    Verard, L
    Fadili, J
    Ruan, S
    Bloyet, D
    PROCEEDINGS OF THE 18TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOL 18, PTS 1-5, 1997, 18 : 1081 - 1082