Conditional Diffusion Models for Semantic 3D Brain MRI Synthesis

被引:5
|
作者
Dorjsembe, Zolnamar [1 ]
Pao, Hsing-Kuo [1 ]
Odonchimed, Sodtavilan [2 ]
Xiao, Furen [3 ]
机构
[1] Natl Taiwan Univ Sci & Technol, Dept Comp Sci & Informat Engn, Taipei 106, Taiwan
[2] Univ Tokyo, Fac Engn, Tokyo 1138654, Japan
[3] Natl Taiwan Univ, Inst Med Device & Imaging, Coll Med, Taipei 100, Taiwan
关键词
Three-dimensional displays; Brain modeling; Biomedical imaging; Solid modeling; Image segmentation; Magnetic resonance imaging; Adaptation models; Conditional diffusion models; semantic image synthesis; generative models; anonymization; data augmentation;
D O I
10.1109/JBHI.2024.3385504
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Artificial intelligence (AI) in healthcare, especially in medical imaging, faces challenges due to data scarcity and privacy concerns. Addressing these, we introduce Med-DDPM, a diffusion model designed for 3D semantic brain MRI synthesis. This model effectively tackles data scarcity and privacy issues by integrating semantic conditioning. This involves the channel-wise concatenation of a conditioning image to the model input, enabling control in image generation. Med-DDPM demonstrates superior stability and performance compared to existing 3D brain imaging synthesis methods. It generates diverse, anatomically coherent images with high visual fidelity. In terms of dice score in the tumor segmentation task, Med-DDPM achieves 0.6207, close to the 0.6531 dice score of real images, and outperforms baseline models. Combined with real images, it further increases segmentation accuracy to 0.6675, showing the potential of the proposed method for data augmentation. This model represents the first use of a diffusion model in 3D semantic brain MRI synthesis, producing high-quality images. Its semantic conditioning feature also shows potential for image anonymization in biomedical imaging, addressing data and privacy issues.
引用
收藏
页码:4084 / 4093
页数:10
相关论文
共 50 条
  • [41] A Semantic and Parametric Method for 3D Models used in 3D Cognitive-Information System
    Apollonio, Fabrizio I.
    Gaiani, Marco
    Corsi, Cristiana
    ECAADE 2010: FUTURE CITIES, 2010, : 863 - 872
  • [42] Deep Conditional Shape Models for 3D Cardiac Image Segmentation
    Jacob, Athira J.
    Sharma, Puneet
    Ruckert, Daniel
    STATISTICAL ATLASES AND COMPUTATIONAL MODELS OF THE HEART. REGULAR AND CMRXRECON CHALLENGE PAPERS, STACOM 2023, 2024, 14507 : 44 - 54
  • [43] Quantification of the accuracy of MRI generated 3D models of long bones compared to CT generated 3D models
    Rathnayaka, Kanchana
    Momot, Konstantin I.
    Noser, Hansrudi
    Volp, Andrew
    Schuetz, Michael A.
    Sahama, Tony
    Schmutz, Beat
    MEDICAL ENGINEERING & PHYSICS, 2012, 34 (03) : 357 - 363
  • [44] High-resolution 3D diffusion tensor MRI of anesthetized rhesus macaque brain at 3T
    Tounekti, Slimane
    Troalen, Thomas
    Bihan-Poudec, Yann
    Froesel, Mathilda
    Lamberton, Franck
    Ozenne, Valery
    Clery, Justine
    Richard, Nathalie
    Descoteaux, Maxime
    Ben Hamed, Suliann
    Hiba, Bassem
    NEUROIMAGE, 2018, 181 : 149 - 161
  • [45] 3D Brain MRI GAN-Based Synthesis Conditioned on Partial Volume Maps
    Rusak, Filip
    Cruz, Rodrigo Santa
    Bourgeat, Pierrick
    Fookes, Clinton
    Fripp, Jurgen
    Bradley, Andrew
    Salvado, Olivier
    SIMULATION AND SYNTHESIS IN MEDICAL IMAGING, SASHIMI 2020, 2020, 12417 : 11 - 20
  • [46] Realistic Tumor generation using 3D conditional latent diffusion model
    Hu, Rui
    Yoon, Siyeop
    Wu, Dufan
    Tivnan, Matthew
    Chen, Zhennong
    Wang, Yuang
    Luo, Jie
    Cui, Jianan
    Li, Quanzheng
    Liu, Huafeng
    Guo, Ning
    JOURNAL OF NUCLEAR MEDICINE, 2024, 65
  • [47] Conditional Regularity for the 3D Damped Boussinesq Equations with Zero Thermal Diffusion
    Li, Zhouyu
    Liu, Wenjuan
    Zhou, Qi
    BULLETIN OF THE BRAZILIAN MATHEMATICAL SOCIETY, 2024, 55 (03):
  • [48] Superresolution emulation of large cosmological fields with a 3D conditional diffusion model
    Rouhiainen, Adam
    Muenchmeyer, Moritz
    Shiu, Gary
    Gira, Michael
    Lee, Kangwook
    PHYSICAL REVIEW D, 2024, 109 (12)
  • [49] BuilDiff: 3D Building Shape Generation using Single-Image Conditional Point Cloud Diffusion Models
    Wei, Yao
    Vosselm, George
    Yang, Michael Ying
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 2902 - 2911
  • [50] Synthesis of 3D models by Petri net
    Mo-fei Song
    Zheng-xing Sun
    Yan Zhang
    Fei-qian Zhang
    Journal of Zhejiang University SCIENCE C, 2013, 14 : 521 - 529