Comparison of Deep Learning Image-to-image Models for Medical Image Translation

被引:0
|
作者
Yang, Zeyu [1 ,2 ]
Zoellner, Frank G. [1 ,2 ]
机构
[1] Heidelberg Univ, Med Fac Mannheim, Comp Assisted Clin Med, Mannheim, Germany
[2] Heidelberg Univ, Mannheim Inst Intelligent Syst Med, Med Fac Mannheim, Mannheim, Germany
关键词
D O I
10.1007/978-3-658-44037-4_89
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
We conducted a comparative analysis of six image-to-image deep learning models for the purpose of MRI-to-CT image translation comprising resUNet, attUnet, DCGAN, pix2pixGAN with resUNet, pix2pixGAN with attUnet, and the denoising diffusion probabilistic model (DDPM). These models underwent training and assessment using the SynthRAD2023 Grand Challenge dataset. For training, 170 MRI and CT image pairs (patients) were employed, while a set of 10 patients was reserved for testing. In summary, the pix2pixGAN with resUNet achieved the hightest scores (SSIM = 0.81 +/- 0.21, MAE = 55.52 +/- 3.50, PSNR = 27.19 +/- 6.29). The DDPM displayed considerable potential in generating CT images that closely resemble real ones in terms of detail and fidelity. Nevertheless, the quality of its generated images exhibited notable fluctuations. Consequently, further refinement is necessary to stabilize its output quality.
引用
收藏
页码:344 / 349
页数:6
相关论文
共 50 条
  • [31] Multimodal Unsupervised Image-to-Image Translation
    Huang, Xun
    Liu, Ming-Yu
    Belongie, Serge
    Kautz, Jan
    COMPUTER VISION - ECCV 2018, PT III, 2018, 11207 : 179 - 196
  • [32] Domain Adaptive Image-to-image Translation
    Chen, Ying-Cong
    Xu, Xiaogang
    Jia, Jiaya
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 5273 - 5282
  • [33] Unsupervised Image-to-Image Translation: A Review
    Hoyez, Henri
    Schockaert, Cedric
    Rambach, Jason
    Mirbach, Bruno
    Stricker, Didier
    SENSORS, 2022, 22 (21)
  • [34] Unsupervised Image-to-Image Translation Networks
    Liu, Ming-Yu
    Breuel, Thomas
    Kautz, Jan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [35] A novel framework for image-to-image translation and image compression
    Yang, Fei
    Wang, Yaxing
    Herranz, Luis
    Cheng, Yongmei
    Mozerov, Mikhail G.
    NEUROCOMPUTING, 2022, 508 : 58 - 70
  • [36] Guided Image Weathering using Image-to-Image Translation
    Chen, Yu
    Shen, I-Chao
    Chen, Bing-Yu
    PROCEEDINGS OF SIGGRAPH ASIA 2021 TECHNICAL COMMUNICATIONS, 2021,
  • [37] Unsupervised Deep Learning for Medical Image Translation
    Schaefferkoetter, Josh
    Ortega, Claudia
    Metser, Ur
    Veit-Haibach, Patrick
    JOURNAL OF NUCLEAR MEDICINE, 2020, 61
  • [38] Correction to: Generative image completion with image-to-image translation
    Shuzhen Xu
    Qing Zhu
    Jin Wang
    Neural Computing and Applications, 2020, 32 : 17809 - 17809
  • [39] SAMPLE ALIGNMENT FOR IMAGE-TO-IMAGE TRANSLATION BASED MEDICAL DOMAIN ADAPTATION
    Li, Heng
    Liu, Haofeng
    Wang, Xiaoxuan
    Yi, Chenlang
    Chen, Hao
    Hu, Yan
    Liu, Jiang
    2022 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (IEEE ISBI 2022), 2022,
  • [40] Binary Noise Guidance Learning for Remote Sensing Image-to-Image Translation
    Zhang, Guoqing
    Zhou, Ruixin
    Zheng, Yuhui
    Li, Baozhu
    REMOTE SENSING, 2024, 16 (01)