Comparison of Deep Learning Image-to-image Models for Medical Image Translation

被引:0
|
作者
Yang, Zeyu [1 ,2 ]
Zoellner, Frank G. [1 ,2 ]
机构
[1] Heidelberg Univ, Med Fac Mannheim, Comp Assisted Clin Med, Mannheim, Germany
[2] Heidelberg Univ, Mannheim Inst Intelligent Syst Med, Med Fac Mannheim, Mannheim, Germany
关键词
D O I
10.1007/978-3-658-44037-4_89
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
We conducted a comparative analysis of six image-to-image deep learning models for the purpose of MRI-to-CT image translation comprising resUNet, attUnet, DCGAN, pix2pixGAN with resUNet, pix2pixGAN with attUnet, and the denoising diffusion probabilistic model (DDPM). These models underwent training and assessment using the SynthRAD2023 Grand Challenge dataset. For training, 170 MRI and CT image pairs (patients) were employed, while a set of 10 patients was reserved for testing. In summary, the pix2pixGAN with resUNet achieved the hightest scores (SSIM = 0.81 +/- 0.21, MAE = 55.52 +/- 3.50, PSNR = 27.19 +/- 6.29). The DDPM displayed considerable potential in generating CT images that closely resemble real ones in terms of detail and fidelity. Nevertheless, the quality of its generated images exhibited notable fluctuations. Consequently, further refinement is necessary to stabilize its output quality.
引用
收藏
页码:344 / 349
页数:6
相关论文
共 50 条
  • [21] Image-to-Image Translation for Data Augmentation on Multimodal Medical Images
    Peng, Yue
    Meng, Zuqiang
    Yang, Lina
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2023, E106D (05) : 686 - 696
  • [22] BBDM: Image-to-Image Translation with Brownian Bridge Diffusion Models
    Li, Bo
    Xue, Kaitao
    Liu, Bin
    Lai, Yu-Kun
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 1952 - 1961
  • [23] Literature Review of Generative models for Image-to-Image translation problems
    Kamil, Anwar
    Shaikh, Talal
    PROCEEDINGS OF 2019 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND KNOWLEDGE ECONOMY (ICCIKE' 2019), 2019, : 341 - 346
  • [24] Deep Image Destruction: Vulnerability of Deep Image-to-Image Models against Adversarial Attacks
    Choi, Jun-Ho
    Zhang, Huan
    Kim, Jun-Hyuk
    Hsieh, Cho-Jui
    Lee, Jong-Seok
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 1287 - 1293
  • [25] Exploring Negatives in Contrastive Learning for Unpaired Image-to-Image Translation
    Lin, Yupei
    Zhang, Sen
    Chen, Tianshui
    Lu, Yongyi
    Li, Guangping
    Shi, Yukai
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 1186 - 1194
  • [26] Truly Unsupervised Image-to-Image Translation with Contrastive Representation Learning
    Hong, Zhiwei
    Feng, Jianxing
    Jiang, Tao
    COMPUTER VISION - ACCV 2022, PT III, 2023, 13843 : 239 - 255
  • [27] Vector Quantized Image-to-Image Translation
    Chen, Yu-Jie
    Cheng, Shin-I
    Chiu, Wei-Chen
    Tseng, Hung-Yu
    Lee, Hsin-Ying
    COMPUTER VISION - ECCV 2022, PT XVI, 2022, 13676 : 440 - 456
  • [28] Image-to-Image Translation: Methods and Applications
    Pang, Yingxue
    Lin, Jianxin
    Qin, Tao
    Chen, Zhibo
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 3859 - 3881
  • [29] A Deep Learning Image-to-Image Translation Approach for a More Accessible Estimator of the Healing Time of Burns
    Rozo, Andrea
    Miskovic, Vanja
    Rose, Thomas
    Keersebilck, Elkana
    Iorio, Carlo
    Varon, Carolina
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2023, 70 (10) : 2886 - 2894
  • [30] Toward Multimodal Image-to-Image Translation
    Zhu, Jun-Yan
    Zhang, Richard
    Pathak, Deepak
    Darrell, Trevor
    Efros, Alexei A.
    Wang, Oliver
    Shechtman, Eli
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30