Universal Network for Image Registration and Generation Using Denoising Diffusion Probability Model

被引:0
|
作者
Ji, Huizhong [1 ]
Xue, Peng [1 ]
Dong, Enqing [1 ]
机构
[1] Shandong Univ, Dept Mech Elect & Informat Engn, Weihai 264209, Peoples R China
基金
中国国家自然科学基金;
关键词
image registration; guided image generation; image deformation; denoising diffusion probability model;
D O I
10.3390/math12162462
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Classical diffusion model-based image registration approaches require separate diffusion and deformation networks to learn the reverse Gaussian transitions and predict deformations between paired images, respectively. However, such cascaded architectures introduce noisy inputs in the registration, leading to excessive computational complexity and issues with low registration accuracy. To overcome these limitations, a diffusion model-based universal network for image registration and generation (UNIRG) is proposed. Specifically, the training process of the diffusion model is generalized as a process of matching the posterior mean of the forward process to the modified mean. Subsequently, the equivalence between the training process for image generation and that for image registration is verified by incorporating the deformation information of the paired images to obtain the modified mean. In this manner, UNIRG integrates image registration and generation within a unified network, achieving shared training parameters. Experimental results on 2D facial and 3D cardiac medical images demonstrate that the proposed approach integrates the capabilities of image registration and guided image generation. Meanwhile, UNIRG achieves registration performance with NMSE of 0.0049, SSIM of 0.859, and PSNR of 27.28 on the 2D facial dataset, along with Dice of 0.795 and PSNR of 12.05 on the 3D cardiac dataset.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] Image Denoising Using Generalized Anisotropic Diffusion
    Bai, Jian
    Feng, Xiang-Chu
    JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2018, 60 (07) : 994 - 1007
  • [22] PolSAR Image Denoising using Directional Diffusion
    Terebes, Romulus
    Borda, Monica
    Malutan, Raul
    Germain, Christian
    Bombrun, Lionel
    Ilea, Ioana
    2016 12TH IEEE INTERNATIONAL SYMPOSIUM ON ELECTRONICS AND TELECOMMUNICATIONS (ISETC'16), 2016, : 339 - 342
  • [23] Image Denoising Using Generalized Anisotropic Diffusion
    Jian Bai
    Xiang-Chu Feng
    Journal of Mathematical Imaging and Vision, 2018, 60 : 994 - 1007
  • [24] Face Inpainting Model Based on Denoising Diffusion Probability Models
    Liu, Ji-Hong
    Huang, Xi-Xiong
    Dongbei Daxue Xuebao/Journal of Northeastern University, 2024, 45 (09): : 1227 - 1234
  • [25] Complex Image Generation SwinTransformer Network for Audio Denoising
    Zhang, Youshan
    Li, Jialu
    INTERSPEECH 2023, 2023, : 186 - 190
  • [26] Holographic image denoising for dense droplet field using conditional diffusion model
    Zhang, Hang
    Wang, Yu
    Wu, Yingchun
    Zhang, Letian
    Wang, Boyi
    Zhao, Yue
    Wu, Xuecheng
    OPTICS LETTERS, 2024, 49 (19) : 5395 - 5398
  • [27] Denoising Diffusion Adversarial Models for Unconditional Medical Image Generation
    Dalmaz, Onat
    Saglam, Baturay
    Elmas, Gokberk
    Mirza, Muhammad
    Cukur, Tolga
    2023 31ST SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE, SIU, 2023,
  • [28] Universal image compression using multiscale recurrent patterns with adaptive probability model
    de Lima Filho, Eddie Batista
    da Silva, Eduardo A. B.
    de Carvalho, Murilo Bresciani
    Pinage, Frederico Silva
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2008, 17 (04) : 512 - 527
  • [29] Real-world image denoising via efficient diffusion model with controllable noise generation
    Yang, Cheng
    Wang, Cong
    Liang, Lijing
    Su, Zhixun
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (04)
  • [30] Image denoising based on probability wavelet shrinkage with gaussian model
    Wang, Zhi-Ming
    2007 INTERNATIONAL CONFERENCE ON WAVELET ANALYSIS AND PATTERN RECOGNITION, VOLS 1-4, PROCEEDINGS, 2007, : 544 - 548