Super-resolution reconstruction of ultrasound image using a modified diffusion model

被引:1
|
作者
Liu, Tianyu [1 ]
Han, Shuai [1 ]
Xie, Linru [1 ]
Xing, Wenyu [1 ]
Liu, Chengcheng [1 ,2 ]
Li, Boyi [1 ]
Ta, Dean [2 ,3 ]
机构
[1] Fudan Univ, Inst Biomed Engn & Technol, Acad Engn & Technol, Shanghai 200433, Peoples R China
[2] Fudan Univ, State Key Lab Integrated Chips & Syst, Shanghai 201203, Peoples R China
[3] Fudan Univ, Sch Informat Sci & Technol, Dept Biomed Engn, Shanghai 200438, Peoples R China
来源
PHYSICS IN MEDICINE AND BIOLOGY | 2024年 / 69卷 / 12期
基金
中国国家自然科学基金;
关键词
ultrasound image; super-resolution; diffusion model; multi-layer self-attention; wavelet transform; RESOLUTION;
D O I
10.1088/1361-6560/ad4086
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objective. This study aims to perform super-resolution (SR) reconstruction of ultrasound images using a modified diffusion model, designated as the diffusion model for ultrasound image super-resolution (DMUISR). SR involves converting low-resolution images to high-resolution ones, and the proposed model is designed to enhance the suitability of diffusion models for this task in the context of ultrasound imaging. Approach. DMUISR incorporates a multi-layer self-attention (MLSA) mechanism and a wavelet-transform based low-resolution image (WTLR) encoder to enhance its suitability for ultrasound image SR tasks. The model takes interpolated and magnified images as input and outputs high-quality, detailed SR images. The study utilized 1,334 ultrasound images from the public fetal head-circumference dataset (HC18) for evaluation. Main results. Experiments were conducted at 2x , 4x , and 8x magnification factors. DMUISR outperformed mainstream ultrasound SR methods (Bicubic, VDSR, DECUSR, DRCN, REDNet, SRGAN) across all scales, providing high-quality images with clear structures and rich detailed textures in both hard and soft tissue regions. DMUISR successfully accomplished multiscale SR reconstruction while suppressing over-smoothing and mode collapse problems. Quantitative results showed that DMUISR achieved the best performance in terms of learned perceptual image patch similarity, with a significant decrease of over 50% at all three magnification factors (2x , 4x , and 8x ), as well as improvements in peak signal-to-noise ratio and structural similarity index measure. Ablation experiments validated the effectiveness of the MLSA mechanism and WTLR encoder in improving DMUISR's SR performance. Furthermore, by reducing the number of diffusion steps, the computational time of DMUISR was shortened to nearly one-tenth of its original while maintaining image quality without significant degradation. Significance. This study demonstrates that the modified diffusion model, DMUISR, provides superior performance for SR reconstruction of ultrasound images and has potential in improving imaging quality in the medical ultrasound field.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Blind Super-resolution Image Reconstruction Based on POCS Model
    Xie Wei
    Zhang Feiyan
    Chen Hao
    Qin Qianqing
    2009 INTERNATIONAL CONFERENCE ON MEASURING TECHNOLOGY AND MECHATRONICS AUTOMATION, VOL I, 2009, : 437 - 440
  • [22] Transpose convolution based model for super-resolution image reconstruction
    Faisal Sahito
    Pan Zhiwen
    Fahad Sahito
    Junaid Ahmed
    Applied Intelligence, 2023, 53 : 10574 - 10584
  • [23] Visual Analysis Motivated Super-Resolution Model for Image Reconstruction
    Wang, Huifen
    Xue, Junda
    Yang, Mingchuan
    Zhang, Yuan
    2022 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2022,
  • [24] A Gated Deep Model for Single Image Super-Resolution Reconstruction
    Qaderi, Nahid
    Saeedi, Parvaneh
    2022 IEEE 24TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2022,
  • [25] An image super-resolution reconstruction model based on fractional-order anisotropic diffusion equation
    Yu, Jimin
    Yin, Jiajun
    Zhou, Shangbo
    Huang, Saiao
    Xie, Xianzhong
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2021, 18 (05) : 6581 - 6607
  • [26] RDSR:Reparameterized Lightweight Diffusion Model for Image Super-Resolution
    Sun, Ouyang
    Long, Jun
    Huang, Wenti
    Yang, Zhan
    Li, ChenHao
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT VIII, 2025, 15038 : 94 - 107
  • [27] ResDiff: Combining CNN and Diffusion Model for Image Super-Resolution
    Shang, Shuyao
    Shan, Zhengyang
    Liu, Guangxing
    Wang, LunQian
    Wang, XingHua
    Zhang, Zekai
    Zhang, Jinglin
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 8, 2024, : 8975 - 8983
  • [28] Iterative super-resolution reconstruction using modified subgradient method
    Ozkan, Kemal
    Seke, Erol
    Adar, Nihat
    Canbek, Selcuk
    MULTIMEDIA CONTENT REPRESENTATION, CLASSIFICATION AND SECURITY, 2006, 4105 : 714 - 721
  • [29] Super-resolution image reconstruction method using homotopy regularization
    Wang, Liping
    Zhou, Shangbo
    Karim, Awudu
    Multimedia Tools and Applications, 2016, 75 (23): : 15993 - 16016
  • [30] Topology optimization using super-resolution image reconstruction methods
    Lee, Seunghye
    Lieu, Qui X.
    Vo, Thuc P.
    Kang, Joowon
    Lee, Jaehong
    ADVANCES IN ENGINEERING SOFTWARE, 2023, 177