ST-Unet: Swin Transformer boosted U-Net with Cross-Layer Feature Enhancement for medical image segmentation

被引:52
|
作者
Zhang, Jing [1 ]
Qin, Qiuge [1 ]
Ye, Qi [1 ]
Ruan, Tong [1 ]
机构
[1] East China Univ Sci & Technol, Dept Comp Sci & Engn, Shanghai 200237, Peoples R China
关键词
Medical image segmentation; Swin Transformer; ST-Unet; Cross-layer feature enhancement; BOUNDARY; NODULES;
D O I
10.1016/j.compbiomed.2022.106516
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Medical image segmentation is an essential task in clinical diagnosis and case analysis. Most of the existing methods are based on U-shaped convolutional neural networks (CNNs), and one of disadvantages is that the long-term dependencies and global contextual connections cannot be effectively established, which results in inaccuracy segmentation. For fully using low-level features to enhance global features and reduce the semantic gap between encoding and decoding stages, we propose a novel Swin Transformer boosted U-Net (ST-Unet) for medical image processing in this paper, in which Swin Transformer and CNNs are used as encoder and decoder respectively. Then a novel Cross-Layer Feature Enhancement (CLFE) module is proposed to realize cross-layer feature learning, and a Spatial and Channel Squeeze & Excitation module is adopted to highlight the saliency of specific regions. Finally, we learn the features fused by the CLFE module through CNNs to recover low-level features and localize local features for realizing more accurate semantic segmentation. Experiments on widely used public datasets Synapse and ISIC 2018 prove that our proposed ST-Unet can achieve 78.86 of dice and 0.9243 of recall performance, outperforming most current medical image segmentation methods.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Image denoising based on Swin Transformer Residual Conv U-Net
    Gan, Yong
    Zhou, Shaohui
    Chen, Haonan
    Wang, Yuefeng
    27TH IEEE/ACIS INTERNATIONAL SUMMER CONFERENCE ON SOFTWARE ENGINEERING ARTIFICIAL INTELLIGENCE NETWORKING AND PARALLEL/DISTRIBUTED COMPUTING, SNPD 2024-SUMMER, 2024, : 166 - 170
  • [22] Multiscale transunet +  + : dense hybrid U-Net with transformer for medical image segmentation
    Bo Wang
    ·Fan Wang
    Pengwei Dong
    ·Chongyi Li
    Signal, Image and Video Processing, 2022, 16 : 1607 - 1614
  • [23] DSTUNET: UNET WITH EFFICIENT DENSE SWIN TRANSFORMER PATHWAY FOR MEDICAL IMAGE SEGMENTATION
    Cai, Zhuotong
    Xin, Jingmin
    Shi, Peiwen
    Wu, Jiayi
    Zheng, Nanning
    2022 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (IEEE ISBI 2022), 2022,
  • [24] An attention based residual U-Net with swin transformer for brain MRI segmentation
    Angona, Tazkia Mim
    Mondal, M. Rubaiyat Hossain
    ARRAY, 2025, 25
  • [25] Edge-Boosted U-Net for 2D Medical Image Segmentation
    Zhao, Renjie
    Chen, Weiting
    Cao, Guitao
    IEEE ACCESS, 2019, 7 : 171214 - 171222
  • [26] Wavelet U-Net for Medical Image Segmentation
    Ying Li
    Yu Wang
    Tuo Leng
    Wen Zhijie
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2020, PT I, 2020, 12396 : 800 - 810
  • [27] A DENSE U-NET WITH CROSS-LAYER INTERSECTION FOR DETECTION AND LOCALIZATION OF IMAGE FORGERY
    Zhang, Rongyu
    Ni, Jiangqun
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 2982 - 2986
  • [28] MFA U-Net: a U-Net like multi-stage feature analysis network for medical image segmentation
    Wang, Yupeng
    Wang, Suyu
    He, Jian
    PATTERN ANALYSIS AND APPLICATIONS, 2024, 27 (04)
  • [29] SwinE-UNet3+: swin transformer encoder network for medical image segmentation
    Ping Zou
    Jian-Sheng Wu
    Progress in Artificial Intelligence, 2023, 12 : 99 - 105
  • [30] CAT-Unet: An enhanced U-Net architecture with coordinate attention and skip-neighborhood attention transformer for medical image segmentation
    Ding, Zhiquan
    Zhang, Yuejin
    Zhu, Chenxin
    Zhang, Guolong
    Li, Xiong
    Jiang, Nan
    Que, Yue
    Peng, Yuanyuan
    Guan, Xiaohui
    INFORMATION SCIENCES, 2024, 670