ST-Unet: Swin Transformer boosted U-Net with Cross-Layer Feature Enhancement for medical image segmentation

被引:52
|
作者
Zhang, Jing [1 ]
Qin, Qiuge [1 ]
Ye, Qi [1 ]
Ruan, Tong [1 ]
机构
[1] East China Univ Sci & Technol, Dept Comp Sci & Engn, Shanghai 200237, Peoples R China
关键词
Medical image segmentation; Swin Transformer; ST-Unet; Cross-layer feature enhancement; BOUNDARY; NODULES;
D O I
10.1016/j.compbiomed.2022.106516
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Medical image segmentation is an essential task in clinical diagnosis and case analysis. Most of the existing methods are based on U-shaped convolutional neural networks (CNNs), and one of disadvantages is that the long-term dependencies and global contextual connections cannot be effectively established, which results in inaccuracy segmentation. For fully using low-level features to enhance global features and reduce the semantic gap between encoding and decoding stages, we propose a novel Swin Transformer boosted U-Net (ST-Unet) for medical image processing in this paper, in which Swin Transformer and CNNs are used as encoder and decoder respectively. Then a novel Cross-Layer Feature Enhancement (CLFE) module is proposed to realize cross-layer feature learning, and a Spatial and Channel Squeeze & Excitation module is adopted to highlight the saliency of specific regions. Finally, we learn the features fused by the CLFE module through CNNs to recover low-level features and localize local features for realizing more accurate semantic segmentation. Experiments on widely used public datasets Synapse and ISIC 2018 prove that our proposed ST-Unet can achieve 78.86 of dice and 0.9243 of recall performance, outperforming most current medical image segmentation methods.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] DS-TransUNet: Dual Swin Transformer U-Net for Medical Image Segmentation
    Lin, Ailiang
    Chen, Bingzhi
    Xu, Jiayu
    Zhang, Zheng
    Lu, Guangming
    Zhang, David
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [2] U-Net Transformer: Self and Cross Attention for Medical Image Segmentation
    Petit, Olivier
    Thome, Nicolas
    Rambour, Clement
    Themyr, Loic
    Collins, Toby
    Soler, Luc
    MACHINE LEARNING IN MEDICAL IMAGING, MLMI 2021, 2021, 12966 : 267 - 276
  • [3] MIXED TRANSFORMER U-NET FOR MEDICAL IMAGE SEGMENTATION
    Wang, Hongyi
    Xie, Shiao
    Lin, Lanfen
    Iwamoto, Yutaro
    Han, Xian-Hua
    Chen, Yen-Wei
    Tong, Ruofeng
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2390 - 2394
  • [4] Diffusion Transformer U-Net for Medical Image Segmentation
    Chowdary, G. Jignesh
    Yin, Zhaozheng
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT IV, 2023, 14223 : 622 - 631
  • [5] Hybrid Swin Deformable Attention U-Net for Medical Image Segmentation
    Wang, Lichao
    Huang, Jiahao
    Xing, Xiaodan
    Yang, Guang
    2023 19TH INTERNATIONAL SYMPOSIUM ON MEDICAL INFORMATION PROCESSING AND ANALYSIS, SIPAIM, 2023,
  • [6] Cross Pyramid Transformer makes U-net stronger in medical image segmentation
    Zhu, Jinghua
    Sheng, Yue
    Cui, Hui
    Ma, Jiquan
    Wang, Jijian
    Xi, Heran
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 86
  • [7] Adaptive enhanced swin transformer with U-net for remote sensing image segmentation*
    Gu, Xingjian
    Li, Sizhe
    Ren, Shougang
    Zheng, Hengbiao
    Fan, Chengcheng
    Xu, Huanliang
    COMPUTERS & ELECTRICAL ENGINEERING, 2022, 102
  • [8] MS-UNet: Swin Transformer U-Net with Multi-scale Nested Decoder for Medical Image Segmentation with Small Training Data
    Chen, Haoyuan
    Han, Yufei
    Li, Yanyi
    Xu, Pin
    Li, Kuan
    Yin, Jianping
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT XIII, 2024, 14437 : 472 - 483
  • [9] Cross-Layer Connection SegFormer Attention U-Net for Efficient TRUS Image Segmentation
    Shi, Yongtao
    Du, Wei
    Gao, Chao
    Li, Xinzhi
    INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2024, 34 (05)
  • [10] PARSE CHALLENGE 2022: PULMONARY ARTERIES SEGMENTATION USING SWIN U-NET TRANSFORMER(SWIN UNETR) AND U-NET
    Padhy, Rohan
    Maurya, Akansh
    Patil, Kunal Dasharath
    Ramakrishna, Kalluri
    Krishnamurthi, Ganapathy
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,