CAT-Unet: An enhanced U-Net architecture with coordinate attention and skip-neighborhood attention transformer for medical image segmentation

被引:8
|
作者
Ding, Zhiquan [1 ,2 ]
Zhang, Yuejin [1 ,2 ]
Zhu, Chenxin [3 ]
Zhang, Guolong [1 ,2 ]
Li, Xiong [4 ]
Jiang, Nan [1 ]
Que, Yue [1 ]
Peng, Yuanyuan [5 ]
Guan, Xiaohui [6 ]
机构
[1] East China Jiaotong Univ, Sch Informat Engn, Nanchang 330013, Peoples R China
[2] East China Jiaotong Univ, Inst Computat & Biomech, Nanchang 330013, Peoples R China
[3] Xian Jiaotong Liverpool Univ, Sch Math & Phys, Suzhou 215028, Peoples R China
[4] East China Jiaotong Univ, Sch Software, Nanchang 330013, Peoples R China
[5] East China Jiaotong Univ, Sch Elect & Automat Engn, Nanchang 330013, Peoples R China
[6] Nanchang Univ, Natl Engn Res Ctr Bioengn Drugs & Technol, Nanchang, Peoples R China
基金
中国国家自然科学基金;
关键词
Medical image segmentation; Neighborhood attention; Depthwise separable convolutions; Coordinate attention; PLUS PLUS; NETWORK;
D O I
10.1016/j.ins.2024.120578
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the rise of deep learning, the U -Net network, based on a U-shaped architecture and skip connections, has found widespread application in various medical image segmentation tasks. However, the receptive field of the standard convolution operation is limited, because it is difficult to achieve global and long-distance semantic information interaction. Inspired by the advantages of ConvNext and Neighborhood Attention (NA), we propose CAT-Unet in this study to address the aforementioned challenges. We effectively reduce the number of parameters by utilizing large kernels and depthwise separable convolutions. Meanwhile, we introduce a Coordinate Attention (CA) module, which enables the model to learn more comprehensive and contextual information from surrounding regions. Furthermore, we introduce Skip -NAT (Neighborhood Attention Transformer) as the main algorithmic framework, replacing U-Net's original skipconnection layers, to lessen the impact of shallow features on network efficiency. Experimental results show that CAT-Unet achieves better segmentation results. On the ISIC2018 dataset, the best results for Dice (Dice Coefficient), IoU (Intersection over Union), and HD (Hausdorff Distance) are 90.26%, 83.58%, and 4.259, respectively. For the PH2 dataset, the best Dice, IoU, and HD results are 96.49%, 91.81%, and 3.971, respectively. Finally, on the DSB2018 dataset, the best Dice, IoU, and HD results are 94.58%, 88.78%, and 3.749, respectively.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] CS U-NET: A Medical Image Segmentation Method Integrating Spatial and Contextual Attention Mechanisms Based on U-NET
    Zhang, Fanyang
    Fan, Zhang
    INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2025, 35 (02)
  • [22] Study on Echocardiographic Image Segmentation Based on Attention U-Net
    Wang, Kai
    Zhang, Jiwei
    Hachiya, Hirotaka
    Wu, Haiyuan
    PROCEEDINGS OF 2022 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION (IEEE ICMA 2022), 2022, : 1091 - 1096
  • [23] WRANet: wavelet integrated residual attention U-Net network for medical image segmentation
    Zhao, Yawu
    Wang, Shudong
    Zhang, Yulin
    Qiao, Sibo
    Zhang, Mufei
    COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (06) : 6971 - 6983
  • [24] An Attention-oriented U-Net Model and Global Feature for Medical Image Segmentation
    Han, Yandong
    Li, Jiangjiang
    JOURNAL OF APPLIED SCIENCE AND ENGINEERING, 2020, 23 (04): : 731 - 738
  • [25] CSCA U-Net: A channel and space compound attention CNN for medical image segmentation
    Shu, Xin
    Wang, Jiashu
    Zhang, Aoping
    Shi, Jinlong
    Wu, Xiao-Jun
    ARTIFICIAL INTELLIGENCE IN MEDICINE, 2024, 150
  • [26] WRANet: wavelet integrated residual attention U-Net network for medical image segmentation
    Yawu Zhao
    Shudong Wang
    Yulin Zhang
    Sibo Qiao
    Mufei Zhang
    Complex & Intelligent Systems, 2023, 9 : 6971 - 6983
  • [27] FUSIONU-NET: U-NET WITH ENHANCED SKIP CONNECTION FOR PATHOLOGY IMAGE SEGMENTATION
    Li, Zongyi
    Lyu, Hongbing
    Wang, Jun
    arXiv, 2023,
  • [28] FusionU-Net: U-Net with Enhanced Skip Connection for Pathology Image Segmentation
    Li, Zongyi
    Lyu, Hongbing
    Wang, Jun
    ASIAN CONFERENCE ON MACHINE LEARNING, VOL 222, 2023, 222
  • [29] LF-UNet: An Attention-Based U-Net for Retinal Vessel Segmentation
    Zhu, Xiaolong
    Zhang, Weihang
    Li, Huiqi
    2024 IEEE 19TH CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS, ICIEA 2024, 2024,
  • [30] MCFA-UNet: Multiscale Cascaded Feature Attention U-Net for Liver Segmentation
    Zhou, Yuran
    Kong, Qianqian
    Zhu, Yan
    Su, Zhen
    IRBM, 2023, 44 (04)