Swin-ASNet: An Adaptive RGB-selection Network with Swin Transformer for Retinal Vessel Segmentation

被引:3
|
作者
Jin, Qunchao [1 ]
Hou, Hongyu [1 ]
Zhang, Guixu [1 ]
Wang, Haoan [1 ]
Li, Zhi [1 ]
机构
[1] East China Normal Univ, Sch Comp Sci & Technol, Shanghai, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Retinal vessel segmentation; Transformer; Adaptive selection; Attention mechanism; IMAGES; NET;
D O I
10.1109/ICME55011.2023.00245
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The retinal vasculature reflected by fundus images provides ophthalmologists with information to diagnose eye-related diseases. Therefore, the development of an accurate and automatic retinal vessel segmentation system is critical. Most deep learning-based methods directly use a color image or use a grayscale image simply transformed from the color image as input, and few models focus on the relationship between the three RGB channels. In this paper, we analyze the characteristics of the separated RGB channel images and propose an adaptive RGB-selection network with swin transformer (Swin-ASNet). The input of Swin-ASNet includes the original fundus image and three grayscale images separated from the color image. Our method can select the useful information adaptively through a designed adaptive selection aggregation module. In addition, we adopt the latest swin transformer as the backbone to extract strong features. To better fuse high and low-level features, we design a high-low interaction module, which applies a modified non-local operation under the graph convolution domain. The low-level features are injected into deep semantic information to enhance the detail representation. Experimental results show that our method can achieve state-of-the-art results in three public datasets, comparing with the existing methods.
引用
收藏
页码:1415 / 1420
页数:6
相关论文
共 50 条
  • [31] SiamC Transformer: Siamese coupling swin transformer Multi-Scale semantic segmentation network for vegetation extraction under shadow conditions
    Cui, Shichao
    Chen, Wei
    Gu, Wenzhu
    Yang, Lan
    Shi, Xinyu
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2023, 213
  • [32] CSwinDoubleU-Net: A double U-shaped network combined with convolution and Swin Transformer for colorectal polyp segmentation
    Lin, Yuanjie
    Han, Xiaoxiang
    Chen, Keyan
    Zhang, Weikun
    Liu, Qiaohong
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 89
  • [33] CSwin-PNet: A CNN-Swin Transformer combined pyramid network for breast lesion segmentation in ultrasound images
    Yang, Haonan
    Yang, Dapeng
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 213
  • [34] Swin Unet3D: a three-dimensional medical image segmentation network combining vision transformer and convolution
    Yimin Cai
    Yuqing Long
    Zhenggong Han
    Mingkun Liu
    Yuchen Zheng
    Wei Yang
    Liming Chen
    BMC Medical Informatics and Decision Making, 23
  • [35] SwinE-Net: hybrid deep learning approach to novel polyp segmentation using convolutional neural network and Swin Transformer
    Park, Kyeong-Beom
    Lee, Jae Yeol
    JOURNAL OF COMPUTATIONAL DESIGN AND ENGINEERING, 2022, 9 (02) : 616 - 632
  • [36] Swin Unet3D: a three-dimensional medical image segmentation network combining vision transformer and convolution
    Cai, Yimin
    Long, Yuqing
    Han, Zhenggong
    Liu, Mingkun
    Zheng, Yuchen
    Yang, Wei
    Chen, Liming
    BMC MEDICAL INFORMATICS AND DECISION MAKING, 2023, 23 (01)
  • [37] Hepatic vessel segmentation based on 3D swin-transformer with inductive biased multi-head self-attention
    Wu, Mian
    Qian, Yinling
    Liao, Xiangyun
    Wang, Qiong
    Heng, Pheng-Ann
    BMC MEDICAL IMAGING, 2023, 23 (01)
  • [38] Hepatic vessel segmentation based on 3D swin-transformer with inductive biased multi-head self-attention
    Mian Wu
    Yinling Qian
    Xiangyun Liao
    Qiong Wang
    Pheng-Ann Heng
    BMC Medical Imaging, 23
  • [39] Retinal Vessel Segmentation via Self-Adaptive Compensation Network
    Zhang Lin
    Wu Chuang
    Fan Xinyu
    Gong Chaoju
    Li Suyan
    Liu Hui
    ACTA OPTICA SINICA, 2023, 43 (14)
  • [40] VCT-NET: AN OCTA RETINAL VESSEL SEGMENTATION NETWORK BASED ON CONVOLUTION AND TRANSFORMER
    Liu, Xiaoming
    Di Zhang
    Zhu, Xin
    Tang, Jinshan
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 2656 - 2660