SWINT-RESNet: An Improved Remote Sensing Image Segmentation Model Based on Transformer

被引:2
|
作者
Ma, Yuefeng [1 ]
Wang, Yingli [1 ]
Liu, Xingya [1 ]
Wang, Haiying [2 ,3 ]
机构
[1] Henan Univ, Coll Geog & Environm Sci, Zhengzhou 475000, Peoples R China
[2] Minist Educ, Key Lab Geospatial Technol Middle & Lower Yellow R, Kaifeng 475004, Peoples R China
[3] Henan Univ, Henan Technol Innovat Ctr Spatio Temporal Big Data, Zhengzhou 450046, Peoples R China
关键词
Feature extraction; Transformers; Remote sensing; Accuracy; Semantics; Convolutional neural networks; Semantic segmentation; Deep learning; remote sensing image segmentation; RESNet; semantic segmentation; transformer;
D O I
10.1109/LGRS.2024.3433034
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Deep neural networks have been widely used in remote sensing image segmentation. Nowadays, artificial intelligence methods are increasingly applied to remote sensing feature classification. Although convolutional neural networks (CNNs) are widely used for image segmentation tasks, their global feature extraction with increasing image samples is insufficient. Furthermore, transformer is now being focused on computer vision. However, although transformer can capture the global information of remote sensing images, it cannot adequately model the detailed information of image changes. To comprehensively compensate for the defects of CNNs and the transformer network in feature extraction, this study proposes a semantic segmentation network with multifeature fusion (SWINT-RESNet). This network combines the transformer-extracted global and local features and those of CNNs to improve the accuracy of remote sensing image segmentation. The experiments show that the segmentation performance of SWINT-RESNet is superior for both small and medium sample remote sensing image datasets.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Remote sensing image semantic segmentation based on cascaded Transformer
    Wang F.
    Ji J.
    Wang Y.
    IEEE. Trans. Artif. Intell., 2024, 8 (4136-4148): : 1 - 12
  • [2] Efficient Transformer for Remote Sensing Image Segmentation
    Xu, Zhiyong
    Zhang, Weicun
    Zhang, Tianxiang
    Yang, Zhifang
    Li, Jiangyun
    REMOTE SENSING, 2021, 13 (18)
  • [3] Research on the Applicability of Transformer Model in Remote-Sensing Image Segmentation
    Yu, Minmin
    Qin, Fen
    APPLIED SCIENCES-BASEL, 2023, 13 (04):
  • [4] An Improved Swin Transformer-Based Model for Remote Sensing Object Detection and Instance Segmentation
    Xu, Xiangkai
    Feng, Zhejun
    Cao, Changqing
    Li, Mengyuan
    Wu, Jin
    Wu, Zengyan
    Shang, Yajie
    Ye, Shubing
    REMOTE SENSING, 2021, 13 (23)
  • [5] Remote Sensing Image Fusion Method Based on Improved Swin Transformer
    Li Zitong
    Zhao Jiankang
    Xu Jingran
    Long Haihui
    Liu Chuanqi
    ACTA PHOTONICA SINICA, 2023, 52 (11)
  • [6] Semantic Segmentation Method for Remote Sensing Images Based on Improved Swin Transformer
    Wang, Yizhong
    Hu, Yaqi
    Wu, Xiaosuo
    Yan, Haowen
    Wang, Xiaocheng
    Computer Engineering and Applications, 2024, 60 (11) : 194 - 203
  • [7] Remote Sensing Image Segmentation Based on Improved Statistical Region Merging
    Gong, Xiuli
    Wang, Zhiming
    ADVANCES IN COMPUTERS, ELECTRONICS AND MECHATRONICS, 2014, 667 : 226 - 229
  • [8] Building segmentation method of remote sensing image based on improved SegNet
    Zhu B.
    Li Z.-W.
    Li Q.
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2023, 53 (01): : 248 - 254
  • [9] Adaptive Context Transformer for Semisupervised Remote Sensing Image Segmentation
    Li, Yunbo
    Yi, Zhiyu
    Wang, Yuebin
    Zhang, Liqiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [10] Remote Sensing Image Segmentation Model Based on Attention Mechanism
    Hang, Liu
    Wang Xili
    LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (04)