SWINT-RESNet: An Improved Remote Sensing Image Segmentation Model Based on Transformer

被引:2
|
作者
Ma, Yuefeng [1 ]
Wang, Yingli [1 ]
Liu, Xingya [1 ]
Wang, Haiying [2 ,3 ]
机构
[1] Henan Univ, Coll Geog & Environm Sci, Zhengzhou 475000, Peoples R China
[2] Minist Educ, Key Lab Geospatial Technol Middle & Lower Yellow R, Kaifeng 475004, Peoples R China
[3] Henan Univ, Henan Technol Innovat Ctr Spatio Temporal Big Data, Zhengzhou 450046, Peoples R China
关键词
Feature extraction; Transformers; Remote sensing; Accuracy; Semantics; Convolutional neural networks; Semantic segmentation; Deep learning; remote sensing image segmentation; RESNet; semantic segmentation; transformer;
D O I
10.1109/LGRS.2024.3433034
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Deep neural networks have been widely used in remote sensing image segmentation. Nowadays, artificial intelligence methods are increasingly applied to remote sensing feature classification. Although convolutional neural networks (CNNs) are widely used for image segmentation tasks, their global feature extraction with increasing image samples is insufficient. Furthermore, transformer is now being focused on computer vision. However, although transformer can capture the global information of remote sensing images, it cannot adequately model the detailed information of image changes. To comprehensively compensate for the defects of CNNs and the transformer network in feature extraction, this study proposes a semantic segmentation network with multifeature fusion (SWINT-RESNet). This network combines the transformer-extracted global and local features and those of CNNs to improve the accuracy of remote sensing image segmentation. The experiments show that the segmentation performance of SWINT-RESNet is superior for both small and medium sample remote sensing image datasets.
引用
收藏
页数:5
相关论文
共 50 条
  • [41] Road Extraction Network of Remote Sensing Image Based on SPUD-ResNet
    Li, Daidong
    He, Xiaohui
    Li, Panle
    Tian, Zhihui
    Zhou, Guangsheng
    Computer Engineering and Applications, 2024, 57 (23) : 240 - 247
  • [42] Improved fast mean shift algorithm for remote sensing image segmentation
    Zhou, Jia-Xiang
    Li, Zhi-Wei
    Fan, Chong
    IET IMAGE PROCESSING, 2015, 9 (05) : 389 - 394
  • [43] Transformer for the Building Segmentation of Urban Remote Sensing
    Zhang, Heqing
    Wang, Zhenxin
    Song, Jun-feng
    Li, Xueyan
    PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2022, 88 (09): : 603 - 609
  • [44] Remote Sensing Image Classification Based on Adaptive Watershed Segmentation and Improved Support Vector Machine
    Li, Gang
    Wan, You-chuan
    ICMS2010: PROCEEDINGS OF THE THIRD INTERNATIONAL CONFERENCE ON MODELLING AND SIMULATION, VOL 6: MODELLING & SIMULATION INDUSTRIAL ENGINEERING & MANAGEMENT, 2010, : 341 - 348
  • [45] A remote sensing industrial solid waste image segmentation method based on improved watershed algorithm
    Bao, Wenxing
    Yu, Bing
    International Journal of Signal Processing, Image Processing and Pattern Recognition, 2015, 8 (02) : 223 - 236
  • [46] SEMANTIC SEGMENTATION OF HIGH-RESOLUTION REMOTE SENSING IMAGES USING AN IMPROVED TRANSFORMER
    Liu, Yuheng
    Mei, Shaohui
    Zhang, Shun
    Wang, Ye
    He, Mingyi
    Du, Qian
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 3496 - 3499
  • [47] MULTI-SOURCE FUSION NETWORK FOR REMOTE SENSING IMAGE SEGMENTATION WITH HIERARCHICAL TRANSFORMER
    Liu, Bo
    Ren, Bo
    Hou, Biao
    Gu, Yu
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 6318 - 6321
  • [48] Multi-Resolution Transformer Network for Building and Road Segmentation of Remote Sensing Image
    Sun, Zhongyu
    Zhou, Wangping
    Ding, Chen
    Xia, Min
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2022, 11 (03)
  • [49] Global Adaptive Second-Order Transformer for Remote Sensing Image Semantic Segmentation
    Zhang, Yijie
    Cheng, Jian
    Su, Yanzhou
    Deng, Changjian
    Xia, Ziying
    Tashi, Nyima
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [50] Adaptive enhanced swin transformer with U-net for remote sensing image segmentation*
    Gu, Xingjian
    Li, Sizhe
    Ren, Shougang
    Zheng, Hengbiao
    Fan, Chengcheng
    Xu, Huanliang
    COMPUTERS & ELECTRICAL ENGINEERING, 2022, 102