SWINT-RESNet: An Improved Remote Sensing Image Segmentation Model Based on Transformer

被引:2
|
作者
Ma, Yuefeng [1 ]
Wang, Yingli [1 ]
Liu, Xingya [1 ]
Wang, Haiying [2 ,3 ]
机构
[1] Henan Univ, Coll Geog & Environm Sci, Zhengzhou 475000, Peoples R China
[2] Minist Educ, Key Lab Geospatial Technol Middle & Lower Yellow R, Kaifeng 475004, Peoples R China
[3] Henan Univ, Henan Technol Innovat Ctr Spatio Temporal Big Data, Zhengzhou 450046, Peoples R China
关键词
Feature extraction; Transformers; Remote sensing; Accuracy; Semantics; Convolutional neural networks; Semantic segmentation; Deep learning; remote sensing image segmentation; RESNet; semantic segmentation; transformer;
D O I
10.1109/LGRS.2024.3433034
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Deep neural networks have been widely used in remote sensing image segmentation. Nowadays, artificial intelligence methods are increasingly applied to remote sensing feature classification. Although convolutional neural networks (CNNs) are widely used for image segmentation tasks, their global feature extraction with increasing image samples is insufficient. Furthermore, transformer is now being focused on computer vision. However, although transformer can capture the global information of remote sensing images, it cannot adequately model the detailed information of image changes. To comprehensively compensate for the defects of CNNs and the transformer network in feature extraction, this study proposes a semantic segmentation network with multifeature fusion (SWINT-RESNet). This network combines the transformer-extracted global and local features and those of CNNs to improve the accuracy of remote sensing image segmentation. The experiments show that the segmentation performance of SWINT-RESNet is superior for both small and medium sample remote sensing image datasets.
引用
收藏
页数:5
相关论文
共 50 条
  • [31] FEST: Feature Enhancement Swin Transformer for Remote Sensing Image Semantic Segmentation
    Zhang, Ronghuan
    Zhao, Jing
    Li, Ming
    Zou, Qingzhi
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 1177 - 1182
  • [32] Semantic Segmentation of Remote Sensing Image Based on GAN and FCN Network Model
    Tian, Liang
    Zhong, Xiaorou
    Chen, Ming
    SCIENTIFIC PROGRAMMING, 2021, 2021
  • [33] TEXTURE SEGMENTATION FOR REMOTE SENSING IMAGE BASED ON TEXTURE-TOPIC MODEL
    Feng, Hao
    Jiang, Zhiguo
    Han, Xingmin
    2011 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2011, : 2669 - 2672
  • [34] SPARSE CODING-BASED TOPIC MODEL FOR REMOTE SENSING IMAGE SEGMENTATION
    Shi, Jun
    Jiang, Zhiguo
    Feng, Hao
    Ma, Yibing
    2013 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2013, : 4122 - 4125
  • [35] DSViT: Dynamically Scalable Vision Transformer for Remote Sensing Image Segmentation and Classification
    Wang, Falin
    Ji, Jian
    Wang, Yuan
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 5441 - 5452
  • [36] Hybrid Shunted Transformer embedding UNet for remote sensing image semantic segmentation
    Zhou H.
    Xiao X.
    Li H.
    Liu X.
    Liang P.
    Neural Computing and Applications, 2024, 36 (25) : 15705 - 15720
  • [37] Analysis of Urban Changes in High-resolution Remote Sensing Images Based on the Improved ResNet Model
    Xu, Zongxia
    Zhang, Kui
    Liang, Hanmei
    Zeng, Yanyan
    Xuping, Zhang
    SENSORS AND MATERIALS, 2023, 35 (01) : 317 - 332
  • [38] Remote sensing image segmentation based on information clustering
    Li, Yu (liyu@lntu.edu.cn), 1600, China University of Mining and Technology (46):
  • [39] REMOTE SENSING IMAGE SEGMENTATION METHOD BASED ON HRNET
    Cheng, Zhi
    Fu, Daocai
    IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 6750 - 6753
  • [40] Remote sensing image segmentation based on game theory
    Chen, H
    Liu, WQ
    Xia, DS
    Xie, J
    INFRARED SPACEBORNE REMOTE SENSING VII, 1999, 3759 : 78 - 83