Sgformer: A Local and Global Features Coupling Network for Semantic Segmentation of Land Cover

被引:22
|
作者
Weng, Liguo [1 ]
Pang, Kai [1 ]
Xia, Min [1 ]
Lin, Haifeng [2 ]
Qian, Ming [3 ]
Zhu, Changjie [4 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Collaborat Innovat Ctr Atmospher Environm & Equipm, B DAT, Nanjing 210044, Peoples R China
[2] Nanjing Forestry Univ, Coll Informat Sci & Technol, Nanjing 210037, Peoples R China
[3] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & Re, Wuhan 430072, Peoples R China
[4] Hohai Univ, Changzhou Campus, Nanjing 210000, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; land cover; neural network; remote sensing; semantic segmentation; CLASSIFIER;
D O I
10.1109/JSTARS.2023.3295729
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With the introduction of Earth observation satellites, the classification technology through high-definition remote sensing images appeared. After decades of evolution, the land cover classification method in high-definition satellite maps has been gradually improved. Recently, high-definition remote sensing maps have been applied to land cover classification. Nowadays, classification methods using high-definition maps have these following problems. First, the traditional land cover classification methods cannot process the rich details in high-definition maps. Second, there are different acquisition conditions in the maps of different regions, which leads to distortion, deformation, and illumination blur of remote sensing images. Third, the existing methods are unable to provide a good generalization performance. To address these issues, a dual-branch parallel network structure is proposed, called Sgformer, to improve the performance of the transformer in the context of high-definition remote sensing maps. The network enhances perceptual learning with convolution operators that extract local features and a self-attention module that captures global representations. Local information and global representations with semantic divergence are fused through a feature coupling module. At last, a decoder is designed to maximize the preservation of local features and global representations and to better recover high-definition feature maps. The results of semantic segmentation experiments show that the methodology in this study has higher accuracy than the other methodologies.
引用
收藏
页码:6812 / 6824
页数:13
相关论文
共 50 条
  • [1] DFFAN: Dual Function Feature Aggregation Network for Semantic Segmentation of Land Cover
    Huang, Junqing
    Weng, Liguo
    Chen, Bingyu
    Xia, Min
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2021, 10 (03)
  • [2] Multi-Scale Feature Aggregation Network for Semantic Segmentation of Land Cover
    Shen, Xu
    Weng, Liguo
    Xia, Min
    Lin, Haifeng
    REMOTE SENSING, 2022, 14 (23)
  • [3] MFANet: A Multi-Level Feature Aggregation Network for Semantic Segmentation of Land Cover
    Chen, Bingyu
    Xia, Min
    Huang, Junqing
    REMOTE SENSING, 2021, 13 (04) : 1 - 20
  • [4] Multispectral Semantic Land Cover Segmentation From Aerial Imagery With Deep EncoderDecoder Network
    Liu, Chengxin
    Du, Shuaiyuan
    Lu, Hao
    Li, Dehui
    Cao, Zhiguo
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [5] Global-Local Attention Network for Semantic Segmentation in Aerial Images
    Li, Minglong
    Shan, Lianlei
    Li, Xiaobin
    Bai, Yang
    Zhou, Dengji
    Wang, Weiqiang
    Lv, Ke
    Luo, Bin
    Chen, Si-Bao
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 5704 - 5711
  • [6] Attention Guided Global Enhancement and Local Refinement Network for Semantic Segmentation
    Li, Jiangyun
    Zha, Sen
    Chen, Chen
    Ding, Meng
    Zhang, Tianxiang
    Yu, Hong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 3211 - 3223
  • [7] Multispectral Semantic Segmentation for Land Cover Classification: An Overview
    Ramos, Leo Thomas
    Sappa, Angel D.
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 14295 - 14336
  • [8] Coupling Global Context and Local Contents for Weakly-Supervised Semantic Segmentation
    Wang, Chunyan
    Zhang, Dong
    Zhang, Liyan
    Tang, Jinhui
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (10) : 13483 - 13495
  • [9] Coupling Global Context and Local Contents for Weakly-Supervised Semantic Segmentation
    Wang, Chunyan
    Zhang, Dong
    Zhang, Liyan
    Tang, Jinhui
    arXiv, 2023,
  • [10] A large-scale point cloud semantic segmentation network via local dual features and global correlations
    Zhao, Yiqiang
    Ma, Xingyi
    Hu, Bin
    Zhang, Qi
    Ye, Mao
    Zhou, Guoqing
    COMPUTERS & GRAPHICS-UK, 2023, 111 : 133 - 144