SFMRNet: Specific Feature Fusion and Multibranch Feature Refinement Network for Land Use Classification

被引:0
|
作者
Chen, Guojun [1 ]
Chen, Haozhen [1 ]
Cui, Tao [1 ]
Li, Huihui [1 ]
机构
[1] China Univ Petr East China, Qingdao Inst Software, Coll Comp Sci & Technol, Qingdao 266000, Peoples R China
关键词
Transformers; Feature extraction; Semantics; Semantic segmentation; Accuracy; Decoding; Context modeling; Feature fusion; global contextual information; remote sensing; semantic segmentation; Swin Transformer; SEMANTIC SEGMENTATION;
D O I
10.1109/JSTARS.2024.3456842
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Land use classification of high-precision satellite images using semantic segmentation methods has become mainstream. In this field, global context information plays an irreplaceable role. However, most current methods struggle to effectively utilize this global context, which results in low segmentation accuracy, especially in scenes with similar objects, small targets, or obscured by shadows. To address the above issues, this article introduces SFMRNet-the network that integrates the advantages of Transformer and convolutional neural network (CNN)-and designs various modules to utilize the power of contextual information as much as possible. First, we design a specific enhanced feature fusion module (SEFFM) that selectively enhances spatial or channel information of feature maps before fusion, effectively mitigating small interclass differences. Second, our proposed multibranch feature refinement module (MFRM) facilitates the interaction between different feature layers and refines these features to enhance multiscale characterization. This improves the segmentation of small-sized targets and addresses the occlusion issues. Finally, comprehensive testing and detailed ablation analysis are conducted on three datasets: the ISPRS Vaihingen, ISPRS Potsdam, and LoveDA land use classification datasets. The results demonstrate that SFMRNet exhibits superior segmentation capabilities compared to existing advanced methods.
引用
收藏
页码:16206 / 16221
页数:16
相关论文
共 50 条
  • [1] Hyperspectral Image Classification Based on Multibranch Adaptive Feature Fusion Network
    Li, Chen
    Wang, Yi
    Fang, Zhice
    Li, Penglei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [2] A Multibranch Crossover Feature Attention Network for Hyperspectral Image Classification
    Liu, Dongxu
    Wang, Yirui
    Liu, Peixun
    Li, Qingqing
    Yang, Hang
    Chen, Dianbing
    Liu, Zhichao
    Han, Guangliang
    REMOTE SENSING, 2022, 14 (22)
  • [3] Multibranch Feature Extraction and Feature Multiplexing Network for Pansharpening
    Lei, Dajiang
    Huang, Yihang
    Zhang, Liping
    Li, Weisheng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [4] Multibranch Feature Fusion Network With Self- and Cross-Guided Attention for Hyperspectral and LiDAR Classification
    Dong, Wenqian
    Zhang, Tian
    Qu, Jiahui
    Xiao, Song
    Zhang, Tongzhen
    Li, Yunsong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [5] FASONet: A Feature Alignment-Based SAR and Optical Image Fusion Network for Land Use Classification
    Deng, Feng
    Huang, Meiyu
    Bao, Wei
    Ji, Nan
    Xiang, Xueshuang
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT X, 2024, 14434 : 298 - 310
  • [7] A 3D-2D Multibranch Feature Fusion and Dense Attention Network for Hyperspectral Image Classification
    Gao, Hongmin
    Zhang, Yiyan
    Zhang, Yunfei
    Chen, Zhonghao
    Li, Chenming
    Zhou, Hui
    MICROMACHINES, 2021, 12 (10)
  • [8] A Multibranch Network With Multilayer Feature Fusion for No-Reference Image Quality Assessment
    Zhao, Wenqing
    Li, Mengwei
    Xu, Lijiao
    Sun, Yue
    Zhao, Zhenbing
    Zhai, Yongjie
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73
  • [9] Turbulent-image Restoration Based on a Compound Multibranch Feature Fusion Network
    Xu, Banglian
    Fang, Yao
    Zhang, Leihong
    Zhang, Dawei
    Zheng, Lulu
    CURRENT OPTICS AND PHOTONICS, 2023, 7 (03) : 237 - 247
  • [10] Image Reconstruction of Multibranch Feature Multiplexing Fusion Network with Mixed Multilayer Attention
    Cai, Yuxi
    Gao, Guxue
    Jia, Zhenhong
    Lai, Huicheng
    REMOTE SENSING, 2022, 14 (09)