CSTFNet: A CNN and Dual Swin-Transformer Fusion Network for Remote Sensing Hyperspectral Data Fusion and Classification of Coastal Areas

被引:0
|
作者
Li, Dekai [1 ]
Neira-Molina, Harold [2 ]
Huang, Mengxing [1 ]
Syam, M. S. [3 ,4 ,5 ]
Yu, Zhang [1 ,6 ]
Zhang, Junfeng [1 ]
Bhatti, Uzair Aslam [1 ]
Asif, Muhammad [7 ]
Sarhan, Nadia [8 ]
Awwad, Emad Mahrous [9 ]
机构
[1] Hainan Univ, Sch Informat & Commun Engn, Haikou 570228, Peoples R China
[2] Univ Costa, Dept Comp Sci & Elect, Barranquilla 080002, Colombia
[3] Jingchu Univ Technol, Sch Artificial Intelligence, Jingmen 448000, Peoples R China
[4] Jingchu Univ Technol, Jingmen Cryptometry Applicat Technol Res Ctr, Jingmen 448000, Peoples R China
[5] Jingchu Univ Technol, Internet Intelligences Applicat Innovat Res Ctr, Jingmen 448000, Peoples R China
[6] Hainan Univ, Sch Comp Sci & Technol, Haikou 570228, Peoples R China
[7] Hunan Univ Sci & Engn, Sch Media, Yongzhou 425199, Peoples R China
[8] King Saud Univ, Coll Business Adm, Dept Quantitat Anal, Riyadh 11421, Saudi Arabia
[9] King Saud Univ, Coll Engn, Dept Elect Engn, Riyadh 11421, Saudi Arabia
基金
美国国家科学基金会;
关键词
Feature extraction; Computational modeling; Transformers; Convolutional neural networks; Accuracy; Hyperspectral imaging; Vectors; Three-dimensional displays; Sea measurements; Faces; Convolutional neural network (CNN); hyperspectral image; remote sensing; Swin transformer; IMAGE CLASSIFICATION;
D O I
10.1109/JSTARS.2025.3530935
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Hyperspectral imaging (HSI) can capture a large amount of spectral information at various wavelengths, enabling detailed material classification and identification, making it a key tool in remote sensing, particularly for coastal area monitoring. In recent years, the convolutional neural network (CNN) framework and transformer models have demonstrated strong performance in HSI classification, especially in applications requiring precise change detection and analysis. However, due to the high dimensionality of HSI data and the complexity of spectral-spatial feature extraction, achieving accurate results in coastal areas remains challenging. This article introduces a new hybrid model, CSTFNet, which combines an improved CNN module and dual-layer Swin transformer (DLST) to tackle these challenges. CSTFNet integrates spectral and spatial processing capabilities, significantly reducing computational complexity while maintaining high classification accuracy. The improved CNN module employs one-dimensional convolutions to handle high-dimensional data, while the DLST module uses window-based multihead attention to capture both local and global dependencies. Experiments conducted on four standard HSI datasets (Houston-2013, Samson, KSC, and Botswana) demonstrate that CSTFNet outperforms traditional and state-of-the-art algorithms, achieving overall classification accuracy exceeding 99% . In particular, on the Houston-2013 dataset, the results for OA and AA are 1.00 and the kappa coefficient is 0. 976. The results highlight the robustness and efficiency of the proposed model in coastal area applications, where accurate and reliable spectral-spatial classification is crucial for monitoring and environmental management.
引用
收藏
页码:5853 / 5865
页数:13
相关论文
共 50 条
  • [41] A Semantic Segmentation Method for Remote Sensing Images Based on the Swin Transformer Fusion Gabor Filter
    Feng, Dongdong
    Zhang, Zhihua
    Yan, Kun
    IEEE ACCESS, 2022, 10 : 77432 - 77451
  • [42] HYPERSPECTRAL REMOTE SENSING IMAGE CLASSIFICATION BASED ON DECISION LEVEL FUSION
    Du, Peijun
    Zhang, Wei
    Zhang, Shubi
    Xia, Junshi
    2009 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, VOLS 1-5, 2009, : 3320 - 3323
  • [43] Hyperspectral remote sensing image classification based on decision level fusion
    Du, Peijun
    Zhang, Wei
    Xia, Junshi
    CHINESE OPTICS LETTERS, 2011, 9 (03)
  • [44] Hyperspectral remote sensing image classification based on decision level fusion
    杜培军
    张伟
    夏俊士
    ChineseOpticsLetters, 2011, 9 (03) : 33 - 36
  • [45] FusionNet: A Convolution-Transformer Fusion Network for Hyperspectral Image Classification
    Yang, Liming
    Yang, Yihang
    Yang, Jinghui
    Zhao, Ningyuan
    Wu, Ling
    Wang, Liguo
    Wang, Tianrui
    REMOTE SENSING, 2022, 14 (16)
  • [46] A Spectral-Spatial Fusion Transformer Network for Hyperspectral Image Classification
    Liao, Diling
    Shi, Cuiping
    Wang, Liguo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [47] Convolution-Transformer Adaptive Fusion Network for Hyperspectral Image Classification
    Li, Jiaju
    Xing, Hanfa
    Ao, Zurui
    Wang, Hefeng
    Liu, Wenkai
    Zhang, Anbing
    APPLIED SCIENCES-BASEL, 2023, 13 (01):
  • [48] Deep Fusion of Remote Sensing Data for Accurate Classification
    Chen, Yushi
    Li, Chunyang
    Ghamisi, Pedram
    Jia, Xiuping
    Gu, Yanfeng
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2017, 14 (08) : 1253 - 1257
  • [49] Swin-MFA: A Multi-Modal Fusion Attention Network Based on Swin-Transformer for Low-Light Image Human Segmentation
    Yi, Xunpeng
    Zhang, Haonan
    Wang, Yibo
    Guo, Shujiang
    Wu, Jingyi
    Fan, Cien
    SENSORS, 2022, 22 (16)
  • [50] Dual-stream GNN fusion network for hyperspectral classification
    Weiming Li
    Qikang Liu
    Shuaishuai Fan
    Cong’an Xu
    Hongyang Bai
    Applied Intelligence, 2023, 53 : 26542 - 26567