Local Information-Enhanced Graph-Transformer for Hyperspectral Image Change Detection With Limited Training Samples

被引:61
|
作者
Dong, Wenqian [1 ]
Yang, Yufei [1 ]
Qu, Jiahui [1 ]
Xiao, Song [2 ,3 ]
Li, Yunsong [1 ]
机构
[1] Xidian Univ, State Key Lab Integrated Serv Network, Xian 710071, Peoples R China
[2] Beijing Elect Sci & Technol Inst, Dept Elect & Commun Engn, Beijing 100070, Peoples R China
[3] Xidian Univ, Sch Telecommun Engn, Xian 710071, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Transformers; Feature extraction; Task analysis; Training; Convolution; Convolutional neural networks; Hyperspectral imaging; Change detection (CD); graph-transformer; hyperspectral image (HSI); limited training samples;
D O I
10.1109/TGRS.2023.3269892
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Hyperspectral image change detection (HSI-CD) is a challenging task that focuses on identifying the differences between multitemporal HSIs. The recent advancement of convolutional neural network (CNN) has made great progress on HSIs-CD. However, due to the limited receptive field, most CNN-based CD models trained with sufficient labeled samples cannot flexibly model the global information that is essential for distinguishing complex objects, thereby achieving relatively low performance. In this article, we propose a dual-branch local information-enhanced graph-transformer (D-LIEG) CD network to fully exploit the local-global spectral-spatial features of the multitemporal HSIs with limited training samples for change recognition. Specifically, the proposed network is composed of a cascaded of LIEG blocks, which jointly extracts local-global features by learning local information representation to enhance the information of graph-transformer. A novel graph-transformer is developed to model global spectral-spatial correlation between graph nodes, enabling the spectral information preservation of HSIs and accurate CD of areas with various sizes. Extensive experiments have proved that our method achieves significant performance improvement than other state-of-the-art methods on four commonly used HSI datasets.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] MGCET: MLP-mixer and Graph Convolutional Enhanced Transformer for Hyperspectral Image Classification
    Al-qaness, Mohammed A. A.
    Wu, Guoyong
    AL-Alimi, Dalal
    REMOTE SENSING, 2024, 16 (16)
  • [22] Superpixel-guided multifeature tensor for hyperspectral image classification with limited training samples
    Wang, Peng
    Zheng, Chengyong
    Liu, Saihua
    OPTICS AND LASER TECHNOLOGY, 2023, 159
  • [23] Spatial-Spectral Relation Network for Hyperspectral Image Classification With Limited Training Samples
    Rao, Mengbin
    Tang, Ping
    Zhang, Zheng
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2019, 12 (12) : 5086 - 5100
  • [24] Hyperspectral Image Classification via Within Class Similarity for Limited Training Samples Problem
    Majdar, Reza Seifi
    Ghassemian, Hassan
    2014 4TH INTERNATIONAL CONFERENCE ON COMPUTER AND KNOWLEDGE ENGINEERING (ICCKE), 2014, : 769 - 774
  • [25] Dual-Path Siamese CNN for Hyperspectral Image Classification With Limited Training Samples
    Huang, Lingbo
    Chen, Yushi
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2021, 18 (03) : 518 - 522
  • [26] Superpixel-guided multifeature tensor for hyperspectral image classification with limited training samples
    Wang, Peng
    Zheng, Chengyong
    Liu, Saihua
    OPTICS AND LASER TECHNOLOGY, 2023, 159
  • [27] CAST: A Cascade Spectral-Aware Transformer for Hyperspectral Image Change Detection
    Zhang, Xiangrong
    Tian, Shunli
    Wang, Guanchun
    Tang, Xu
    Feng, Jie
    Jiao, Licheng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [28] A Generative Pretrained Transformer for Semi-Supervised Hyperspectral Image Change Detection
    Wang, Yanheng
    Sha, Jianjun
    Yu, Xiaohan
    Gao, Yongsheng
    Zhang, Yonggang
    Rong, Xianhui
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2025, 22
  • [29] LESSFormer: Local-Enhanced Spectral-Spatial Transformer for Hyperspectral Image Classification
    Zou, Jiaqi
    He, Wei
    Zhang, Hongyan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [30] SAGN: Sharpening-Aware Graph Network for Hyperspectral Image Change Detection
    Yang, Bing
    Sun, Weiwei
    Peng, Jiangtao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 12