Local Information-Enhanced Graph-Transformer for Hyperspectral Image Change Detection With Limited Training Samples

被引:61
|
作者
Dong, Wenqian [1 ]
Yang, Yufei [1 ]
Qu, Jiahui [1 ]
Xiao, Song [2 ,3 ]
Li, Yunsong [1 ]
机构
[1] Xidian Univ, State Key Lab Integrated Serv Network, Xian 710071, Peoples R China
[2] Beijing Elect Sci & Technol Inst, Dept Elect & Commun Engn, Beijing 100070, Peoples R China
[3] Xidian Univ, Sch Telecommun Engn, Xian 710071, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Transformers; Feature extraction; Task analysis; Training; Convolution; Convolutional neural networks; Hyperspectral imaging; Change detection (CD); graph-transformer; hyperspectral image (HSI); limited training samples;
D O I
10.1109/TGRS.2023.3269892
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Hyperspectral image change detection (HSI-CD) is a challenging task that focuses on identifying the differences between multitemporal HSIs. The recent advancement of convolutional neural network (CNN) has made great progress on HSIs-CD. However, due to the limited receptive field, most CNN-based CD models trained with sufficient labeled samples cannot flexibly model the global information that is essential for distinguishing complex objects, thereby achieving relatively low performance. In this article, we propose a dual-branch local information-enhanced graph-transformer (D-LIEG) CD network to fully exploit the local-global spectral-spatial features of the multitemporal HSIs with limited training samples for change recognition. Specifically, the proposed network is composed of a cascaded of LIEG blocks, which jointly extracts local-global features by learning local information representation to enhance the information of graph-transformer. A novel graph-transformer is developed to model global spectral-spatial correlation between graph nodes, enabling the spectral information preservation of HSIs and accurate CD of areas with various sizes. Extensive experiments have proved that our method achieves significant performance improvement than other state-of-the-art methods on four commonly used HSI datasets.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] DIEFEN: Differential Information-Enhanced Feature Exchange Network for Hyperspectral Change Detection
    Wu, Lanxin
    Ma, Lei
    Peng, Jiangtao
    Yang, Bing
    Sun, Weiwei
    Wang, Junhao
    Luo, Xinyu
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [2] Graph-Transformer with spatial-spectral features fusion for hyperspectral image classification
    Zheng, Zhouzhou
    Debbagh, Mohamed
    Zhou, Xuehai
    Sun, Shangpeng
    Huang, Yuxiang
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 264
  • [3] Dual Graph Convolutional Network for Hyperspectral Image Classification With Limited Training Samples
    He, Xin
    Chen, Yushi
    Ghamisi, Pedram
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [4] GTransCD: Graph Transformer-Guided Multitemporal Information United Framework for Hyperspectral Image Change Detection
    Zhao, Xiaoyang
    Li, Siyao
    Geng, Tingting
    Wang, Xianghai
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 13
  • [5] Global and Local Attention-Based Transformer for Hyperspectral Image Change Detection
    Wang, Ziyi
    Gao, Feng
    Dong, Junyu
    Du, Qian
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2025, 22
  • [6] A Spatio-Temporal Enhanced Graph-Transformer AutoEncoder embedded pose for anomaly detection
    Zhu, Honglei
    Wei, Pengjuan
    Xu, Zhigang
    IET COMPUTER VISION, 2024, 18 (03) : 405 - 419
  • [7] TrmGLU-Net: transformer-augmented global-local U-Net for hyperspectral image classification with limited training samples
    Liu, Bing
    Sun, Yifan
    Wang, Ruirui
    Yu, Anzhu
    Xue, Zhixiang
    Wang, Yusong
    EUROPEAN JOURNAL OF REMOTE SENSING, 2023, 56 (01)
  • [8] Hyperspectral Image Classification with Capsule Network Using Limited Training Samples
    Deng, Fei
    Pu, Shengliang
    Chen, Xuehong
    Shi, Yusheng
    Yuan, Ting
    Pu, Shengyan
    SENSORS, 2018, 18 (09)
  • [9] Optimal superpixel selection for hyperspectral image classification of limited training samples
    Wang, Wenning
    Liu, Xuebin
    Mou, Xuanqin
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2021, 42 (23) : 9059 - 9075
  • [10] Multilevel Features Fused and Change Information Enhanced Neural Network for Hyperspectral Image Change Detection
    Ding, Jigang
    Li, Xiaorun
    Xiang, Shu
    Chen, Shuhan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 13