Local Information-Enhanced Graph-Transformer for Hyperspectral Image Change Detection With Limited Training Samples

被引:61
|
作者
Dong, Wenqian [1 ]
Yang, Yufei [1 ]
Qu, Jiahui [1 ]
Xiao, Song [2 ,3 ]
Li, Yunsong [1 ]
机构
[1] Xidian Univ, State Key Lab Integrated Serv Network, Xian 710071, Peoples R China
[2] Beijing Elect Sci & Technol Inst, Dept Elect & Commun Engn, Beijing 100070, Peoples R China
[3] Xidian Univ, Sch Telecommun Engn, Xian 710071, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Transformers; Feature extraction; Task analysis; Training; Convolution; Convolutional neural networks; Hyperspectral imaging; Change detection (CD); graph-transformer; hyperspectral image (HSI); limited training samples;
D O I
10.1109/TGRS.2023.3269892
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Hyperspectral image change detection (HSI-CD) is a challenging task that focuses on identifying the differences between multitemporal HSIs. The recent advancement of convolutional neural network (CNN) has made great progress on HSIs-CD. However, due to the limited receptive field, most CNN-based CD models trained with sufficient labeled samples cannot flexibly model the global information that is essential for distinguishing complex objects, thereby achieving relatively low performance. In this article, we propose a dual-branch local information-enhanced graph-transformer (D-LIEG) CD network to fully exploit the local-global spectral-spatial features of the multitemporal HSIs with limited training samples for change recognition. Specifically, the proposed network is composed of a cascaded of LIEG blocks, which jointly extracts local-global features by learning local information representation to enhance the information of graph-transformer. A novel graph-transformer is developed to model global spectral-spatial correlation between graph nodes, enabling the spectral information preservation of HSIs and accurate CD of areas with various sizes. Extensive experiments have proved that our method achieves significant performance improvement than other state-of-the-art methods on four commonly used HSI datasets.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] TriTF: A Triplet Transformer Framework Based on Parents and Brother Attention for Hyperspectral Image Change Detection
    Wang, Xianghai
    Zhao, Keyun
    Zhao, Xiaoyang
    Li, Siyao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [42] Enhanced hybrid CNN and transformer network for remote sensing image change detection
    Yang, Junjie
    Wan, Haibo
    Shang, Zhihai
    SCIENTIFIC REPORTS, 2025, 15 (01):
  • [44] Multi-dimensional, multi-branch hyperspectral remote sensing image classification with limited training samples
    Zeng, Yiliang
    Lv, Zhiwu
    Zhang, Hao
    Zhao, Jiahong
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (10) : 7199 - 7210
  • [45] Adaptive spectral-spatial feature fusion network for hyperspectral image classification using limited training samples
    Gao, Hongmin
    Chen, Zhonghao
    Xu, Feng
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2022, 107
  • [46] A novel non-parametric weighted feature extraction method for classification of hyperspectral image with limited training samples
    Yang, Jinn-Min
    Yu, Pao-Ta
    Kuo, Bor-Chen
    Huang, Hsiao-Yun
    IGARSS: 2007 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, VOLS 1-12: SENSING AND UNDERSTANDING OUR PLANET, 2007, : 1552 - 1555
  • [47] Uncertainty-Aware Graph Self-Supervised Learning for Hyperspectral Image Change Detection
    Jian, Ping
    Ou, Yimin
    Chen, Keming
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 19
  • [48] Dual-Branch Difference Amplification Graph Convolutional Network for Hyperspectral Image Change Detection
    Qu, Jiahui
    Xu, Yunshuang
    Dong, Wenqian
    Li, Yunsong
    Du, Qian
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [49] Global and Local Graph-Based Difference Image Enhancement for Change Detection
    Zheng, Xiaolong
    Guan, Dongdong
    Li, Bangjie
    Chen, Zhengsheng
    Pan, Lefei
    REMOTE SENSING, 2023, 15 (05)
  • [50] An enhanced local outlier detection using random walk on grid information graph
    Chunyan She
    Shaohua Zeng
    The Journal of Supercomputing, 2022, 78 : 14530 - 14547