An Attention-Based Multiscale Spectral-Spatial Network for Hyperspectral Target Detection

被引:5
|
作者
Feng, Shou [1 ,2 ,3 ]
Feng, Rui [1 ,2 ]
Liu, Jianfei [1 ,2 ]
Zhao, Chunhui [1 ,2 ]
Xiong, Fengchao [4 ]
Zhang, Lifu [3 ]
机构
[1] Harbin Engn Univ, Coll Informat & Commun Engn, Minist Ind & Informat Technol, Harbin 150001, Peoples R China
[2] Harbin Engn Univ, Key Lab Adv Marine Commun & Informat Technol, Minist Ind & Informat Technol, Harbin 150001, Peoples R China
[3] Chinese Acad Sci, Aerosp Informat Res Inst, State Key Lab Remote Sensing Sci, Beijing 100101, Peoples R China
[4] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Convolutional neural networks; Testing; Detectors; Training; Transformers; Object detection; Hyperspectral images (HSIs); Siamese structure; target detection; vision Transformer (ViT); SPARSE;
D O I
10.1109/LGRS.2023.3265938
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Deep-learning-based methods have made great progress in hyperspectral target detection (HTD). Unfortunately, the insufficient utilization of spatial information in most methods leaves deep-learning-based methods to confront ineffectiveness. To ameliorate this issue, an attention-based multiscale spectral-spatial detector (AMSSD) for HTD is proposed. First, the AMSSD leverages the Siamese structure to establish a similarity discrimination network, which can enlarge intraclass similarity and interclass dissimilarity to facilitate better discrimination between the target and the background. Second, 1-D convolutional neural network (CNN) and vision Transformer (ViT) are used combinedly to extract spectral-spatial features more feasibly and adaptively. The joint use of spectral-spatial information can obtain more comprehensive features, which promotes subsequent similarity measurement. Finally, a multiscale spectral-spatial difference feature fusion module is devised to integrate spectral-spatial difference features of different scales to obtain more distinguishable representation and boost detection competence. Experiments conducted on two HSI datasets indicate that the AMSSD outperforms seven compared methods.
引用
收藏
页数:5
相关论文
共 50 条
  • [31] Self-spectral learning with GAN based spectral-spatial target detection for hyperspectral image
    Xie, Weiying
    Zhang, Jiaqing
    Lei, Jie
    Li, Yunsong
    Jia, Xiuping
    NEURAL NETWORKS, 2021, 142 : 375 - 387
  • [32] Enhanced Spectral-Spatial Residual Attention Network for Hyperspectral Image Classification
    Zhan, Yanting
    Wu, Ke
    Dong, Yanni
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 7171 - 7186
  • [33] Cross-Attention Spectral-Spatial Network for Hyperspectral Image Classification
    Yang, Kai
    Sun, Hao
    Zou, Chunbo
    Lu, Xiaoqiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [34] Cooperative Spectral-Spatial Attention Dense Network for Hyperspectral Image Classification
    Dong, Zhimin
    Cai, Yaoming
    Cai, Zhihua
    Liu, Xiaobo
    Yang, Zhaoyu
    Zhuge, Mingchen
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2021, 18 (05) : 866 - 870
  • [35] Spectral-Spatial Graph Attention Network for Semisupervised Hyperspectral Image Classification
    Zhao, Zhengang
    Wang, Hao
    Yu, Xianchuan
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [36] A Deep Spectral-Spatial Residual Attention Network for Hyperspectral Image Classification
    Chhapariya, Koushikey
    Buddhiraju, Krishna Mohan
    Kumar, Anil
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 15393 - 15406
  • [37] Spectral-Spatial Residual Graph Attention Network for Hyperspectral Image Classification
    Xu, Kejie
    Zhao, Yue
    Zhang, Lingming
    Gao, Chenqiang
    Huang, Hong
    IEEE Geoscience and Remote Sensing Letters, 2022, 19
  • [38] SSANet: An Adaptive Spectral-Spatial Attention Autoencoder Network for Hyperspectral Unmixing
    Wang, Jie
    Xu, Jindong
    Chong, Qianpeng
    Liu, Zhaowei
    Yan, Weiqing
    Xing, Haihua
    Xing, Qianguo
    Ni, Mengying
    REMOTE SENSING, 2023, 15 (08)
  • [39] Spectral-Spatial Residual Graph Attention Network for Hyperspectral Image Classification
    Xu, Kejie
    Zhao, Yue
    Zhang, Lingming
    Gao, Chenqiang
    Huang, Hong
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [40] SSAU-Net: A Spectral-Spatial Attention-Based U-Net for Hyperspectral Image Fusion
    Liu, Shuaiqi
    Liu, Siyuan
    Zhang, Shichong
    Li, Bing
    Hu, Weiming
    Zhang, Yu-Dong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60