An Attention-Based Multiscale Spectral-Spatial Network for Hyperspectral Target Detection

被引:5
|
作者
Feng, Shou [1 ,2 ,3 ]
Feng, Rui [1 ,2 ]
Liu, Jianfei [1 ,2 ]
Zhao, Chunhui [1 ,2 ]
Xiong, Fengchao [4 ]
Zhang, Lifu [3 ]
机构
[1] Harbin Engn Univ, Coll Informat & Commun Engn, Minist Ind & Informat Technol, Harbin 150001, Peoples R China
[2] Harbin Engn Univ, Key Lab Adv Marine Commun & Informat Technol, Minist Ind & Informat Technol, Harbin 150001, Peoples R China
[3] Chinese Acad Sci, Aerosp Informat Res Inst, State Key Lab Remote Sensing Sci, Beijing 100101, Peoples R China
[4] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Convolutional neural networks; Testing; Detectors; Training; Transformers; Object detection; Hyperspectral images (HSIs); Siamese structure; target detection; vision Transformer (ViT); SPARSE;
D O I
10.1109/LGRS.2023.3265938
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Deep-learning-based methods have made great progress in hyperspectral target detection (HTD). Unfortunately, the insufficient utilization of spatial information in most methods leaves deep-learning-based methods to confront ineffectiveness. To ameliorate this issue, an attention-based multiscale spectral-spatial detector (AMSSD) for HTD is proposed. First, the AMSSD leverages the Siamese structure to establish a similarity discrimination network, which can enlarge intraclass similarity and interclass dissimilarity to facilitate better discrimination between the target and the background. Second, 1-D convolutional neural network (CNN) and vision Transformer (ViT) are used combinedly to extract spectral-spatial features more feasibly and adaptively. The joint use of spectral-spatial information can obtain more comprehensive features, which promotes subsequent similarity measurement. Finally, a multiscale spectral-spatial difference feature fusion module is devised to integrate spectral-spatial difference features of different scales to obtain more distinguishable representation and boost detection competence. Experiments conducted on two HSI datasets indicate that the AMSSD outperforms seven compared methods.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Hyperspectral image classification based on multiscale piecewise spectral-spatial attention network
    Fan, Xinru
    Guo, Wenhui
    Wang, Xueqin
    Wang, Yanjiang
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2023, 44 (11) : 3529 - 3549
  • [2] A Deep Network Based on Multiscale Spectral-Spatial Fusion for Hyperspectral Classification
    Li, Zhaokui
    Huang, Lin
    Zhang, Deyuan
    Liu, Cuiwei
    Wang, Yan
    Shi, Xiangbin
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, KSEM 2018, PT II, 2018, 11062 : 283 - 290
  • [3] Hyperspectral Image Classification Based on Multiscale Spectral-Spatial Deformable Network
    Nie, Jinyan
    Xu, Qizhi
    Pan, Junjun
    Guo, Mengyao
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [4] Semi-Supervised Hyperspectral Image Classification Based on Multiscale Spectral-Spatial Graph Attention Network
    Han, Xizhen
    Jiang, Zhengang
    Liu, Yuanyuan
    Zhao, Jian
    Sun, Qiang
    Liu, Jianzhuo
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [5] Spectral-Spatial Attention Network for Hyperspectral Image Classification
    Sun, Hao
    Zheng, Xiangtao
    Lu, Xiaoqiang
    Wu, Siyuan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (05): : 3232 - 3245
  • [6] A SPECTRAL-SPATIAL ATTENTION AUTOENCODER NETWORK FOR HYPERSPECTRAL UNMIXING
    Wang, Jie
    Xu, Jindong
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 7519 - 7522
  • [7] SPECTRAL-SPATIAL CLASSIFICATION OF HYPERSPECTRAL IMAGE BASED ON A JOINT ATTENTION NETWORK
    Pan, Erting
    Ma, Yong
    Mei, Xiaoguang
    Dai, Xiaobing
    Fan, Fan
    Tian, Xin
    Ma, Jiayi
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 413 - 416
  • [8] Hyperspectral Image Classification Based on Spectral-Spatial Attention Tensor Network
    Zhang, Wei-Tao
    Li, Yi-Bang
    Liu, Lu
    Bai, Yv
    Cui, Jian
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [9] SPECTRAL-SPATIAL MULTISCALE RESIDUAL NETWORK FOR HYPERSPECTRAL IMAGE CLASSIFICATION
    He, Shi
    Jing, Haitao
    Xue, Huazhu
    XXIV ISPRS CONGRESS: IMAGING TODAY, FORESEEING TOMORROW, COMMISSION III, 2022, 43-B3 : 389 - 395
  • [10] SSFAN: A Compact and Efficient Spectral-Spatial Feature Extraction and Attention-Based Neural Network for Hyperspectral Image Classification
    Wang, Chunyang
    Zhan, Chao
    Lu, Bibo
    Yang, Wei
    Zhang, Yingjie
    Wang, Gaige
    Zhao, Zongze
    REMOTE SENSING, 2024, 16 (22)