Spatial-Temporal Based Multihead Self-Attention for Remote Sensing Image Change Detection

被引:46
|
作者
Zhou, Yong [1 ,2 ]
Wang, Fengkai [1 ,2 ]
Zhao, Jiaqi [1 ,2 ,3 ]
Yao, Rui [1 ,2 ]
Chen, Silin [1 ,2 ]
Ma, Heping [4 ]
机构
[1] China Univ Min & Technol, Sch Comp Sci & Technol, Xuzhou 221116, Peoples R China
[2] Minist Educ Peoples Republ China, Engn Res Ctr Mine Digitizat, Xuzhou 221116, Peoples R China
[3] China Univ Min & Technol, Innovat Res Ctr Disaster Intelligent Prevent & Em, Xuzhou 221116, Peoples R China
[4] Shanghai Royal View Co Ltd, Shanghai 201803, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Remote sensing; Task analysis; Imaging; Transformers; Interference; Computer vision; Building change detection; deep learning; multi-scale; attention mechanism; CONVOLUTIONAL NEURAL-NETWORK; BUILDING CHANGE DETECTION; FUSION NETWORK;
D O I
10.1109/TCSVT.2022.3176055
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The neural network-based remote sensing image change detection method faces a large amount of imaging interference and severe class imbalance problems under high-resolution conditions, which bring new challenges to the accuracy of the detection network. In this work, to address the imaging interference caused by different imaging angles and times, the siamese strategy and multi-head self-attention mechanism are used to reduce the imaging differences between the dual-temporal images and fully exploit the inter-temporal information. Secondly, a learnable multi-part feature learning module is used to adaptively exploit features from different scales to obtain more comprehensive features. Finally, a mixed loss function strategy is used to ensure that the network converges effectively and excludes the adverse interference of a large number of negative samples to the network. Extensive experiments show that our method outperforms numerous methods on LEVIR-CD, WHU, and DSIFN datasets.
引用
收藏
页码:6615 / 6626
页数:12
相关论文
共 50 条
  • [1] A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection
    Chen, Hao
    Shi, Zhenwei
    REMOTE SENSING, 2020, 12 (10)
  • [2] Enhanced multihead self-attention block network for remote sensing image scene classification
    Li, Yijin
    Wang, Jiaxin
    Chen, Sibao
    Tang, Jin
    Luo, Bin
    JOURNAL OF APPLIED REMOTE SENSING, 2023, 17 (01) : 16517
  • [3] Lane Marker Detection Based on Multihead Self-Attention
    Shengli F.
    Yuzhi Z.
    Xiaohui B.
    Mobile Information Systems, 2023, 2023
  • [4] Spatial-Temporal Semantic Perception Network for Remote Sensing Image Semantic Change Detection
    He, You
    Zhang, Hanchao
    Ning, Xiaogang
    Zhang, Ruiqian
    Chang, Dong
    Hao, Minghui
    REMOTE SENSING, 2023, 15 (16)
  • [5] Optical Remote Sensing Image Cloud Detection with Self-Attention and Spatial Pyramid Pooling Fusion
    Pu, Weihua
    Wang, Zhipan
    Liu, Di
    Zhang, Qingling
    REMOTE SENSING, 2022, 14 (17)
  • [6] Self-attention module and FPN-based remote sensing image target detection
    Zhongyu Li
    Huajun Wang
    Hengfei Zhong
    Yuting Dai
    Arabian Journal of Geosciences, 2021, 14 (23)
  • [7] Enhanced Self-Attention Network for Remote Sensing Building Change Detection
    Liang, Shike
    Hua, Zhen
    Li, Jinjiang
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 4900 - 4915
  • [8] Spatial-Temporal Action Localization With Hierarchical Self-Attention
    Pramono, Rizard Renanda Adhi
    Chen, Yie-Tarng
    Fang, Wen-Hsien
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 625 - 639
  • [9] Remote sensing image recommendation based on spatial-temporal model
    Chen, Xu
    Liu, Yixian
    Li, Feng
    Li, Xiangxiang
    Jia, Xiangyang
    COMPUTERS & GEOSCIENCES, 2021, 157
  • [10] Joint Self-Attention for Remote Sensing Image Matching
    Li, Liangzhi
    Han, Ling
    Cao, Hongye
    Hu, Huijuan
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19