Spatial-Temporal Based Multihead Self-Attention for Remote Sensing Image Change Detection

被引:46
|
作者
Zhou, Yong [1 ,2 ]
Wang, Fengkai [1 ,2 ]
Zhao, Jiaqi [1 ,2 ,3 ]
Yao, Rui [1 ,2 ]
Chen, Silin [1 ,2 ]
Ma, Heping [4 ]
机构
[1] China Univ Min & Technol, Sch Comp Sci & Technol, Xuzhou 221116, Peoples R China
[2] Minist Educ Peoples Republ China, Engn Res Ctr Mine Digitizat, Xuzhou 221116, Peoples R China
[3] China Univ Min & Technol, Innovat Res Ctr Disaster Intelligent Prevent & Em, Xuzhou 221116, Peoples R China
[4] Shanghai Royal View Co Ltd, Shanghai 201803, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Remote sensing; Task analysis; Imaging; Transformers; Interference; Computer vision; Building change detection; deep learning; multi-scale; attention mechanism; CONVOLUTIONAL NEURAL-NETWORK; BUILDING CHANGE DETECTION; FUSION NETWORK;
D O I
10.1109/TCSVT.2022.3176055
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The neural network-based remote sensing image change detection method faces a large amount of imaging interference and severe class imbalance problems under high-resolution conditions, which bring new challenges to the accuracy of the detection network. In this work, to address the imaging interference caused by different imaging angles and times, the siamese strategy and multi-head self-attention mechanism are used to reduce the imaging differences between the dual-temporal images and fully exploit the inter-temporal information. Secondly, a learnable multi-part feature learning module is used to adaptively exploit features from different scales to obtain more comprehensive features. Finally, a mixed loss function strategy is used to ensure that the network converges effectively and excludes the adverse interference of a large number of negative samples to the network. Extensive experiments show that our method outperforms numerous methods on LEVIR-CD, WHU, and DSIFN datasets.
引用
收藏
页码:6615 / 6626
页数:12
相关论文
共 50 条
  • [21] Time series classification of remote sensing data based on temporal self-attention mechanism
    Zhang W.
    Tang P.
    Zhang Z.
    National Remote Sensing Bulletin, 2023, 27 (08) : 1914 - 1924
  • [22] STRobustNet: Efficient Change Detection via Spatial-Temporal Robust Representations in Remote Sensing
    Zhang, Hong
    Teng, Yuhang
    Li, Haojie
    Wang, Zhihui
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [23] Spatial-Temporal Context-Aware Location Prediction Based on Bidirectional Self-Attention Network
    Lin, Kuijie
    Chen, Junxin
    Lian, Xiaoqin
    Mai, Weimin
    Guo, Zhiheng
    Chen, Xiang
    Hsu, Terng-Yin
    2022 14TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING, WCSP, 2022, : 701 - 706
  • [24] Parallel Spatial-Temporal Self-Attention CNN-Based Motor Imagery Classification for BCI
    Liu, Xiuling
    Shen, Yonglong
    Liu, Jing
    Yang, Jianli
    Xiong, Peng
    Lin, Feng
    FRONTIERS IN NEUROSCIENCE, 2020, 14
  • [25] Enhancing Deepfake Detection: Spatial-Temporal Preprocessing and Self-Attention ResI3D Model
    Sangho, Son
    Jaekyu, Lee
    Kyungha, Min
    Kim, Wooju
    PROCEEDINGS OF 2023 6TH ARTIFICIAL INTELLIGENCE AND CLOUD COMPUTING CONFERENCE, AICCC 2023, 2023, : 27 - 35
  • [26] Spatial-Temporal Self-Attention Transformer Networks for Battery State of Charge Estimation
    Shi, Dapai
    Zhao, Jingyuan
    Wang, Zhenghong
    Zhao, Heng
    Wang, Junbin
    Lian, Yubo
    Burke, Andrew F.
    ELECTRONICS, 2023, 12 (12)
  • [27] Small Object Detection in Remote Sensing Images Based on Window Self-Attention Mechanism
    Xu, Jiaxin
    Zhang, Qiao
    Liu, Yu
    Zheng, Mengting
    PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2023, 89 (08): : 489 - 497
  • [28] STSANet: Retinal Vessel Segmentation via Spatial-Temporal and Self-Attention Encoding
    Huang, Yi
    Deng, Tao
    2022 14TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING, WCSP, 2022, : 132 - 137
  • [29] Spatial-temporal Analysis of Land Use Change in County Level Based on Remote Sensing
    Lin, Hui
    Du, Peijun
    Pei, Liu
    Zhang, Lianpeng
    Sun, Huasheng
    2010 18TH INTERNATIONAL CONFERENCE ON GEOINFORMATICS, 2010,
  • [30] CSANet: a channel-spatial attention network for remote sensing image change detection
    Cai, Yuyang
    Liao, Shuhong
    He, Wenxuan
    Huang, Weiliang
    Yan, Jingwen
    Liu, Lei
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2023, 44 (19) : 5936 - 5959