STNet: Spatial and Temporal feature fusion network for change detection in remote sensing images

被引:5
|
作者
Ma, Xiaowen [1 ]
Yang, Jiawei [1 ]
Hong, Tingfeng [1 ]
Ma, Mengting [1 ]
Zhao, Ziyan [1 ]
Feng, Tian [1 ,2 ]
Zhang, Wei [1 ]
机构
[1] Zhejiang Univ, Hangzhou, Peoples R China
[2] Alibaba Zhejiang Univ Joint Res Inst Frontier Tec, Hangzhou, Peoples R China
来源
2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME | 2023年
基金
中国国家自然科学基金;
关键词
Change Detection; Cross-temporal Gating Mechanism; Cross-scale Attention Mechanism;
D O I
10.1109/ICME55011.2023.00375
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As an important task in remote sensing image analysis, remote sensing change detection (RSCD) aims to identify changes of interest in a region from spatially co-registered multi-temporal remote sensing images, so as to monitor the local development. Existing RSCD methods usually formulate RSCD as a binary classification task, representing changes of interest by merely feature concatenation or feature subtraction and recovering the spatial details via densely connected change representations, whose performances need further improvement. In this paper, we propose STNet, a RSCD network based on spatial and temporal feature fusions. Specifically, we design a temporal feature fusion (TFF) module to combine bitemporal features using a cross-temporal gating mechanism for emphasizing changes of interest; a spatial feature fusion module is deployed to capture fine-grained information using a cross-scale attention mechanism for recovering the spatial details of change representations. Experimental results on three benchmark datasets for RSCD demonstrate that the proposed method achieves the state-of-the-art performance. Code is available at https://github.com/xwmaxwma/rschange.
引用
收藏
页码:2195 / 2200
页数:6
相关论文
共 50 条
  • [21] Dynamic Feature Fusion for Object Detection in Remote Sensing Images
    Xie, Xing-Xing
    Cheng, Gong
    Yao, Yan-Qing
    Yao, Xi-Wen
    Han, Jun-Wei
    Jisuanji Xuebao/Chinese Journal of Computers, 2022, 45 (04): : 735 - 747
  • [22] MAFF-Net: Multi-Attention Guided Feature Fusion Network for Change Detection in Remote Sensing Images
    Ma, Jinming
    Shi, Gang
    Li, Yanxiang
    Zhao, Ziyu
    SENSORS, 2022, 22 (03)
  • [23] A Full-Scale Feature Fusion Siamese Network for Remote Sensing Change Detection
    Zhou, Huaping
    Song, Minglong
    Sun, Kelei
    ELECTRONICS, 2023, 12 (01)
  • [24] Two-Level Feature Fusion Network for Remote Sensing Image Change Detection
    Feng, Mingyao
    Zhang, Ruifan
    Wang, Hao
    Liu, Yikun
    Yang, Gongping
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 8477 - 8489
  • [25] MFIHNet: Multiscale Feature Interaction Hybrid Network for Change Detection of Remote Sensing Images
    Cao, Lin
    Liu, Qi
    Tian, Shu
    Kang, Lihong
    Tian, Jing
    Xing, Xiangwei
    Du, Kangning
    Bian, Huanyu
    Song, Peiran
    Guo, Yanan
    Fan, Chunzhuo
    Fu, Chong
    Zhang, Ye
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 16672 - 16691
  • [26] Adversarial Feature Equilibrium Network for Multimodal Change Detection in Heterogeneous Remote Sensing Images
    Pu, Yan
    Gong, Maoguo
    Liu, Tongfei
    Zhang, Mingyang
    Gao, Tianqi
    Jiang, Fenlong
    Hu, Xiaobo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [27] A deeply supervised image fusion network for change detection in high resolution bi-temporal remote sensing images
    Zhang, Chenxiao
    Yue, Peng
    Tapete, Deodato
    Jiang, Liangcun
    Shangguan, Boyi
    Huang, Li
    Liu, Guangchao
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 166 : 183 - 200
  • [28] Change Detection in Multispectral Remote Sensing Images with Leader Intelligence PSO and NSCT Feature Fusion
    Paul, Josephina
    Shankar, B. Uma
    Bhattacharyya, Balaram
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2020, 9 (07)
  • [29] A Multi-Feature Fusion-Based Change Detection Method for Remote Sensing Images
    Cai, Liping
    Shi, Wenzhong
    Hao, Ming
    Zhang, Hua
    Gao, Lipeng
    JOURNAL OF THE INDIAN SOCIETY OF REMOTE SENSING, 2018, 46 (12) : 2015 - 2022
  • [30] A Multi-Feature Fusion-Based Change Detection Method for Remote Sensing Images
    Liping Cai
    Wenzhong Shi
    Ming Hao
    Hua Zhang
    Lipeng Gao
    Journal of the Indian Society of Remote Sensing, 2018, 46 : 2015 - 2022