STNet: Spatial and Temporal feature fusion network for change detection in remote sensing images

被引:5
|
作者
Ma, Xiaowen [1 ]
Yang, Jiawei [1 ]
Hong, Tingfeng [1 ]
Ma, Mengting [1 ]
Zhao, Ziyan [1 ]
Feng, Tian [1 ,2 ]
Zhang, Wei [1 ]
机构
[1] Zhejiang Univ, Hangzhou, Peoples R China
[2] Alibaba Zhejiang Univ Joint Res Inst Frontier Tec, Hangzhou, Peoples R China
来源
2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME | 2023年
基金
中国国家自然科学基金;
关键词
Change Detection; Cross-temporal Gating Mechanism; Cross-scale Attention Mechanism;
D O I
10.1109/ICME55011.2023.00375
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As an important task in remote sensing image analysis, remote sensing change detection (RSCD) aims to identify changes of interest in a region from spatially co-registered multi-temporal remote sensing images, so as to monitor the local development. Existing RSCD methods usually formulate RSCD as a binary classification task, representing changes of interest by merely feature concatenation or feature subtraction and recovering the spatial details via densely connected change representations, whose performances need further improvement. In this paper, we propose STNet, a RSCD network based on spatial and temporal feature fusions. Specifically, we design a temporal feature fusion (TFF) module to combine bitemporal features using a cross-temporal gating mechanism for emphasizing changes of interest; a spatial feature fusion module is deployed to capture fine-grained information using a cross-scale attention mechanism for recovering the spatial details of change representations. Experimental results on three benchmark datasets for RSCD demonstrate that the proposed method achieves the state-of-the-art performance. Code is available at https://github.com/xwmaxwma/rschange.
引用
收藏
页码:2195 / 2200
页数:6
相关论文
共 50 条
  • [41] Hierarchical Attention Feature Fusion-Based Network for Land Cover Change Detection With Homogeneous and Heterogeneous Remote Sensing Images
    Lv, ZhiYong
    Liu, Jie
    Sun, Weiwei
    Lei, Tao
    Benediktsson, Jon Atli
    Jia, Xiuping
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [42] DCFF-Net: A Densely Connected Feature Fusion Network for Change Detection in High-Resolution Remote Sensing Images
    Pan, Fei
    Wu, Zebin
    Liu, Qian
    Xu, Yang
    Wei, Zhihui
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 11974 - 11985
  • [43] FSANet: Feature-and-Spatial-Aligned Network for Tiny Object Detection in Remote Sensing Images
    Wu, Jixiang
    Pan, Zongxu
    Lei, Bin
    Hu, Yuxin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [44] FFPNet: Fine-Grained Feature Perception Network for Semantic Change Detection on Bi-Temporal Remote Sensing Images
    Zhang, Fengwei
    Xia, Kai
    Yin, Jianxin
    Deng, Susu
    Feng, Hailin
    REMOTE SENSING, 2024, 16 (21)
  • [45] Multi-scale feature progressive fusion network for remote sensing image change detection
    Lu, Di
    Cheng, Shuli
    Wang, Liejun
    Song, Shiji
    SCIENTIFIC REPORTS, 2022, 12 (01)
  • [46] EDGE-GUIDED FEATURE DENSE FUSION NETWORK FOR REMOTE SENSING IMAGE CHANGE DETECTION
    Luo, Hejun
    Liu, Jia
    Liu, Fang
    Zhang, Wenhua
    Yang, Jingxiang
    Xiao, Liang
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 6684 - 6687
  • [47] Multi-scale feature progressive fusion network for remote sensing image change detection
    Di Lu
    Shuli Cheng
    Liejun Wang
    Shiji Song
    Scientific Reports, 12
  • [48] Feature Decomposition-Optimization-Reorganization Network for Building Change Detection in Remote Sensing Images
    Ye, Yuanxin
    Zhou, Liang
    Zhu, Bai
    Yang, Chao
    Sun, Miaomiao
    Fan, Jianwei
    Fu, Zhitao
    REMOTE SENSING, 2022, 14 (03)
  • [49] Change Detection in Heterogeneous Optical and SAR Remote Sensing Images Via Deep Homogeneous Feature Fusion
    Jiang, Xiao
    Li, Gang
    Liu, Yu
    Zhang, Xiao-Ping
    He, You
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 (13) : 1551 - 1566
  • [50] Change Detection in Bitemporal Remote Sensing Images by using Feature Fusion and Fuzzy C-Means
    Wang, Xin
    Huang, Jing
    Chu, Yanli
    Shi, Aiye
    Xu, Lizhong
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2018, 12 (04): : 1714 - 1729