Spatiotemporal Enhancement and Interlevel Fusion Network for Remote Sensing Images Change Detection

被引:50
|
作者
Huang, Yanyuan [1 ]
Li, Xinghua [1 ,2 ]
Du, Zhengshun [1 ]
Shen, Huanfeng [3 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Peoples R China
[2] Hubei Luojia Lab, Wuhan 430079, Peoples R China
[3] Wuhan Univ, Sch Resource & Environm Sci, Wuhan 430079, Peoples R China
关键词
Feature extraction; Spatiotemporal phenomena; Remote sensing; Decoding; Semantics; Location awareness; Deep learning; Change detection (CD); deep learning (DL); difference enhancement; feature fusion; remote sensing (RS); BUILDING CHANGE DETECTION; CONVOLUTIONAL NETWORK;
D O I
10.1109/TGRS.2024.3360516
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Remote sensing (RS) image change detection (CD) plays a crucial role in monitoring surface dynamics; however, current deep learning (DL)-based CD methods still suffer from pseudo changes and scale variations due to inadequate exploration of temporal differences and under-use of multiscale features. Based on the aforementioned considerations, a spatiotemporal enhancement and interlevel fusion network (SEIFNet) is proposed to improve the ability of feature representation for changing objects. First, the multilevel feature maps are acquired from the Siamese hierarchical backbone. To highlight the disparity in the same location at different times, the spatiotemporal difference enhancement modules (ST-DEMs) are introduced to capture global and local information from bitemporal feature maps at each level. Coordinate attention (CA) and cascaded convolutions are adopted in subtraction and connection branches, respectively. Then, an adaptive context fusion module (ACFM) is designed to integrate interlevel features under the guidance of different semantic information, constituting a progressive decoder. Additionally, a plain refinement module and a concise summation-based prediction head are employed to enhance the boundary details and internal integrity of CD results. The experimental results validate the superiority of our lightweight network over eight state-of-the-art (SOTA) methods on LEVIR-CD, SYSU-CD, and WHU-CD datasets, both in accuracy and efficiency. Also, the effects of different types of backbones and differential enhancement modules are discussed in the ablation experiments in detail. The code will be available at https://github.com/lixinghua5540/SEIFNet.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 50 条
  • [21] STANET: SPATIOTEMPORAL ADAPTIVE NETWORK FOR REMOTE SENSING IMAGES
    Hu, Chenlu
    Ma, Mengting
    Ma, Xiaowen
    Zhang, Huanting
    Wu, Dun
    Gao, Guang
    Zhang, Wei
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 3429 - 3433
  • [22] Adaptive Differentiation Siamese Fusion Network for Remote Sensing Change Detection
    Zhang, Yunzuo
    Zhen, Jiawen
    Liu, Ting
    Yang, Yuehui
    Cheng, Yu
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2025, 22
  • [23] Remote Sensing Images Mosaicking Method Based on Spatiotemporal Fusion
    He Chaoqi
    Li Qize
    Liu Hualin
    Wei Jingbo
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (14)
  • [24] Multilevel feature aggregation and enhancement network for remote sensing change detection
    Yan, Wenkai
    Liu, Yikun
    Li, Mingsong
    Zhang, Ruifan
    Yang, Gongping
    JOURNAL OF APPLIED REMOTE SENSING, 2024, 18 (01)
  • [25] Spatiotemporal Fusion With Only Two Remote Sensing Images as Input
    Wu, Jingan
    Cheng, Qing
    Li, Huifang
    Li, Shuang
    Guan, Xiaobin
    Shen, Huanfeng
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 : 6206 - 6219
  • [26] FastSAM-based Change Detection Network for Remote Sensing Images
    Kong, Xiangshuo
    Wang, Jiapeng
    Shen, Jiaxiao
    Ling, Zaiying
    Jing, Changwei
    Zhang, Dengrong
    Hu, Zunying
    2024 5TH INTERNATIONAL CONFERENCE ON GEOLOGY, MAPPING AND REMOTE SENSING, ICGMRS 2024, 2024, : 53 - 58
  • [27] FRCD: Feature Refine Change Detection Network for Remote Sensing Images
    Wang, Zhewei
    Pan, Zongxu
    Hu, Yuxin
    Lei, Bin
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [28] Change Detection in Multispectral Remote Sensing Images Based on Optimized Fusion of Subspaces
    Chen, Yuanyuan
    Zhang, Jianlong
    Gao, Xinbo
    INTELLIGENCE SCIENCE AND BIG DATA ENGINEERING, 2018, 11266 : 528 - 538
  • [29] Adaptive Fusion NestedUNet for Change Detection Using Optical Remote Sensing Images
    Li, Junwei
    Li, Shijie
    Wang, Feng
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 5374 - 5386
  • [30] Change Detection in Heterogeneous Remote Sensing Images Based on the Fusion of Pixel Transformation
    Liu, Zhun-ga
    Zhang, Li
    Lie, Gang
    He, You
    2017 20TH INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION), 2017, : 263 - 268