MPS2L: Mutual Prediction Self-Supervised Learning for Remote Sensing Image Change Detection

被引:0
|
作者
Wang, Qingwang [1 ,2 ]
Qiu, Yujie [1 ,2 ]
Jin, Pengcheng [1 ,2 ]
Shen, Tao [1 ,2 ]
Gu, Yanfeng [3 ,4 ]
机构
[1] Kunming Univ Sci & Technol, Fac Informat Engn & Automat, Kunming 650500, Peoples R China
[2] Kunming Univ Sci & Technol, Yunnan Key Lab Comp Technol Applicat, Kunming 650500, Peoples R China
[3] Harbin Inst Technol, Sch Elect & Informat Engn, Harbin 150001, Peoples R China
[4] Heilongjiang Prov Key Lab Space Air Ground Integra, Harbin 150001, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Transformers; Remote sensing; Training; Decoding; Image reconstruction; Predictive models; Attention mechanism; masked image modeling (MIM); remote sensing (RS) image change detection (CD); self-supervised learning; BUILDING CHANGE DETECTION; TIME-SERIES; CLASSIFICATION; TRANSFORMERS; DATASET; NETWORK;
D O I
10.1109/TGRS.2024.3468008
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
In this article, we propose a novel mutual prediction self-supervised learning (MPS2L) method for remote sensing (RS) image change detection (CD). Compared with the previous self-supervised CD methods based on contrastive learning (CL), MPS2L employing a pixel-level training strategy based on masked image modeling (MIM) can effectively train the model to interpret the local scene of RS images. Utilizing global and local scenes and temporal change features extracted from masked bitemporal images to achieve cross-temporal mutual prediction makes the model have the ability to understand the overall observation scene and capture the change information. The training of the two abilities is carried out simultaneously, avoiding the problem of multiobjective conflict or mutual inhibition. To better focus on the changing regions in RS scenes, we further introduce a change feature interaction module (CFIM), comprising spatial and channel feature interaction. The channel interaction module (CIM) can facilitate the cross-temporal transmission of global scene information by channel attention, and the spatial interaction module (SIM) can promote the network to capture information on changing regions by spatial attention. The experimental results on three benchmark RS CD datasets demonstrate the effectiveness and priority of our proposed MPS2L compared to some existing state-of-the-art (SOTA) methods. The source code of the proposed MPS2L will be made available publicly at https://github.com/KustTeamWQW/MPS2L.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Self-Supervised Representation Learning for Remote Sensing Image Change Detection Based on Temporal Prediction
    Dong, Huihui
    Ma, Wenping
    Wu, Yue
    Zhang, Jun
    Jiao, Licheng
    REMOTE SENSING, 2020, 12 (11)
  • [2] TASK-RELATED SELF-SUPERVISED LEARNING FOR REMOTE SENSING IMAGE CHANGE DETECTION
    Cai, Zhinan
    Jiang, Zhiyu
    Yuan, Yuan
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1535 - 1539
  • [3] Multicue Contrastive Self-Supervised Learning for Change Detection in Remote Sensing
    Yang, Meijuan
    Jiao, Licheng
    Liu, Fang
    Hou, Biao
    Yang, Shuyuan
    Zhang, Yake
    Wang, Jianlong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61 : 1 - 14
  • [4] Self-Supervised Learning in Remote Sensing
    Wang, Yi
    Albrecht, Conrad M.
    Ait Ali Braham, Nassim
    Mou, Lichao
    Zhu, Xiao Xiang
    IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE, 2022, 10 (04) : 213 - 247
  • [5] Self-Supervised Change Detection in Multiview Remote Sensing Images
    Chen, Yuxing
    Bruzzone, Lorenzo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [6] Remote sensing image intelligent interpretation: from supervised learning to self-supervised learning
    Tao C.
    Yin Z.
    Zhu Q.
    Li H.
    Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2021, 50 (08): : 1122 - 1134
  • [7] SELF-SUPERVISED REMOTE SENSING IMAGE RETRIEVAL
    Walter, Kane
    Gibson, Matthew J.
    Sowmya, Arcot
    IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 1683 - 1686
  • [8] Self-supervised multimodal change detection based on difference contrast learning for remote sensing imagery
    Hou, Xuan
    Bai, Yunpeng
    Xie, Yefan
    Zhang, Yunfeng
    Fu, Lei
    Li, Ying
    Shang, Changjing
    Shen, Qiang
    PATTERN RECOGNITION, 2025, 159
  • [9] A Self-Supervised Learning Method for Shadow Detection in Remote Sensing Imagery
    Yin, Shoulin
    Liu, Jie
    Li, Hang
    3D RESEARCH, 2018, 9 (04)
  • [10] SELF-SUPERVISED CONFIDENT LEARNING FOR HYPERSPECTRAL IMAGE CHANGE DETECTION
    Wu, Haonan
    Chen, Zhao
    2022 12TH WORKSHOP ON HYPERSPECTRAL IMAGING AND SIGNAL PROCESSING: EVOLUTION IN REMOTE SENSING (WHISPERS), 2022,