MPS2L: Mutual Prediction Self-Supervised Learning for Remote Sensing Image Change Detection

被引:0
|
作者
Wang, Qingwang [1 ,2 ]
Qiu, Yujie [1 ,2 ]
Jin, Pengcheng [1 ,2 ]
Shen, Tao [1 ,2 ]
Gu, Yanfeng [3 ,4 ]
机构
[1] Kunming Univ Sci & Technol, Fac Informat Engn & Automat, Kunming 650500, Peoples R China
[2] Kunming Univ Sci & Technol, Yunnan Key Lab Comp Technol Applicat, Kunming 650500, Peoples R China
[3] Harbin Inst Technol, Sch Elect & Informat Engn, Harbin 150001, Peoples R China
[4] Heilongjiang Prov Key Lab Space Air Ground Integra, Harbin 150001, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Transformers; Remote sensing; Training; Decoding; Image reconstruction; Predictive models; Attention mechanism; masked image modeling (MIM); remote sensing (RS) image change detection (CD); self-supervised learning; BUILDING CHANGE DETECTION; TIME-SERIES; CLASSIFICATION; TRANSFORMERS; DATASET; NETWORK;
D O I
10.1109/TGRS.2024.3468008
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
In this article, we propose a novel mutual prediction self-supervised learning (MPS2L) method for remote sensing (RS) image change detection (CD). Compared with the previous self-supervised CD methods based on contrastive learning (CL), MPS2L employing a pixel-level training strategy based on masked image modeling (MIM) can effectively train the model to interpret the local scene of RS images. Utilizing global and local scenes and temporal change features extracted from masked bitemporal images to achieve cross-temporal mutual prediction makes the model have the ability to understand the overall observation scene and capture the change information. The training of the two abilities is carried out simultaneously, avoiding the problem of multiobjective conflict or mutual inhibition. To better focus on the changing regions in RS scenes, we further introduce a change feature interaction module (CFIM), comprising spatial and channel feature interaction. The channel interaction module (CIM) can facilitate the cross-temporal transmission of global scene information by channel attention, and the spatial interaction module (SIM) can promote the network to capture information on changing regions by spatial attention. The experimental results on three benchmark RS CD datasets demonstrate the effectiveness and priority of our proposed MPS2L compared to some existing state-of-the-art (SOTA) methods. The source code of the proposed MPS2L will be made available publicly at https://github.com/KustTeamWQW/MPS2L.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] Learning From Self-Supervised Features for Hashing-Based Remote Sensing Image Retrieval
    Tang, Jiayi
    Wang, Dali
    Tong, Xiaochong
    Qiu, Chunping
    Yang, Weiming
    Lei, Yi
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [32] Self-supervised Learning for Anomaly Detection in Fundus Image
    Ahn, Sangil
    Shin, Jitae
    OPHTHALMIC MEDICAL IMAGE ANALYSIS, OMIA 2022, 2022, 13576 : 143 - 151
  • [33] Deep Contrastive Self-Supervised Hashing for Remote Sensing Image Retrieval
    Tan, Xiaoyan
    Zou, Yun
    Guo, Ziyang
    Zhou, Ke
    Yuan, Qiangqiang
    REMOTE SENSING, 2022, 14 (15)
  • [34] Semisupervised image classification by mutual learning of multiple self-supervised models
    Zhang, Jian
    Yang, Jianing
    Yu, Jun
    Fan, Jianping
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2022, 37 (05) : 3117 - 3141
  • [35] Self-supervised representation learning for SAR change detection
    Davis, Eric K.
    Houglund, Ian
    Franz, Douglas
    Allen, Michael
    ALGORITHMS FOR SYNTHETIC APERTURE RADAR IMAGERY XXX, 2023, 12520
  • [36] RAPID WILDFIRE HOTSPOT DETECTION USING SELF-SUPERVISED LEARNING ON TEMPORAL REMOTE SENSING DATA
    Barco, Luca
    Urbanelli, Angelica
    Rossi, Claudio
    IGARSS 2024-2024 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, IGARSS 2024, 2024, : 2061 - 2065
  • [37] TD-SSCD: A Novel Network by Fusing Temporal and Differential Information for Self-Supervised Remote Sensing Image Change Detection
    Qu, Yang
    Li, Jiayi
    Huang, Xin
    Wen, Dawei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [38] Uncertainty-Aware Graph Self-Supervised Learning for Hyperspectral Image Change Detection
    Jian, Ping
    Ou, Yimin
    Chen, Keming
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 19
  • [39] A Hyperspectral Image Change Detection Framework With Self-Supervised Contrastive Learning Pretrained Model
    Ou, Xianfeng
    Liu, Liangzhen
    Tan, Shulun
    Zhang, Guoyun
    Li, Wujing
    Tu, Bing
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 7724 - 7740
  • [40] Semi- and Self-Supervised Metric Learning for Remote Sensing Applications
    Hernandez-Sequeira, Itza
    Fernandez-Beltran, Ruben
    Pla, Filiberto
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5