Heterogeneous Image Change Detection Based on Dual Image Translation and Dual Contrastive Learning

被引:2
|
作者
Ma, Zongfang [1 ]
Wang, Ruiqi [1 ]
Hao, Fan [2 ]
Song, Lin [1 ]
机构
[1] Xian Univ Architecture & Technol, Sch Informat & Control Engn, Xian 710055, Peoples R China
[2] Beijing Univ Posts & Telecommun, Sch Integrated Circuits, Beijing 100876, Peoples R China
基金
中国国家自然科学基金;
关键词
Task analysis; Feature extraction; Image reconstruction; Optical imaging; Representation learning; Optical sensors; Image sensors; Contrastive learning; heterogeneous change detection (CD); image translation; multiscale feature; REMOTE-SENSING IMAGES; UNSUPERVISED CHANGE DETECTION; SAR; CLASSIFICATION; NETWORK;
D O I
10.1109/TGRS.2024.3402391
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Nowadays, remote sensing (RS) change detection (CD) plays an important role in Earth observation applications. Recently, the value of cross-modal CD has gradually emerged because of the complementary features in content. However, existing domain adaption-based methods are generally limited to the optical domain and suffer from imbalanced information between modalities. In this article, a novel CD method based on dual image translation and dual contrastive learning (C3D) is proposed for heterogeneous RS images, including a translation module and a CD module. First, the translation module aims to learn a comparable representation between the different domains through a C3D structure based on feature samples, which can break the consistency constraint and better solve the imbalanced information. Then the similarity metric of patches is compared by contextual features at different scales in the CD module to achieve a more accurate classification of changed and unchanged pixels. The C3D is compared with state-of-the-art methods and validated by the basic experimental results on five datasets. In addition, further experiments on the translation module were also performed to explore the effectiveness of contrastive learning in the CD task.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 50 条
  • [31] Multi-feature contrastive learning for unpaired image-to-image translation
    Yao Gou
    Min Li
    Yu Song
    Yujie He
    Litao Wang
    Complex & Intelligent Systems, 2023, 9 : 4111 - 4122
  • [32] DueT: Image-Text Contrastive Transfer Learning with Dual-adapter Tuning
    Hasegawa, Taku
    Nishida, Kyosuke
    Maeda, Koki
    Saito, Kuniko
    2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2023), 2023, : 13607 - 13624
  • [33] DueT: Image-Text Contrastive Transfer Learning with Dual-adapter Tuning
    Hasegawa, Taku
    Nishida, Kyosuke
    Maeda, Koki
    Saito, Kuniko
    EMNLP 2023 - 2023 Conference on Empirical Methods in Natural Language Processing, Proceedings, 2023, : 13607 - 13624
  • [34] HETEROGENEOUS IMAGE CHANGE DETECTION BASED ON TWO-STAGE JOINT FEATURE LEARNING
    Han, Te
    Tang, Yuqi
    Chen, Yuzeng
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 3215 - 3218
  • [35] Dual Heterogeneous Network for Hyperspectral Image Classification
    Jin, Mingxin
    Wang, Cong
    Yuan, Yuan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (03) : 2905 - 2917
  • [36] Transformer-based contrastive learning framework for image anomaly detection
    Wentao Fan
    Weimin Shangguan
    Yewang Chen
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 3413 - 3426
  • [37] Patch-Wise Graph Contrastive Learning for Image Translation
    Jung, Chanyong
    Kwon, Gihyun
    Ye, Jong Chul
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 12, 2024, : 13013 - 13021
  • [38] Transformer-based contrastive learning framework for image anomaly detection
    Fan, Wentao
    Shangguan, Weimin
    Chen, Yewang
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (10) : 3413 - 3426
  • [39] Aerial image change detection using dual regions of interest networks
    Han, Pengcheng
    Ma, Cunbao
    Li, Qing
    Leng, Pengyu
    Bu, Shuhui
    Li, Ke
    NEUROCOMPUTING, 2019, 349 : 190 - 201
  • [40] Dual Contrastive Learning for General Face Forgery Detection
    Sun, Ke
    Yao, Taiping
    Chen, Shen
    Ding, Shouhong
    Li, Jilin
    Ji, Rongrong
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 2316 - 2324