Heterogeneous Image Change Detection Based on Dual Image Translation and Dual Contrastive Learning

被引:2
|
作者
Ma, Zongfang [1 ]
Wang, Ruiqi [1 ]
Hao, Fan [2 ]
Song, Lin [1 ]
机构
[1] Xian Univ Architecture & Technol, Sch Informat & Control Engn, Xian 710055, Peoples R China
[2] Beijing Univ Posts & Telecommun, Sch Integrated Circuits, Beijing 100876, Peoples R China
基金
中国国家自然科学基金;
关键词
Task analysis; Feature extraction; Image reconstruction; Optical imaging; Representation learning; Optical sensors; Image sensors; Contrastive learning; heterogeneous change detection (CD); image translation; multiscale feature; REMOTE-SENSING IMAGES; UNSUPERVISED CHANGE DETECTION; SAR; CLASSIFICATION; NETWORK;
D O I
10.1109/TGRS.2024.3402391
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Nowadays, remote sensing (RS) change detection (CD) plays an important role in Earth observation applications. Recently, the value of cross-modal CD has gradually emerged because of the complementary features in content. However, existing domain adaption-based methods are generally limited to the optical domain and suffer from imbalanced information between modalities. In this article, a novel CD method based on dual image translation and dual contrastive learning (C3D) is proposed for heterogeneous RS images, including a translation module and a CD module. First, the translation module aims to learn a comparable representation between the different domains through a C3D structure based on feature samples, which can break the consistency constraint and better solve the imbalanced information. Then the similarity metric of patches is compared by contextual features at different scales in the CD module to achieve a more accurate classification of changed and unchanged pixels. The C3D is compared with state-of-the-art methods and validated by the basic experimental results on five datasets. In addition, further experiments on the translation module were also performed to explore the effectiveness of contrastive learning in the CD task.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 50 条
  • [1] Dual Contrastive Learning for Unsupervised Image-to-Image Translation
    Han, Junlin
    Shoeiby, Mehrdad
    Petersson, Lars
    Armin, Mohammad Ali
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 746 - 755
  • [2] Spectral normalization and dual contrastive regularization for image-to-image translation
    Zhao, Chen
    Cai, Wei-Ling
    Yuan, Zheng
    VISUAL COMPUTER, 2025, 41 (01): : 129 - 140
  • [3] DualGAN: Unsupervised Dual Learning for Image-to-Image Translation
    Yi, Zili
    Zhang, Hao
    Tan, Ping
    Gong, Minglun
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 2868 - 2876
  • [4] Dual contrastive learning based image-to-image translation of unstained skin tissue into virtually stained H&E images
    Asaf, Muhammad Zeeshan
    Rao, Babar
    Akram, Muhammad Usman
    Khawaja, Sajid Gul
    Khan, Samavia
    Truong, Thu Minh
    Sekhon, Palveen
    Khan, Irfan J.
    Abbasi, Muhammad Shahmir
    SCIENTIFIC REPORTS, 2024, 14 (01)
  • [5] CTACL:HYPERSPECTRAL IMAGE CHANGE DETECTION BASED ON ADAPTIVE CONTRASTIVE LEARNING
    Tian, Shunli
    Zhang, Xiangrong
    Wang, Guanchun
    Han, Xiao
    Chen, Puhua
    Cheng, Xina
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 7340 - 7343
  • [6] Contrastive learning for unsupervised image-to-image translation
    Lee, Hanbit
    Seol, Jinseok
    Lee, Sang-goo
    Park, Jaehui
    Shim, Junho
    APPLIED SOFT COMPUTING, 2024, 151
  • [7] Unsupervised Change Detection from Heterogeneous Data Based on Image Translation
    Liu, Zhun-Ga
    Zhang, Zuo-Wei
    Pan, Quan
    Ning, Liang-Bo
    IEEE Transactions on Geoscience and Remote Sensing, 2022, 60
  • [8] Unsupervised Change Detection From Heterogeneous Data Based on Image Translation
    Liu, Zhun-Ga
    Zhang, Zuo-Wei
    Pan, Quan
    Ning, Liang-Bo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [9] Unpaired Deep Image Deraining Using Dual Contrastive Learning
    Chen, Xiang
    Pan, Jinshan
    Jiang, Kui
    Li, Yufeng
    Huang, Yufeng
    Kong, Caihua
    Dai, Longgang
    Fan, Zhentao
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 2007 - 2016
  • [10] HETEROGENEOUS IMAGE CHANGE DETECTION BASED ON DEEP IMAGE TRANSLATION AND FEATURE REFINEMENT-AGGREGATION
    Zhao, Tianrui
    Wang, Lu
    Zhao, Chunhui
    Liu, Tian
    Ohtsuki, Tomoaki
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1705 - 1709