DDF: A Novel Dual-Domain Image Fusion Strategy for Remote Sensing Image Semantic Segmentation With Unsupervised Domain Adaptation

被引:3
|
作者
Ran, Lingyan [1 ,2 ]
Wang, Lushuang [1 ,2 ]
Zhuo, Tao [3 ]
Xing, Yinghui [1 ,2 ]
Zhang, Yanning [1 ,2 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Shaanxi Prov Key Lab Speech & Image Informat Proc, Xian 710072, Peoples R China
[2] Northwestern Polytech Univ, Sch Comp Sci, Natl Engn Lab Integrated Aerosp Ground Ocean Big D, Xian 710072, Peoples R China
[3] Northwest A&F Univ, Coll Informat Engn, Yangling 712100, Xianyang, Peoples R China
基金
中国国家自然科学基金;
关键词
Training; Adaptation models; Remote sensing; Semantic segmentation; Task analysis; Accuracy; Semantics; Domain adaptation; feature fusion; semantic segmentation;
D O I
10.1109/TGRS.2024.3433564
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The semantic segmentation of remote sensing (RS) images is a challenging and hot issue due to the large amount of unlabeled data and domain variation. Unsupervised domain adaptation (UDA) has proven to be advantageous in leveraging unlabeled information from the target domain. However, traditional approaches of independently fine-tuning UDA models in the source and target domains have a limited effect on the result. In this article, we propose a hybrid training strategy that boosts self-training methods with domain fusion images. First, we introduce a novel dual-domain image fusion (DDF) strategy to effectively utilize the original image, the style-transferred image, and the intermediate-domain information. Second, to further refine the precision of pseudolabels, we present a region-specific reweighting strategy that assigns different weights to pseudolabel regions based on their spatial context. Finally, we conduct a series of extensive benchmark experiments and ablation studies on the ISPRS Vaihingen and Potsdam datasets. These results show the efficiency of our approach and establish a practical basis for implementing semantic segmentation in remote sensors.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] DDRNet: Dual-Domain Refinement Network for Remote Sensing Image Semantic Segmentation
    Yang, Zhenhao
    Bi, Fukun
    Hou, Xinghai
    Zhou, Dehao
    Wang, Yanping
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 20177 - 20189
  • [2] Decomposition-Based Unsupervised Domain Adaptation for Remote Sensing Image Semantic Segmentation
    Ma, Xianping
    Zhang, Xiaokang
    Ding, Xingchen
    Pun, Man-On
    Ma, Siwei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [3] Unsupervised Domain Adaptation for Remote Sensing Image Semantic Segmentation Using Region and Category Adaptive Domain Discriminator
    Chen, Xiaoshu
    Pan, Shaoming
    Chong, Yanwen
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [4] Unsupervised Domain Adaptation for Remote Sensing Semantic Segmentation with Transformer
    Li, Weitao
    Gao, Hui
    Su, Yi
    Momanyi, Biffon Manyura
    REMOTE SENSING, 2022, 14 (19)
  • [5] Unsupervised Domain Adaptation for the Semantic Segmentation of Remote Sensing Images via One-Shot Image-to-Image Translation
    Ismael, Sarmad F.
    Kayabol, Koray
    Aptoula, Erchan
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [6] A multiscale fuzzy dual-domain attention network for urban remote sensing image segmentation
    Chong, Qianpeng
    Xu, Jindong
    Jia, Fei
    Liu, Zhaowei
    Yan, Weiqing
    Wang, Xuan
    Song, Yongchao
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2022, 43 (14) : 5480 - 5501
  • [7] Unsupervised global-local domain adaptation with self-training for remote sensing image semantic segmentation
    Zhang, Junbo
    Li, Zhiyong
    Wang, Mantao
    Li, Kunhong
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2025, 46 (05) : 2254 - 2284
  • [8] Unsupervised Domain Adaptation with Dual-Scheme Fusion Network for Medical Image Segmentation
    Zou, Danbing
    Zhu, Qikui
    Yan, Pingkun
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 3291 - 3298
  • [9] DOCNet: Dual-Domain Optimized Class-Aware Network for Remote Sensing Image Segmentation
    Ma, Xiaowen
    Che, Rui
    Wang, Xinyu
    Ma, Mengting
    Wu, Sensen
    Feng, Tian
    Zhang, Wei
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [10] Dual-Domain Fusion Network Based on Wavelet Frequency Decomposition and Fuzzy Spatial Constraint for Remote Sensing Image Segmentation
    Wei, Guangyi
    Xu, Jindong
    Yan, Weiqing
    Chong, Qianpeng
    Xing, Haihua
    Ni, Mengying
    REMOTE SENSING, 2024, 16 (19)