Enhancing Semi-Supervised Semantic Segmentation of Remote Sensing Images via Feature Perturbation-Based Consistency Regularization Methods

被引:6
|
作者
Xin, Yi [1 ]
Fan, Zide [1 ]
Qi, Xiyu [1 ]
Geng, Ying [1 ]
Li, Xinming [2 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Target Cognit & Applicat Technol, Beijing 100190, Peoples R China
[2] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100190, Peoples R China
关键词
remote sensing; semantic segmentation; semi-supervised learning; consistency regularization; feature perturbation; contrastive learning; CLASSIFICATION; NETWORK;
D O I
10.3390/s24030730
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In the field of remote sensing technology, the semantic segmentation of remote sensing images carries substantial importance. The creation of high-quality models for this task calls for an extensive collection of image data. However, the manual annotation of these images can be both time-consuming and labor-intensive. This has catalyzed the advent of semi-supervised semantic segmentation methodologies. Yet, the complexities inherent within the foreground categories of these remote sensing images present challenges in preserving prediction consistency. Moreover, remote sensing images possess more complex features, and different categories are confused within the feature space, making optimization based on the feature space challenging. To enhance model consistency and to optimize feature-based class categorization, this paper introduces a novel semi-supervised semantic segmentation framework based on Mean Teacher (MT). Unlike the conventional Mean Teacher that only introduces perturbations at the image level, we incorporate perturbations at the feature level. Simultaneously, to maintain consistency after feature perturbation, we employ contrastive learning for feature-level learning. In response to the complex feature space of remote sensing images, we utilize entropy threshold to assist contrastive learning, selecting feature key-values more precisely, thereby enhancing the accuracy of segmentation. Extensive experimental results on the ISPRS Potsdam dataset and the challenging iSAID dataset substantiate the superior performance of our proposed methodology.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Semi-supervised Deep Learning via Transformation Consistency Regularization for Remote Sensing Image Semantic Segmentation
    Zhang, Bin
    Zhang, Yongjun
    Li, Yansheng
    Wan, Yi
    Guo, Haoyu
    Zheng, Zhi
    Yang, Kun
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 5782 - 5796
  • [2] Perturbation consistency and mutual information regularization for semi-supervised semantic segmentation
    Wu, Yulin
    Liu, Chang
    Chen, Lei
    Zhao, Dong
    Zheng, Qinghe
    Zhou, Hongchao
    MULTIMEDIA SYSTEMS, 2023, 29 (02) : 511 - 523
  • [3] Perturbation consistency and mutual information regularization for semi-supervised semantic segmentation
    Yulin Wu
    Chang Liu
    Lei Chen
    Dong Zhao
    Qinghe Zheng
    Hongchao Zhou
    Multimedia Systems, 2023, 29 : 511 - 523
  • [4] Multi-Dimensional Manifolds Consistency Regularization for semi-supervised remote sensing semantic segmentation
    Lu, Yujie
    Zhang, Yongjun
    Cui, Zhongwei
    Long, Wei
    Chen, Ziyang
    KNOWLEDGE-BASED SYSTEMS, 2024, 299
  • [5] Enhancing the Semi-Supervised Semantic Segmentation With Prototype-Based Supervision for Remote Sensing Images
    Zheng, Zhiyu
    Lv, Liang
    Zhang, Lefei
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21
  • [6] Semi-Supervised Semantic Segmentation of Remote Sensing Images Based on Dual Cross-Entropy Consistency
    Cui, Mengtian
    Li, Kai
    Li, Yulan
    Kamuhanda, Dany
    Tessone, Claudio J.
    ENTROPY, 2023, 25 (04)
  • [7] SEMI-SUPERVISED SEMANTIC SEGMENTATION CONSTRAINED BY CONSISTENCY REGULARIZATION
    Li, Xiaoqiang
    He, Qin
    Dai, Songmin
    Wu, Pin
    Tong, Weiqin
    2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [8] Semi-Supervised Remote Sensing Image Semantic Segmentation via Consistency Regularization and Average Update of Pseudo-Label
    Wang, Jiaxin
    Ding, Chris H. Q.
    Chen, Sibao
    He, Chenggang
    Luo, Bin
    REMOTE SENSING, 2020, 12 (21) : 1 - 16
  • [9] Semi-supervised Semantic Segmentation with Prototype-based Consistency Regularization
    Xu, Hai-Ming
    Liu, Lingqiao
    Bian, Qiuchen
    Yang, Zhen
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [10] Decouple and weight semi-supervised semantic segmentation of remote sensing images
    Huang, Wei
    Shi, Yilei
    Xiong, Zhitong
    Zhu, Xiao Xiang
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2024, 212 : 13 - 26