Enhancing Semi-Supervised Semantic Segmentation of Remote Sensing Images via Feature Perturbation-Based Consistency Regularization Methods

被引:6
|
作者
Xin, Yi [1 ]
Fan, Zide [1 ]
Qi, Xiyu [1 ]
Geng, Ying [1 ]
Li, Xinming [2 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Target Cognit & Applicat Technol, Beijing 100190, Peoples R China
[2] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100190, Peoples R China
关键词
remote sensing; semantic segmentation; semi-supervised learning; consistency regularization; feature perturbation; contrastive learning; CLASSIFICATION; NETWORK;
D O I
10.3390/s24030730
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In the field of remote sensing technology, the semantic segmentation of remote sensing images carries substantial importance. The creation of high-quality models for this task calls for an extensive collection of image data. However, the manual annotation of these images can be both time-consuming and labor-intensive. This has catalyzed the advent of semi-supervised semantic segmentation methodologies. Yet, the complexities inherent within the foreground categories of these remote sensing images present challenges in preserving prediction consistency. Moreover, remote sensing images possess more complex features, and different categories are confused within the feature space, making optimization based on the feature space challenging. To enhance model consistency and to optimize feature-based class categorization, this paper introduces a novel semi-supervised semantic segmentation framework based on Mean Teacher (MT). Unlike the conventional Mean Teacher that only introduces perturbations at the image level, we incorporate perturbations at the feature level. Simultaneously, to maintain consistency after feature perturbation, we employ contrastive learning for feature-level learning. In response to the complex feature space of remote sensing images, we utilize entropy threshold to assist contrastive learning, selecting feature key-values more precisely, thereby enhancing the accuracy of segmentation. Extensive experimental results on the ISPRS Potsdam dataset and the challenging iSAID dataset substantiate the superior performance of our proposed methodology.
引用
收藏
页数:19
相关论文
共 50 条
  • [31] STCRNet: A Semi-Supervised Network Based on Self-Training and Consistency Regularization for Change Detection in VHR Remote Sensing Images
    Wang, Lukang
    Zhang, Min
    Shi, Wenzhong
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 2272 - 2282
  • [32] CGSNet: Cross-consistency guiding semi-supervised semantic segmentation network for remote sensing of plateau lake
    Chen, Guangchen
    Shi, Benjie
    Zhang, Yinhui
    He, Zifen
    Zhang, Pengcheng
    JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2024, 230
  • [33] Dual Consistency Regularization for Semi-supervised Medical Image Segmentation
    Wei, Lin
    Sha, Runxuan
    Shi, Yucheng
    Wang, Qingxian
    Shi, Lei
    Gao, Yufei
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT V, ICIC 2024, 2024, 14866 : 197 - 206
  • [34] Towards the Uncharted: Density-Descending Feature Perturbation for Semi-supervised Semantic Segmentation
    Wang, Xiaoyang
    Bai, Huihui
    Yu, Limin
    Zhao, Yao
    Xiao, Jimin
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 3303 - 3312
  • [35] Class Probability Space Regularization for semi-supervised semantic segmentation
    Yin, Jianjian
    Yan, Shuai
    Chen, Tao
    Chen, Yi
    Yao, Yazhou
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2024, 249
  • [36] SEMI-SUPERVISED CEREBROVASCULAR SEGMENTATION USING TOF-MRA IMAGES BASED ON LABEL REFINEMENT AND CONSISTENCY REGULARIZATION
    Huang, Haibin
    Cui, Yue
    Shi, Mingxia
    Yu, Shan
    IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI 2024, 2024,
  • [37] Hierarchical Augmentation and Region-Aware Contrastive Learning for Semi-Supervised Semantic Segmentation of Remote Sensing Images
    Luo, Yuan
    Sun, Bin
    Li, Shutao
    Hu, Yulong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [38] Difference-Complementary Learning and Label Reassignment for Multimodal Semi-Supervised Semantic Segmentation of Remote Sensing Images
    Han, Wenqi
    Jiang, Wen
    Geng, Jie
    Miao, Wang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2025, 34 : 566 - 580
  • [39] Semantic Segmentation of seafloor images in Philippines based on semi-supervised learning
    Wang, Shulei
    Mizuno, Katsunori
    Tabeta, Shigeru
    Kei, Terayama
    2023 IEEE UNDERWATER TECHNOLOGY, UT, 2023,
  • [40] Semi-Supervised Remote Sensing Building Change Detection with Joint Perturbation and Feature Complementation
    Chen, Zhanlong
    Wang, Rui
    Xu, Yongyang
    REMOTE SENSING, 2024, 16 (18)