Dynamic and Adaptive Self-Training for Semi-Supervised Remote Sensing Image Semantic Segmentation

被引:1
|
作者
Jin, Jidong [1 ,2 ,3 ,4 ]
Lu, Wanxuan [1 ,2 ]
Yu, Hongfeng [1 ,2 ]
Rong, Xuee [1 ,2 ,3 ,4 ]
Sun, Xian [1 ,2 ,3 ,4 ]
Wu, Yirong [1 ,2 ,3 ,4 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Inst Elect, Beijing 100190, Peoples R China
[2] Chinese Acad Sci, Inst Elect, Key Lab Network Informat Syst Technol NIST, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100190, Peoples R China
[4] Univ Chinese Acad Sci, Sch Elect Elect & Commun Engn, Beijing 100190, Peoples R China
基金
中国国家自然科学基金;
关键词
Remote sensing; Semantic segmentation; Transformers; Data models; Training; Semantics; Predictive models; Consistency regularization (CR); remote sensing (RS) image; self-training; semantic segmentation; semisupervised learning (SSL);
D O I
10.1109/TGRS.2024.3407142
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Remote sensing (RS) technology has made remarkable progress, providing a wealth of data for various applications, such as ecological conservation and urban planning. However, the meticulous annotation of this data is labor-intensive, leading to a shortage of labeled data, particularly in tasks like semantic segmentation. Semi-supervised methods, combining consistency regularization (CR) with self-training, offer a solution to efficiently utilize labeled and unlabeled data. However, these methods encounter challenges due to imbalanced data ratios. To tackle these challenges, we introduce a self-training approach named dynamic and adaptive self-training (DAST), which is combined with dynamic pseudo-label sampling (DPS), distribution matching (DM), and adaptive threshold updating (ATU). DPS is tailored to address the issue of class distribution imbalance by giving priority to classes with fewer samples. Meanwhile, DM and ATU aim to reduce distribution disparities by adjusting model predictions across augmented images within the framework of CR, ensuring they align with the actual data distribution. Experimental results on the Potsdam and iSAID datasets demonstrate that DAST effectively balances class distribution, aligns model predictions with data distribution, and stabilizes pseudo-labels, leading to state-of-the-art performance on both datasets. These findings highlight the potential of DAST in overcoming the challenges associated with significant disparities in labeled-to-unlabeled data ratios.
引用
收藏
页码:1 / 1
页数:14
相关论文
共 50 条
  • [41] Semi-supervised point cloud segmentation using self-training with label confidence prediction
    Li, Hongyan
    Sun, Zhengxing
    Wu, Yunjie
    Song, Youcheng
    NEUROCOMPUTING, 2021, 437 : 227 - 237
  • [42] SISU: A Holistic Self-training Framework on Semi-supervised White Blood Cell Segmentation
    Hien Quang Kha
    Minh Huu Nhat Le
    Lam Huu Phuc Nguyen
    Minh Nguyen Tuan Tran
    Linh My Nguyen
    Hung Quay Thong
    Nguyen Quoc Khanh Le
    TRUSTWORTHY ARTIFICIAL INTELLIGENCE FOR HEALTHCARE, TAI4H 2024, 2024, 14812 : 134 - 144
  • [43] Semi-supervised semantic segmentation with cross teacher training
    Xiao, Hui
    Li, Dong
    Xu, Hao
    Fu, Shuibo
    Yan, Diqun
    Song, Kangkang
    Peng, Chengbin
    NEUROCOMPUTING, 2022, 508 : 36 - 46
  • [44] Training Vision Transformers for Semi-Supervised Semantic Segmentation
    Hu, Xinting
    Jiang, Li
    Schiele, Bernt
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 4007 - 4017
  • [45] A Semi-supervised Road Segmentation Method for Remote Sensing Image Based on SegFormer
    Ma, Tian
    Zhou, Xinlei
    Xi, Runtao
    Yang, Jiayi
    Zhang, Jiehui
    Li, Fanhui
    ARTIFICIAL INTELLIGENCE AND ROBOTICS, ISAIR 2022, PT II, 2022, 1701 : 189 - 201
  • [46] Advancing perturbation space expansion based on information fusion for semi-supervised remote sensing image semantic segmentation
    Zhou, Liang
    Duan, Keyi
    Dai, Jinkun
    Ye, Yuanxin
    INFORMATION FUSION, 2025, 117
  • [47] Semi-supervised semantic segmentation based on Generative Adversarial Networks for remote sensing images
    Liu Yu-Xi
    Zhang Bo
    Wang Bin
    JOURNAL OF INFRARED AND MILLIMETER WAVES, 2020, 39 (04) : 473 - 482
  • [48] Self-training and Multi-level Adversarial Network for Domain Adaptive Remote Sensing Image Segmentation
    Zheng, Yilin
    He, Lingmin
    Wu, Xiangping
    Pan, Chen
    NEURAL PROCESSING LETTERS, 2023, 55 (08) : 10613 - 10638
  • [49] Self-training and Multi-level Adversarial Network for Domain Adaptive Remote Sensing Image Segmentation
    Yilin Zheng
    Lingmin He
    Xiangping Wu
    Chen Pan
    Neural Processing Letters, 2023, 55 : 10613 - 10638
  • [50] Adaptive Adversarial Self-Training for Semi-Supervised Object Detection in Complex Maritime Scenes
    Feng, Junjian
    Tian, Lianfang
    Li, Xiangxia
    MATHEMATICS, 2024, 12 (15)