Self-supervised sub-category exploration for Pseudo label generation

被引:0
|
作者
Chern, Wei-Chih [1 ]
Kim, Taegeon [2 ]
Nguyen, Tam, V [3 ]
Asari, Vijayan K. [1 ]
Kim, Hongjo [2 ]
机构
[1] Univ Dayton, Dept Elect & Comp Engn, Dayton, OH 45469 USA
[2] Yonsei Univ, Dept Civil & Environm Engn, Seoul, South Korea
[3] Univ Dayton, Dept Comp Sci, Dayton, OH 45469 USA
关键词
Self -supervised learning; Weakly supervised learning; Semantic segmentation; Pseudo label generation; Training data preparation; Construction vehicle;
D O I
10.1016/j.autcon.2023.104862
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Image segmentation-based applications have been actively investigated. However, it is non-trivial to prepare polygon annotations. Previous studies suggested pseudo label generation methods based on weakly supervised learning to lessen the burden of annotation. Nevertheless, the quality of pseudo labels could not be ideal due to target object characteristics and insufficient data size in the construction domain, as identified in this study. This study proposes a fusion architecture, SESC-CAM, to address the challenge, building upon weakly and self -supervised learning methods. The proposed architecture was validated on the AIM dataset, and the generated pseudo labels recorded a mIoU score of 64.99% and 67.65% after the refinement by using a conditional random field, and outperformed its predecessors by 11.29% and 9.14%. The refined pseudo labels were used to train a segmentation model and recorded a 74% mIoU score in semantic segmentation results. The findings of this study provide insights for automated training data preparation.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Improved sub-category exploration and attention hybrid network for weakly supervised semantic segmentation
    Zhu, Hegui
    Geng, Tian
    Wang, Jiayi
    Tang, Qingsong
    Jiang, Wuming
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (14): : 10573 - 10587
  • [2] Improved sub-category exploration and attention hybrid network for weakly supervised semantic segmentation
    Hegui Zhu
    Tian Geng
    Jiayi Wang
    Qingsong Tang
    Wuming Jiang
    Neural Computing and Applications, 2023, 35 : 10573 - 10587
  • [3] Enhanced Pseudo-Label Generation With Self-Supervised Training for Weakly- Supervised Semantic Segmentation
    Qin, Zhen
    Chen, Yujie
    Zhu, Guosong
    Zhou, Erqiang
    Zhou, Yingjie
    Zhou, Yicong
    Zhu, Ce
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (08) : 7017 - 7028
  • [4] Self-supervised video object segmentation via pseudo label rectification
    Guo, Pinxue
    Zhang, Wei
    Li, Xiaoqiang
    Fan, Jianping
    Zhang, Wenqiang
    PATTERN RECOGNITION, 2025, 163
  • [5] Self-Supervised GANs with Label Augmentation
    Hou, Liang
    Shen, Huawei
    Cao, Qi
    Cheng, Xueqi
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [6] DiPS: Discriminative pseudo-label sampling with self-supervised transformers for weakly supervised object localization
    Murtaza, Shakeeb
    Belharbi, Soufiane
    Pedersoli, Marco
    Sarraf, Aydin
    Granger, Eric
    IMAGE AND VISION COMPUTING, 2023, 140
  • [7] Pseudo-label enhancement for weakly supervised object detection using self-supervised vision transformer
    Yang, Kequan
    Wu, Yuanchen
    Li, Jide
    Yin, Chao
    Li, Xiaoqiang
    KNOWLEDGE-BASED SYSTEMS, 2025, 311
  • [8] Category contrastive distillation with self-supervised classification
    Chen, Weiwei
    Xu, Jiazhen
    Zheng, Yujie
    Wang, Chong
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (01)
  • [9] Self-Supervised Network Distillation for Exploration
    Zhang, Xu
    Dai, Ruiyu
    Chen, Weisi
    Qiu, Jiguang
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2023, 37 (15)
  • [10] Self-Supervised Exploration via Disagreement
    Pathak, Deepak
    Gandhi, Dhiraj
    Gupta, Abhinav
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97