Self-supervised sub-category exploration for Pseudo label generation

被引:0
|
作者
Chern, Wei-Chih [1 ]
Kim, Taegeon [2 ]
Nguyen, Tam, V [3 ]
Asari, Vijayan K. [1 ]
Kim, Hongjo [2 ]
机构
[1] Univ Dayton, Dept Elect & Comp Engn, Dayton, OH 45469 USA
[2] Yonsei Univ, Dept Civil & Environm Engn, Seoul, South Korea
[3] Univ Dayton, Dept Comp Sci, Dayton, OH 45469 USA
关键词
Self -supervised learning; Weakly supervised learning; Semantic segmentation; Pseudo label generation; Training data preparation; Construction vehicle;
D O I
10.1016/j.autcon.2023.104862
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Image segmentation-based applications have been actively investigated. However, it is non-trivial to prepare polygon annotations. Previous studies suggested pseudo label generation methods based on weakly supervised learning to lessen the burden of annotation. Nevertheless, the quality of pseudo labels could not be ideal due to target object characteristics and insufficient data size in the construction domain, as identified in this study. This study proposes a fusion architecture, SESC-CAM, to address the challenge, building upon weakly and self -supervised learning methods. The proposed architecture was validated on the AIM dataset, and the generated pseudo labels recorded a mIoU score of 64.99% and 67.65% after the refinement by using a conditional random field, and outperformed its predecessors by 11.29% and 9.14%. The refined pseudo labels were used to train a segmentation model and recorded a 74% mIoU score in semantic segmentation results. The findings of this study provide insights for automated training data preparation.
引用
收藏
页数:9
相关论文
共 50 条
  • [31] Decoupled self-supervised label augmentation for fully-supervised image classification
    Gao, Wanshun
    Wu, Meiqing
    Lam, Siew-Kei
    Xia, Qihui
    Zou, Jianhua
    KNOWLEDGE-BASED SYSTEMS, 2022, 235
  • [32] Reducing Label Effort: Self-Supervised meets Active Learning
    Bengar, Javad Zolfaghari
    van de Weijer, Joost
    Twardowski, Bartlomiej
    Raducanu, Bogdan
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 1631 - 1639
  • [33] Investigating Self-Supervised Methods for Label-Efficient Learning
    Nandam, Srinivasa Rao
    Atito, Sara
    Feng, Zhenhua
    Kittler, Josef
    Awais, Muhammed
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2025,
  • [34] Self-supervised category-enhanced graph neural networks for recommendation
    Yang, Funing
    Du, Haihui
    Zhang, Xingliang
    Yang, Yongjian
    Wang, Ying
    KNOWLEDGE-BASED SYSTEMS, 2025, 311
  • [35] Multi-Label Self-Supervised Learning with Scene Images
    Zhu, Ke
    Fu, Minghao
    Wu, Jianxin
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 6671 - 6680
  • [36] Self-Supervised Learning for Label Sparsity in Computational Drug Repositioning
    Yang, Xinxing
    Yang, Genke
    Chu, Jian
    IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, 2023, 20 (05) : 3245 - 3256
  • [37] Label-free Monitoring of Self-Supervised Learning Progress
    Xu, Isaac
    Lowe, Scott
    Trappenberg, Thomas
    2022 IEEE CANADIAN CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING (CCECE), 2022, : 78 - 84
  • [38] Self-Supervised Wasserstein Pseudo-Labeling for Semi-Supervised Image Classification
    Taherkhani, Fariborz
    Dabouei, Ali
    Soleymani, Sobhan
    Dawson, Jeremy
    Nasrabadi, Nasser M.
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 12262 - 12272
  • [39] Noisy Agents: Self-supervised Exploration by Predicting Auditory Events
    Gan, Chuang
    Chen, Xiaoyu
    Isola, Phillip
    Torralba, Antonio
    Tenenbaum, Joshua B.
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 9259 - 9265
  • [40] Multi-level correlation mining framework with self-supervised label generation for multimodal sentiment analysis
    Li, Zuhe
    Guo, Qingbing
    Pan, Yushan
    Ding, Weiping
    Yu, Jun
    Zhang, Yazhou
    Liu, Weihua
    Chen, Haoran
    Wang, Hao
    Xie, Ying
    INFORMATION FUSION, 2023, 99