Self-supervised sub-category exploration for Pseudo label generation

被引:0
|
作者
Chern, Wei-Chih [1 ]
Kim, Taegeon [2 ]
Nguyen, Tam, V [3 ]
Asari, Vijayan K. [1 ]
Kim, Hongjo [2 ]
机构
[1] Univ Dayton, Dept Elect & Comp Engn, Dayton, OH 45469 USA
[2] Yonsei Univ, Dept Civil & Environm Engn, Seoul, South Korea
[3] Univ Dayton, Dept Comp Sci, Dayton, OH 45469 USA
关键词
Self -supervised learning; Weakly supervised learning; Semantic segmentation; Pseudo label generation; Training data preparation; Construction vehicle;
D O I
10.1016/j.autcon.2023.104862
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Image segmentation-based applications have been actively investigated. However, it is non-trivial to prepare polygon annotations. Previous studies suggested pseudo label generation methods based on weakly supervised learning to lessen the burden of annotation. Nevertheless, the quality of pseudo labels could not be ideal due to target object characteristics and insufficient data size in the construction domain, as identified in this study. This study proposes a fusion architecture, SESC-CAM, to address the challenge, building upon weakly and self -supervised learning methods. The proposed architecture was validated on the AIM dataset, and the generated pseudo labels recorded a mIoU score of 64.99% and 67.65% after the refinement by using a conditional random field, and outperformed its predecessors by 11.29% and 9.14%. The refined pseudo labels were used to train a segmentation model and recorded a 74% mIoU score in semantic segmentation results. The findings of this study provide insights for automated training data preparation.
引用
收藏
页数:9
相关论文
共 50 条
  • [41] EXPLORATION OF A SELF-SUPERVISED SPEECH MODEL: A STUDY ON EMOTIONAL CORPORA
    Li, Yuanchao
    Mohamied, Yumnah
    Bell, Peter
    Lai, Catherine
    2022 IEEE SPOKEN LANGUAGE TECHNOLOGY WORKSHOP, SLT, 2022, : 868 - 875
  • [42] Self-Supervised Unimodal Label Generation Strategy Using Recalibrated Modality Representations for Multimodal Sentiment Analysis
    Hwang, Yewon
    Kim, Jong-Hwan
    17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, 2023, : 35 - 46
  • [43] Transformer-based correlation mining network with self-supervised label generation for multimodal sentiment analysis
    Wang, Ruiqing
    Yang, Qimeng
    Tian, Shengwei
    Yu, Long
    He, Xiaoyu
    Wang, Bo
    NEUROCOMPUTING, 2025, 618
  • [44] Self-supervised terrain classification for planetary surface exploration rovers
    Brooks, Christopher A.
    Iagnemma, Karl
    JOURNAL OF FIELD ROBOTICS, 2012, 29 (03) : 445 - 468
  • [45] Variational Dynamic for Self-Supervised Exploration in Deep Reinforcement Learning
    Bai, Chenjia
    Liu, Peng
    Liu, Kaiyu
    Wang, Lingxiao
    Zhao, Yingnan
    Han, Lei
    Wang, Zhaoran
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (08) : 4776 - 4790
  • [46] Self-Supervised Exploration via Temporal Inconsistency in Reinforcement Learning
    Gao Z.
    Xu K.
    Zhai Y.
    Ding B.
    Feng D.
    Mao X.
    Wang H.
    IEEE Transactions on Artificial Intelligence, 2024, 5 (11): : 1 - 10
  • [47] Self-Supervised Real-to-Sim Scene Generation
    Prakash, Aayush
    Debnath, Shoubhik
    Lafleche, Jean-Francois
    Cameracci, Eric
    State, Gavriel
    Birchfield, Stan
    Law, Marc T.
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 16024 - 16034
  • [48] Self-Supervised Generation of Spatial Audio for 360° Video
    Morgado, Pedro
    Vasconcelos, Nuno
    Langlois, Timothy
    Wang, Oliver
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [49] Self-supervised Image-specific Prototype Exploration for Weakly Supervised Semantic Segmentation
    Chen, Qi
    Yang, Lingxiao
    Lai, Jianhuang
    Xie, Xiaohua
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 4278 - 4288
  • [50] Self-supervised Dimensionality Reduction with Neural Networks and Pseudo-labeling
    Espadoto, Mateus
    Hirata, Nina
    Telea, Alexandru
    IVAPP: PROCEEDINGS OF THE 16TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS - VOL. 3: IVAPP, 2021, : 27 - 37