Proposal Learning for Semi-Supervised Object Detection

被引:56
|
作者
Tang, Peng [1 ]
Ramaiah, Chetan [1 ]
Wang, Yan [2 ]
Xu, Ran [1 ]
Xiong, Caiming [1 ]
机构
[1] Salesforce Res, Palo Alto, CA 94301 USA
[2] East China Normal Univ, Shanghai Key Lab Multidimens Informat Proc, Shanghai, Peoples R China
关键词
D O I
10.1109/WACV48630.2021.00234
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we focus on semi-supervised object detection to boost performance of proposal-based object detectors (a.k.a. two-stage object detectors) by training on both labeled and unlabeled data. However, it is non-trivial to train object detectors on unlabeled data due to the unavailability of ground truth labels. To address this problem, we present a proposal learning approach to learn proposal features and predictions from both labeled and unlabeled data. The approach consists of a self-supervised proposal learning module and a consistency-based proposal learning module. In the self-supervised proposal learning module, we present a proposal location loss and a contrastive loss to learn context-aware and noise-robust proposal features respectively. In the consistency-based proposal learning module, we apply consistency losses to both bounding box classification and regression predictions of proposals to learn noise-robust proposal features and predictions. Our approach enjoys the following benefits: 1) encouraging more context information to be delivered in the proposals learning procedure; 2) noisy proposal features and enforcing consistency to allow noise-robust object detection; 3) building a general and high-performance semi-supervised object detection framework, which can be easily adapted to proposal-based object detectors with different backbone architectures. Experiments are conducted on the COCO dataset with all available labeled and unlabeled data. Results demonstrate that our approach consistently improves the performance of fully-supervised baselines. In particular, after combining with data distillation [39], our approach improves AP by about 2.0% and 0.9% on average compared to fully-supervised baselines and data distillation baselines respectively.
引用
收藏
页码:2290 / 2300
页数:11
相关论文
共 50 条
  • [1] Semi-Supervised Active Learning for Object Detection
    Chen, Sijin
    Yang, Yingyun
    Hua, Yan
    ELECTRONICS, 2023, 12 (02)
  • [2] Semi-supervised Object Detection via VC Learning
    Chen, Changrui
    Debattista, Kurt
    Han, Jungong
    COMPUTER VISION, ECCV 2022, PT XXXI, 2022, 13691 : 169 - 185
  • [3] Dense Learning based Semi-Supervised Object Detection
    Chen, Binghui
    Li, Pengyu
    Chen, Xiang
    Wang, Biao
    Zhang, Lei
    Hua, Xian-Sheng
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 4805 - 4814
  • [4] Semi-supervised Learning of Feature Hierarchies for Object Detection in a Video
    Yang, Yang
    Shu, Guang
    Shah, Mubarak
    2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, : 1650 - 1657
  • [5] Semi-Supervised Exemplar Learning for Object Detection in Aerial Imagery
    Overbey, Lucas A.
    Lyle, Jamie
    Pan, Jean
    Holt, Branson
    Jaegar, Alan
    Jaeger, Ryan
    van Epps, Todd
    Ruane, Martin
    GEOSPATIAL INFORMATICS XI, 2021, 11733
  • [6] Consistency-based Semi-supervised Learning for Object Detection
    Jeong, Jisoo
    Lee, Seungeui
    Kim, Jeesoo
    Kwak, Nojun
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [7] Active and semi-supervised learning for object detection with imperfect data
    Rhee, Phill Kyu
    Erdenee, Enkhbayar
    Kyun, Shin Dong
    Ahmed, Minhaz Uddin
    Jin, Songguo
    COGNITIVE SYSTEMS RESEARCH, 2017, 45 : 109 - 123
  • [8] Interpolation-based Semi-supervised Learning for Object Detection
    Jeong, Jisoo
    Verma, Vikas
    Hyun, Minsung
    Kannala, Juho
    Kwak, Nojun
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 11597 - 11606
  • [9] Dense Information Learning Based Semi-Supervised Object Detection
    Yang, Xi
    Li, Penghui
    Zhou, Qiubai
    Wang, Nannan
    Gao, Xinbo
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2025, 34 : 1022 - 1035
  • [10] Semi-supervised learning based object detection in aerial imagery
    Yao, J
    Zhang, ZF
    2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol 1, Proceedings, 2005, : 1011 - 1016