Automatic adaptation of object detectors to new domains using self-training

被引:110
|
作者
RoyChowdhury, Aruni [1 ]
Chakrabarty, Prithvijit [1 ]
Singh, Ashish [1 ]
Jin, SouYoung [1 ]
Jiang, Huaizu [1 ]
Cao, Liangliang [1 ]
Learned-Miller, Erik [1 ]
机构
[1] Univ Massachusetts, Coll Informat & Comp Sci, Amherst, MA 01003 USA
关键词
D O I
10.1109/CVPR.2019.00087
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This work addresses the unsupervised adaptation of an existing object detector to a new target domain. We assume that a large number of unlabeled videos from this domain are readily available. We automatically obtain labels on the target data by using high-confidence detections from the existing detector, augmented with hard (mis-classified) examples acquired by exploiting temporal cues using a tracker. These automatically-obtained labels are then used for re-training the original model. A modified knowledge distillation loss is proposed, and we investigate several ways of assigning soft-labels to the training examples from the target domain. Our approach is empirically evaluated on challenging face and pedestrian detection tasks: a face detector trained on WIDER-Face, which consists of high-quality images crawled from the web, is adapted to a largescale surveillance data set; a pedestrian detector trained on clear, daytime images from the BDD-100K driving data set is adapted to all other scenarios such as rainy, foggy, night-time. Our results demonstrate the usefulness of incorporating hard examples obtained from tracking, the advantage of using soft-labels via distillation loss versus hard-labels, and show promising performance as a simple method for unsupervised domain adaptation of object detectors, with minimal dependence on hyper-parameters.
引用
收藏
页码:780 / 790
页数:11
相关论文
共 50 条
  • [41] Unsupervised Domain Adaptation with Adversarial Self-Training for Crop Classification Using Remote Sensing Images
    Kwak, Geun-Ho
    Park, No-Wook
    REMOTE SENSING, 2022, 14 (18)
  • [42] Enhancing racism classification: an automatic multilingual data annotation system using self-training and CNN
    El Miqdadi, Ikram
    Hourri, Soufiane
    El Idrysy, Fatima Zahra
    Hayati, Assia
    Namir, Yassine
    Nikolov, Nikola S.
    Kharroubi, Jamal
    DATA MINING AND KNOWLEDGE DISCOVERY, 2024, 38 (06) : 3805 - 3830
  • [43] Addressing the Overfitting in Partial Domain Adaptation With Self-Training and Contrastive Learning
    He, Chunmei
    Li, Xiuguang
    Xia, Yue
    Tang, Jing
    Yang, Jie
    Ye, Zhengchun
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (03) : 1532 - 1545
  • [44] Unsupervised Video Domain Adaptation with Masked Pre-Training and Collaborative Self-Training
    Reddy, Arun
    Paul, William
    Rivera, Corban
    Shah, Ketul
    de Melo, Celso M.
    Chellappa, Rama
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 18919 - 18929
  • [45] 3D Object Detection Based on Iterative Self-Training
    Wang Kangru
    Tan Jingang
    Du Liang
    Chen Lili
    Li Jiamao
    Zhang Xiaolin
    ACTA OPTICA SINICA, 2020, 40 (09)
  • [46] Self-Training Based Adversarial Domain Adaptation for Radio Signal Recognition
    Liang, Zhi
    Xie, Jian
    Yang, Xin
    Tao, Mingliang
    Wang, Ling
    IEEE COMMUNICATIONS LETTERS, 2022, 26 (11) : 2646 - 2650
  • [47] Machine Reading Comprehension Framework Based on Self-Training for Domain Adaptation
    Lee, Hyeon-Gu
    Jang, Youngjin
    Kim, Harksoo
    IEEE Access, 2021, 9 : 21279 - 21285
  • [48] Automatic and unbiased self-training method for updating a reactive force field using QM calculations
    Salazar, Michael R.
    ABSTRACTS OF PAPERS OF THE AMERICAN CHEMICAL SOCIETY, 2012, 244
  • [49] A multi camera unsupervised domain adaptation pipeline for object detection in cultural sites through adversarial learning and self-training
    Pasqualino, Giovanni
    Furnari, Antonino
    Farinella, Giovanni Maria
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2022, 222
  • [50] JS']JST: Joint Self-training for Unsupervised Domain Adaptation on 2D&3D Object Detection
    Ding, Guangyao
    Zhang, Meiying
    Li, E.
    Hao, Qi
    2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2022), 2022,