Cross-Domain Car Detection Using Unsupervised Image-to-Image Translation: From Day to Night

被引:53
|
作者
Arruda, Vinicius F. [1 ]
Paixao, Thiago M. [1 ,2 ]
Berriel, Rodrigo F. [1 ]
De Souza, Alberto F. [1 ]
Badue, Claudine [1 ]
Sebe, Nicu [3 ]
Oliveira-Santos, Thiago [1 ]
机构
[1] Univ Fed Espirito Santo, Vitoria, ES, Brazil
[2] Inst Fed Espirito Santo, Vitoria, ES, Brazil
[3] Univ Trento, Trento, Italy
关键词
Object Detection; Generative Adversarial Networks; Unpaired Image-to-Image Translation; Unsupervised Domain Adaptation;
D O I
10.1109/ijcnn.2019.8852008
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning techniques have enabled the emergence of state-of-the-art models to address object detection tasks. However, these techniques are data-driven, delegating the accuracy to the training dataset which must resemble the images in the target task. The acquisition of a dataset involves annotating images, an arduous and expensive process, generally requiring time and manual effort. Thus, a challenging scenario arises when the target domain of application has no annotated dataset available, making tasks in such situation to lean on a training dataset of a different domain. Sharing this issue, object detection is a vital task for autonomous vehicles where the large amount of driving scenarios yields several domains of application requiring annotated data for the training process. In this work, a method for training a car detection system with annotated data from a source domain (day images) without requiring the image annotations of the target domain (night images) is presented. For that, a model based on Generative Adversarial Networks (GANs) is explored to enable the generation of an artificial dataset with its respective annotations. The artificial dataset (fake dataset) is created translating images from day-time domain to night-time domain. The fake dataset, which comprises annotated images of only the target domain (night images), is then used to train the car detector model. Experimental results showed that the proposed method achieved significant and consistent improvements, including the increasing by more than 10% of the detection performance when compared to the training with only the available annotated data (i.e., day images).
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Learning Unsupervised Cross-domain Image-to-Image Translation using a Shared Discriminator
    Kumar, Rajiv
    Dabral, Rishabh
    Sivakumar, G.
    VISAPP: PROCEEDINGS OF THE 16TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS - VOL. 5: VISAPP, 2021, : 256 - 264
  • [2] Image-to-image translation for cross-domain disentanglement
    Gonzalez-Garcia, Abel
    van de Weijer, Joost
    Bengio, Yoshua
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [3] Cross-domain object detection using unsupervised image translation
    Arruda, Vinicius F.
    Berriel, Rodrigo F.
    Paixao, Thiago M.
    Badue, Claudine
    De Souza, Alberto F.
    Sebe, Nicu
    Oliveira-Santos, Thiago
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 192
  • [4] Cross-Domain Interpolation for Unpaired Image-to-Image Translation
    Lopez, Jorge
    Mauricio, Antoni
    Diaz, Jose
    Camara, Guillermo
    COMPUTER VISION SYSTEMS (ICVS 2019), 2019, 11754 : 542 - 551
  • [5] Image-To-Image Translation Using a Cross-Domain Auto-Encoder and Decoder
    Yoo, Jaechang
    Eom, Heesong
    Choi, Yong Suk
    APPLIED SCIENCES-BASEL, 2019, 9 (22):
  • [6] Cross-Domain Infrared Image Classification via Image-to-Image Translation and Deep Domain Generalization
    Guo, Zhao-Rui
    Niu, Jia-Wei
    Liu, Zhun-Ga
    2022 17TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION (ICARCV), 2022, : 487 - 493
  • [7] CROSS-DOMAIN SAR SHIP DETECTION IN STRONG INTERFERENCE ENVIRONMENT BASED ON IMAGE-TO-IMAGE TRANSLATION
    Pu, Xinyang
    Jia, Hecheng
    Xu, Feng
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 1798 - 1801
  • [8] Domain-knowledge Inspired Pseudo Supervision (DIPS) for unsupervised image-to-image translation models to support cross-domain classification
    Al-Hindawi, Firas
    Siddiquee, Md Mahfuzur Rahman
    Wu, Teresa
    Hu, Han
    Sun, Ying
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 127
  • [9] Domain Bridge for Unpaired Image-to-Image Translation and Unsupervised Domain Adaptation
    Pizzati, Fabio
    de Charette, Raoul
    Zaccaria, Michela
    Cerri, Pietro
    2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 2979 - 2987
  • [10] Unsupervised image-to-image translation using intra-domain reconstruction loss
    Yuan Fan
    Mingwen Shao
    Wangmeng Zuo
    Qingyun Li
    International Journal of Machine Learning and Cybernetics, 2020, 11 : 2077 - 2088