FOOD: Fast Out-Of-Distribution Detector

被引:1
|
作者
Amit, Guy [1 ]
Levy, Moshe [1 ]
Rosenberg, Ishai [1 ]
Shabtai, Asaf [1 ]
Elovici, Yuval [1 ]
机构
[1] Ben Gurion Univ Negev, Dept Software & Informat Syst Engn, Beer Sheva, Israel
关键词
Neural network; Out-of-Distribution; Representations;
D O I
10.1109/IJCNN52387.2021.9533465
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep neural networks (DNNs) perform well at classifying inputs associated with the classes they have been trained on, which are known as in-distribution inputs. However, out-of-distribution (OOD) inputs pose a great challenge to DNNs and consequently represent a major risk when DNNs are implemented in safety-critical systems. Extensive research has been performed in the domain of OOD detection. However, current state-of-theart methods for OOD detection suffer from at least one of the following limitations: (1) increased inference time - this limits existing methods' applicability to many real-world applications, and (2) the need for OOD training data - such data can be difficult to acquire and may not be representative enough, thus limiting the ability of the OOD detector to generalize. In this paper, we propose FOOD - Fast Out-Of-Distribution detector an extended DNN classifier capable of efficiently detecting OOD samples with minimal inference time overhead. Our architecture features a DNN with a final Gaussian layer combined with the log likelihood ratio statistical test and an additional output neuron for OOD detection. Instead of using real OOD data, we use a novel method to craft artificial OOD samples from in-distribution data, which are used to train our OOD detector neuron. We evaluate FOOD's detection performance on the SVHN, CIFAR-10, and CIFAR-100 datasets. Our results demonstrate that in addition to achieving state-of-the-art performance, FOOD is fast and applicable to real-world applications.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] SUBSPACE MODELING FOR FAST OUT-OF-DISTRIBUTION AND ANOMALY DETECTION
    Ndiour, Ibrahima J.
    Ahuja, Nilesh A.
    Tickoo, Omesh
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 3041 - 3045
  • [2] Out-of-distribution Detection Learning with Unreliable Out-of-distribution Sources
    Zheng, Haotian
    Wang, Qizhou
    Fang, Zhen
    Xia, Xiaobo
    Liu, Feng
    Liu, Tongliang
    Han, Bo
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [3] GCOOD: A Generic Coupled Out-of-Distribution Detector for Robust Classification
    de Moraes, Rogerio Ferreira
    Evangelista, Raphael dos S.
    Fernandes, Leandro A. F.
    Marti, Luis
    2021 34TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI 2021), 2021, : 409 - 416
  • [4] Fast Customization of Chemical Language Models to Out-of-Distribution Data Sets
    Toniato, Alessandra
    Vaucher, Alain C.
    Lehmann, Marzena Maria
    Luksch, Torsten
    Schwaller, Philippe
    Stenta, Marco
    Laino, Teodoro
    CHEMISTRY OF MATERIALS, 2023, 35 (21) : 8806 - 8815
  • [5] Out-of-Distribution Identification: Let Detector Tell Which I Am Not Sure
    Li, Ruoqi
    Zhang, Chongyang
    Zhou, Hao
    Shi, Chao
    Luo, Yan
    COMPUTER VISION, ECCV 2022, PT X, 2022, 13670 : 638 - 654
  • [6] On the Learnability of Out-of-distribution Detection
    Fang, Zhen
    Li, Yixuan
    Liu, Feng
    Han, Bo
    Lu, Jie
    Journal of Machine Learning Research, 2024, 25
  • [7] Panoptic Out-of-Distribution Segmentation
    Mohan, Rohit
    Kumaraswamy, Kiran
    Hurtado, Juana Valeria
    Petek, Kursat
    Valada, Abhinav
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (05) : 4075 - 4082
  • [8] Certifiable Out-of-Distribution Generalization
    Ye, Nanyang
    Zhu, Lin
    Wang, Jia
    Zeng, Zhaoyu
    Shao, Jiayao
    Peng, Chensheng
    Pan, Bikang
    Li, Kaican
    Zhu, Jun
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 9, 2023, : 10927 - 10935
  • [9] Entropic Out-of-Distribution Detection
    Macedo, David
    Ren, Tsang Ing
    Zanchettin, Cleber
    Oliveira, Adriano L., I
    Ludermir, Teresa
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [10] The Value of Out-of-Distribution Data
    De Silva, Ashwin
    Ramesh, Rahul
    Priebe, Carey E.
    Chaudhari, Pratik
    Vogelstein, Joshua T.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 202, 2023, 202