FOOD: Fast Out-Of-Distribution Detector

被引:1
|
作者
Amit, Guy [1 ]
Levy, Moshe [1 ]
Rosenberg, Ishai [1 ]
Shabtai, Asaf [1 ]
Elovici, Yuval [1 ]
机构
[1] Ben Gurion Univ Negev, Dept Software & Informat Syst Engn, Beer Sheva, Israel
关键词
Neural network; Out-of-Distribution; Representations;
D O I
10.1109/IJCNN52387.2021.9533465
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep neural networks (DNNs) perform well at classifying inputs associated with the classes they have been trained on, which are known as in-distribution inputs. However, out-of-distribution (OOD) inputs pose a great challenge to DNNs and consequently represent a major risk when DNNs are implemented in safety-critical systems. Extensive research has been performed in the domain of OOD detection. However, current state-of-theart methods for OOD detection suffer from at least one of the following limitations: (1) increased inference time - this limits existing methods' applicability to many real-world applications, and (2) the need for OOD training data - such data can be difficult to acquire and may not be representative enough, thus limiting the ability of the OOD detector to generalize. In this paper, we propose FOOD - Fast Out-Of-Distribution detector an extended DNN classifier capable of efficiently detecting OOD samples with minimal inference time overhead. Our architecture features a DNN with a final Gaussian layer combined with the log likelihood ratio statistical test and an additional output neuron for OOD detection. Instead of using real OOD data, we use a novel method to craft artificial OOD samples from in-distribution data, which are used to train our OOD detector neuron. We evaluate FOOD's detection performance on the SVHN, CIFAR-10, and CIFAR-100 datasets. Our results demonstrate that in addition to achieving state-of-the-art performance, FOOD is fast and applicable to real-world applications.
引用
收藏
页数:8
相关论文
共 50 条
  • [31] Segment Every Out-of-Distribution Object
    Zhao, Wenjie
    Li, Jia
    Dong, Xin
    Xiang, Yu
    Guo, Yunhui
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 3910 - 3920
  • [32] Out-of-Distribution Generalization in Kernel Regression
    Canatar, Abdulkadir
    Bordelon, Blake
    Pehlevan, Cengiz
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [33] Open Set Vehicle Detection for UAV-Based Images Using an Out-of-Distribution Detector
    Zhao, Fei
    Lou, Wenzhong
    Sun, Yi
    Zhang, Zihao
    Ma, Wenlong
    Li, Chenglong
    DRONES, 2023, 7 (07)
  • [34] Towards In-Distribution Compatible Out-of-Distribution Detection
    Wu, Boxi
    Jiang, Jie
    Ren, Haidong
    Du, Zifan
    Wang, Wenxiao
    Li, Zhifeng
    Cai, Deng
    He, Xiaofei
    Lin, Binbin
    Liu, Wei
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 9, 2023, : 10333 - 10341
  • [35] Recognition Models for Distribution and Out-of-Distribution of Human Activities
    Staab, Sergio
    Krissel, Simon
    Luderschmidt, Johannes
    Martin, Ludger
    2022 18TH INTERNATIONAL CONFERENCE ON WIRELESS AND MOBILE COMPUTING, NETWORKING AND COMMUNICATIONS (WIMOB), 2022,
  • [36] On the Impact of Spurious Correlation for Out-of-Distribution Detection
    Ming, Yifei
    Yin, Hang
    Li, Yixuan
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 10051 - 10059
  • [37] Provable Guarantees for Understanding Out-of-Distribution Detection
    Morteza, Peyman
    Li, Yixuan
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 7831 - 7840
  • [38] Your Out-of-Distribution Detection Method is Not Robust!
    Azizmalayeri, Mohammad
    Moakhar, Arshia Soltani
    Zarei, Arman
    Zohrabi, Reihaneh
    Manzuri, Mohammad Taghi
    Rohban, Mohammad Hossein
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [39] Learning to Augment Distributions for Out-of-Distribution Detection
    Wang, Qizhou
    Fang, Zhen
    Zhang, Yonggang
    Liu, Feng
    Li, Yixuan
    Han, Bo
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [40] Latent Transformer Models for out-of-distribution detection
    Graham, Mark S.
    Tudosiu, Petru-Daniel
    Wright, Paul
    Pinaya, Walter Hugo Lopez
    Teikari, Petteri
    Patel, Ashay
    U-King-Im, Jean-Marie
    Mah, Yee H.
    Teo, James T.
    Jager, Hans Rolf
    Werring, David
    Rees, Geraint
    Nachev, Parashkev
    Ourselin, Sebastien
    Cardoso, M. Jorge
    MEDICAL IMAGE ANALYSIS, 2023, 90