Out-of-Distribution Detection Based on Multiple Metrics Fusion of Network Hidden Features

被引:0
|
作者
Zhu, Qiuyu [1 ]
He, Yiwei [1 ]
机构
[1] Shanghai Univ, Sch Commun & Informat Engn, Shanghai 200444, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Feature extraction; Measurement; Training; Data models; Semantics; Neural networks; Data mining; Uncertainty; Training data; Posterior probability; Pattern recognition; Out-of-distribution detection; hidden features; pattern recognition; multiple metrics fusion;
D O I
10.1109/ACCESS.2024.3471693
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional pattern recognition models achieve excellent classification performance. However, when out-of-distribution (OOD) samples, which are outside the training distribution of in-distribution (ID) data, are input into the model, the model often assigns excessively high confidence. Simply using the probability information of the output classification from the network for OOD detection does not yield satisfactory results. The paper starts with the hidden feature information from the intermediate layers of neural networks to design discriminative metrics, including the modulus ratio of input and output from the convolutional layers and the feature distribution differences of the Batch Normalization (BN) layers within the network. Combined with the OOD detection model based on predefined evenly-distribution class centroids (PEDCC)-Loss, we propose a fusion metric selection strategy. This strategy selects appropriate feature metrics for multi-feature fusion to achieve optimal detection capability for both ID and OOD samples simultaneously. Our method requires only training the classification network model, without any input pre-processing or specific OOD data pre-tuning. Extensive experiments on several benchmark datasets show that our approach achieves state-of-the-art performance in simultaneously recognizing ID and OOD samples while ensuring that the recognition rate of ID samples does not decrease. The code for the paper can be found at https://github.com/Hewell0/HiddenOOD.
引用
收藏
页码:145450 / 145458
页数:9
相关论文
共 50 条
  • [21] Semantic Driven Energy based Out-of-Distribution Detection
    Joshi, Abhishek
    Chalasani, Sathish
    Iyer, Kiran Nanjunda
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [22] Out-of-distribution detection based on multi-classifiers
    Jiang, Weijie
    Yu, Yuanlong
    COGNITIVE COMPUTATION AND SYSTEMS, 2023, 5 (02) : 95 - 108
  • [23] Fault Diagnosis of PV Modules based on Convolution Neural Network and Out-of-distribution Detection
    Liu, Mengcheng
    Hong, Liu
    Sheng, Jie
    Li, Feng
    Zhu, Jin
    Ling, Qiang
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 1170 - 1175
  • [24] SAFE: Sensitivity-Aware Features for Out-of-Distribution Object Detection
    Wilson, Samuel
    Fischer, Tobias
    Dayoub, Feras
    Miller, Dimity
    Sunderhauf, Niko
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 23508 - 23519
  • [25] Exploring Channel-Aware Typical Features for Out-of-Distribution Detection
    He, Rundong
    Yuan, Yue
    Han, Zhongyi
    Wang, Fan
    Su, Wan
    Yin, Yilong
    Liu, Tongliang
    Gong, Yongshun
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 11, 2024, : 12402 - 12410
  • [26] Enhancing Out-of-Distribution Detection with Multitesting-based Layer-wise Feature Fusion
    Li, Jiawei
    Li, Sitong
    Wang, Shanshan
    Zeng, Yicheng
    Tan, Falong
    Xie, Chuanlong
    2024 IEEE CONFERENCE ON ARTIFICIAL INTELLIGENCE, CAI 2024, 2024, : 510 - 517
  • [27] Out-of-Distribution Representation and Graph Neural Network Fusion Learning for ECG Biometrics
    Ma, Tianbang
    Huang, Yuwen
    Yi, Ran
    Yang, Gongping
    Yin, Yilong
    IEEE TRANSACTIONS ON BIOMETRICS, BEHAVIOR, AND IDENTITY SCIENCE, 2025, 7 (02): : 225 - 233
  • [28] Out-of-Distribution Detection for Automotive Perception
    Nitsch, Julia
    Itkina, Masha
    Senanayake, Ransalu
    Nieto, Juan
    Schmidt, Max
    Siegwart, Roland
    Kochenderfer, Mykel J.
    Cadena, Cesar
    2021 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2021, : 2938 - 2943
  • [29] Decoupling MaxLogit for Out-of-Distribution Detection
    Zhang, Zihan
    Xiang, Xiang
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 3388 - 3397
  • [30] Robust Cough Detection With Out-of-Distribution Detection
    Chen, Yuhan
    Attri, Pankaj
    Barahona, Jeffrey
    Hernandez, Michelle L.
    Carpenter, Delesha
    Bozkurt, Alper
    Lobaton, Edgar
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (07) : 3210 - 3221