Interpretable Latent Space for Meteorological Out-of-Distribution Detection via Weak Supervision

被引:0
|
作者
Das, Suman [1 ]
Yuhas, Michael [1 ]
Koh, Rachel [1 ]
Easwaran, Arvind [1 ]
机构
[1] Nanyang Technol Univ, 50 Nanyang Ave,32 Block N4 02a, Singapore 639798, Singapore
基金
新加坡国家研究基金会;
关键词
Safety critical system; rain detection; lightness detection; representation learning; autonomous vehicle;
D O I
10.1145/3651224
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Deep neural networks (DNNs) are effective tools for learning-enabled cyber-physical systems (CPSs) that handle high-dimensional image data. However, DNNs may make incorrect decisions when presented with inputs outside the distribution of their training data. These inputs can compromise the safety of CPSs. So, it becomes crucial to detect inputs as out-of-distribution (OOD) and interpret the reasons for their classification as OOD. In this study, we propose an interpretable learning method to detect OOD caused by meteorological features like darkness, lightness, and rain. To achieve this, we employ a variational autoencoder (VAE) to map high-dimensional image data to a lower-dimensional latent space. We then focus on a specific latent dimension and encourage it to classify different intensities of a particular meteorological feature in a monotonically increasing manner. This is accomplished by incorporating two additional terms into the VAE's loss function: a classification loss and a positional loss. During training, we optimize the utilization of label information for classification. Remarkably, our results demonstrate that using only 25% of the training data labels is sufficient to train a single pre-selected latent dimension to classify different intensities of a specific meteorological feature. We evaluate the proposed method on two distinct datasets, CARLA and Duckietown, employing two different rain-generation methods. We show that our approach outperforms existing approaches by at least 15% in the F1 score and precision when trained and tested on CARLA dataset.
引用
收藏
页码:1 / 26
页数:26
相关论文
共 50 条
  • [1] Adequate structuring of the latent space for easy classification and out-of-distribution detection
    Ossonce, Maxime
    Duhamel, Pierre
    Alberge, Florence
    32ND EUROPEAN SIGNAL PROCESSING CONFERENCE, EUSIPCO 2024, 2024, : 1776 - 1780
  • [2] Latent Transformer Models for out-of-distribution detection
    Graham, Mark S.
    Tudosiu, Petru-Daniel
    Wright, Paul
    Pinaya, Walter Hugo Lopez
    Teikari, Petteri
    Patel, Ashay
    U-King-Im, Jean-Marie
    Mah, Yee H.
    Teo, James T.
    Jager, Hans Rolf
    Werring, David
    Rees, Geraint
    Nachev, Parashkev
    Ourselin, Sebastien
    Cardoso, M. Jorge
    MEDICAL IMAGE ANALYSIS, 2023, 90
  • [3] Exploring transition states of protein conformational changes via out-of-distribution detection in the hyperspherical latent space
    Liu, Bojun
    Boysen, Jordan G.
    Unarta, Ilona Christy
    Du, Xuefeng
    Li, Yixuan
    Huang, Xuhui
    NATURE COMMUNICATIONS, 2025, 16 (01)
  • [4] Out-of-Distribution Detection in Multi-Label Datasets using Latent Space of β-VAE
    Sundar, Vijaya Kumar
    Ramakrishna, Shreyas
    Rahiminasab, Zahra
    Easwaran, Arvind
    Dubey, Abhishek
    2020 IEEE SYMPOSIUM ON SECURITY AND PRIVACY WORKSHOPS (SPW 2020), 2020, : 250 - 255
  • [5] Supervision Adaptation Balancing In-Distribution Generalization and Out-of-Distribution Detection
    Zhao, Zhilin
    Cao, Longbing
    Lin, Kun-Yu
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (12) : 15743 - 15758
  • [6] Variational- and Metric-based Deep Latent Space for Out-of-Distribution Detection
    Dinari, Or
    Freifeld, Oren
    UNCERTAINTY IN ARTIFICIAL INTELLIGENCE, VOL 180, 2022, 180 : 568 - 578
  • [7] Efficient Out-of-Distribution Detection Using Latent Space of β-VAE for Cyber-Physical Systems
    Ramakrishna, Shreyas
    Rahiminasab, Zahra
    Karsai, Gabor
    Easwaran, Arvind
    Dubey, Abhishek
    ACM TRANSACTIONS ON CYBER-PHYSICAL SYSTEMS, 2022, 6 (02)
  • [8] Out-of-distribution Detection Learning with Unreliable Out-of-distribution Sources
    Zheng, Haotian
    Wang, Qizhou
    Fang, Zhen
    Xia, Xiaobo
    Liu, Feng
    Liu, Tongliang
    Han, Bo
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [9] Principled Out-of-Distribution Detection via Multiple Testing
    Magesh, Akshayaa
    Veeravalli, Venugopal V.
    Roy, Anirban
    Jha, Susmit
    JOURNAL OF MACHINE LEARNING RESEARCH, 2023, 24
  • [10] On the Learnability of Out-of-distribution Detection
    Fang, Zhen
    Li, Yixuan
    Liu, Feng
    Han, Bo
    Lu, Jie
    Journal of Machine Learning Research, 2024, 25