Towards Fair Deep Anomaly Detection

被引:22
|
作者
Zhang, Hongjing [1 ]
Davidson, Ian [1 ]
机构
[1] Univ Calif Davis, Davis, CA 95616 USA
关键词
machine learning; algorithmic fairness; anomaly detection; deep learning; adversarial learning;
D O I
10.1145/3442188.3445878
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Anomaly detection aims to find instances that are considered unusual and is a fundamental problem of data science. Recently, deep anomaly detection methods were shown to achieve superior results particularly in complex data such as images. Our work focuses on deep one-class classification for anomaly detection which learns a mapping only from the normal samples. However, the non-linear transformation performed by deep learning can potentially find patterns associated with social bias. The challenge with adding fairness to deep anomaly detection is to ensure both making fair and correct anomaly predictions simultaneously. In this paper, we propose a new architecture for the fair anomaly detection approach (Deep Fair SVDD) and train it using an adversarial network to de-correlate the relationships between the sensitive attributes and the learned representations. This differs from how fairness is typically added namely as a regularizer or a constraint. Further, we propose two effective fairness measures and empirically demonstrate that existing deep anomaly detection methods are unfair. We show that our proposed approach can remove the unfairness largely with minimal loss on the anomaly detection performance. Lastly, we conduct an in-depth analysis to show the strength and limitations of our proposed model, including parameter analysis, feature visualization, and run-time analysis.
引用
收藏
页码:138 / 148
页数:11
相关论文
共 50 条
  • [1] Towards Deep Anomaly Detection with Structured Knowledge Representations
    Kirchheim, Konstantin
    COMPUTER SAFETY, RELIABILITY, AND SECURITY, SAFECOMP 2023 WORKSHOPS, 2023, 14182 : 382 - 389
  • [2] Towards Efficient Deep Autoencoders for Multivariate Time Series Anomaly Detection
    Pietron, Marcin
    Zurek, Dominik
    Faber, Kamil
    Corizzo, Roberto
    COMPUTATIONAL SCIENCE, ICCS 2024, PT III, 2024, 14834 : 461 - 469
  • [3] Poster Abstract: Towards Adaptive Anomaly Detection in Buildings with Deep Reinforcement Learning
    Wu, Tong
    Ortiz, Jorge
    BUILDSYS'19: PROCEEDINGS OF THE 6TH ACM INTERNATIONAL CONFERENCE ON SYSTEMS FOR ENERGY-EFFICIENT BUILDINGS, CITIES, AND TRANSPORTATION, 2019, : 380 - 382
  • [4] Towards Deep Industrial Transfer Learning for Anomaly Detection on Time Series Data
    Maschler, Benjamin
    Knodel, Tim
    Weyrich, Michael
    2021 26TH IEEE INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2021,
  • [5] Towards Graph-level Anomaly Detection via Deep Evolutionary Mapping
    Ma, Xiaoxiao
    Wu, Jia
    Yang, Jian
    Sheng, Quan Z.
    PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 1631 - 1642
  • [6] Deep Learning for Anomaly Detection
    Pang, Guansong
    Aggarwal, Charu
    Shen, Chunhua
    Sebe, Nicu
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (06) : 2282 - 2286
  • [7] Deep Unsupervised Anomaly Detection
    Li, Tangqing
    Wang, Zheng
    Liu, Siying
    Lin, Wen-Yan
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, : 3635 - 3644
  • [8] Deep Learning for Anomaly Detection
    Wang, Ruoying
    Nie, Kexin
    Wang, Tie
    Yang, Yang
    Long, Bo
    PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING (WSDM '20), 2020, : 894 - 896
  • [9] Deep Learning for Anomaly Detection
    Wang, Ruoying
    Nie, Kexin
    Chang, Yen-Jung
    Gong, Xinwei
    Wang, Tie
    Yang, Yang
    Long, Bo
    KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, : 3569 - 3570
  • [10] Network anomaly detection methods in IoT environments via deep learning: A Fair comparison of performance and robustness
    Bovenzi, Giampaolo
    Aceto, Giuseppe
    Ciuonzo, Domenico
    Montieri, Antonio
    Persico, Valerio
    Pescape, Antonio
    COMPUTERS & SECURITY, 2023, 128