Towards Fair Deep Anomaly Detection

被引:22
|
作者
Zhang, Hongjing [1 ]
Davidson, Ian [1 ]
机构
[1] Univ Calif Davis, Davis, CA 95616 USA
关键词
machine learning; algorithmic fairness; anomaly detection; deep learning; adversarial learning;
D O I
10.1145/3442188.3445878
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Anomaly detection aims to find instances that are considered unusual and is a fundamental problem of data science. Recently, deep anomaly detection methods were shown to achieve superior results particularly in complex data such as images. Our work focuses on deep one-class classification for anomaly detection which learns a mapping only from the normal samples. However, the non-linear transformation performed by deep learning can potentially find patterns associated with social bias. The challenge with adding fairness to deep anomaly detection is to ensure both making fair and correct anomaly predictions simultaneously. In this paper, we propose a new architecture for the fair anomaly detection approach (Deep Fair SVDD) and train it using an adversarial network to de-correlate the relationships between the sensitive attributes and the learned representations. This differs from how fairness is typically added namely as a regularizer or a constraint. Further, we propose two effective fairness measures and empirically demonstrate that existing deep anomaly detection methods are unfair. We show that our proposed approach can remove the unfairness largely with minimal loss on the anomaly detection performance. Lastly, we conduct an in-depth analysis to show the strength and limitations of our proposed model, including parameter analysis, feature visualization, and run-time analysis.
引用
收藏
页码:138 / 148
页数:11
相关论文
共 50 条
  • [41] Towards a Science of Anomaly Detection System Evasion
    Ali, Muhammad Qasim
    Ashfaq, Ayesha Binte
    Al-Shaer, Ehab
    Duan, Qi
    2015 IEEE CONFERENCE ON COMMUNICATIONS AND NETWORK SECURITY (CNS), 2015, : 460 - 468
  • [42] Towards Total Recall in Industrial Anomaly Detection
    Roth, Karsten
    Pemula, Latha
    Zepeda, Joaquin
    Scholkopf, Bernhard
    Brox, Thomas
    Gehler, Peter
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 14298 - 14308
  • [43] Tackling racial bias in automated online hate detection: Towards fair and accurate detection of hateful users with geometric deep learning
    Zo Ahmed
    Bertie Vidgen
    Scott A. Hale
    EPJ Data Science, 11
  • [44] Tackling racial bias in automated online hate detection: Towards fair and accurate detection of hateful users with geometric deep learning
    Ahmed, Zo
    Vidgen, Bertie
    Hale, Scott A.
    EPJ DATA SCIENCE, 2022, 11 (01)
  • [45] Unsupervised Deep Anomaly Detection in Chest Radiographs
    Takahiro Nakao
    Shouhei Hanaoka
    Yukihiro Nomura
    Masaki Murata
    Tomomi Takenaga
    Soichiro Miki
    Takeyuki Watadani
    Takeharu Yoshikawa
    Naoto Hayashi
    Osamu Abe
    Journal of Digital Imaging, 2021, 34 : 418 - 427
  • [46] Unsupervised Phase Discovery with Deep Anomaly Detection
    Kottmann, Korbinian
    Huembeli, Patrick
    Lewenstein, Maciej
    Acin, Antonio
    PHYSICAL REVIEW LETTERS, 2020, 125 (17)
  • [47] Energy Anomaly Detection with Forecasting and Deep Learning
    Hollingsworth, Keith
    Rouse, Kathryn
    Cho, Jin
    Harris, Austin
    Sartipi, Mina
    Sozer, Sevin
    Enevoldson, Bryce
    2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2018, : 4921 - 4925
  • [48] Towards trustworthy cybersecurity operations using Bayesian Deep Learning to improve uncertainty quantification of anomaly detection
    Yang, Tengfei
    Qiao, Yuansong
    Lee, Brian
    COMPUTERS & SECURITY, 2024, 144
  • [49] Deep Unrolling for Anomaly Detection in Network Flows
    Schynol, Lukas
    Pesavento, Marius
    2023 IEEE 9TH INTERNATIONAL WORKSHOP ON COMPUTATIONAL ADVANCES IN MULTI-SENSOR ADAPTIVE PROCESSING, CAMSAP, 2023, : 61 - 65
  • [50] Robust Deep Learning Methods for Anomaly Detection
    Chalapathy, Raghavendra
    Khoa, Nguyen Lu Dang
    Chawla, Sanjay
    KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, : 3507 - 3508