Towards Fair Deep Anomaly Detection

被引:22
|
作者
Zhang, Hongjing [1 ]
Davidson, Ian [1 ]
机构
[1] Univ Calif Davis, Davis, CA 95616 USA
关键词
machine learning; algorithmic fairness; anomaly detection; deep learning; adversarial learning;
D O I
10.1145/3442188.3445878
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Anomaly detection aims to find instances that are considered unusual and is a fundamental problem of data science. Recently, deep anomaly detection methods were shown to achieve superior results particularly in complex data such as images. Our work focuses on deep one-class classification for anomaly detection which learns a mapping only from the normal samples. However, the non-linear transformation performed by deep learning can potentially find patterns associated with social bias. The challenge with adding fairness to deep anomaly detection is to ensure both making fair and correct anomaly predictions simultaneously. In this paper, we propose a new architecture for the fair anomaly detection approach (Deep Fair SVDD) and train it using an adversarial network to de-correlate the relationships between the sensitive attributes and the learned representations. This differs from how fairness is typically added namely as a regularizer or a constraint. Further, we propose two effective fairness measures and empirically demonstrate that existing deep anomaly detection methods are unfair. We show that our proposed approach can remove the unfairness largely with minimal loss on the anomaly detection performance. Lastly, we conduct an in-depth analysis to show the strength and limitations of our proposed model, including parameter analysis, feature visualization, and run-time analysis.
引用
收藏
页码:138 / 148
页数:11
相关论文
共 50 条
  • [31] Deep learning for collective anomaly detection
    Ahmed, Mohiuddin
    Pathan, Al-Sakib Khan
    INTERNATIONAL JOURNAL OF COMPUTATIONAL SCIENCE AND ENGINEERING, 2020, 21 (01) : 137 - 145
  • [32] Towards Interpretable Anomaly Detection: Unsupervised Deep Neural Network Approach using Feedback Loop
    Chawla, Ashima
    Jacob, Paul
    Farrell, Paddy
    Aumayr, Erik
    Fallon, Sheila
    PROCEEDINGS OF THE IEEE/IFIP NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM 2022, 2022,
  • [33] Share or Not Share? Towards the Practicability of Deep Models for Unsupervised Anomaly Detection in Modern Online Systems
    He, Zilong
    Chen, Pengfei
    Huang, Tao
    2022 IEEE 33RD INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING (ISSRE 2022), 2022, : 25 - 36
  • [34] Deep Clustering based Fair Outlier Detection
    Song, Hanyu
    Li, Peizhao
    Liu, Hongfu
    KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, : 1481 - 1489
  • [35] Towards Generalizable Network Anomaly Detection Models
    Arifuzzaman, Md
    Islam, Shafkat
    Arslan, Engin
    PROCEEDINGS OF THE IEEE 46TH CONFERENCE ON LOCAL COMPUTER NETWORKS (LCN 2021), 2021, : 375 - 378
  • [36] Towards Continual Adaptation in Industrial Anomaly Detection
    Li, Wujin
    Zhan, Jiawei
    Wang, Jinbao
    Xia, Bizhong
    Gao, Bin-Bin
    Liu, Jun
    Wang, Chengjie
    Zheng, Feng
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 2871 - 2880
  • [37] Towards Open Set Video Anomaly Detection
    Zhu, Yuansheng
    Bao, Wentao
    Yu, Qi
    COMPUTER VISION, ECCV 2022, PT XXXIV, 2022, 13694 : 395 - 412
  • [38] Towards Reproducible, Automated, and Scalable Anomaly Detection
    Zhao, Yue
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 20, 2024, : 22687 - 22687
  • [39] Towards IoT Anomaly Detection with Tsetlin Machines
    Gunvaldsen, Ole
    Thorsen, Henning Blomfeldt
    Andersen, Per-Arne
    Granmo, Ole-Christoffer
    Goodwin, Morten
    2023 INTERNATIONAL SYMPOSIUM ON THE TSETLIN MACHINE, ISTM, 2023,
  • [40] Fence GAN: Towards Better Anomaly Detection
    Phuc Cuong Ngo
    Winarto, Amadeus Aristo
    Kou, Connie Khor Li
    Park, Sojeong
    Akram, Farhan
    Lee, Hwee Kuan
    2019 IEEE 31ST INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2019), 2019, : 141 - 148