Towards Fair Deep Anomaly Detection

被引:22
|
作者
Zhang, Hongjing [1 ]
Davidson, Ian [1 ]
机构
[1] Univ Calif Davis, Davis, CA 95616 USA
关键词
machine learning; algorithmic fairness; anomaly detection; deep learning; adversarial learning;
D O I
10.1145/3442188.3445878
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Anomaly detection aims to find instances that are considered unusual and is a fundamental problem of data science. Recently, deep anomaly detection methods were shown to achieve superior results particularly in complex data such as images. Our work focuses on deep one-class classification for anomaly detection which learns a mapping only from the normal samples. However, the non-linear transformation performed by deep learning can potentially find patterns associated with social bias. The challenge with adding fairness to deep anomaly detection is to ensure both making fair and correct anomaly predictions simultaneously. In this paper, we propose a new architecture for the fair anomaly detection approach (Deep Fair SVDD) and train it using an adversarial network to de-correlate the relationships between the sensitive attributes and the learned representations. This differs from how fairness is typically added namely as a regularizer or a constraint. Further, we propose two effective fairness measures and empirically demonstrate that existing deep anomaly detection methods are unfair. We show that our proposed approach can remove the unfairness largely with minimal loss on the anomaly detection performance. Lastly, we conduct an in-depth analysis to show the strength and limitations of our proposed model, including parameter analysis, feature visualization, and run-time analysis.
引用
收藏
页码:138 / 148
页数:11
相关论文
共 50 条
  • [21] Cooperative Deep Unsupervised Anomaly Detection
    Angiulli, Fabrizio
    Fassetti, Fabio
    Ferragina, Luca
    Spada, Rosaria
    DISCOVERY SCIENCE (DS 2022), 2022, 13601 : 318 - 328
  • [22] Diagnosing Epileptogenesis with Deep Anomaly Detection
    Farahat, Amr
    Lu, Diyuan
    Bauer, Sebastian
    Neubert, Valentin
    Costard, Lara Sophie
    Rosenow, Felix
    Triesch, Jochen
    MACHINE LEARNING FOR HEALTHCARE CONFERENCE, VOL 182, 2022, 182 : 325 - 342
  • [23] Anomaly Detection with Robust Deep Autoencoders
    Zhou, Chong
    Paffenroth, Randy C.
    KDD'17: PROCEEDINGS OF THE 23RD ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2017, : 665 - 674
  • [24] Spectral anomaly detection in deep shadows
    Kanaev, Andrey V.
    Murray-Krezan, Jeremy
    APPLIED OPTICS, 2010, 49 (09) : 1614 - 1622
  • [25] Deep Block Transformer for Anomaly Detection
    Ishaq, Muhammad Yasir
    Yong, Zhou
    Xue, Shaxin
    Raza, Qamar
    An, Zhijian
    Amin, Muhammad Usama
    2024 4TH INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATION AND ARTIFICIAL INTELLIGENCE, CCAI 2024, 2024, : 481 - 486
  • [26] Unsupervised Deep Subgraph Anomaly Detection
    Zhang, Zheng
    Zhao, Liang
    2022 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2022, : 753 - 762
  • [27] A review on deep anomaly detection in blockchain
    Mounnan, Oussama
    Manad, Otman
    Boubchir, Larbi
    El Mouatasim, Abdelkrim
    Daachi, Boubaker
    BLOCKCHAIN-RESEARCH AND APPLICATIONS, 2024, 5 (04):
  • [28] Toward Explainable Deep Anomaly Detection
    Pang, Guansong
    Aggarwal, Charu
    KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, : 4056 - 4057
  • [29] Deep anomaly detection in packet payload
    Liu, Jiaxin
    Song, Xucheng
    Zhou, Yingjie
    Peng, Xi
    Zhang, Yanru
    Liu, Pei
    Wu, Dapeng
    Zhu, Ce
    NEUROCOMPUTING, 2022, 485 : 205 - 218
  • [30] Network Anomaly Detection with Deep Learning
    Cekmez, Ugur
    Erdem, Zeki
    Yavuz, Ali Gokhan
    Sahingoz, Ozgur Koray
    Buldu, Ali
    2018 26TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2018,