A Framework for Verifiable and Auditable Collaborative Anomaly Detection

被引:1
|
作者
Santin, Gabriele [1 ]
Skarbovsky, Inna [2 ]
Fournier, Fabiana [2 ]
Lepri, Bruno [1 ]
机构
[1] Bruno Kessler Fdn FBK, Digital Soc Ctr, I-38123 Trento, Italy
[2] IBM Res, Haifa Univ Campus, IL-3498825 Haifa, Israel
来源
IEEE ACCESS | 2022年 / 10卷
关键词
Collaboration; Collaborative work; Anomaly detection; Radio frequency; Training; Computer architecture; Task analysis; Algorithm auditing; anomaly detection; blockchain; collaborative learning; BLOCKCHAIN;
D O I
10.1109/ACCESS.2022.3196391
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Collaborative and Federated Leaning are emerging approaches to manage cooperation between a group of agents for the solution of Machine Learning tasks, with the goal of improving each agent's performance without disclosing any data. In this paper we present a novel algorithmic architecture that tackle this problem in the particular case of Anomaly Detection (or classification of rare events), a setting where typical applications often comprise data with sensible information, but where the scarcity of anomalous examples encourages collaboration. We show how Random Forests can be used as a tool for the development of accurate classifiers with an effective insight-sharing mechanism that does not break the data integrity. Moreover, we explain how the new architecture can be readily integrated in a blockchain infrastructure to ensure the verifiable and auditable execution of the algorithm. Furthermore, we discuss how this work may set the basis for a more general approach for the design of collaborative ensemble-learning methods beyond the specific task and architecture discussed in this paper.
引用
收藏
页码:82896 / 82909
页数:14
相关论文
共 50 条
  • [31] An Anomaly Detection Framework for Twitter Data
    Kumar, Sandeep
    Khan, Muhammad Badruddin
    Abul Hasanat, Mozaherul Hoque
    Saudagar, Abdul Khader Jilani
    AlTameem, Abdullah
    AlKhathami, Mohammed
    APPLIED SCIENCES-BASEL, 2022, 12 (21):
  • [32] An Anomaly Detection Framework for IIoT in Agriculture
    Swate, Clementine
    Sithungu, Siphesihle Philezwini
    Lebea, Khutso
    PROCEEDINGS OF NINTH INTERNATIONAL CONGRESS ON INFORMATION AND COMMUNICATION TECHNOLOGY, ICICT 2024, VOL 7, 2024, 1003 : 419 - 429
  • [33] Developing a generic framework for anomaly detection
    Fatemifar, Soroush
    Awais, Muhammad
    Akbari, Ali
    Kittler, Josef
    PATTERN RECOGNITION, 2022, 124
  • [34] A Comprehensive Augmentation Framework for Anomaly Detection
    Lin, Jiang
    Yan, Yaping
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 8, 2024, : 8742 - 8749
  • [35] Anomaly Detection of Metro Station Tracks Based on Sequential Updatable Anomaly Detection Framework
    Zheng, Zhongxing
    Liu, Weiming
    Liu, Ruikang
    Wang, Liang
    Mao, Liang
    Qiu, Qisheng
    Ling, Guangzheng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (11) : 7677 - 7691
  • [36] Sparse and collaborative representation-based anomaly detection
    Maryam Imani
    Signal, Image and Video Processing, 2020, 14 : 1573 - 1581
  • [37] Hyperspectral Anomaly Detection Via Dual Collaborative Representation
    Zhang, Guoyun
    Li, Nanying
    Tu, Bing
    Liao, Zhuolang
    Peng, Yishu
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 (13) : 4881 - 4894
  • [38] Collaborative Contextual Anomaly Detection for Industrial Equipment Groups
    Shi, Kai
    Song, Hang
    Yu, Hai
    Zhu, Zhiliang
    PROCEEDINGS OF 2016 9TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID), VOL 1, 2016, : 381 - 385
  • [39] RCA: A Deep Collaborative Autoencoder Approach for Anomaly Detection
    Liu, Boyang
    Wang, Ding
    Lin, Kaixiang
    Tan, Pang-Ning
    Zhou, Jiayu
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 1505 - 1511
  • [40] On the Usefulness of Machine Learning Techniques in Collaborative Anomaly Detection
    Senel-Kleine, Secil
    Bouche, Johannes
    Kappes, Martin
    2015 INTERNET TECHNOLOGIES AND APPLICATIONS (ITA) PROCEEDINGS OF THE SIXTH INTERNATIONAL CONFERENCE (ITA 15), 2015, : 213 - 218