A New Statistical Method for Anomaly Detection in Distributed Systems

被引:1
|
作者
Vafaie, Bamdad [1 ]
Shamsi, Mahboubeh [2 ]
Javan, Morteza Sargolzaei [3 ]
El-Khatib, Khalil [1 ]
机构
[1] Ontario Tech Univ, Fac Business & Informat Technol, Oshawa, ON, Canada
[2] Qom Univ Technol, Fac Elect & Comp Engn, Qom, Iran
[3] Amirkabir Univ Technol, Dept Comp Engn & IT, Tehran, Iran
来源
2020 IEEE CANADIAN CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING (CCECE) | 2020年
关键词
Distributed systems; Distributed Monitoring; Anomalies in Distributed systems; Statistical analytic techniques; the Principal component analysis; DIAGNOSIS;
D O I
10.1109/ccece47787.2020.9255700
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Distributed computing systems are increasing in popularity and being widely used as a new way of large-scale data processing. However, to achieve a reliable and efficient performance in a distributed environment, it is important to deal with system anomalies as soon as they are encountered. In this paper, two novel anomaly detection algorithms will be introduced and compared with previous anomaly detection algorithms. These novel algorithms are devised based on data summarization and error prediction in comparison with previously extracted data. The result of our experiments show that the proposed methods exhibit higher performance in terms of precision and accuracy.
引用
收藏
页数:4
相关论文
共 50 条
  • [1] Moving Dispersion Method for Statistical Anomaly Detection in Intrusion Detection Systems
    Golic, Jovan Dj.
    ISECURE-ISC INTERNATIONAL JOURNAL OF INFORMATION SECURITY, 2009, 1 (02): : 71 - 90
  • [2] New statistical approaches for anomaly detection
    Callegari, Christian
    Giordano, Stefano
    Pagano, Michele
    SECURITY AND COMMUNICATION NETWORKS, 2009, 2 (06) : 611 - 634
  • [3] Anomaly detection in distributed computer communication systems
    Grzech, Adam
    CYBERNETICS AND SYSTEMS, 2006, 37 (06) : 635 - 652
  • [4] Distributed Systems Anomaly Detection Based on Log
    Lai, Fenggang
    Zhang, Pan
    Cheng, Ruiying
    Xu, Peng
    2021 INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGIES FOR DISASTER MANAGEMENT (ICT-DM), 2021, : 72 - 79
  • [5] A New Statistical Approach to Network Anomaly Detection
    Callegari, Christian
    Vaton, Sandrine
    Pagano, Michele
    PROCEEDINGS OF THE 2008 INTERNATIONAL SYMPOSIUM ON PERFORMANCE EVALUATION OF COMPUTER AND TELECOMMUNICATION SYSTEMS, 2008, : 441 - +
  • [6] Cascaded Anomaly Detection with Coarse Sampling in Distributed Systems
    Badica, Amelia
    Badica, Costin
    Bolanowski, Marek
    Fidanova, Stefka
    Ganzha, Maria
    Harizanov, Stanislav
    Ivanovic, Mirjana
    Lirkov, Ivan
    Paprzycki, Marcin
    Paszkiewicz, Andrzej
    Tomczyk, Kacper
    BIG-DATA-ANALYTICS IN ASTRONOMY, SCIENCE, AND ENGINEERING, BDA 2021, 2022, 13167 : 181 - 200
  • [7] MAAD: A Distributed Anomaly Detection Architecture for Microservices Systems
    Tan, Rongyuan
    Li, Zhuozhao
    PROCEEDINGS 2024 IEEE INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM, IPDPS 2024, 2024, : 1009 - 1021
  • [8] Log summarization and anomaly detection for troubleshooting distributed systems
    Gunter, Dan
    Tierney, Brian L.
    Brown, Aaron
    Swany, Martin
    Bresnahan, John
    Schopf, Jennifer M.
    2007 8TH IEEE/ACM INTERNATIONAL CONFERENCE ON GRID COMPUTING, 2007, : 41 - +
  • [9] Anomaly Detection in Distributed Systems via Variational Autoencoders
    Qian, Yun
    Ying, Shi
    Wang, Bingming
    2020 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2020, : 2822 - 2829
  • [10] LogSpy: System Log Anomaly Detection for Distributed Systems
    Li, Haoming
    Li, Yuguo
    2020 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND COMPUTER ENGINEERING (ICAICE 2020), 2020, : 347 - 352