Selective ensemble method for anomaly detection based on parallel learning

被引:2
|
作者
Liu, Yansong [1 ,2 ]
Zhu, Li [1 ]
Ding, Lei [3 ]
Huang, Zifeng [4 ]
Sui, He [5 ,6 ]
Wang, Shuang [6 ]
Song, Yuedong [7 ]
机构
[1] Xi An Jiao Tong Univ, Sch Software Engn, Xian, Peoples R China
[2] Shandong Management Univ, Sch Intelligent Engn, Jinan, Peoples R China
[3] Guangzhou Univ, Sch Cyberspace Secur, Guangzhou, Peoples R China
[4] Guangzhou Univ, Sch Elect & Commun Engn, Guangzhou 510006, Peoples R China
[5] Civil Aviat Univ China, Coll Aeronaut Engn, Tianjin 300300, Peoples R China
[6] Civil Aviat Univ China, Informat Secur Evaluat Ctr Civil Aviat, Tianjin 300300, Peoples R China
[7] Shanghai Hua Xun Network Informat Syst Co Ltd, Shanghai 200135, Peoples R China
关键词
D O I
10.1038/s41598-024-51849-3
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Anomaly detection is a highly important task in the field of data analysis. Traditional anomaly detection approaches often strongly depend on data size, structure and features, while introducing the idea of ensemble into anomaly detection can greatly improve the generalization ability. Ensemble-based anomaly detection methods still face some challenges, however, such as data imbalance, time and space demand and the selection of base detectors. To this end, we propose a selective ensemble method for anomaly detection based on parallel learning (SEAD-PL). First, a differentiated stratified sampling method is designed to alleviate the problem of data imbalance. Then, a distributed parallel training frame is built to address the problem of excessive time and space consumption for base detector training. Finally, a clustering-based ensemble selection strategy is introduced to balance the accuracy and diversity of base detectors. Experiments are performed on six datasets, which demonstrate that the proposed method has obvious advantages over four selected methods.
引用
收藏
页数:21
相关论文
共 50 条
  • [21] Sequential Ensemble Method for Unsupervised Anomaly Detection
    Huy Van Nguyen
    Trung Thanh Nguyen
    Quang Uy Nguyen
    2017 9TH INTERNATIONAL CONFERENCE ON KNOWLEDGE AND SYSTEMS ENGINEERING (KSE 2017), 2017, : 71 - 76
  • [22] Anomaly Detection with Selective Dictionary Learning
    Ilie-Ablachim, Denis C.
    Dumitrescu, Bogdan
    2022 8TH INTERNATIONAL CONFERENCE ON CONTROL, DECISION AND INFORMATION TECHNOLOGIES (CODIT'22), 2022, : 255 - 260
  • [23] A Discriminative Metric Learning Based Anomaly Detection Method
    Du, Bo
    Zhang, Liangpei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2014, 52 (11): : 6844 - 6857
  • [24] Multivariate Variance-Based Genetic Ensemble Learning for Satellite Anomaly Detection
    Sadr, Mohammad Amin Maleki
    Zhu, Yeying
    Hu, Peng
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (11) : 14155 - 14165
  • [25] An Anomaly Detection Algorithm Based on Ensemble Learning for 5G Environment
    Lei, Lifeng
    Kou, Liang
    Zhan, Xianghao
    Zhang, Jilin
    Ren, Yongjian
    SENSORS, 2022, 22 (19)
  • [26] A Correlation Analysis-Based Mobile Core Network KPI Anomaly Detection Method via Ensemble Learning
    Wang, Li
    Liu, Ying
    Zhang, Weiting
    Yan, Xincheng
    Zhou, Na
    Jiang, Zhihong
    EMERGING NETWORKING ARCHITECTURE AND TECHNOLOGIES, ICENAT 2022, 2023, 1696 : 479 - 493
  • [27] Hyperspectral Anomaly Detection Using Sparse Kernel-based Ensemble Learning
    Gurram, Prudhvi
    Han, Timothy
    Kwon, Heesung
    ALGORITHMS AND TECHNOLOGIES FOR MULTISPECTRAL, HYPERSPECTRAL, AND ULTRASPECTRAL IMAGERY XVII, 2011, 8048
  • [28] Cloud-based multiclass anomaly detection and categorization using ensemble learning
    Shahzad, Faisal
    Mannan, Abdul
    Javed, Abdul Rehman
    Almadhor, Ahmad S.
    Baker, Thar
    Obe, Dhiya Al-Jumeily
    JOURNAL OF CLOUD COMPUTING-ADVANCES SYSTEMS AND APPLICATIONS, 2022, 11 (01):
  • [29] Anomaly-Based Intrusion Detection Using Machine Learning: An Ensemble Approach
    Lalduhsaka R.
    Bora N.
    Khan A.K.
    International Journal of Information Security and Privacy, 2022, 16 (01):
  • [30] Diversity Aware-Based Sequential Ensemble Learning for Robust Anomaly Detection
    Zhang, Jia
    Li, Zhiyong
    Chen, Shaomiao
    IEEE ACCESS, 2020, 8 (08): : 42349 - 42363