Selective ensemble method for anomaly detection based on parallel learning

被引:2
|
作者
Liu, Yansong [1 ,2 ]
Zhu, Li [1 ]
Ding, Lei [3 ]
Huang, Zifeng [4 ]
Sui, He [5 ,6 ]
Wang, Shuang [6 ]
Song, Yuedong [7 ]
机构
[1] Xi An Jiao Tong Univ, Sch Software Engn, Xian, Peoples R China
[2] Shandong Management Univ, Sch Intelligent Engn, Jinan, Peoples R China
[3] Guangzhou Univ, Sch Cyberspace Secur, Guangzhou, Peoples R China
[4] Guangzhou Univ, Sch Elect & Commun Engn, Guangzhou 510006, Peoples R China
[5] Civil Aviat Univ China, Coll Aeronaut Engn, Tianjin 300300, Peoples R China
[6] Civil Aviat Univ China, Informat Secur Evaluat Ctr Civil Aviat, Tianjin 300300, Peoples R China
[7] Shanghai Hua Xun Network Informat Syst Co Ltd, Shanghai 200135, Peoples R China
关键词
D O I
10.1038/s41598-024-51849-3
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Anomaly detection is a highly important task in the field of data analysis. Traditional anomaly detection approaches often strongly depend on data size, structure and features, while introducing the idea of ensemble into anomaly detection can greatly improve the generalization ability. Ensemble-based anomaly detection methods still face some challenges, however, such as data imbalance, time and space demand and the selection of base detectors. To this end, we propose a selective ensemble method for anomaly detection based on parallel learning (SEAD-PL). First, a differentiated stratified sampling method is designed to alleviate the problem of data imbalance. Then, a distributed parallel training frame is built to address the problem of excessive time and space consumption for base detector training. Finally, a clustering-based ensemble selection strategy is introduced to balance the accuracy and diversity of base detectors. Experiments are performed on six datasets, which demonstrate that the proposed method has obvious advantages over four selected methods.
引用
收藏
页数:21
相关论文
共 50 条
  • [31] HELAD: A novel network anomaly detection model based on heterogeneous ensemble learning
    Zhong, Ying
    Chen, Wenqi
    Wang, Zhiliang
    Chen, Yifan
    Wang, Kai
    Li, Yahui
    Yin, Xia
    Shi, Xingang
    Yang, Jiahai
    Li, Keqin
    COMPUTER NETWORKS, 2020, 169 (169)
  • [32] Cloud-based multiclass anomaly detection and categorization using ensemble learning
    Faisal Shahzad
    Abdul Mannan
    Abdul Rehman Javed
    Ahmad S. Almadhor
    Thar Baker
    Dhiya Al-Jumeily OBE
    Journal of Cloud Computing, 11
  • [33] Power data classification method based on selective ensemble learning
    Zhang, Yi-Ying
    Liu, Fei
    Pang, Hao-Yuan
    Zhang, Bo
    Wang, Yang
    Journal of Computers (Taiwan), 2020, 31 (01) : 253 - 260
  • [34] A Parallel Majority Learning Algorithm for Anomaly Detection
    Huang, Shin-Ying
    Peng, Ya-Yun
    Yu, Fang
    2017 IEEE 15TH INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, 15TH INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, 3RD INTL CONF ON BIG DATA INTELLIGENCE AND COMPUTING AND CYBER SCIENCE AND TECHNOLOGY CONGRESS(DASC/PICOM/DATACOM/CYBERSCI, 2017, : 1310 - 1313
  • [35] Robust Anomaly Detection via Sequential Ensemble Learning
    Yilmaz, Selim F.
    Kozat, Suleyman S.
    2020 28TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2020,
  • [36] Mateen: Adaptive Ensemble Learning for Network Anomaly Detection
    Alotaibi, Fahad
    Maffeis, Sergio
    PROCEEDINGS OF 27TH INTERNATIONAL SYMPOSIUM ON RESEARCH IN ATTACKS, INTRUSIONS AND DEFENSES, RAID 2024, 2024, : 215 - 234
  • [37] SELECTIVE ENSEMBLE LEARNING WITH PARALLEL OPTIMIZATION AND HIERARCHICAL SELECTION
    Gu, Jia-Sheng
    Zeng, Jian-Cang
    Chen, Jin-Xiu
    Zou, Quan
    PROCEEDINGS OF 2015 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS (ICMLC), VOL. 1, 2015, : 194 - 199
  • [38] Spatial Ensemble Anomaly Detection Method for Exhaustive Map-Based Datasets
    Liu, Wendi
    Pyrcz, Michael J.
    ENERGY EXPLORATION & EXPLOITATION, 2023, 41 (02) : 406 - 420
  • [39] Anomaly Symptom Detection using Ensemble Prediction based on New Weighting Method
    Murakami, Kenya
    Suzuki, Satoshi
    Matsui, Tetsuro
    2017 56TH ANNUAL CONFERENCE OF THE SOCIETY OF INSTRUMENT AND CONTROL ENGINEERS OF JAPAN (SICE), 2017, : 1144 - 1146
  • [40] Electricity Theft Detection Method Based on Ensemble Learning and Prototype Learning
    Sun, Xinwu
    Hu, Jiaxiang
    Zhang, Zhenyuan
    Cao, Di
    Huang, Qi
    Chen, Zhe
    Hu, Weihao
    JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2024, 12 (01) : 213 - 224