Strategies for data stream mining method applied in anomaly detection

被引:13
|
作者
Sun, Ruxia [1 ]
Zhang, Sun [1 ]
Yin, Chunyong [1 ]
Wang, Jin [2 ,3 ]
Min, Seungwook [4 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Jiangsu Collaborat Innovat Ctr Atmospher Environm, Jiangsu Engn Ctr Network Monitoring, Sch Comp & Software, Nanjing, Jiangsu, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Minist Educ, Key Lab Broadband Wireless Commun & Sensor Networ, Nanjing, Jiangsu, Peoples R China
[3] Yangzhou Univ, Coll Informat Engn, Yangzhou, Jiangsu, Peoples R China
[4] Sangmyung Univ, Dept Comp Sci, Seoul, South Korea
基金
中国国家自然科学基金;
关键词
Anomaly detection; Data stream; Clustering; Concept drift; DETECTION SYSTEM; ALGORITHMS;
D O I
10.1007/s10586-018-2835-2
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Anomaly detection, which is a method of intrusion detection, detects anomaly behaviors and protects network security. Data mining technology has been integrated to improve the performance of anomaly detection and some algorithms have been improved for anomaly detection field. We think that most data mining algorithms are analyzed on static data sets and ignore the influence of dynamic data streams. Data stream is the potentially unbounded, ordered sequence of data objects which arrive over time. The entire data objects cannot be stored and they need to be handled in one-time scanning. The data distribution of data stream may change over time and this phenomenon is called concept drift. The properties of data stream make analysis method different from the method based on data set and the analysis model is required to be updated immediately when concept drift occurs. In this paper, we summarize the characteristics of data stream, compare the difference between data stream and data set, discuss the problems of data stream mining and propose some corresponding strategies.
引用
收藏
页码:399 / 408
页数:10
相关论文
共 50 条
  • [1] Strategies for data stream mining method applied in anomaly detection
    Ruxia Sun
    Sun Zhang
    Chunyong Yin
    Jin Wang
    Seungwook Min
    Cluster Computing, 2019, 22 : 399 - 408
  • [2] A KNNS Based Anomaly Detection Method Applied for UAV Flight Data Stream
    Liu, Yu
    Ding, Wenrui
    2015 PROGNOSTICS AND SYSTEM HEALTH MANAGEMENT CONFERENCE (PHM), 2015,
  • [3] Anomaly Detection in Business Process based on Data Stream Mining
    Tavares, Gabriel Marques
    Turrisi da Costa, Victor G.
    Martins, Vinicius Eiji
    Ceravolo, Paolo
    Barbon, Sylvio, Jr.
    PROCEEDINGS OF THE 14TH BRAZILIAN SYMPOSIUM ON INFORMATION SYSTEMS (SBSI2018), 2018, : 120 - 127
  • [4] A Data Mining based Approach for Electric Motor Anomaly Detection Applied on Vibration Data
    Egaji, Oche A.
    Ekwevugbe, Tobore
    Griffiths, Mark
    PROCEEDINGS OF THE 2020 FOURTH WORLD CONFERENCE ON SMART TRENDS IN SYSTEMS, SECURITY AND SUSTAINABILITY (WORLDS4 2020), 2020, : 330 - 334
  • [5] Big Data Stream Anomaly Detection with Spectral Method for UWB Radar Data
    Yun, Ying
    Wang, Wei
    PROCEEDINGS OF THE THIRD INTERNATIONAL CONFERENCE ON COMMUNICATIONS, SIGNAL PROCESSING, AND SYSTEMS, 2015, 322 : 253 - 259
  • [6] Data Mining Method for Anomaly Detection in the Supercomputer Task Flow
    Voevodin, Vadim
    Voevodin, Vladimir
    Shaikhislamov, Denis
    Nikitenko, Dmitry
    NUMERICAL COMPUTATIONS: THEORY AND ALGORITHMS (NUMTA-2016), 2016, 1776
  • [7] Noise tolerant drift detection method for data stream mining
    Wang, Pingfan
    Jin, Nanlin
    Woo, Wai Lok
    Woodward, John R.
    Davies, Duncan
    INFORMATION SCIENCES, 2022, 609 : 1318 - 1333
  • [8] Intrusion Detection System using Stream Data Mining and Drift Detection Method
    Kumar, Manish
    Hanumanthappa, M.
    2013 FOURTH INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATIONS AND NETWORKING TECHNOLOGIES (ICCCNT), 2013,
  • [9] Anomaly Detection for Time Series Data Stream
    Wang, Qifan
    Yan, Bo
    Su, Hongyi
    Zheng, Hong
    2021 IEEE 6TH INTERNATIONAL CONFERENCE ON BIG DATA ANALYTICS (ICBDA 2021), 2021, : 118 - 122
  • [10] Method of Anomaly Detection of Temperature Data in Vacuum Thermal Test based on Data Mining
    Xie, Jihui
    Wu, Dongliang
    Liao, Tao
    2018 EIGHTH INTERNATIONAL CONFERENCE ON INSTRUMENTATION AND MEASUREMENT, COMPUTER, COMMUNICATION AND CONTROL (IMCCC 2018), 2018, : 1040 - 1045