Anomaly detection method for sensor network data streams based on sliding window sampling and optimized clustering

被引:12
|
作者
Lin, Ling [1 ,2 ]
Su, Jinshan [1 ]
机构
[1] Yili Normal Univ, Elect & Informat Engn Coll, Yining 835000, Xinjiang, Peoples R China
[2] Nanjing Univ, Collaborat Innovat Ctr Novel Software Technol & I, State Key Lab Novel Software Technol, Nanjing 210025, Jiangsu, Peoples R China
关键词
Data stream sampling; Dimension cluster; Maximum entropy principle; Clustering; Anomaly detection;
D O I
10.1016/j.ssci.2019.04.047
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
When detecting abnormal data in the sensor network data stream, it is necessary to accurately obtain the source of the abnormal data. The traditional data stream clustering algorithm has the disadvantages of large clustering information loss and low accuracy. Therefore, this paper proposes a sensor network data stream anomaly detection method based on optimized clustering. Firstly, the proposed sampling algorithm is used to sample the data stream. The sampling result is used as a sample set. Use dynamic data histogram to divide the data dimension into different dimension groups, calculate the maximum entropy division dimension space cluster of each dimension, and aggregate the data of the same dimension cluster into the micro cluster. The abnormality detection of the data stream is realized by comparing the information entropy size of the micro cluster and its distribution characteristics. The experimental results show that the proposed algorithm can improve the accuracy and effectiveness of data stream anomaly detection.
引用
收藏
页码:70 / 75
页数:6
相关论文
共 50 条
  • [31] An adaptive approximation method to discover frequent itemsets over sliding-window-based data streams
    Li, Chao-Wei
    Jea, Kuen-Fang
    EXPERT SYSTEMS WITH APPLICATIONS, 2011, 38 (10) : 13386 - 13404
  • [32] Research on Anomaly Detection of Smart Meters Data Based on Feature Clustering Method
    Chen, Zhiru
    Guo, Liang
    Du, Yan
    Dong, Xianguang
    Wang, Yuxi
    Liu, Ningning
    2021 IEEE IAS INDUSTRIAL AND COMMERCIAL POWER SYSTEM ASIA (IEEE I&CPS ASIA 2021), 2021, : 1562 - 1566
  • [33] A Sliding Window-Based Joint Sparse Representation (SWJS']JSR) Method for Hyperspectral Anomaly Detection
    Soofbaf, Seyyed Reza
    Sahebi, Mahmod Reza
    Mojaradi, Barat
    REMOTE SENSING, 2018, 10 (03):
  • [34] Network anomaly detection based on clustering of sequence patterns
    Noh, Sang-Kyun
    Kim, Yong-Min
    Kim, DongKook
    Noh, Bong-Nam
    COMPUTATIONAL SCIENCE AND ITS APPLICATIONS - ICCSA 2006, PT 2, 2006, 3981 : 349 - 358
  • [35] An EM-Based Algorithm for Clustering Data Streams in Sliding Windows
    Dang, Xuan Hong
    Lee, Vincent
    Ng, Wee Keong
    Ciptadi, Arridhang
    Ong, Kok Leong
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, PROCEEDINGS, 2009, 5463 : 230 - +
  • [36] Network anomaly detection based on DSOM and ACO clustering
    Feng, Yong
    Zhong, Jiang
    Xiong, Zhong-yang
    Ye, Chun-xiao
    Wu, Kai-gui
    ADVANCES IN NEURAL NETWORKS - ISNN 2007, PT 2, PROCEEDINGS, 2007, 4492 : 947 - +
  • [37] Research on network anomaly detection based on clustering and classifier
    Yang, Hongyu
    Xie, Feng
    Lu, Yi
    2006 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND SECURITY, PTS 1 AND 2, PROCEEDINGS, 2006, : 592 - 597
  • [38] Unsupervised Anomaly Detection for Network Data Streams in Industrial Control Systems
    Liu, Limengwei
    Hu, Modi
    Kang, Chaoqun
    Li, Xiaoyong
    INFORMATION, 2020, 11 (02)
  • [39] Anomaly Detection of Sensor Data Based on Similarity
    Sheng, Xun
    Hu, Min
    Yu, Gang
    Teng, Li
    Su, Donghua
    2024 IEEE 7TH INTERNATIONAL CONFERENCE ON AUTOMATION, ELECTRONICS AND ELECTRICAL ENGINEERING, AUTEEE, 2024, : 895 - 898
  • [40] Frequent pattern mining algorithm for uncertain data streams based on sliding window
    Yang, Junrui
    Yang, Cai
    Wei, Yanjun
    2016 8TH INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN-MACHINE SYSTEMS AND CYBERNETICS (IHMSC), VOL. 2, 2016, : 265 - 268