Anomaly Detection Based on Mining Six Local Data Features and BP Neural Network

被引:6
|
作者
Zhang, Yu [1 ]
Zhu, Yuanpeng [2 ]
Li, Xuqiao [2 ]
Wang, Xiaole [2 ]
Guo, Xutong [2 ]
机构
[1] South China Univ Technol, Sch Mech & Automot Engn, Guangzhou 510641, Guangdong, Peoples R China
[2] South China Univ Technol, Sch Math, Guangzhou 510641, Guangdong, Peoples R China
来源
SYMMETRY-BASEL | 2019年 / 11卷 / 04期
基金
中国国家自然科学基金;
关键词
anomaly detection; local data features; BP neural network; local monotonicity; convexity; concavity; local inflection; peaks distribution;
D O I
10.3390/sym11040571
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Key performance indicators (KPIs) are time series with the format of (timestamp, value). The accuracy of KPIs anomaly detection is far beyond our initial expectations sometimes. The reasons include the unbalanced distribution between the normal data and the anomalies as well as the existence of many different types of the KPIs data curves. In this paper, we propose a new anomaly detection model based on mining six local data features as the input of back-propagation (BP) neural network. By means of vectorization description on a normalized dataset innovatively, the local geometric characteristics of one time series curve could be well described in a precise mathematical way. Differing from some traditional statistics data characteristics describing the entire variation situation of one sequence, the six mined local data features give a subtle insight of local dynamics by describing the local monotonicity, the local convexity/concavity, the local inflection property and peaks distribution of one KPI time series. In order to demonstrate the validity of the proposed model, we applied our method on 14 classical KPIs time series datasets. Numerical results show that the new given scheme achieves an average F-1-score over 90%. Comparison results show that the proposed model detects the anomaly more precisely.
引用
收藏
页数:20
相关论文
共 50 条
  • [21] Application of data mining technology based on BP neural network in yarn qualities forecast
    Wang wen
    Fei Shumin
    Zheng Bo
    Wu Chengyun
    Wen Yaoqi
    2006 CHINESE CONTROL CONFERENCE, VOLS 1-5, 2006, : 1035 - +
  • [22] An Audit Risk Model Based on Improved BP Neural Network Data Mining Algorithm
    Niu, Wenjia
    Zhao, Lihua
    Jia, Peiyao
    Chu, Jiankun
    ADVANCES IN MULTIMEDIA, 2022, 2022
  • [23] The Evaluation on Data Mining Methods of Horizontal Bar Training Based on BP Neural Network
    Zhang, Yanhui
    Liu, Shaoqing
    2015 INTERNATIONAL CONFERENCE ON ENERGY, MATERIALS AND MANUFACTURING ENGINEERING (EMME 2015), 2015, 25
  • [24] Data Mining Approach for Anomaly Detection in Social Network Analysis
    Sudha, M. Swarna
    Priya, K. Arun
    Lakshmi, A. Kanaka
    Kruthika, A.
    Priya, D. Lakshmi
    Valarmathi, K.
    PROCEEDINGS OF THE 2018 SECOND INTERNATIONAL CONFERENCE ON INVENTIVE COMMUNICATION AND COMPUTATIONAL TECHNOLOGIES (ICICCT), 2018, : 1862 - 1866
  • [25] Applying fuzzy data mining to network unsupervised anomaly detection
    Xiang, G
    Min, W
    Zhao, RC
    INTERNATIONAL SYMPOSIUM ON COMMUNICATIONS AND INFORMATION TECHNOLOGIES 2005, VOLS 1 AND 2, PROCEEDINGS, 2005, : 1249 - 1253
  • [26] Data Anomaly Detection for Structural Health Monitoring Based on a Convolutional Neural Network
    Kim, Soon-Young
    Mukhiddinov, Mukhriddin
    SENSORS, 2023, 23 (20)
  • [27] Local Area Network Anomaly Detection using Association Rules Mining
    Li, Xiaolei
    Zhang, Yun
    Li, Xun
    2009 5TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, NETWORKING AND MOBILE COMPUTING, VOLS 1-8, 2009, : 4678 - +
  • [28] Algorithm Optimization of Anomaly Detection Based on Data Mining
    Zhang, Lei
    Chen, Yong
    Liao, Shaowen
    2018 10TH INTERNATIONAL CONFERENCE ON MEASURING TECHNOLOGY AND MECHATRONICS AUTOMATION (ICMTMA), 2018, : 402 - 404
  • [29] The Coal Production Anomaly Detection Based on Data Mining
    Wang Guanghui
    Kuang Yali
    Wang Zhangguo
    MEASUREMENT TECHNOLOGY AND ITS APPLICATION, PTS 1 AND 2, 2013, 239-240 : 744 - 748
  • [30] Modification of BP neural network algorithm and its application in data mining
    Chen, LC
    Liu, YS
    Tian, R
    Yang, GS
    ISTM/2003: 5TH INTERNATIONAL SYMPOSIUM ON TEST AND MEASUREMENT, VOLS 1-6, CONFERENCE PROCEEDINGS, 2003, : 948 - 952