dSalmon: High-Speed Anomaly Detection for Evolving Multivariate Data Streams

被引:0
|
作者
Hartl, Alexander [1 ]
Iglesias, Felix [1 ]
Zseby, Tanja [1 ]
机构
[1] TU Wien Inst Telecommun, A-1040 Vienna, Austria
来源
PERFORMANCE EVALUATION METHODOLOGIES AND TOOLS, VALUETOOLS 2023 | 2024年 / 539卷
关键词
Outlier detection; Data streams; Unsupervised learning; !text type='Python']Python[!/text; C plus;
D O I
10.1007/978-3-031-48885-6_10
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We introduce dSalmon, a highly efficient framework for outlier detection on streaming data. dSalmon can be used with both Python and C++, meeting the requirements of modern data science research. It provides an intuitive interface and has almost no package dependencies. dSalmon implements main stream outlier detection approaches from literature. By using pure C++ in its core and making the most of available parallelism, data is analyzed with superior processing speed. We describe design decisions and outline the software architecture of dSalmon. Additionally, we perform thorough evaluations on benchmarking datasets to measure execution time, memory requirements and energy consumption when performing outlier detection. Experiments show that dSalmon requires substantially less resources and in most cases is able to process datasets between one and three orders of magnitude faster than established Python implementations.
引用
收藏
页码:153 / 169
页数:17
相关论文
共 50 条
  • [21] Anomaly detection for high-speed machining using hybrid regularized support vector data description
    Ma, Zhipeng
    Zhao, Ming
    Dai, Xuebin
    Chen, Yang
    ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2025, 94
  • [22] Intrusion detection for high-speed railways based on unsupervised anomaly detection models
    Wang, Yao
    Yu, Zujun
    Zhu, Liqiang
    APPLIED INTELLIGENCE, 2023, 53 (07) : 8453 - 8466
  • [23] Intrusion detection for high-speed railways based on unsupervised anomaly detection models
    Yao Wang
    Zujun Yu
    Liqiang Zhu
    Applied Intelligence, 2023, 53 : 8453 - 8466
  • [24] Estimation of mixing of high-speed streams
    Kumar, RR
    Kurian, J
    JOURNAL OF PROPULSION AND POWER, 1996, 12 (02) : 429 - 431
  • [25] WHI High-Speed Streams at Geospace
    Maris, G.
    Maris, O.
    HIGHLIGHTS OF ASTRONOMY, VOL 15, 2010, 15 : 494 - +
  • [26] HIGH-SPEED STREAMS AND SECTOR BOUNDARIES
    SAWYER, C
    JOURNAL OF GEOPHYSICAL RESEARCH-SPACE PHYSICS, 1976, 81 (13): : 2437 - 2441
  • [27] Classifying high-speed text streams
    Fung, GPC
    Yu, JX
    Lu, HJ
    ADVANCES IN WEB-AGE INFORMATION MANAGEMENT, PROCEEDINGS, 2003, 2762 : 148 - 160
  • [28] Enhancing Accuracy for Super Spreader Identification in High-Speed Data Streams
    Wang, Haibo
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2024, 17 (11): : 3124 - 3137
  • [29] Multi-scale anomaly detection for high-speed network traffic
    Jiang, Dingde
    Yao, Cheng
    Xu, Zhengzheng
    Qin, Wenda
    TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES, 2015, 26 (03): : 308 - 317
  • [30] Anomaly Detection Guidelines for Data Streams in Big Data
    Rana, Annie Ibrahim
    Estrada, Giovani
    Sole, Marc
    Muntes, Victor
    2016 3RD INTERNATIONAL CONFERENCE ON SOFT COMPUTING & MACHINE INTELLIGENCE (ISCMI 2016), 2016, : 94 - 98