A Lightweight Concept Drift Detection and Adaptation Framework for IoT Data Streams

被引:66
|
作者
Yang L. [1 ]
Shami A. [1 ]
机构
[1] Western University, Ontario
来源
IEEE Internet of Things Magazine | 2021年 / 4卷 / 02期
关键词
Anomaly detection - Data Analytics;
D O I
10.1109/IOTM.0001.2100012
中图分类号
学科分类号
摘要
In recent years, with the increasing popularity of 'Smart Technology', the number of Internet of Things (IoT) devices and systems have surged significantly. Various IoT services and functionalities are based on the analytics of IoT streaming data. However, IoT data analytics faces concept drift challenges due to the dynamic nature of IoT systems and the ever-changing patterns of IoT data streams. In this article, we propose an adaptive IoT streaming data analytics framework for anomaly detection use cases based on optimized LightGBM and concept drift adaptation. A novel drift adaptation method named Optimized Adaptive and Sliding Windowing (OASW) is proposed to adapt to the pattern changes of online IoT data streams. Experiments on two public datasets show the high accuracy and efficiency of our proposed adaptive LightGBM model compared against other state-of-the-art approaches. The proposed adaptive LightGBM model can perform continuous learning and drift adaptation on IoT data streams without human intervention. © 2018 IEEE.
引用
收藏
页码:96 / 101
页数:5
相关论文
共 50 条
  • [41] Survey of Concept Drift Detection and Adaptation Methods
    Meng, Fanxing
    Han, Meng
    Li, Chunpeng
    Zhang, Ruihua
    He, Feifei
    Computer Engineering and Applications, 2024, 60 (04) : 75 - 88
  • [42] Online Feature Screening for Data Streams With Concept Drift
    Wang, Mingyuan
    Barbu, Adrian
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (11) : 11693 - 11707
  • [43] A comprehensive analysis of concept drift locality in data streams
    Aguiar, Gabriel J.
    Cano, Alberto
    KNOWLEDGE-BASED SYSTEMS, 2024, 289
  • [44] An Ultimately Simple Concept Drift Detector for Data Streams
    Ferreira Maciel, Bruno Iran
    Gonzalez Hidalgo, Juan Isidro
    Maior de Barros, Roberto Souto
    2021 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2021, : 625 - 630
  • [45] An Active Learning Method for Data Streams with Concept Drift
    Park, Cheong Hee
    Kang, Youngsoon
    2016 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2016, : 746 - 752
  • [46] Incremental Weighted Ensemble for Data Streams With Concept Drift
    Jiao B.
    Guo Y.
    Yang C.
    Pu J.
    Zheng Z.
    Gong D.
    IEEE Transactions on Artificial Intelligence, 2024, 5 (01): : 92 - 103
  • [47] Accuracy Updated Ensemble for Data Streams with Concept Drift
    Brzezinski, Dariusz
    Stefanowski, Jerzy
    HYBRID ARTIFICIAL INTELLIGENT SYSTEMS, PART II, 2011, 6679 : 155 - 163
  • [48] A comprehensive analysis of concept drift locality in data streams
    Department of Computer Science, Virginia Commonwealth University, Richmond
    VA, United States
    Knowl Based Syst,
  • [49] Utilizing an Ensemble Machine Learning Framework for Handling Concept Drift in Spatiotemporal Data Streams Classification
    Angbera, Ature
    Chan, Huah Yong
    Informatica (Slovenia), 2024, 48 (02): : 213 - 222
  • [50] Semi-supervised concept drift detection and adaptation based on conformal martingale framework
    Zhang, Yu
    Zhou, Ping
    Zhang, Ruiyao
    Lu, Shaowen
    Chai, Tianyou
    JOURNAL OF PROCESS CONTROL, 2025, 147