A Lightweight Concept Drift Detection and Adaptation Framework for IoT Data Streams

被引:66
|
作者
Yang L. [1 ]
Shami A. [1 ]
机构
[1] Western University, Ontario
来源
IEEE Internet of Things Magazine | 2021年 / 4卷 / 02期
关键词
Anomaly detection - Data Analytics;
D O I
10.1109/IOTM.0001.2100012
中图分类号
学科分类号
摘要
In recent years, with the increasing popularity of 'Smart Technology', the number of Internet of Things (IoT) devices and systems have surged significantly. Various IoT services and functionalities are based on the analytics of IoT streaming data. However, IoT data analytics faces concept drift challenges due to the dynamic nature of IoT systems and the ever-changing patterns of IoT data streams. In this article, we propose an adaptive IoT streaming data analytics framework for anomaly detection use cases based on optimized LightGBM and concept drift adaptation. A novel drift adaptation method named Optimized Adaptive and Sliding Windowing (OASW) is proposed to adapt to the pattern changes of online IoT data streams. Experiments on two public datasets show the high accuracy and efficiency of our proposed adaptive LightGBM model compared against other state-of-the-art approaches. The proposed adaptive LightGBM model can perform continuous learning and drift adaptation on IoT data streams without human intervention. © 2018 IEEE.
引用
收藏
页码:96 / 101
页数:5
相关论文
共 50 条
  • [31] Concept Drift Detection from Multi-Class Imbalanced Data Streams
    Korycki, Lukasz
    Krawczyk, Bartosz
    2021 IEEE 37TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2021), 2021, : 1068 - 1079
  • [32] Disposition-Based Concept Drift Detection and Adaptation in Data Stream
    Supriya Agrahari
    Anil Kumar Singh
    Arabian Journal for Science and Engineering, 2022, 47 : 10605 - 10621
  • [33] Disposition-Based Concept Drift Detection and Adaptation in Data Stream
    Agrahari, Supriya
    Singh, Anil Kumar
    ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2022, 47 (08) : 10605 - 10621
  • [34] Ensemble framework for concept-drift detection in multidimensional streaming data
    Prasad K.S.N.
    Rao A.S.
    Ramana A.V.
    International Journal of Computers and Applications, 2022, 44 (12) : 1193 - 1200
  • [35] Regional Concept Drift Detection and Density Synchronized Drift Adaptation
    Liu, Anjin
    Song, Yiliao
    Zhang, Guangquan
    Lu, Jie
    PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 2280 - 2286
  • [36] Comparing Block Ensembles for Data Streams with Concept Drift
    Deckert, Magdalena
    Stefanowski, Jerzy
    NEW TRENDS IN DATABASES AND INFORMATION SYSTEMS, 2013, 185 : 69 - 78
  • [37] Accurate detecting concept drift in evolving data streams
    Yan, Myuu Myuu Wai
    ICT EXPRESS, 2020, 6 (04): : 332 - 338
  • [38] Concept Drift Detection Technique using Supervised and Unsupervised Learning for Big Data Streams
    Hashmani, Manzoor Ahmed
    Jameel, Syed Muslim
    Uddin, Vali
    Rizvi, Syed Sajjad Hussain
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2020, 20 (01): : 106 - +
  • [39] Concept Drift Detection for Multivariate Data Streams and Temporal Segmentation of Daylong Egocentric Videos
    Nagar, Pravin
    Khemka, Mansi
    Arora, Chetan
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 1065 - 1074
  • [40] Proactive Drift Detection: Predicting Concept Drifts in Data Streams using Probabilistic Networks
    Chen, Kylie
    Koh, Yun Sing
    Riddle, Patricia
    2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 780 - 787