A Lightweight Concept Drift Detection and Adaptation Framework for IoT Data Streams

被引:66
|
作者
Yang L. [1 ]
Shami A. [1 ]
机构
[1] Western University, Ontario
来源
IEEE Internet of Things Magazine | 2021年 / 4卷 / 02期
关键词
Anomaly detection - Data Analytics;
D O I
10.1109/IOTM.0001.2100012
中图分类号
学科分类号
摘要
In recent years, with the increasing popularity of 'Smart Technology', the number of Internet of Things (IoT) devices and systems have surged significantly. Various IoT services and functionalities are based on the analytics of IoT streaming data. However, IoT data analytics faces concept drift challenges due to the dynamic nature of IoT systems and the ever-changing patterns of IoT data streams. In this article, we propose an adaptive IoT streaming data analytics framework for anomaly detection use cases based on optimized LightGBM and concept drift adaptation. A novel drift adaptation method named Optimized Adaptive and Sliding Windowing (OASW) is proposed to adapt to the pattern changes of online IoT data streams. Experiments on two public datasets show the high accuracy and efficiency of our proposed adaptive LightGBM model compared against other state-of-the-art approaches. The proposed adaptive LightGBM model can perform continuous learning and drift adaptation on IoT data streams without human intervention. © 2018 IEEE.
引用
收藏
页码:96 / 101
页数:5
相关论文
共 50 条
  • [1] PWPAE: An Ensemble Framework for Concept Drift Adaptation in IoT Data Streams
    Yang, Li
    Manias, Dimitrios Michael
    Shami, Abdallah
    2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [2] Intrusion detection in the IoT data streams using concept drift localization
    Chu, Renjie
    Jin, Peiyuan
    Qiao, Hanli
    Feng, Quanxi
    AIMS MATHEMATICS, 2024, 9 (01): : 1535 - 1561
  • [3] Ensemble framework for concept drift detection and class imbalance in data streams
    S P.
    R A.U.
    Multimedia Tools and Applications, 2025, 84 (11) : 8823 - 8837
  • [4] Addressing Concept Drift in IoT Anomaly Detection: Drift Detection, Interpretation, and Adaptation
    Xu, Lijuan
    Han, Ziyu
    Zhao, Dawei
    Li, Xin
    Yu, Fuqiang
    Chen, Chuan
    IEEE TRANSACTIONS ON SUSTAINABLE COMPUTING, 2024, 9 (06): : 913 - 924
  • [5] A novel framework for concept drift detection using autoencoders for classification problems in data streams
    Ali, Usman
    Mahmood, Tariq
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2025, 16 (01) : 397 - 418
  • [6] Handling Concept Drift in Data Streams by Using Drift Detection Methods
    Patil, Malini M.
    DATA MANAGEMENT, ANALYTICS AND INNOVATION, ICDMAI 2018, VOL 2, 2019, 839 : 155 - 166
  • [7] OASIS: Online adaptive ensembles for drift adaptation on evolving IoT data streams
    Anithakumari, T.
    Mishra, Sanket
    INTERNET OF THINGS, 2025, 31
  • [8] On learning guarantees to unsupervised concept drift detection on data streams
    de Mello, Rodrigo F.
    Vaz, Yule
    Grossi, Carlos H.
    Bifet, Albert
    EXPERT SYSTEMS WITH APPLICATIONS, 2019, 117 : 90 - 102
  • [9] Nacre: Proactive Recurrent Concept Drift Detection in Data Streams
    Wu, Ocean
    Koh, Yun Sing
    Dobbie, Gillian
    Lacombe, Thomas
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [10] Online Clustering for Novelty Detection and Concept Drift in Data Streams
    Garcia, Kemilly Dearo
    Poel, Mannes
    Kok, Joost N.
    de Carvalho, Andre C. P. L. F.
    PROGRESS IN ARTIFICIAL INTELLIGENCE, PT II, 2019, 11805 : 448 - 459