Research on detection and integration classification based on concept drift of data stream

被引:0
|
作者
Baoju Zhang
Yidi Chen
机构
[1] Tianjin Normal University,Tianjin Key Laboratory of Wireless Mobile Communications and Power Transmission
关键词
Data stream; Concept drift detection mechanism; Essential emerging pattern; Integration classification;
D O I
暂无
中图分类号
学科分类号
摘要
As a new type of data, data stream has the characteristics of massive, high-speed, orderly, and continuous and is widely distributed in sensor networks, mobile communication, financial transactions, network traffic analysis, and other fields. However, due to the inherent problem of concept drift, it poses a great challenge to data stream mining. Therefore, this paper proposes a dual detection mechanism to judge the drift of concepts, and on this basis, the integration classification of data stream is carried out. The system periodically detects data stream with the index of classification error and uses the features of the essential emerging pattern (eEP) with high discrimination to help build the integrated classifiers to solve the classification mining problems in the dynamic data stream environment. Experiments show that the proposed algorithm can obtain better classification results under the premise of effectively coping with the change of concepts.
引用
收藏
相关论文
共 50 条
  • [21] Analyzing and repairing concept drift adaptation in data stream classification
    Ben Halstead
    Yun Sing Koh
    Patricia Riddle
    Russel Pears
    Mykola Pechenizkiy
    Albert Bifet
    Gustavo Olivares
    Guy Coulson
    Machine Learning, 2022, 111 : 3489 - 3523
  • [22] An ensemble method for data stream classification in the presence of concept drift
    Omid ABBASZADEH
    Ali AMIRI
    Ali Reza KHANTEYMOORI
    FrontiersofInformationTechnology&ElectronicEngineering, 2015, 16 (12) : 1059 - 1068
  • [23] Analyzing and repairing concept drift adaptation in data stream classification
    Halstead, Ben
    Koh, Yun Sing
    Riddle, Patricia
    Pears, Russel
    Pechenizkiy, Mykola
    Bifet, Albert
    Olivares, Gustavo
    Coulson, Guy
    MACHINE LEARNING, 2022, 111 (10) : 3489 - 3523
  • [24] An ensemble method for data stream classification in the presence of concept drift
    Omid Abbaszadeh
    Ali Amiri
    Ali Reza Khanteymoori
    Frontiers of Information Technology & Electronic Engineering, 2015, 16 : 1059 - 1068
  • [25] Feature Selection for Handling Concept Drift in the Data Stream Classification
    Turkov, Pavel
    Krasotkina, Olga
    Mottl, Vadim
    Sychugov, Alexey
    MACHINE LEARNING AND DATA MINING IN PATTERN RECOGNITION (MLDM 2016), 2016, 9729 : 614 - 629
  • [26] Concept Drift Detection in Histogram-Based Straightforward Data Stream Prediction
    Casillas, Jorge
    Wang, Shuo
    Yao, Xin
    2018 18TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW), 2018, : 878 - 885
  • [27] Bhattacharyya distance based concept drift detection method for evolving data stream
    Baidari, Ishwar
    Honnikoll, Nagaraj
    EXPERT SYSTEMS WITH APPLICATIONS, 2021, 183
  • [28] A Classification and Novel Class Detection Algorithm for Concept Drift Data Stream Based on the Cohesiveness and Separation Index of Mahalanobis Distance
    Li, Xiangjun
    Zhou, Yong
    Jin, Ziyan
    Yu, Peng
    Zhou, Shun
    JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING, 2020, 2020
  • [29] Concept Drift Detection in Data Stream Mining : A literature review
    Agrahari, Supriya
    Singh, Anil Kumar
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (10) : 9523 - 9540
  • [30] Novel Class Detection with Concept Drift in Data Stream - AhtNODE
    Gandhi, Jay
    Gandhi, Vaibhav
    INTERNATIONAL JOURNAL OF DISTRIBUTED SYSTEMS AND TECHNOLOGIES, 2020, 11 (01) : 15 - 26