Fast concept drift detection using unlabeled data

被引:0
|
作者
Shang, Dan [1 ]
Zhang, Guangquan [1 ]
Lu, Jie [1 ]
机构
[1] Univ Technol Sydney, Ctr Artificial Intelligence, Fac Engn & Informat Technol, Sydney, NSW 2007, Australia
基金
澳大利亚研究理事会;
关键词
Concept Drift; Unsupervised Learning; Stream Data Mining;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Streaming data mining is in use today in many industrial applications, but performance of the models is deteriorated by concept drift, especially when true labels are unavailable. This paper addresses the need of detecting concept drifts under unsupervised situation and proposes the Unsupervised Concept Drift Detection (UCDD) method. A cluster technique is first applied to determine artificial labels of the data set, then a fast drift detection algorithm is used to detect the boundary change between the labeled clusters. Through the empirical evaluation, the method demonstrates effectiveness on detecting various types of concept drifts.
引用
收藏
页码:133 / 140
页数:8
相关论文
共 50 条
  • [41] Fast Adaptive Real-Time Classification for Data Streams with Concept Drift
    Tennant, Mark
    Stahl, Frederic
    Gomes, Joao Bartolo
    INTERNET AND DISTRIBUTED COMPUTING SYSTEMS, IDCS 2015, 2015, 9258 : 265 - 272
  • [42] Detection & management of concept drift
    Mak, Lee-Onn
    Krause, Paul
    PROCEEDINGS OF 2006 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2006, : 3486 - +
  • [43] Learning from Concept Drifting Data Streams with Unlabeled Data
    Li, Peipei
    Wu, Xindong
    Hu, Xuegang
    PROCEEDINGS OF THE TWENTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE (AAAI-10), 2010, : 1945 - 1946
  • [44] Learning from concept drifting data streams with unlabeled data
    Wu, Xindong
    Li, Peipei
    Hu, Xuegang
    NEUROCOMPUTING, 2012, 92 : 145 - 155
  • [45] A Multiscale Concept Drift Detection Method for Learning from Data Streams
    Wang, XueSong
    Kang, Qi
    Zhou, MengChu
    Yao, SiYa
    2018 IEEE 14TH INTERNATIONAL CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING (CASE), 2018, : 786 - 790
  • [46] SDDM: an interpretable statistical concept drift detection method for data streams
    Simona Micevska
    Ahmed Awad
    Sherif Sakr
    Journal of Intelligent Information Systems, 2021, 56 : 459 - 484
  • [47] Research on detection and integration classification based on concept drift of data stream
    Baoju Zhang
    Yidi Chen
    EURASIP Journal on Wireless Communications and Networking, 2019
  • [48] Disposition-Based Concept Drift Detection and Adaptation in Data Stream
    Supriya Agrahari
    Anil Kumar Singh
    Arabian Journal for Science and Engineering, 2022, 47 : 10605 - 10621
  • [49] Combining active learning with concept drift detection for data stream mining
    Krawczyk, Bartosz
    Pfahringer, Bernhard
    Wozniak, Michal
    2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2018, : 2239 - 2244
  • [50] Bayesian Nonparametric Unsupervised Concept Drift Detection for Data Stream Mining
    Xuan, Junyu
    Lu, Jie
    Zhang, Guangquan
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2021, 12 (01)