Fast concept drift detection using unlabeled data

被引：0
|
作者：
Shang, Dan [1 ]
Zhang, Guangquan [1 ]
Lu, Jie [1 ]
机构：
[1] Univ Technol Sydney, Ctr Artificial Intelligence, Fac Engn & Informat Technol, Sydney, NSW 2007, Australia
来源：
DEVELOPMENTS OF ARTIFICIAL INTELLIGENCE TECHNOLOGIES IN COMPUTATION AND ROBOTICS | 2020年 / 12卷
基金：
澳大利亚研究理事会;
关键词：
Concept Drift; Unsupervised Learning; Stream Data Mining;
D O I：
暂无
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
Streaming data mining is in use today in many industrial applications, but performance of the models is deteriorated by concept drift, especially when true labels are unavailable. This paper addresses the need of detecting concept drifts under unsupervised situation and proposes the Unsupervised Concept Drift Detection (UCDD) method. A cluster technique is first applied to determine artificial labels of the data set, then a fast drift detection algorithm is used to detect the boundary change between the labeled clusters. Through the empirical evaluation, the method demonstrates effectiveness on detecting various types of concept drifts.
引用
收藏
页码：133 / 140
页数：8
相关论文
共 50 条
  • [21] Concept Drift Detection Technique using Supervised and Unsupervised Learning for Big Data Streams
    Hashmani, Manzoor Ahmed
    Jameel, Syed Muslim
    Uddin, Vali
    Rizvi, Syed Sajjad Hussain
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2020, 20 (01): : 106 - +
  • [22] Proactive Drift Detection: Predicting Concept Drifts in Data Streams using Probabilistic Networks
    Chen, Kylie
    Koh, Yun Sing
    Riddle, Patricia
    2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 780 - 787
  • [23] A novel framework for concept drift detection using autoencoders for classification problems in data streams
    Ali, Usman
    Mahmood, Tariq
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2025, 16 (01) : 397 - 418
  • [24] Concept Drift Detection in Data Stream Mining : A literature review
    Agrahari, Supriya
    Singh, Anil Kumar
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (10) : 9523 - 9540
  • [25] On learning guarantees to unsupervised concept drift detection on data streams
    de Mello, Rodrigo F.
    Vaz, Yule
    Grossi, Carlos H.
    Bifet, Albert
    EXPERT SYSTEMS WITH APPLICATIONS, 2019, 117 : 90 - 102
  • [26] Situational Anomaly Detection in Multimedia Data under Concept Drift
    Kumari, Pratibha
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 2969 - 2973
  • [27] Concept Drift Detection on Streaming Data with Dynamic Outlier Aggregation
    Zellner, Ludwig
    Richter, Florian
    Sontheim, Janina
    Maldonado, Andrea
    Seidl, Thomas
    PROCESS MINING WORKSHOPS, ICPM 2020 INTERNATIONAL WORKSHOPS, 2021, 406 : 206 - 217
  • [28] Concept Drift Detection using Supervised Bivariate Grids
    Salperwyck, Christophe
    Boulle, Marc
    Lemaire, Vincent
    2015 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2015,
  • [29] Online Clustering for Novelty Detection and Concept Drift in Data Streams
    Garcia, Kemilly Dearo
    Poel, Mannes
    Kok, Joost N.
    de Carvalho, Andre C. P. L. F.
    PROGRESS IN ARTIFICIAL INTELLIGENCE, PT II, 2019, 11805 : 448 - 459
  • [30] Novel Class Detection with Concept Drift in Data Stream - AhtNODE
    Gandhi, Jay
    Gandhi, Vaibhav
    INTERNATIONAL JOURNAL OF DISTRIBUTED SYSTEMS AND TECHNOLOGIES, 2020, 11 (01) : 15 - 26
12345