Learning under Concept Drift: A Review

被引:883
|
作者
Lu, Jie [1 ]
Liu, Anjin [1 ]
Dong, Fan [1 ]
Gu, Feng [1 ]
Gama, Joao [2 ]
Zhang, Guangquan [1 ]
机构
[1] Univ Technol Sydney, Fac Engn & Informat Technol, Ctr Artificial Intelligence, Decis Syst & E Serv Intelligence Lab, Sydney, NSW 2007, Australia
[2] Univ Porto, Fac Econ, Lab Artificial Intelligence & Decis Support, P-4099002 Porto, Portugal
基金
澳大利亚研究理事会;
关键词
Machine learning; Market research; Data analysis; Big Data; Mobile handsets; Data models; Cameras; Concept drift; change detection; adaptive learning; data streams; TIME ADAPTIVE CLASSIFIERS; TRACKING CONCEPT DRIFT; DATA STREAMS; DECISION TREES; ENSEMBLE; ONLINE; CLASSIFICATION; MACHINE; DIFFERENCE;
D O I
10.1109/TKDE.2018.2876857
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Concept drift describes unforeseeable changes in the underlying distribution of streaming data over time. Concept drift research involves the development of methodologies and techniques for drift detection, understanding, and adaptation. Data analysis has revealed that machine learning in a concept drift environment will result in poor learning results if the drift is not addressed. To help researchers identify which research topics are significant and how to apply related techniques in data analysis tasks, it is necessary that a high quality, instructive review of current research developments and trends in the concept drift field is conducted. In addition, due to the rapid development of concept drift in recent years, the methodologies of learning under concept drift have become noticeably systematic, unveiling a framework which has not been mentioned in literature. This paper reviews over 130 high quality publications in concept drift related research areas, analyzes up-to-date developments in methodologies and techniques, and establishes a framework of learning under concept drift including three main components: concept drift detection, concept drift understanding, and concept drift adaptation. This paper lists and discusses 10 popular synthetic datasets and 14 publicly available benchmark datasets used for evaluating the performance of learning algorithms aiming at handling concept drift. Also, concept drift related research directions are covered and discussed. By providing state-of-the-art knowledge, this survey will directly support researchers in their understanding of research developments in the field of learning under concept drift.
引用
收藏
页码:2346 / 2363
页数:18
相关论文
共 50 条
  • [11] Concept Drift Evolution In Machine Learning Approaches: A Systematic Literature Review
    Hashmani, Manzoor Ahmed
    Jameel, Syed Muslim
    Rehman, Mobashar
    Inoue, Atsushi
    INTERNATIONAL JOURNAL ON SMART SENSING AND INTELLIGENT SYSTEMS, 2020, 13 (01): : 1 - 16
  • [12] Learning classification rules for telecom customer call data under concept drift
    M. Black
    R. Hickey
    Soft Computing, 2003, 8 : 102 - 108
  • [13] Evaluating and Explaining Generative Adversarial Networks for Continual Learning under Concept Drift
    Guzy, Filip
    Wozniak, Michal
    Krawczyk, Bartosz
    21ST IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS ICDMW 2021, 2021, : 295 - 303
  • [14] Reinforcement Learning-Based Streaming Process Discovery Under Concept Drift
    Cai, Rujian
    Zheng, Chao
    Wang, Jian
    Li, Duantengchuan
    Wang, Chong
    Li, Bing
    ADVANCED INFORMATION SYSTEMS ENGINEERING, CAISE 2024, 2024, 14663 : 55 - 70
  • [15] Learning classification rules for telecom customer call data under concept drift
    Black, M
    Hickey, R
    SOFT COMPUTING, 2003, 8 (02) : 102 - 108
  • [16] Class-Incremental Experience Replay for Continual Learning under Concept Drift
    Korycki, Lukasz
    Krawczyk, Bartosz
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 3644 - 3653
  • [17] Combining Time and Space Similarity for Small Size Learning under Concept Drift
    Zliobaite, Indre
    FOUNDATIONS OF INTELLIGENT SYSTEMS, PROCEEDINGS, 2009, 5722 : 412 - 421
  • [18] Learning under concept drift with follow the regularized leader and adaptive decaying proximal
    Ngoc Anh Huynh
    Ng, Wee Keong
    Ariyapala, Kanishka
    EXPERT SYSTEMS WITH APPLICATIONS, 2018, 96 : 49 - 63
  • [19] Concept Drift Learning with Alternating Learners
    Xu, Yunwen
    Xu, Rui
    Yan, Weizhong
    Ardis, Paul
    2017 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2017, : 2104 - 2111
  • [20] Predictive learning models for concept drift
    Case, J
    Jain, S
    Kaufmann, S
    Sharma, A
    Stephan, F
    ALGORITHMIC LEARNING THEORY, 1998, 1501 : 276 - 290