Learning Convolutional Neural Networks in presence of Concept Drift

被引:20
|
作者
Disabato, Simone [1 ]
Roveri, Manuel [1 ]
机构
[1] Politecn Milan, Dipartimento Elettron Informaz & Bioingn, Milan, Italy
关键词
D O I
10.1109/ijcnn.2019.8851731
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Designing adaptive machine learning systems able to operate in nonstationary conditions, also called concept drift, is a novel and promising research area. Convolutional Neural Networks (CNNs) have not been considered a viable solution for such adaptive systems due to the high computational load and the high number of images they require for the training. This paper introduces an adaptive mechanism for learning CNNs able to operate in presence of concept drift. Such an adaptive mechanism follows an "active approach", where the adaptation is triggered by the detection of a concept drift, and relies on the "transfer learning" paradigm to transfer (part of the) knowledge from the CNN operating before the concept drift to the one operating after. The effectiveness of the proposed solution has been evaluated on two types of CNNs and two real-world image benchmarks.
引用
收藏
页数:8
相关论文
共 50 条
  • [21] Learning to Binarize Convolutional Neural Networks with Adaptive Neural Encoder
    Zhang, Shuai
    Ge, Fangyuan
    Ding, Rui
    Liu, Haijun
    Zhou, Xichuan
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [22] Continual learning for neural regression networks to cope with concept drift in industrial processes using convex optimisation
    Grote-Ramm, Wolfgang
    Lanuschny, David
    Lorenzen, Finn
    Brito, Marcel Oliveira
    Schoenig, Felix
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 120
  • [23] Clustering in the Presence of Concept Drift
    Moulton, Richard Hugh
    Viktor, Herna L.
    Japkowicz, Nathalie
    Gama, Joao
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2018, PT I, 2019, 11051 : 339 - 355
  • [24] A concept-aware explainability method for convolutional neural networks
    Gurkan, Mustafa Kagan
    Arica, Nafiz
    Vural, Fatos T. Yarman
    MACHINE VISION AND APPLICATIONS, 2025, 36 (02)
  • [25] Consideration on application of the concept of Saak transform to convolutional neural networks
    Maeda, Tomonori
    Nishikawa, Kiyoshi
    2019 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2019, : 1710 - 1716
  • [26] A NOVEL WEIGHTING METHOD FOR ONLINE ENSEMBLE LEARNING WITH THE PRESENCE OF CONCEPT DRIFT
    Liu, Anjin
    Zhang, Guangquan
    Lu, Jie
    DECISION MAKING AND SOFT COMPUTING, 2014, 9 : 550 - 555
  • [27] Plant identification with convolutional neural networks and transfer learning
    Karahan, Tolgahan
    Nabiyev, Vasif
    PAMUKKALE UNIVERSITY JOURNAL OF ENGINEERING SCIENCES-PAMUKKALE UNIVERSITESI MUHENDISLIK BILIMLERI DERGISI, 2021, 27 (05): : 638 - 645
  • [28] Feature learning for steganalysis using convolutional neural networks
    Qian, Yinlong
    Dong, Jing
    Wang, Wei
    Tan, Tieniu
    MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (15) : 19633 - 19657
  • [29] Learning ability of interpolating deep convolutional neural networks
    Zhou, Tian-Yi
    Huo, Xiaoming
    APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2024, 68
  • [30] Deep Learning of Graphs with Ngram Convolutional Neural Networks
    Luo, Zhiling
    Liu, Ling
    Yin, Jianwei
    Li, Ying
    Wu, Zhaohui
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2017, 29 (10) : 2125 - 2139