A novel drift detection method using parallel detection and anti-noise techniques

被引:0
|
作者
Zhang, Qian [1 ,2 ,3 ]
Liu, Guanjun [1 ,2 ,3 ]
机构
[1] Tongji Univ, Dept Comp Sci & Technol, 4800 Caoan Highway, Shanghai 201804, Peoples R China
[2] Tongji Univ, Minist Educ, Key Lab Embedded Syst & Serv Comp, 4800 Caoan Highway, Shanghai 201804, Peoples R China
[3] Tongji Univ, Shanghai Elect Transact & Informat Serv, Collaborat Innovat Ctr, Shanghai 201804, Peoples R China
关键词
Stream data; Concept drift; Machine learning; Change detection; ONLINE;
D O I
10.1007/s10489-024-05988-9
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the rapid development of the Internet industry, a large amount of streaming data with significant application value will be generated on the Internet. The distribution of stream data is evolving over time compared to traditional data, posing a significant challenge in the learning process from streaming data. In order to adapt the change of data distribution, concept drift detection methods are proposed to pinpoint when the concept drift occurs. Most existing drift detection methods, however, overlook the improvement of the current classifier and the influence of noise data on drift detection. This oversight leads to a decrease in the effectiveness of drift detection. In this paper, we propose a novel adaptation drift detection method to overcome the shortcomings of previous algorithms, such as error detection and lack of anti-noise capability. Meanwhile, stream computing and parallel computing are used to enhance the efficiency of our algorithm. The results of a simulation experiment on 9 synthetic stream data and 6 real-world stream data, all exhibiting concept drift, demonstrate that our method is more effective in handling concept drift compared to other state-of-the-art methods.
引用
收藏
页数:18
相关论文
共 50 条
  • [41] ACPJS']JS: An Anti-noise Concept Drift Processing Algorithm Based on JS']JS-divergence
    Song, Xin
    Qin, Shizhen
    Niu, Shaokai
    Wang, Yan
    ADVANCES IN NEURAL NETWORKS - ISNN 2019, PT I, 2019, 11554 : 444 - 453
  • [42] A Comparison of Techniques for Virtual Concept Drift Detection
    Gonzalez, Manuel L.
    Sedano, Javier
    Garcia-Vico, Angel M.
    Villar, Jose R.
    16TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING MODELS IN INDUSTRIAL AND ENVIRONMENTAL APPLICATIONS (SOCO 2021), 2022, 1401 : 3 - 13
  • [43] Predication of efficiency of railway anti-noise barriers with statistical energy analysis method
    Wang, Shao-Jia
    Gao, Shu-Ying
    Xinan Jiaotong Daxue Xuebao/Journal of Southwest Jiaotong University, 2001, 36 (06):
  • [44] A Novel Concept Drift Detection Method for Incremental Learning in Nonstationary Environments
    Yang, Zhe
    Al-Dahidi, Sameer
    Baraldi, Piero
    Zio, Enrico
    Montelatici, Lorenzo
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (01) : 309 - 320
  • [45] An Anti-Noise Method for Radial Velocity Measurement of M-Type Stars
    Yi Zhen-ping
    Pan Jing-change
    Song Yi-han
    Luo A-li
    SPECTROSCOPY AND SPECTRAL ANALYSIS, 2017, 37 (08) : 2594 - 2597
  • [46] A novel method of active low-frequency drift for islanding detection
    Chen, Zenglu
    Meng, Xinxin
    Wang, Xiaojun
    Wang, Ning
    Tian, Miaomiao
    Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2014, (13): : 202 - 207
  • [48] Anti-Noise 3D Object Detection of Multimodal Feature Attention Fusion Based on PV-RCNN
    Zhu, Yuan
    Xu, Ruidong
    An, Hao
    Tao, Chongben
    Lu, Ke
    SENSORS, 2023, 23 (01)
  • [49] A novel method for graffiti detection using change detection algorithm
    Angiati, D
    Gera, G
    Piva, S
    Regazzoni, CS
    AVSS 2005: Advanced Video and Signal Based Surveillance, Proceedings, 2005, : 242 - 246
  • [50] Robust audio retrieval method based on anti-noise fingerprinting and segmental matching
    Zhang, Xueshuai
    Zhan, Ge
    Wang, Wenchao
    Zhang, Pengyuan
    Yan, Yonghong
    ELECTRONICS LETTERS, 2020, 56 (05) : 245 - +