A novel drift detection method using parallel detection and anti-noise techniques

被引:0
|
作者
Zhang, Qian [1 ,2 ,3 ]
Liu, Guanjun [1 ,2 ,3 ]
机构
[1] Tongji Univ, Dept Comp Sci & Technol, 4800 Caoan Highway, Shanghai 201804, Peoples R China
[2] Tongji Univ, Minist Educ, Key Lab Embedded Syst & Serv Comp, 4800 Caoan Highway, Shanghai 201804, Peoples R China
[3] Tongji Univ, Shanghai Elect Transact & Informat Serv, Collaborat Innovat Ctr, Shanghai 201804, Peoples R China
关键词
Stream data; Concept drift; Machine learning; Change detection; ONLINE;
D O I
10.1007/s10489-024-05988-9
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the rapid development of the Internet industry, a large amount of streaming data with significant application value will be generated on the Internet. The distribution of stream data is evolving over time compared to traditional data, posing a significant challenge in the learning process from streaming data. In order to adapt the change of data distribution, concept drift detection methods are proposed to pinpoint when the concept drift occurs. Most existing drift detection methods, however, overlook the improvement of the current classifier and the influence of noise data on drift detection. This oversight leads to a decrease in the effectiveness of drift detection. In this paper, we propose a novel adaptation drift detection method to overcome the shortcomings of previous algorithms, such as error detection and lack of anti-noise capability. Meanwhile, stream computing and parallel computing are used to enhance the efficiency of our algorithm. The results of a simulation experiment on 9 synthetic stream data and 6 real-world stream data, all exhibiting concept drift, demonstrate that our method is more effective in handling concept drift compared to other state-of-the-art methods.
引用
收藏
页数:18
相关论文
共 50 条
  • [31] Anti-noise FCM image segmentation method based on quadratic polynomial
    Zhang, Xijing
    Ning, Yang
    Li, Xuemei
    Zhang, Caiming
    Zhang, Xijing (2662872194@qq.com), 1600, Elsevier B.V. (178):
  • [32] Improved Active Frequency Drift Anti-Islanding Detection Method
    Ge Yangyang
    Sun, Junjie
    Gang, Wang
    Gao Zhiqiang
    Li, Yu
    PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON MATERIALS ENGINEERING AND INFORMATION TECHNOLOGY APPLICATIONS, 2015, 28 : 249 - 255
  • [33] An Improved Active Frequency Drift Anti-islanding Detection Method
    Wang, Shuai
    Zhang, Shaoru
    Liu, Lingling
    Jia, Yikun
    Qie, Chenjie
    PROCEEDINGS OF THE 2016 IEEE 11TH CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA), 2016, : 2170 - 2173
  • [34] An interpretable anti-noise convolutional neural network for online chatter detection in thin-walled parts milling
    Lu, Yezhong
    Ma, Haifeng
    Sun, Yuxin
    Song, Qinghua
    Liu, Zhanqiang
    Xiong, Zhenhua
    MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2024, 206
  • [35] On a pitch detection method using noise reduction
    Kim, J
    Lee, KY
    Bae, MJ
    COMPUTATIONAL LINGUISTICS AND INTELLIGENT TEXT PROCESSING, 2005, 3406 : 429 - 432
  • [36] An anti-noise φ-OTDR based distributed acoustic sensing system for high-speed railway intrusion detection
    Li, Zhongqi
    Zhang, Jianwei
    Wang, Maoning
    Chai, Jinchuan
    Wu, Yu
    Peng, Fei
    LASER PHYSICS, 2020, 30 (08)
  • [37] A novel blink detection method based on pupillometry noise
    Hershman, Ronen
    Henik, Avishai
    Cohen, Noga
    BEHAVIOR RESEARCH METHODS, 2018, 50 (01) : 107 - 114
  • [38] A novel blink detection method based on pupillometry noise
    Ronen Hershman
    Avishai Henik
    Noga Cohen
    Behavior Research Methods, 2018, 50 : 107 - 114
  • [39] A novel manufacturing defect detection method using association rule mining techniques
    Chen, WC
    Tseng, SS
    Wang, CY
    EXPERT SYSTEMS WITH APPLICATIONS, 2005, 29 (04) : 807 - 815
  • [40] Rapid bird sound recognition using anti-noise texture features
    Wei, Jing-Ming
    Li, Ying
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2015, 43 (01): : 185 - 190