A novel drift detection method using parallel detection and anti-noise techniques

被引:0
|
作者
Zhang, Qian [1 ,2 ,3 ]
Liu, Guanjun [1 ,2 ,3 ]
机构
[1] Tongji Univ, Dept Comp Sci & Technol, 4800 Caoan Highway, Shanghai 201804, Peoples R China
[2] Tongji Univ, Minist Educ, Key Lab Embedded Syst & Serv Comp, 4800 Caoan Highway, Shanghai 201804, Peoples R China
[3] Tongji Univ, Shanghai Elect Transact & Informat Serv, Collaborat Innovat Ctr, Shanghai 201804, Peoples R China
关键词
Stream data; Concept drift; Machine learning; Change detection; ONLINE;
D O I
10.1007/s10489-024-05988-9
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the rapid development of the Internet industry, a large amount of streaming data with significant application value will be generated on the Internet. The distribution of stream data is evolving over time compared to traditional data, posing a significant challenge in the learning process from streaming data. In order to adapt the change of data distribution, concept drift detection methods are proposed to pinpoint when the concept drift occurs. Most existing drift detection methods, however, overlook the improvement of the current classifier and the influence of noise data on drift detection. This oversight leads to a decrease in the effectiveness of drift detection. In this paper, we propose a novel adaptation drift detection method to overcome the shortcomings of previous algorithms, such as error detection and lack of anti-noise capability. Meanwhile, stream computing and parallel computing are used to enhance the efficiency of our algorithm. The results of a simulation experiment on 9 synthetic stream data and 6 real-world stream data, all exhibiting concept drift, demonstrate that our method is more effective in handling concept drift compared to other state-of-the-art methods.
引用
收藏
页数:18
相关论文
共 50 条
  • [21] A NSZT Method for Frequency Estimation and Anti-noise Performance Analysis
    ZHANG Wenxin
    LIU Xiaojun
    CHEN Xiuwei
    LIU Qing
    FANG Guangyou
    Chinese Journal of Electronics, 2018, 27 (03) : 648 - 657
  • [22] An anti-noise SVM parameter optimization method for speech recognition
    Bai, Jing
    Yang, Lihong
    Zhang, Xueying
    Zhongnan Daxue Xuebao (Ziran Kexue Ban)/Journal of Central South University (Science and Technology), 2013, 44 (02): : 604 - 611
  • [23] Research of anti-noise image salient region extraction method
    Xu, Bing
    Xie, Shiyi
    Li, Zhende
    Xu, B. (bingxuswcd@163.com), 1600, International Hellenic University - School of Science (07): : 143 - 147
  • [24] A Novel Method for Malware Detection Using Audio Signal Processing Techniques
    Farrokhmanesh, Mehrdad
    Hamzeh, Ali
    2016 ARTIFICIAL INTELLIGENCE AND ROBOTICS (IRANOPEN), 2016, : 85 - 91
  • [25] Anti-noise computational imaging using unsupervised deep learning
    Zhai, Xinliang
    Wu, Xiaoyan
    Sun, Yiwei
    Shi, Jianhong
    Zeng, Guihua
    OPTICS EXPRESS, 2022, 30 (23) : 41884 - 41897
  • [26] Intrusion Detection System using Stream Data Mining and Drift Detection Method
    Kumar, Manish
    Hanumanthappa, M.
    2013 FOURTH INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATIONS AND NETWORKING TECHNOLOGIES (ICCCNT), 2013,
  • [27] Novel statistical method for data drift detection in satellite telemetry
    Praveen, M. V. Ramachandra
    Kuchhal, Piyush
    Choudhury, Sushabhan
    INTERNATIONAL JOURNAL OF COMMUNICATION SYSTEMS, 2024, 37 (09)
  • [28] An anti-noise text categorization method based on support vector machines
    Chen, L
    Huang, J
    Gong, ZH
    ADVANCES IN WEB INTELLIGENCE, PROCEEDINGS, 2005, 3528 : 272 - 278
  • [29] Impulse noise detection and removal using fuzzy techniques
    Zhang, D
    Wang, Z
    ELECTRONICS LETTERS, 1997, 33 (05) : 378 - 379
  • [30] Anti-noise FCM image segmentation method based on quadratic polynomial
    Zhang, Xijing
    Ning, Yang
    Li, Xuemei
    Zhang, Caiming
    SIGNAL PROCESSING, 2021, 178