A novel drift detection method using parallel detection and anti-noise techniques

被引:0
|
作者
Zhang, Qian [1 ,2 ,3 ]
Liu, Guanjun [1 ,2 ,3 ]
机构
[1] Tongji Univ, Dept Comp Sci & Technol, 4800 Caoan Highway, Shanghai 201804, Peoples R China
[2] Tongji Univ, Minist Educ, Key Lab Embedded Syst & Serv Comp, 4800 Caoan Highway, Shanghai 201804, Peoples R China
[3] Tongji Univ, Shanghai Elect Transact & Informat Serv, Collaborat Innovat Ctr, Shanghai 201804, Peoples R China
关键词
Stream data; Concept drift; Machine learning; Change detection; ONLINE;
D O I
10.1007/s10489-024-05988-9
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the rapid development of the Internet industry, a large amount of streaming data with significant application value will be generated on the Internet. The distribution of stream data is evolving over time compared to traditional data, posing a significant challenge in the learning process from streaming data. In order to adapt the change of data distribution, concept drift detection methods are proposed to pinpoint when the concept drift occurs. Most existing drift detection methods, however, overlook the improvement of the current classifier and the influence of noise data on drift detection. This oversight leads to a decrease in the effectiveness of drift detection. In this paper, we propose a novel adaptation drift detection method to overcome the shortcomings of previous algorithms, such as error detection and lack of anti-noise capability. Meanwhile, stream computing and parallel computing are used to enhance the efficiency of our algorithm. The results of a simulation experiment on 9 synthetic stream data and 6 real-world stream data, all exhibiting concept drift, demonstrate that our method is more effective in handling concept drift compared to other state-of-the-art methods.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] An Anti-Noise Fast Circle Detection Method Using Five-Quadrant Segmentation
    Ou, Yun
    Deng, Honggui
    Liu, Yang
    Zhang, Zeyu
    Lan, Xin
    SENSORS, 2023, 23 (05)
  • [2] PANORAMA OF ANTI-NOISE TECHNIQUES
    SALFATI, D
    INTER ELECTRONIQUE, 1972, 27 (56): : 21 - +
  • [3] Anti-noise Capability Improvement of Minimum Energy Combination Method for SSVEP Detection
    Trigui, Omar
    Zouch, Wassim
    Ben Messaoud, Mohamed
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2016, 7 (09) : 393 - 401
  • [4] Enhanced GPU-Based Anti-Noise Hybrid Edge Detection Method
    Abed, Sa'ed
    Ali, Mohammed H.
    Al-Shayeji, Mohammad
    COMPUTER SYSTEMS SCIENCE AND ENGINEERING, 2020, 35 (01): : 21 - 37
  • [5] Anti-noise Performance of Correlation Detection Method for Ranging System Based on Combined Modulation
    Hao, Xinhong
    Zhao, Xiangqi
    Yan, Xiaopeng
    INTERNATIONAL CONFERENCE ON GRAPHIC AND IMAGE PROCESSING (ICGIP 2012), 2013, 8768
  • [6] Ellipse Shape Prior Based Anti-noise Network for Parathyroid Detection
    Liu, Wanling
    Cai, Zhongsheng
    Chen, Fei
    Wang, Bo
    Zhao, Wenxin
    Lu, Wenhuan
    FOURTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING, ICGIP 2022, 2022, 12705
  • [7] ADNet: Anti-noise dual-branch network for road defect detection
    Wan, Bin
    Zhou, Xiaofei
    Sun, Yaoqi
    Wang, Tingyu
    Lv, Chengtao
    Wang, Shuai
    Yin, Haibing
    Yan, Chenggang
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 132
  • [8] Multi-structure Elements Morphology for Improved Anti-noise Edge Detection
    Ma, Yarui
    Cui, Jiwen
    Lai, Houhu
    Wang, Hui
    Tan, Jiubin
    TENTH INTERNATIONAL SYMPOSIUM ON PRECISION ENGINEERING MEASUREMENTS AND INSTRUMENTATION, 2019, 11053
  • [9] A New Method For Anti-noise FM Interference
    Jiang, Changyong
    Gao, Meiguo
    Shi, Yiwei
    Fu, Xiongjun
    ICSP: 2008 9TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, VOLS 1-5, PROCEEDINGS, 2008, : 2393 - 2396
  • [10] Orthogonal modulation based light beam induced current method for anti-noise defect detection in photovoltaic cells
    Gan, Dongwen
    Quan, Lei
    Zhu, Fan
    Xie, Kai
    Bai, Junmei
    SOLAR ENERGY, 2022, 245 : 158 - 164