Ensemble Noise Filtering for Streaming Data Using Poisson Bootstrap Model Filtering

被引:2
|
作者
Satyanarayana, Ashwin [1 ]
Chinchilla, Rosemary [1 ]
机构
[1] CUNY, New York City Coll Technol, Dept Comp Syst Technol, N-913,300 Jay St, Brooklyn, NY 11201 USA
来源
关键词
D O I
10.1007/978-3-319-32467-8_75
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Ensemble filtering techniques filter noisy instances by combining the predictions of multiple base models, each of which is learned using a traditional algorithm. However, in the last decade, due to the massive increase in the amount of online streaming data, ensemble filtering methods, which largely operate in batch mode and requiresmultiple passes over the data, cause time and storage complexities. In this paper, we present an ensemble bootstrap model filtering technique with multiple inductive learning algorithms on several small Poisson bootstrapped samples of online data to filter noisy instances. We analyze three prior filtering techniques using Bayesian computational analysis to understand the underlying distribution of the model space. We implement our and other prior filtering approaches and show that our approach is more accurate than other prior filtering methods.
引用
收藏
页码:869 / 879
页数:11
相关论文
共 50 条
  • [41] Reducing Forecast Errors Due to Model Imperfections Using Ensemble Kalman Filtering
    Koyama, Hiroshi
    Watanabe, Masahiro
    MONTHLY WEATHER REVIEW, 2010, 138 (08) : 3316 - 3332
  • [42] Battery Health Estimation Using Electrochemical Aging Model and Ensemble Kalman Filtering
    Xu, Le
    Deng, Zhongwei
    Hu, Xiaosong
    2021 IEEE INTERNATIONAL FUTURE ENERGY ELECTRONICS CONFERENCE (IFEEC), 2021,
  • [43] Value-based predicate filtering of streaming XML data
    Kwon, Joonho
    Rao, Praveen
    Moon, Bongki
    Lee, Sukho
    MUE: 2007 INTERNATIONAL CONFERENCE ON MULTIMEDIA AND UBIQUITOUS ENGINEERING, PROCEEDINGS, 2007, : 289 - +
  • [44] Bootstrap filtering for the position location using wireless communication on highways
    Cho, S
    Chun, J
    PROCEEDINGS OF THE 39TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-5, 2000, : 1017 - 1018
  • [45] Filtering of white noise using the interacting multiple model for speech enhancement
    Kim, JB
    Lee, CW
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 1997, E80D (12) : 1227 - 1229
  • [46] Ensemble Kalman filtering for force model identification in milling
    Schwenzer, Max
    Stemmler, Sebastian
    Ay, Muzaffer
    Bergs, Thomas
    Abel, Dirk
    17TH CIRP CONFERENCE ON MODELLING OF MACHINING OPERATIONS (17TH CIRP CMMO), 2019, 82 : 296 - 301
  • [47] Local ensemble Kalman filtering in the presence of model bias
    Baek, SJ
    Hunt, BR
    Kalnay, E
    Ott, E
    Szunyogh, I
    TELLUS SERIES A-DYNAMIC METEOROLOGY AND OCEANOGRAPHY, 2006, 58 (03) : 293 - 306
  • [48] A Novel Noise Filtering Model for Photon-Counting Laser Altimeter Data
    Wang, Xiao
    Pan, Zhigang
    Glennie, Craig
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2016, 13 (07) : 947 - 951
  • [49] An Ensemble Machine Learning Botnet Detection Framework Based on Noise Filtering
    Liu, Tzong-Jye
    Lin, Tze-Shiun
    Chen, Ching-Wen
    JOURNAL OF INTERNET TECHNOLOGY, 2021, 22 (06): : 1347 - 1357
  • [50] Moving average filtering with deconvolution (MAD) for hidden Markov model with filtering and correlated noise
    Ibrahim M. Almanjahie
    Ramzan Nazim Khan
    Robin K. Milne
    Takeshi Nomura
    Boris Martinac
    European Biophysics Journal, 2019, 48 : 383 - 393