Ensemble Noise Filtering for Streaming Data Using Poisson Bootstrap Model Filtering

被引:2
|
作者
Satyanarayana, Ashwin [1 ]
Chinchilla, Rosemary [1 ]
机构
[1] CUNY, New York City Coll Technol, Dept Comp Syst Technol, N-913,300 Jay St, Brooklyn, NY 11201 USA
来源
关键词
D O I
10.1007/978-3-319-32467-8_75
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Ensemble filtering techniques filter noisy instances by combining the predictions of multiple base models, each of which is learned using a traditional algorithm. However, in the last decade, due to the massive increase in the amount of online streaming data, ensemble filtering methods, which largely operate in batch mode and requiresmultiple passes over the data, cause time and storage complexities. In this paper, we present an ensemble bootstrap model filtering technique with multiple inductive learning algorithms on several small Poisson bootstrapped samples of online data to filter noisy instances. We analyze three prior filtering techniques using Bayesian computational analysis to understand the underlying distribution of the model space. We implement our and other prior filtering approaches and show that our approach is more accurate than other prior filtering methods.
引用
收藏
页码:869 / 879
页数:11
相关论文
共 50 条
  • [1] BAYESIAN FILTERING OF POISSON NOISE USING LOCAL STATISTICS
    RABBANI, M
    IEEE TRANSACTIONS ON ACOUSTICS SPEECH AND SIGNAL PROCESSING, 1988, 36 (06): : 933 - 937
  • [2] Sequential data assimilation for streamflow forecasting using a distributed hydrologic model: particle filtering and ensemble Kalman filtering
    Noh, Seong Jin
    Tachikawa, Yasuto
    Shiiba, Michiharu
    Kim, Sunmin
    FLOODS: FROM RISK TO OPPORTUNITY, 2013, 357 : 341 - +
  • [3] INVERSE POISSON TRANSFORMATION AND SHOT NOISE FILTERING
    QIAN, H
    REVIEW OF SCIENTIFIC INSTRUMENTS, 1990, 61 (08): : 2088 - 2091
  • [4] LASSO for streaming data with adaptative filtering
    Marco Capó
    Aritz Pérez
    José A. Lozano
    Statistics and Computing, 2023, 33
  • [5] LASSO for streaming data with adaptative filtering
    Capo, Marco
    Perez, Aritz
    Lozano, Jose A.
    STATISTICS AND COMPUTING, 2023, 33 (01)
  • [6] Ensemble Kalman filtering with coloured observation noise
    Raboudi, Naila F.
    Ait-El-Fquih, Boujemaa
    Ombao, Hernando
    Hoteit, Ibrahim
    QUARTERLY JOURNAL OF THE ROYAL METEOROLOGICAL SOCIETY, 2021, 147 (741) : 4408 - 4424
  • [7] Noise filtering to improve data and model quality for crowdsourcing
    Li, Chaoqun
    Sheng, Victor S.
    Jiang, Liangxiao
    Li, Hongwei
    KNOWLEDGE-BASED SYSTEMS, 2016, 107 : 96 - 103
  • [8] Using novel noise filtering techniques to ensemble classifiers for credit scoring
    Ngoc Anh Nguyen-Thi
    Quynh Pham-Nhu
    Son Luong-Ngoc
    Nam Vu-Thanh
    2019 INTERNATIONAL CONFERENCE ON TECHNOLOGIES AND APPLICATIONS OF ARTIFICIAL INTELLIGENCE (TAAI), 2019,
  • [9] ICA-domain filtering of Poisson noise images
    Han, XH
    Chen, YW
    Nakao, Z
    Lu, HQ
    THIRD INTERNATIONAL SYMPOSIUM ON MULTISPECTRAL IMAGE PROCESSING AND PATTERN RECOGNITION, PTS 1 AND 2, 2003, 5286 : 811 - 814
  • [10] Iterative Filtering and Smoothing of Measurements Possessing Poisson Noise
    Einicke, G. A.
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2015, 51 (03) : 2205 - 2211