Real-Time Principal Component Analysis

被引：1

作者：

Chowdhury, Ranak Roy ^{[1
]}

Adnan, Muhammad Abdullah ^{[2
]}

Gupta, Rajesh K. ^{[1
]}

机构：

[1] University of California San Diego, Halıcıoglu Data Science Institute, United States

[2] Bangladesh University of Engineering and Technology (BUET), Bangladesh

来源：

ACM/IMS Transactions on Data Science | 2020年 / 1卷 / 02期

关键词：

We propose a variant of Principal Component Analysis (PCA) that is suited for real-time applications. In the real-time version of the PCA problem; we maintain a window over the most recent data and project every incoming row of data into a lower-dimensional subspace; which we generate as the output of the model. The goal is to reduce the reconstruction error of the output from the input and to retain major components pertaining to previous distributions of the data. We use the reconstruction error as the termination criteria to update the eigenspace as new data arrives. We then propose two variants of this algorithm that are progressively more time efficient. To verify whether our proposed model can capture the essence of the changing distribution of large datasets in real time; we have implemented the algorithms and compared performance against carefully designed simulations that change distributions of data sources over time in a controllable manner. Furthermore; we have demonstrated that proposed algorithms can capture the changing distributions of real-life datasets by running simulations on datasets from a variety of real-time applications; e.g; localization; activity recognition; customer expenditure; and so forth. Results show that straightforward modifications to convert PCA to use a sliding window of datasets do not work because of the difficulties associated with determination of optimal window size. Instead; we propose algorithmic enhancements that rely on spectral analysis to improve dimensionality reduction. Results show that our methods can successfully capture the changing distribution of data in a real-time scenario; thus enabling real-time PCA. © 2020 ACM;

D O I：

10.1145/3374750

中图分类号：

学科分类号：

摘要：

引用

共 50 条

[21] Edge Effect Detection for Real-time Cellular Analyzer using Functional Principal Component Analysis
Guo, Qian
Pan, Tianhong
PROCEEDINGS OF 2018 IEEE 7TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE (DDCLS), 2018, : 1011 - 1016
[22] Least Squares Sparse Principal Component Analysis and Parallel Coordinates for Real-Time Process Monitoring
Gajjar, Shriram
Kulahci, Murat
Palazoglu, Ahmet
INDUSTRIAL & ENGINEERING CHEMISTRY RESEARCH, 2020, 59 (35) : 15656 - 15670
[23] A Robust Real-Time Acceleration and Reconstruction Scheme for Rapid MRI Using Principal Component Analysis
Wright, M.
Dietz, B.
Yip, E.
Yun, J.
Fallone, B. G.
Wachowicz, K.
MEDICAL PHYSICS, 2020, 47 (06) : E510 - E511
[24] Real-time monitoring of chemical processes based on variation information of principal component analysis model
Wang, Bei
Yan, Xuefeng
JOURNAL OF INTELLIGENT MANUFACTURING, 2019, 30 (02) : 795 - 808
[25] Fast training and real-time classification algorithm based on Principal Component Analysis and F-transform
Hurtik, Petr
Perfilieva, Irina
2018 JOINT 10TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND INTELLIGENT SYSTEMS (SCIS) AND 19TH INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT SYSTEMS (ISIS), 2018, : 275 - 280
[26] Application of Principal Component Analysis and Adaptive Median Filter to Improve Real-Time Prostate Capsula Detection
Wu, Shixiao
Guo, Chengcheng
Wang, Xinghuan
JOURNAL OF MEDICAL IMAGING AND HEALTH INFORMATICS, 2020, 10 (02) : 336 - 347
[27] Nonlinear real-time process monitoring and fault diagnosis based on principal component analysis and kernel fisher discriminant analysis
Zhang, Xi
Yani, Weiwu
Zhao, Xu
Shao, Huihe
CHEMICAL ENGINEERING & TECHNOLOGY, 2007, 30 (09) : 1203 - 1211
[28] Structured covariance principal component analysis for real-time onsite feature extraction and dimensionality reduction in hyperspectral imaging
Zabalza, Jaime
Ren, Jinchang
Ren, Jie
Liu, Zhe
Marshall, Stephen
APPLIED OPTICS, 2014, 53 (20) : 4440 - 4449
[29] Real-time principal component analysis of in-line NIR spectroscopic data as applied to heterogeneous catalysis research
Strauss, Margaret J.
Prinsloo, Nicolaas M.
APPLIED CATALYSIS A-GENERAL, 2007, 320 (16-23) : 16 - 23
[30] Real-Time Estimation of the Vehicle Sideslip Angle through Regression based on Principal Component Analysis and Neural Networks
De Martino, Massimiliano
Farroni, Flavio
Pasquino, Nicola
Sakhnevych, Aleksandr
Timpone, Francesco
2017 IEEE INTERNATIONAL SYMPOSIUM ON SYSTEMS ENGINEERING (ISSE 2017), 2017, : 151 - 156

← 1 2 3 4 5 →