Application Research of Energy Data Acquisition and Analysis Based on Real-time Stream Processing Platform

被引：0

作者：

Li, Kunming ^{[1
]}

Ji, Cong ^{[1
]}

Zhong, Chunlin ^{[1
]}

Zheng, Fei ^{[1
]}

Shao, Jun ^{[1
]}

机构：

[1] Jiangsu Frontier Elect Technol CO LTD, Smart Grid Prod Ctr, Nanjing, Peoples R China

来源：

PROCEEDINGS OF 2017 6TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND NETWORK TECHNOLOGY (ICCSNT 2017) | 2017年

关键词：

energy saving and emission reduction; real-time stream processing platform; data acquisition; Kafka; Storm;

D O I：

暂无

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

In the context of national energy-saving emission reduction strategy, the user energy efficiency has become a hot topic in academia and the business community. In order to solve the problems of large amount of data and fast changing speed in real-time transmission terminal equipment, it has strict requirement for processing timeliness. We need to introduce distributed real-time data, high-speed synchronization, acquisition and processing and analysis technology to build a real-time flow processing platform. Real-time stream processing platform uses message queue (Kafka) to receive data from different real-time sources, and the back-end uses stream processing technology (Storm) to analyze real-time data.

引用

页码：175 / 178

页数：4

共 50 条

[41] Automated Dam Data Acquisition and Analysis in Real-Time
Kumar, Neelam Sanjeev
Chandrasekaran, Gokul
Karthikeyan, P. R.
DISTRIBUTED COMPUTING AND OPTIMIZATION TECHNIQUES, ICDCOT 2021, 2022, 903 : 199 - 207
[42] Application Development with the FlexWAFE Real-Time Stream Processing Architecture for FPGAs
Lucas, Amilcar Do Carmo
Sahlbach, Henning
Whitty, Sean
Heithecker, Sven
Ernst, Rolf
ACM TRANSACTIONS ON EMBEDDED COMPUTING SYSTEMS, 2009, 9 (01) : 4
[43] Real-Time Data Acquisition and Performance Analysis in Sports
Novatchkov, Hristo
Bichler, Sebastian
Tampier, Martin
Kornfeind, Philipp
Baca, Arnold
PROCEEDINGS OF THE 8TH INTERNATIONAL SYMPOSIUM ON COMPUTER SCIENCE IN SPORT (IACSS2011), 2011, : 76 - 80
[44] Tesla: An application for real-time data analysis in High Energy Physics
Aaij, R.
Amato, S.
Anderlini, L.
Benson, S.
Cattaneo, M.
Clemencic, M.
Couturier, B.
Frank, M.
Gligorov, V. V.
Head, T.
Jones, C.
Komarov, I.
Lupton, O.
Matev, R.
Raven, G.
Sciascia, B.
Skwarnicki, T.
Spradlin, P.
Stahl, S.
Storaci, B.
Vesterinen, M.
COMPUTER PHYSICS COMMUNICATIONS, 2016, 208 : 35 - 42
[45] DSP-based real-time image acquisition and processing
Yan, Shikui
Xu, Shunjiang
Li, Hongdi
Wang, Yanfang
Hedianzixue Yu Tance Jishu/Nuclear Electronics & Detection Technology, 2000, 20 (06): : 444 - 447
[46] A real-time stream storage and analysis platform for underwater acoustic monitoring
Hayes, J. P.
Kolar, H. R.
Akhriev, A.
Barry, M. G.
Purcell, M. E.
McKeown, E. P.
IBM JOURNAL OF RESEARCH AND DEVELOPMENT, 2013, 57 (3-4)
[47] A HIGH-SPEED DATA ACQUISITION AND PROCESSING SYSTEM FOR REAL-TIME DATA-ANALYSIS AND CONTROL
FERRON, JR
REVIEW OF SCIENTIFIC INSTRUMENTS, 1992, 63 (11): : 5464 - 5468
[48] Real-Time Data Processing Pipeline for Trigger Readout Board-Based Data Acquisition Systems
Malige, A.
Korcyl, G.
Firlej, M.
Fiutowski, T.
Idzik, M.
Korzeniak, B.
Lalik, R.
Misiak, A.
Molenda, A.
Moron, J.
Rathod, N.
Salabura, P.
Smyrski, J.
Swientek, K.
Wintz, P.
IEEE TRANSACTIONS ON NUCLEAR SCIENCE, 2022, 69 (07) : 1765 - 1772
[49] On the method of data acquisition and processing in the real-time supervision and control system
Wu, Shiying
Xu, Zurun
Yang, Chaowen
Hedianzixue Yu Tance Jishu/Nuclear Electronics & Detection Technology, 1997, 17 (02): : 112 - 115
[50] The Analysis of Intelligent Real-Time Image Acquisition System Based on Data Mining
Zhang, Xiaohuan
Advances in Transdisciplinary Engineering, 2023, 42 : 1063 - 1078

← 1 2 3 4 5 →