Application Research of Energy Data Acquisition and Analysis Based on Real-time Stream Processing Platform

被引：0
|
作者：
Li, Kunming [1 ]
Ji, Cong [1 ]
Zhong, Chunlin [1 ]
Zheng, Fei [1 ]
Shao, Jun [1 ]
机构：
[1] Jiangsu Frontier Elect Technol CO LTD, Smart Grid Prod Ctr, Nanjing, Peoples R China
来源：
PROCEEDINGS OF 2017 6TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND NETWORK TECHNOLOGY (ICCSNT 2017) | 2017年
关键词：
energy saving and emission reduction; real-time stream processing platform; data acquisition; Kafka; Storm;
D O I：
暂无
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
In the context of national energy-saving emission reduction strategy, the user energy efficiency has become a hot topic in academia and the business community. In order to solve the problems of large amount of data and fast changing speed in real-time transmission terminal equipment, it has strict requirement for processing timeliness. We need to introduce distributed real-time data, high-speed synchronization, acquisition and processing and analysis technology to build a real-time flow processing platform. Real-time stream processing platform uses message queue (Kafka) to receive data from different real-time sources, and the back-end uses stream processing technology (Storm) to analyze real-time data.
引用
收藏
页码：175 / 178
页数：4
相关论文
共 50 条
  • [21] Design of Real-time Image Data Acquisition and Processing System based on SOPC
    Song Wei
    Qin Shu-yuan
    Chen Yan-xiao
    Zhang Long-ji
    MECHATRONICS, ROBOTICS AND AUTOMATION, PTS 1-3, 2013, 373-375 : 650 - 653
  • [22] Development of a real-time framework for parallel data stream processing
    Kwon, Giil
    Hong, Jaesic
    FUSION ENGINEERING AND DESIGN, 2020, 157
  • [23] Real-Time Processing of Continuous Physiological Signals in a Neurocritical Care Unit on a Stream Data Analytics Platform
    Bai, Yong
    Sow, Daby
    Vespa, Paul
    Hu, Xiao
    INTRACRANIAL PRESSURE AND BRAIN MONITORING XV, 2016, 122 : 75 - 80
  • [24] FLEXIBLE REAL-TIME NUCLEAR DATA ACQUISITION PROCESSING SOFTWARE
    TAFF, LM
    SPORREL, F
    NUCLEAR INSTRUMENTS & METHODS, 1979, 160 (01): : 147 - 158
  • [25] THE USE OF A REAL-TIME COMPUTER DIARY FOR DATA ACQUISITION AND PROCESSING
    TAYLOR, CB
    FRIED, L
    KENARDY, J
    BEHAVIOUR RESEARCH AND THERAPY, 1990, 28 (01) : 93 - 97
  • [26] In-vehicle data acquisition, transfer, and real-time processing
    Hoadley, D
    Siegel, J
    Scarfe, D
    ELECTRONIC ENGINEERING, 1998, 70 (862): : 37 - 38
  • [27] In-vehicle data acquisition, transfer, and real-time processing
    Hoadley, David
    Siegel, Jeff
    Scarfe, Darren
    Electronic Engineering (London), 1998, 70 (862): : 37 - 38
  • [28] PXI-based architecture for real-time data acquisition and distributed dynamic data processing
    Barrera, E
    Ruiz, M
    López, S
    Machón, D
    Vega, J
    IEEE TRANSACTIONS ON NUCLEAR SCIENCE, 2006, 53 (03) : 923 - 926
  • [29] Smart City Data Platform for Real-Time Processing and Data Sharing
    Vitor, Gonialo
    Rito, Pedro
    Sargento, Susana
    26TH IEEE SYMPOSIUM ON COMPUTERS AND COMMUNICATIONS (IEEE ISCC 2021), 2021,
  • [30] Platform for real-time data analysis and visualization based on Big Data methods
    Ferreira, Gabriel
    Alves, Paulo
    de Almeida, Simone
    PROCEEDINGS OF 2021 16TH IBERIAN CONFERENCE ON INFORMATION SYSTEMS AND TECHNOLOGIES (CISTI'2021), 2021,
12345