Transient power quality assessment based on big data analysis

被引:0
|
作者
Huang Zhiwei [1 ]
Gao Tian [2 ]
Zhang Huaying [1 ]
Han Xu [2 ]
Cao Junwei [2 ]
Hu Ziheng [1 ]
Yao Senjing [1 ]
Zhu Zhengguo [1 ]
机构
[1] Shenzhen Power Supply Co Ltd, Shenzhen, Peoples R China
[2] Tsinghua Univ, Beijing Shi, Peoples R China
来源
2014 CHINA INTERNATIONAL CONFERENCE ON ELECTRICITY DISTRIBUTION (CICED) | 2014年
关键词
Big data; MapReduce; Distributed data mining; Naive bayes classification;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
A transient power quality assessment method is proposed in this paper, using Naive Bayes classification method which is based on big data processing architecture. In this architecture, data sources will be extended to the aspects of power grid monitoring data, the power customer data and the public data, and the assessment severity will be classified into the normal state, the abnormal state, the critical state, and the failed state, according to the Naive Bayes classification results. Based on the data type of transient power quality assessment, big data processing architecture used in this paper can be able to process distributed data and streaming data, so that it can ensure not only updates classifier rules regularly, but also the real-time condition assessment. In the classifier training phase, we use the massive historical data as the distributed learning object, and generate assessment rules periodically. In the state assessment phase, each assessment node will update the assessment rules generated by training phase, generate real-time evaluation of samples from stream processing framework, and evaluate the power quality state according to the current rule. On this basis, this paper designs a Naive Bayes classification method based on MapReduce processing, and realizes the map and reduce process method to compute the priori probability and the conditional probability in distributed way. Experiments show that the transient power quality evaluation method based on the big data analysis presented in this paper is feasible, and achieve good results both in classification accuracy and processing speed.
引用
收藏
页数:5
相关论文
共 50 条
  • [21] Mobile Terminal Quality of Experience Analysis Based on Big Data
    Li, Mingxin
    Wei, Heng
    Liao, Hongxi
    2016 16TH INTERNATIONAL SYMPOSIUM ON COMMUNICATIONS AND INFORMATION TECHNOLOGIES (ISCIT), 2016, : 241 - 245
  • [22] Quality of life, big data and the power of statistics
    Gupta, Shivam
    Mateu, Jorge
    Degbelo, Auriol
    Pebesma, Edzer
    STATISTICS & PROBABILITY LETTERS, 2018, 136 : 101 - 104
  • [23] BIGQA: Declarative Big Data Quality Assessment
    Fadlallah, Hadi
    Kilany, Rima
    Dhayne, Houssein
    El Haddad, Rami
    Haque, Rafiqul
    Taher, Yehia
    Jaber, Ali
    ACM JOURNAL OF DATA AND INFORMATION QUALITY, 2023, 15 (03):
  • [24] Using big data for quality assessment in oncology
    Broughman, James R.
    Chen, Ronald C.
    JOURNAL OF COMPARATIVE EFFECTIVENESS RESEARCH, 2016, 5 (03) : 309 - 319
  • [25] A Recovery Algorithm of Power Quality Big Data Based on Improved Differential Kriging
    Yuan, Dongbing
    Xu, Bintai
    Gao, Sheng
    JOURNAL OF NANOELECTRONICS AND OPTOELECTRONICS, 2021, 16 (09) : 1444 - 1449
  • [26] BIG DATA ANALYTICS FOR AIR QUALITY MONITORING ASSESSMENT BASED ON IoT PLATFORM
    Ivanova, Desislava
    Elenkov, Angel
    INTERNATIONAL JOURNAL ON INFORMATION TECHNOLOGIES AND SECURITY, 2019, 11 (02): : 43 - 50
  • [27] Context-aware data quality assessment for big data
    Ardagna, Danilo
    Cappiello, Cinzia
    Sama, Walter
    Vitali, Monica
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 89 : 548 - 562
  • [28] Big Data Analysis Model of Power Customer Satisfaction Based on ANP
    Li, Xue
    Yang, Shaobing
    PROCEEDINGS OF 2018 IEEE 3RD ADVANCED INFORMATION TECHNOLOGY, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IAEAC 2018), 2018, : 2601 - 2606
  • [29] Analysis of Power User Behavior Based on Big Data Technology: A Review
    Gu, Xingchen
    Xiong, Boyue
    2018 2ND IEEE CONFERENCE ON ENERGY INTERNET AND ENERGY SYSTEM INTEGRATION (EI2), 2018,
  • [30] An Identification Method of Power User Group Based on Big Data Analysis
    Li X.
    Zeng H.
    Chen H.
    Li X.
    Liu M.
    Journal of Engineering Science and Technology Review, 2023, 16 (01) : 109 - 114