Transient power quality assessment based on big data analysis

被引:0
|
作者
Huang Zhiwei [1 ]
Gao Tian [2 ]
Zhang Huaying [1 ]
Han Xu [2 ]
Cao Junwei [2 ]
Hu Ziheng [1 ]
Yao Senjing [1 ]
Zhu Zhengguo [1 ]
机构
[1] Shenzhen Power Supply Co Ltd, Shenzhen, Peoples R China
[2] Tsinghua Univ, Beijing Shi, Peoples R China
来源
2014 CHINA INTERNATIONAL CONFERENCE ON ELECTRICITY DISTRIBUTION (CICED) | 2014年
关键词
Big data; MapReduce; Distributed data mining; Naive bayes classification;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
A transient power quality assessment method is proposed in this paper, using Naive Bayes classification method which is based on big data processing architecture. In this architecture, data sources will be extended to the aspects of power grid monitoring data, the power customer data and the public data, and the assessment severity will be classified into the normal state, the abnormal state, the critical state, and the failed state, according to the Naive Bayes classification results. Based on the data type of transient power quality assessment, big data processing architecture used in this paper can be able to process distributed data and streaming data, so that it can ensure not only updates classifier rules regularly, but also the real-time condition assessment. In the classifier training phase, we use the massive historical data as the distributed learning object, and generate assessment rules periodically. In the state assessment phase, each assessment node will update the assessment rules generated by training phase, generate real-time evaluation of samples from stream processing framework, and evaluate the power quality state according to the current rule. On this basis, this paper designs a Naive Bayes classification method based on MapReduce processing, and realizes the map and reduce process method to compute the priori probability and the conditional probability in distributed way. Experiments show that the transient power quality evaluation method based on the big data analysis presented in this paper is feasible, and achieve good results both in classification accuracy and processing speed.
引用
收藏
页数:5
相关论文
共 50 条
  • [11] A Method of Quality Improvement based on Big Quality Warranty Data Analysis
    Pan, Xing
    Zhang, Manli
    Chen, Xi
    2018 IEEE 18TH INTERNATIONAL CONFERENCE ON SOFTWARE QUALITY, RELIABILITY AND SECURITY COMPANION (QRS-C), 2018, : 643 - 644
  • [12] Big Data Quality Analysis
    Qin, Haifei
    Sun, Ying
    Zhao, Yongchao
    PROCEEDINGS OF THE 2013 ASIA-PACIFIC COMPUTATIONAL INTELLIGENCE AND INFORMATION TECHNOLOGY CONFERENCE, 2013, : 608 - 613
  • [13] Analysis of Power Marketing Data Mining Based on the Big Data Technology
    Yu, Jiwen
    Shu, Xiaoxiao
    Shang, Chao
    Liu, Fan
    PROCEEDINGS OF THE 2017 7TH INTERNATIONAL CONFERENCE ON EDUCATION, MANAGEMENT, COMPUTER AND SOCIETY (EMCS 2017), 2017, 61 : 376 - 380
  • [14] Air quality data analysis and forecasting platform based on big data
    Wang, Jinghan
    Zhang, Jinnan
    Yuan, XueGuang
    Tang, Yu
    Hao, Hongyu
    Zuo, Yong
    Tan, Zebin
    Qiao, Min
    Cao, Yang Hua
    Ai, Lingmei
    Wan, Yihang
    Chen, Hao
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 2042 - 2046
  • [15] Data Quality Identification Model for Power Big Data
    Zheng, Haijie
    Tian, Bing
    Liu, Xiaobao
    Zhang, Wenbin
    Liu, Shenqi
    Wang, Cong
    DATA SCIENCE (ICPCSEE 2022), PT II, 2022, 1629 : 20 - 29
  • [16] Big Data Quality Assessment Model for Unstructured Data
    Taleb, Ikbal
    Serhani, Mohamed Adel
    Dssouli, Rachida
    PROCEEDINGS OF THE 2018 13TH INTERNATIONAL CONFERENCE ON INNOVATIONS IN INFORMATION TECHNOLOGY (IIT), 2018, : 69 - 74
  • [17] Fault Feature Analysis of Power Network Based on Big Data
    Di, Cai-yun
    ADVANCED HYBRID INFORMATION PROCESSING, ADHIP 2019, PT I, 2019, 301 : 143 - 151
  • [18] Learning Quality Evaluation of MOOC Based on Big Data Analysis
    Zhao, Zihao
    Wu, Qiangqiang
    Chen, Haopeng
    Wan, Chengcheng
    SMART COMPUTING AND COMMUNICATION, SMARTCOM 2016, 2017, 10135 : 277 - 286
  • [19] TEACHING QUALITY EVALUATION AND IMPROVEMENT BASED ON BIG DATA ANALYSIS
    Zhuang, Xueqiu
    Song, Meijing
    SCALABLE COMPUTING-PRACTICE AND EXPERIENCE, 2025, 26 (01): : 220 - 230
  • [20] Research on Product Quality Evaluation Based on Big Data Analysis
    Song, Huaming
    Cao, Zhexiu
    2017 IEEE 2ND INTERNATIONAL CONFERENCE ON BIG DATA ANALYSIS (ICBDA), 2017, : 178 - 182