A method for cleaning wind power anomaly data by combining image processing with community detection algorithms

被引:0
|
作者
Yang, Qiaoling [1 ]
Chen, Kai [1 ]
Man, Jianzhang [1 ]
Duan, Jiaheng [1 ]
Jin, Zuoqi [1 ]
机构
[1] Lanzhou Univ Technol, Coll Elect & Informat Engn, Lanzhou 730050, Peoples R China
来源
GLOBAL ENERGY INTERCONNECTION-CHINA | 2024年 / 7卷 / 03期
基金
中国国家自然科学基金;
关键词
Wind turbine power curve; Abnormal data cleaning; Community detection; Louvain algorithm; Mathematical morphology operation; UNCERTAINTY;
D O I
10.1016/j.gloei.2024.06.001
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Current methodologies for cleaning wind power anomaly data exhibit limited capabilities in identifying abnormal data within extensive datasets and struggle to accommodate the considerable variability and intricacy of wind farm data. Consequently, a method for cleaning wind power anomaly data by combining image processing with community detection algorithms (CWPAD-IPCDA) is proposed. To precisely identify and initially clean anomalous data, wind power curve (WPC) images are converted into graph structures, which employ the Louvain community recognition algorithm and graphtheoretic methods for community detection and segmentation. Furthermore, the mathematical morphology operation (MMO) determines the main part of the initially cleaned wind power curve images and maps them back to the normal wind power points to complete the final cleaning. The CWPAD-IPCDA method was applied to clean datasets from 25 wind turbines (WTs) in two wind farms in northwest China to validate its feasibility. A comparison was conducted using density-based spatial clustering of applications with noise (DBSCAN) algorithm, an improved isolation forest algorithm, and an image-based (IB) algorithm. The experimental results demonstrate that the CWPAD-IPCDA method surpasses the other three algorithms, achieving an approximately 7.23% higher average data cleaning rate. The mean value of the sum of the squared errors (SSE) of the dataset after cleaning is approximately 6.887 lower than that of the other algorithms. Moreover, the mean of overall accuracy, as measured by the F1-score, exceeds that of the other methods by approximately 10.49%; this indicates that the CWPAD-IPCDA method is more conducive to improving the accuracy and reliability of wind power curve modeling and wind farm power forecasting.
引用
收藏
页码:293 / 312
页数:20
相关论文
共 50 条
  • [41] The power of temporal pattern processing in Anomaly Intrusion Detection
    Al-Subaie, Mohammad
    Zuikernine, Mohammad
    2007 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, VOLS 1-14, 2007, : 1391 - 1398
  • [42] Detection of power lines by image processing
    Seibold, Peter
    Gerke, Michael
    Masar, Ivan
    Jelenciak, Frantisek
    Bahnik, Pavol
    Bahr, Lothar
    COMPUTATIONAL VISION AND MEDICAL IMAGE PROCESSING IV, 2014, : 203 - 209
  • [43] Anomaly detection for image data based on data distribution and reconstruction
    Luo, Yixin
    Ma, Yangling
    APPLIED INTELLIGENCE, 2023, 53 (19) : 22500 - 22510
  • [44] Anomaly detection for image data based on data distribution and reconstruction
    Yixin Luo
    Yangling Ma
    Applied Intelligence, 2023, 53 : 22500 - 22510
  • [45] GeoSClean: Secure Cleaning of GPS Trajectory Data using Anomaly Detection
    Patil, Vikram
    Singh, Priyanka
    Parikh, Shivam
    Atrey, Pradeep K.
    IEEE 1ST CONFERENCE ON MULTIMEDIA INFORMATION PROCESSING AND RETRIEVAL (MIPR 2018), 2018, : 166 - 169
  • [46] Data Cleaning for XML Electronic Dictionaries via Statistical Anomaly Detection
    Bloodgood, Michael
    Strauss, Benjamin
    2016 IEEE TENTH INTERNATIONAL CONFERENCE ON SEMANTIC COMPUTING (ICSC), 2016, : 79 - 86
  • [47] Combining Software Algorithms and Machine Learning in Business Data Processing
    Ivanova, Valentina
    Chivarov, Nayden
    Staikova, Maya
    IFAC PAPERSONLINE, 2024, 58 (03): : 198 - 202
  • [48] An Improved Data-Efficiency Algorithm Based on Combining Isolation Forest and Mean Shift for Anomaly Data Filtering in Wind Power Curve
    Wang, Wei
    Yang, Shiyou
    Yang, Yankun
    ENERGIES, 2022, 15 (13)
  • [49] Data Visualization of Anomaly Detection in Semiconductor Processing Tools
    Fan, Shu-Kai S.
    Tsai, Du-Ming
    Jen, Chih-Hung
    Hsu, Chia-Yu
    He, Fei
    Juan, Li-Ting
    IEEE TRANSACTIONS ON SEMICONDUCTOR MANUFACTURING, 2022, 35 (02) : 186 - 197
  • [50] Anomaly detection and treatment for meteorological and wind turbine power measurements
    Ghayuri, Mohammad
    Wood, David
    Mohebalhojeh, Ali R.
    Mirzaei, Mohammad
    JOURNAL OF RENEWABLE AND SUSTAINABLE ENERGY, 2023, 15 (01)