将图像处理与群体检测算法相结合的风能异常数据清理方法

IF 1.9 Q4 ENERGY & FUELS Global Energy Interconnection Pub Date : 2024-06-01 DOI:10.1016/j.gloei.2024.06.001
Qiaoling Yang, Kai Chen, Jianzhang Man, Jiaheng Duan, Zuoqi Jin
{"title":"将图像处理与群体检测算法相结合的风能异常数据清理方法","authors":"Qiaoling Yang,&nbsp;Kai Chen,&nbsp;Jianzhang Man,&nbsp;Jiaheng Duan,&nbsp;Zuoqi Jin","doi":"10.1016/j.gloei.2024.06.001","DOIUrl":null,"url":null,"abstract":"<div><p>Current methodologies for cleaning wind power anomaly data exhibit limited capabilities in identifying abnormal data within extensive datasets and struggle to accommodate the considerable variability and intricacy of wind farm data. Consequently, a method for cleaning wind power anomaly data by combining image processing with community detection algorithms (CWPAD-IPCDA) is proposed. To precisely identify and initially clean anomalous data, wind power curve (WPC) images are converted into graph structures, which employ the Louvain community recognition algorithm and graph- theoretic methods for community detection and segmentation. Furthermore, the mathematical morphology operation (MMO) determines the main part of the initially cleaned wind power curve images and maps them back to the normal wind power points to complete the final cleaning. The CWPAD-IPCDA method was applied to clean datasets from 25 wind turbines (WTs) in two wind farms in northwest China to validate its feasibility. A comparison was conducted using density-based spatial clustering of applications with noise (DBSCAN) algorithm, an improved isolation forest algorithm, and an image-based (IB) algorithm. The experimental results demonstrate that the CWPAD-IPCDA method surpasses the other three algorithms, achieving an approximately 7.23% higher average data cleaning rate. The mean value of the sum of the squared errors (SSE) of the dataset after cleaning is approximately 6.887 lower than that of the other algorithms. Moreover, the mean of overall accuracy, as measured by the F1-score, exceeds that of the other methods by approximately 10.49%; this indicates that the CWPAD-IPCDA method is more conducive to improving the accuracy and reliability of wind power curve modeling and wind farm power forecasting.</p></div>","PeriodicalId":36174,"journal":{"name":"Global Energy Interconnection","volume":"7 3","pages":"Pages 293-312"},"PeriodicalIF":1.9000,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2096511724000409/pdf?md5=76bef55c59575e27e863e1a13c83d015&pid=1-s2.0-S2096511724000409-main.pdf","citationCount":"0","resultStr":"{\"title\":\"A method for cleaning wind power anomaly data by combining image processing with community detection algorithms\",\"authors\":\"Qiaoling Yang,&nbsp;Kai Chen,&nbsp;Jianzhang Man,&nbsp;Jiaheng Duan,&nbsp;Zuoqi Jin\",\"doi\":\"10.1016/j.gloei.2024.06.001\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Current methodologies for cleaning wind power anomaly data exhibit limited capabilities in identifying abnormal data within extensive datasets and struggle to accommodate the considerable variability and intricacy of wind farm data. Consequently, a method for cleaning wind power anomaly data by combining image processing with community detection algorithms (CWPAD-IPCDA) is proposed. To precisely identify and initially clean anomalous data, wind power curve (WPC) images are converted into graph structures, which employ the Louvain community recognition algorithm and graph- theoretic methods for community detection and segmentation. Furthermore, the mathematical morphology operation (MMO) determines the main part of the initially cleaned wind power curve images and maps them back to the normal wind power points to complete the final cleaning. The CWPAD-IPCDA method was applied to clean datasets from 25 wind turbines (WTs) in two wind farms in northwest China to validate its feasibility. A comparison was conducted using density-based spatial clustering of applications with noise (DBSCAN) algorithm, an improved isolation forest algorithm, and an image-based (IB) algorithm. The experimental results demonstrate that the CWPAD-IPCDA method surpasses the other three algorithms, achieving an approximately 7.23% higher average data cleaning rate. The mean value of the sum of the squared errors (SSE) of the dataset after cleaning is approximately 6.887 lower than that of the other algorithms. Moreover, the mean of overall accuracy, as measured by the F1-score, exceeds that of the other methods by approximately 10.49%; this indicates that the CWPAD-IPCDA method is more conducive to improving the accuracy and reliability of wind power curve modeling and wind farm power forecasting.</p></div>\",\"PeriodicalId\":36174,\"journal\":{\"name\":\"Global Energy Interconnection\",\"volume\":\"7 3\",\"pages\":\"Pages 293-312\"},\"PeriodicalIF\":1.9000,\"publicationDate\":\"2024-06-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S2096511724000409/pdf?md5=76bef55c59575e27e863e1a13c83d015&pid=1-s2.0-S2096511724000409-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Global Energy Interconnection\",\"FirstCategoryId\":\"1087\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2096511724000409\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"ENERGY & FUELS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Global Energy Interconnection","FirstCategoryId":"1087","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2096511724000409","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ENERGY & FUELS","Score":null,"Total":0}
引用次数: 0

摘要

目前用于清理风电异常数据的方法在识别大量数据集中的异常数据方面能力有限,并且难以适应风电场数据的可变性和复杂性。因此,我们提出了一种结合图像处理和群体检测算法的风电异常数据清理方法(CWPAD-IPCDA)。为了精确识别和初步清理异常数据,将风力曲线(WPC)图像转换成图结构,采用卢万群落识别算法和图论方法进行群落检测和分割。此外,数学形态学运算(MMO)可确定初步清理的风力曲线图像的主要部分,并将其映射回正常风力点,从而完成最终清理。为了验证 CWPAD-IPCDA 方法的可行性,我们将其应用于中国西北部两个风电场 25 台风机的清洁数据集。使用基于密度的带噪声应用空间聚类算法(DBSCAN)、改进的隔离林算法和基于图像的算法(IB)进行了比较。实验结果表明,CWPAD-IPCDA 方法超过了其他三种算法,平均数据清理率提高了约 7.23%。清洗后数据集的平方误差之和(SSE)的平均值比其他算法低约 6.887。此外,用 F1 分数衡量的总体准确度均值比其他方法高出约 10.49%,这表明 CWPAD-IPCDA 方法更有利于提高风能曲线建模和风电场功率预测的准确性和可靠性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
A method for cleaning wind power anomaly data by combining image processing with community detection algorithms

Current methodologies for cleaning wind power anomaly data exhibit limited capabilities in identifying abnormal data within extensive datasets and struggle to accommodate the considerable variability and intricacy of wind farm data. Consequently, a method for cleaning wind power anomaly data by combining image processing with community detection algorithms (CWPAD-IPCDA) is proposed. To precisely identify and initially clean anomalous data, wind power curve (WPC) images are converted into graph structures, which employ the Louvain community recognition algorithm and graph- theoretic methods for community detection and segmentation. Furthermore, the mathematical morphology operation (MMO) determines the main part of the initially cleaned wind power curve images and maps them back to the normal wind power points to complete the final cleaning. The CWPAD-IPCDA method was applied to clean datasets from 25 wind turbines (WTs) in two wind farms in northwest China to validate its feasibility. A comparison was conducted using density-based spatial clustering of applications with noise (DBSCAN) algorithm, an improved isolation forest algorithm, and an image-based (IB) algorithm. The experimental results demonstrate that the CWPAD-IPCDA method surpasses the other three algorithms, achieving an approximately 7.23% higher average data cleaning rate. The mean value of the sum of the squared errors (SSE) of the dataset after cleaning is approximately 6.887 lower than that of the other algorithms. Moreover, the mean of overall accuracy, as measured by the F1-score, exceeds that of the other methods by approximately 10.49%; this indicates that the CWPAD-IPCDA method is more conducive to improving the accuracy and reliability of wind power curve modeling and wind farm power forecasting.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Global Energy Interconnection
Global Energy Interconnection Engineering-Automotive Engineering
CiteScore
5.70
自引率
0.00%
发文量
985
审稿时长
15 weeks
期刊最新文献
Enhancing photovoltaic power prediction using a CNN-LSTM-attention hybrid model with Bayesian hyperparameter optimization Adaptive VSG control of flywheel energy storage array for frequency support in microgrids Adaptive linear active disturbance-rejection control strategy reduces the impulse current of compressed air energy storage connected to the grid Optimization dispatching strategy for an energy storage system considering its unused capacity sharing Optimal scheduling of zero-carbon park considering variational characteristics of hydrogen energy storage systems
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1