Md Al Amin Sarker, Bharanidharan Shanmugam, Sami Azam, Suresh Thennadil
{"title":"加强智能电网负荷预测:基于注意力的深度学习模型与联合学习和 XAI 相结合,提高安全性和可解释性","authors":"Md Al Amin Sarker, Bharanidharan Shanmugam, Sami Azam, Suresh Thennadil","doi":"10.1016/j.iswa.2024.200422","DOIUrl":null,"url":null,"abstract":"<div><p>Smart grid is a transformative advancement that modernized the traditional power system for effective electricity management, and involves optimized energy distribution by load forecasting. Precise load forecasting provides the best utilization of energy resources and increases sustainability. Dynamic changes of several connected factors, such as temporal and geographical variability, pose challenges to accurate load prediction. Integrating Artificial Intelligence (AI) in the smart grid can enhance the performance of the forecasting process by capturing these changes. This study investigated load forecasting tasks on four different datasets. Several preprocessing and augmentation techniques are applied to increase the data quality. An attention-based 1D-CNN-GRU model is proposed to capture the temporal patterns from the time-series data, and the hyperparameters of the model are optimized using a particle swarm optimization (PSO) algorithm that also accelerates the convergence and results in an efficient training session. Empirical evaluations highlight that the proposed model substantially minimizes the loss, reflecting the ability to make accurate predictions. It obtains MAE values of 0.12, 0.8, 16.48, and 82.64 for the four datasets. Moreover, the explainable AI (XAI) technique is applied using Shapley Additive explanations (SHAP) to interpret the model prediction, providing the feature ranking based on their prediction score. Moreover, this study utilizes federated learning, enables collaborative training, maintains the privacy of the grid data, and secures the process comprehensively. The aggregation mechanism in federated learning is modified using pruning-based methods that reduce the parameters and computational cost, resulting in a more efficient framework. Integrating all these approaches provides valuable insights for developing a load forecasting model and outlines potential contributions in the smart grid domain.</p></div>","PeriodicalId":100684,"journal":{"name":"Intelligent Systems with Applications","volume":"23 ","pages":"Article 200422"},"PeriodicalIF":0.0000,"publicationDate":"2024-08-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2667305324000966/pdfft?md5=6bef1c0253b216dd874359b6617d6b66&pid=1-s2.0-S2667305324000966-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Enhancing smart grid load forecasting: An attention-based deep learning model integrated with federated learning and XAI for security and interpretability\",\"authors\":\"Md Al Amin Sarker, Bharanidharan Shanmugam, Sami Azam, Suresh Thennadil\",\"doi\":\"10.1016/j.iswa.2024.200422\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Smart grid is a transformative advancement that modernized the traditional power system for effective electricity management, and involves optimized energy distribution by load forecasting. Precise load forecasting provides the best utilization of energy resources and increases sustainability. Dynamic changes of several connected factors, such as temporal and geographical variability, pose challenges to accurate load prediction. Integrating Artificial Intelligence (AI) in the smart grid can enhance the performance of the forecasting process by capturing these changes. This study investigated load forecasting tasks on four different datasets. Several preprocessing and augmentation techniques are applied to increase the data quality. An attention-based 1D-CNN-GRU model is proposed to capture the temporal patterns from the time-series data, and the hyperparameters of the model are optimized using a particle swarm optimization (PSO) algorithm that also accelerates the convergence and results in an efficient training session. Empirical evaluations highlight that the proposed model substantially minimizes the loss, reflecting the ability to make accurate predictions. It obtains MAE values of 0.12, 0.8, 16.48, and 82.64 for the four datasets. Moreover, the explainable AI (XAI) technique is applied using Shapley Additive explanations (SHAP) to interpret the model prediction, providing the feature ranking based on their prediction score. Moreover, this study utilizes federated learning, enables collaborative training, maintains the privacy of the grid data, and secures the process comprehensively. The aggregation mechanism in federated learning is modified using pruning-based methods that reduce the parameters and computational cost, resulting in a more efficient framework. Integrating all these approaches provides valuable insights for developing a load forecasting model and outlines potential contributions in the smart grid domain.</p></div>\",\"PeriodicalId\":100684,\"journal\":{\"name\":\"Intelligent Systems with Applications\",\"volume\":\"23 \",\"pages\":\"Article 200422\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-08-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S2667305324000966/pdfft?md5=6bef1c0253b216dd874359b6617d6b66&pid=1-s2.0-S2667305324000966-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Intelligent Systems with Applications\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2667305324000966\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Intelligent Systems with Applications","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2667305324000966","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
智能电网是一种变革性的进步,它将传统的电力系统现代化,以实现有效的电力管理,并通过负荷预测来优化能源分配。精确的负荷预测可使能源资源得到最佳利用,并提高可持续性。一些相关因素的动态变化,如时间和地理上的可变性,给精确的负荷预测带来了挑战。在智能电网中集成人工智能(AI)可以通过捕捉这些变化来提高预测过程的性能。本研究调查了四个不同数据集上的负荷预测任务。为提高数据质量,采用了多种预处理和增强技术。研究提出了一种基于注意力的 1D-CNN-GRU 模型来捕捉时间序列数据中的时间模式,并使用粒子群优化(PSO)算法优化了该模型的超参数,该算法还能加速收敛并实现高效的训练过程。实证评估结果表明,所提出的模型极大地减少了损失,体现了准确预测的能力。该模型在四个数据集上的 MAE 值分别为 0.12、0.8、16.48 和 82.64。此外,可解释人工智能(XAI)技术使用夏普利相加解释(SHAP)来解释模型预测,根据预测得分提供特征排名。此外,本研究还利用联盟学习,实现了协作训练,维护了网格数据的隐私,并全面保障了整个过程的安全。联合学习中的聚合机制通过基于剪枝的方法进行了修改,从而减少了参数和计算成本,形成了一个更高效的框架。整合所有这些方法为开发负荷预测模型提供了宝贵的见解,并勾勒出在智能电网领域的潜在贡献。
Enhancing smart grid load forecasting: An attention-based deep learning model integrated with federated learning and XAI for security and interpretability
Smart grid is a transformative advancement that modernized the traditional power system for effective electricity management, and involves optimized energy distribution by load forecasting. Precise load forecasting provides the best utilization of energy resources and increases sustainability. Dynamic changes of several connected factors, such as temporal and geographical variability, pose challenges to accurate load prediction. Integrating Artificial Intelligence (AI) in the smart grid can enhance the performance of the forecasting process by capturing these changes. This study investigated load forecasting tasks on four different datasets. Several preprocessing and augmentation techniques are applied to increase the data quality. An attention-based 1D-CNN-GRU model is proposed to capture the temporal patterns from the time-series data, and the hyperparameters of the model are optimized using a particle swarm optimization (PSO) algorithm that also accelerates the convergence and results in an efficient training session. Empirical evaluations highlight that the proposed model substantially minimizes the loss, reflecting the ability to make accurate predictions. It obtains MAE values of 0.12, 0.8, 16.48, and 82.64 for the four datasets. Moreover, the explainable AI (XAI) technique is applied using Shapley Additive explanations (SHAP) to interpret the model prediction, providing the feature ranking based on their prediction score. Moreover, this study utilizes federated learning, enables collaborative training, maintains the privacy of the grid data, and secures the process comprehensively. The aggregation mechanism in federated learning is modified using pruning-based methods that reduce the parameters and computational cost, resulting in a more efficient framework. Integrating all these approaches provides valuable insights for developing a load forecasting model and outlines potential contributions in the smart grid domain.