{"title":"Energy consumption prediction using modified deep CNN-Bi LSTM with attention mechanism.","authors":"Adel Binbusayyis, Mohemmed Sha","doi":"10.1016/j.heliyon.2024.e41507","DOIUrl":null,"url":null,"abstract":"<p><p>The prediction of energy consumption in households is essential due to the reliance on electrical appliances for daily activities. Accurate assessment of energy demand is crucial for effective energy generation, preventing overloads and optimizing energy storage. Traditional techniques have limitations in accuracy and error rates, necessitating advancements in prediction techniques. To enhance prediction accuracy, a proposed smart city system utilizes the Household Energy Consumption dataset, employing deep learning algorithms. In the beginning, data pre-processing addresses missing values and performs feature scaling for normalizing independent variables. Followed by that, Modified Deep CNN-Bi-LSTM (Convolutional Neural Network and Bi-directional Long Short Term Memory) with attention mechanism is utilized for regression which extracts temporal and spatial complex features. Deep CNN extracts features impacting energy consumption whereas Bi-LSTM with attention layer finds suitability for regression as it is capable of modelling irregular trends in the time-series components, where the attention mechanism is implemented to enhance the decoder's ability to selectively focus on the most relevant segments of the input sequence. This is achieved through a weighted integration of all encoded input trajectories, allowing the model to dynamically emphasize the vectors that carry the highest significance for accurate predictions. Based on regression outcomes from analysis taken in hourly, daily and monthly time intervals, enhanced prediction accuracy is estimated through evaluation metrics such as MSE (Mean Square Error), MAPE (Mean Absolute Percentage Error) and RMSE (Root Mean Square Error) which determines the efficacy of the system, where Specifically, the proposed model achieves MSE of 0.123, MAE of 0.22, and MAPE of 324.12. Furthermore, this model demonstrates a training time of 692.12 s and a prediction time of just 1.87 s. Therefore, present research highlights the critical need for accurate energy consumption prediction in households, driven by the increasing reliance on electrical appliances in daily life.</p>","PeriodicalId":12894,"journal":{"name":"Heliyon","volume":"11 1","pages":"e41507"},"PeriodicalIF":3.6000,"publicationDate":"2024-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11755059/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Heliyon","FirstCategoryId":"103","ListUrlMain":"https://doi.org/10.1016/j.heliyon.2024.e41507","RegionNum":3,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/15 0:00:00","PubModel":"eCollection","JCR":"Q1","JCRName":"MULTIDISCIPLINARY SCIENCES","Score":null,"Total":0}
引用次数: 0
Abstract
The prediction of energy consumption in households is essential due to the reliance on electrical appliances for daily activities. Accurate assessment of energy demand is crucial for effective energy generation, preventing overloads and optimizing energy storage. Traditional techniques have limitations in accuracy and error rates, necessitating advancements in prediction techniques. To enhance prediction accuracy, a proposed smart city system utilizes the Household Energy Consumption dataset, employing deep learning algorithms. In the beginning, data pre-processing addresses missing values and performs feature scaling for normalizing independent variables. Followed by that, Modified Deep CNN-Bi-LSTM (Convolutional Neural Network and Bi-directional Long Short Term Memory) with attention mechanism is utilized for regression which extracts temporal and spatial complex features. Deep CNN extracts features impacting energy consumption whereas Bi-LSTM with attention layer finds suitability for regression as it is capable of modelling irregular trends in the time-series components, where the attention mechanism is implemented to enhance the decoder's ability to selectively focus on the most relevant segments of the input sequence. This is achieved through a weighted integration of all encoded input trajectories, allowing the model to dynamically emphasize the vectors that carry the highest significance for accurate predictions. Based on regression outcomes from analysis taken in hourly, daily and monthly time intervals, enhanced prediction accuracy is estimated through evaluation metrics such as MSE (Mean Square Error), MAPE (Mean Absolute Percentage Error) and RMSE (Root Mean Square Error) which determines the efficacy of the system, where Specifically, the proposed model achieves MSE of 0.123, MAE of 0.22, and MAPE of 324.12. Furthermore, this model demonstrates a training time of 692.12 s and a prediction time of just 1.87 s. Therefore, present research highlights the critical need for accurate energy consumption prediction in households, driven by the increasing reliance on electrical appliances in daily life.
由于日常生活都依赖于电器,因此对家庭能源消耗的预测是必不可少的。准确评估能源需求对于有效发电、防止过载和优化能源储存至关重要。传统的预测技术在准确性和错误率方面存在局限性,因此需要改进预测技术。为了提高预测精度,提出了一种智能城市系统,利用家庭能源消耗数据集,采用深度学习算法。在开始时,数据预处理处理缺失值,并执行特征缩放以规范化独立变量。然后,利用带有注意机制的Modified Deep CNN-Bi-LSTM (Convolutional Neural Network and Bi-directional Long - Short Term Memory)进行回归,提取时空复杂特征。深度CNN提取影响能量消耗的特征,而具有注意层的Bi-LSTM发现适合回归,因为它能够模拟时间序列组件中的不规则趋势,其中实现了注意机制以增强解码器选择性关注输入序列中最相关部分的能力。这是通过对所有编码输入轨迹的加权积分来实现的,允许模型动态地强调对准确预测具有最高意义的向量。基于每小时、每天和每月时间间隔分析的回归结果,通过MSE(均方误差)、MAPE(平均绝对百分比误差)和RMSE(均方根误差)等评估指标来评估系统的有效性,其中,所提出的模型实现了MSE为0.123,MAE为0.22,MAPE为324.12。此外,该模型的训练时间为692.12 s,预测时间仅为1.87 s。因此,目前的研究强调了在日常生活中对电器的依赖日益增加的推动下,对家庭能源消耗进行准确预测的迫切需要。
期刊介绍:
Heliyon is an all-science, open access journal that is part of the Cell Press family. Any paper reporting scientifically accurate and valuable research, which adheres to accepted ethical and scientific publishing standards, will be considered for publication. Our growing team of dedicated section editors, along with our in-house team, handle your paper and manage the publication process end-to-end, giving your research the editorial support it deserves.