{"title":"Energy consumption prediction using modified deep CNN-Bi LSTM with attention mechanism.","authors":"Adel Binbusayyis, Mohemmed Sha","doi":"10.1016/j.heliyon.2024.e41507","DOIUrl":null,"url":null,"abstract":"<p><p>The prediction of energy consumption in households is essential due to the reliance on electrical appliances for daily activities. Accurate assessment of energy demand is crucial for effective energy generation, preventing overloads and optimizing energy storage. Traditional techniques have limitations in accuracy and error rates, necessitating advancements in prediction techniques. To enhance prediction accuracy, a proposed smart city system utilizes the Household Energy Consumption dataset, employing deep learning algorithms. In the beginning, data pre-processing addresses missing values and performs feature scaling for normalizing independent variables. Followed by that, Modified Deep CNN-Bi-LSTM (Convolutional Neural Network and Bi-directional Long Short Term Memory) with attention mechanism is utilized for regression which extracts temporal and spatial complex features. Deep CNN extracts features impacting energy consumption whereas Bi-LSTM with attention layer finds suitability for regression as it is capable of modelling irregular trends in the time-series components, where the attention mechanism is implemented to enhance the decoder's ability to selectively focus on the most relevant segments of the input sequence. This is achieved through a weighted integration of all encoded input trajectories, allowing the model to dynamically emphasize the vectors that carry the highest significance for accurate predictions. Based on regression outcomes from analysis taken in hourly, daily and monthly time intervals, enhanced prediction accuracy is estimated through evaluation metrics such as MSE (Mean Square Error), MAPE (Mean Absolute Percentage Error) and RMSE (Root Mean Square Error) which determines the efficacy of the system, where Specifically, the proposed model achieves MSE of 0.123, MAE of 0.22, and MAPE of 324.12. Furthermore, this model demonstrates a training time of 692.12 s and a prediction time of just 1.87 s. Therefore, present research highlights the critical need for accurate energy consumption prediction in households, driven by the increasing reliance on electrical appliances in daily life.</p>","PeriodicalId":12894,"journal":{"name":"Heliyon","volume":"11 1","pages":"e41507"},"PeriodicalIF":3.4000,"publicationDate":"2024-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11755059/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Heliyon","FirstCategoryId":"103","ListUrlMain":"https://doi.org/10.1016/j.heliyon.2024.e41507","RegionNum":3,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/15 0:00:00","PubModel":"eCollection","JCR":"Q1","JCRName":"MULTIDISCIPLINARY SCIENCES","Score":null,"Total":0}
引用次数: 0
Abstract
The prediction of energy consumption in households is essential due to the reliance on electrical appliances for daily activities. Accurate assessment of energy demand is crucial for effective energy generation, preventing overloads and optimizing energy storage. Traditional techniques have limitations in accuracy and error rates, necessitating advancements in prediction techniques. To enhance prediction accuracy, a proposed smart city system utilizes the Household Energy Consumption dataset, employing deep learning algorithms. In the beginning, data pre-processing addresses missing values and performs feature scaling for normalizing independent variables. Followed by that, Modified Deep CNN-Bi-LSTM (Convolutional Neural Network and Bi-directional Long Short Term Memory) with attention mechanism is utilized for regression which extracts temporal and spatial complex features. Deep CNN extracts features impacting energy consumption whereas Bi-LSTM with attention layer finds suitability for regression as it is capable of modelling irregular trends in the time-series components, where the attention mechanism is implemented to enhance the decoder's ability to selectively focus on the most relevant segments of the input sequence. This is achieved through a weighted integration of all encoded input trajectories, allowing the model to dynamically emphasize the vectors that carry the highest significance for accurate predictions. Based on regression outcomes from analysis taken in hourly, daily and monthly time intervals, enhanced prediction accuracy is estimated through evaluation metrics such as MSE (Mean Square Error), MAPE (Mean Absolute Percentage Error) and RMSE (Root Mean Square Error) which determines the efficacy of the system, where Specifically, the proposed model achieves MSE of 0.123, MAE of 0.22, and MAPE of 324.12. Furthermore, this model demonstrates a training time of 692.12 s and a prediction time of just 1.87 s. Therefore, present research highlights the critical need for accurate energy consumption prediction in households, driven by the increasing reliance on electrical appliances in daily life.
期刊介绍:
Heliyon is an all-science, open access journal that is part of the Cell Press family. Any paper reporting scientifically accurate and valuable research, which adheres to accepted ethical and scientific publishing standards, will be considered for publication. Our growing team of dedicated section editors, along with our in-house team, handle your paper and manage the publication process end-to-end, giving your research the editorial support it deserves.