Yuan Gao , Zehuan Hu , Wei-An Chen , Mingzhe Liu , Yingjun Ruan
{"title":"基于 Kolmogorov-Arnold 的具有可解释性和灵活性的革命性神经网络架构,用于太阳辐射和温度预报","authors":"Yuan Gao , Zehuan Hu , Wei-An Chen , Mingzhe Liu , Yingjun Ruan","doi":"10.1016/j.apenergy.2024.124844","DOIUrl":null,"url":null,"abstract":"<div><div>Deep learning models are increasingly being used to predict renewable energy-related variables, such as solar radiation and outdoor temperature. However, the black-box nature of these models results in a lack of interpretability in their predictions, and the design of deep network architectures significantly impacts the final prediction outcomes. The introduction of Kolmogorov–Arnold Network (KAN) provides an excellent solution to both of these issues. We hope that the KAN mechanism can provide fully interpretable neural network models, enhancing the potential for practical deployment. At the same time, KAN is capable of achieving good prediction results across various network architectures and neuron counts. We conducted case studies using real-world data from the Tokyo Meteorological Observatory to predict solar radiation and outdoor temperature, comparing the results with those of commonly used recurrent neural network baseline models. The results indicate that KAN can maintain model performance regardless of the chosen number of neurons. For instance, in the solar radiation prediction task, the KAN with a single hidden neuron reduces the MSE error by 75.33% compared to the baseline model. More importantly, KAN allows for the quantification of each step in the network’s computations, thereby enhancing overall interpretability.</div></div>","PeriodicalId":246,"journal":{"name":"Applied Energy","volume":"378 ","pages":"Article 124844"},"PeriodicalIF":10.1000,"publicationDate":"2024-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A revolutionary neural network architecture with interpretability and flexibility based on Kolmogorov–Arnold for solar radiation and temperature forecasting\",\"authors\":\"Yuan Gao , Zehuan Hu , Wei-An Chen , Mingzhe Liu , Yingjun Ruan\",\"doi\":\"10.1016/j.apenergy.2024.124844\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Deep learning models are increasingly being used to predict renewable energy-related variables, such as solar radiation and outdoor temperature. However, the black-box nature of these models results in a lack of interpretability in their predictions, and the design of deep network architectures significantly impacts the final prediction outcomes. The introduction of Kolmogorov–Arnold Network (KAN) provides an excellent solution to both of these issues. We hope that the KAN mechanism can provide fully interpretable neural network models, enhancing the potential for practical deployment. At the same time, KAN is capable of achieving good prediction results across various network architectures and neuron counts. We conducted case studies using real-world data from the Tokyo Meteorological Observatory to predict solar radiation and outdoor temperature, comparing the results with those of commonly used recurrent neural network baseline models. The results indicate that KAN can maintain model performance regardless of the chosen number of neurons. For instance, in the solar radiation prediction task, the KAN with a single hidden neuron reduces the MSE error by 75.33% compared to the baseline model. More importantly, KAN allows for the quantification of each step in the network’s computations, thereby enhancing overall interpretability.</div></div>\",\"PeriodicalId\":246,\"journal\":{\"name\":\"Applied Energy\",\"volume\":\"378 \",\"pages\":\"Article 124844\"},\"PeriodicalIF\":10.1000,\"publicationDate\":\"2024-11-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Applied Energy\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S030626192402227X\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENERGY & FUELS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Energy","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S030626192402227X","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENERGY & FUELS","Score":null,"Total":0}
引用次数: 0
摘要
深度学习模型越来越多地被用于预测可再生能源相关变量,如太阳辐射和室外温度。然而,这些模型的黑箱性质导致其预测结果缺乏可解释性,而且深度网络架构的设计会对最终预测结果产生重大影响。柯尔莫哥洛夫-阿诺德网络(KAN)的引入很好地解决了这两个问题。我们希望 KAN 机制能够提供完全可解释的神经网络模型,从而提高实际部署的潜力。同时,KAN 能够在不同的网络架构和神经元数量下取得良好的预测结果。我们利用东京气象台的实际数据进行了案例研究,预测太阳辐射和室外温度,并将结果与常用的递归神经网络基线模型进行了比较。结果表明,无论选择多少神经元,KAN 都能保持模型的性能。例如,在太阳辐射预测任务中,与基线模型相比,只有一个隐藏神经元的 KAN 可将 MSE 误差降低 75.33%。更重要的是,KAN 可以量化网络计算的每一步,从而提高整体可解释性。
A revolutionary neural network architecture with interpretability and flexibility based on Kolmogorov–Arnold for solar radiation and temperature forecasting
Deep learning models are increasingly being used to predict renewable energy-related variables, such as solar radiation and outdoor temperature. However, the black-box nature of these models results in a lack of interpretability in their predictions, and the design of deep network architectures significantly impacts the final prediction outcomes. The introduction of Kolmogorov–Arnold Network (KAN) provides an excellent solution to both of these issues. We hope that the KAN mechanism can provide fully interpretable neural network models, enhancing the potential for practical deployment. At the same time, KAN is capable of achieving good prediction results across various network architectures and neuron counts. We conducted case studies using real-world data from the Tokyo Meteorological Observatory to predict solar radiation and outdoor temperature, comparing the results with those of commonly used recurrent neural network baseline models. The results indicate that KAN can maintain model performance regardless of the chosen number of neurons. For instance, in the solar radiation prediction task, the KAN with a single hidden neuron reduces the MSE error by 75.33% compared to the baseline model. More importantly, KAN allows for the quantification of each step in the network’s computations, thereby enhancing overall interpretability.
期刊介绍:
Applied Energy serves as a platform for sharing innovations, research, development, and demonstrations in energy conversion, conservation, and sustainable energy systems. The journal covers topics such as optimal energy resource use, environmental pollutant mitigation, and energy process analysis. It welcomes original papers, review articles, technical notes, and letters to the editor. Authors are encouraged to submit manuscripts that bridge the gap between research, development, and implementation. The journal addresses a wide spectrum of topics, including fossil and renewable energy technologies, energy economics, and environmental impacts. Applied Energy also explores modeling and forecasting, conservation strategies, and the social and economic implications of energy policies, including climate change mitigation. It is complemented by the open-access journal Advances in Applied Energy.