Interpolation of Environmental Data Using Deep Learning and Model Inference

C. Ibebuchi, Itohan-Osa Abu
{"title":"Interpolation of Environmental Data Using Deep Learning and Model Inference","authors":"C. Ibebuchi, Itohan-Osa Abu","doi":"10.1088/2632-2153/ad4b94","DOIUrl":null,"url":null,"abstract":"\n The temporal resolution of environmental data sets plays a major role in the granularity of the information that can be derived from the data. In most cases, it is required that different data sets have a common temporal resolution to enable their consistent evaluations and applications in making informed decisions. This study leverages deep learning with long short-term memory (LSTM) neural networks and model inference to enhance the temporal resolution of climate datasets, specifically temperature, and precipitation, from daily to sub-daily scales. We trained our model to learn the relationship between daily and sub-daily data, subsequently applying this knowledge to increase the resolution of a separate dataset with a coarser (daily) temporal resolution. Our findings reveal a high degree of accuracy for temperature predictions, evidenced by a correlation of 0.99 and a mean absolute error of 0.21 °C, between the actual and predicted sub-daily values. In contrast, the approach was less effective for precipitation, achieving an explained variance of only 37%, compared to 98% for temperature. Further, besides the sub-daily interpolation of the climate data sets, we adapted our approach to increase the resolution of the Normalized difference vegetation index of Landsat (from 16-day to 5-day interval) using the LSTM model pre-trained from the Sentinel 2 Normalized difference vegetation index - that exists at a relatively higher temporal resolution. The explained variance between the predicted Landsat and Sentinel 1 data is 70% with a mean absolute error of 0.03. These results suggest that our method is particularly suitable for environmental datasets with less pronounced short-term variability, offering a promising tool for improving the resolution and utility of the data.","PeriodicalId":503691,"journal":{"name":"Machine Learning: Science and Technology","volume":"12 26","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Machine Learning: Science and Technology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1088/2632-2153/ad4b94","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

The temporal resolution of environmental data sets plays a major role in the granularity of the information that can be derived from the data. In most cases, it is required that different data sets have a common temporal resolution to enable their consistent evaluations and applications in making informed decisions. This study leverages deep learning with long short-term memory (LSTM) neural networks and model inference to enhance the temporal resolution of climate datasets, specifically temperature, and precipitation, from daily to sub-daily scales. We trained our model to learn the relationship between daily and sub-daily data, subsequently applying this knowledge to increase the resolution of a separate dataset with a coarser (daily) temporal resolution. Our findings reveal a high degree of accuracy for temperature predictions, evidenced by a correlation of 0.99 and a mean absolute error of 0.21 °C, between the actual and predicted sub-daily values. In contrast, the approach was less effective for precipitation, achieving an explained variance of only 37%, compared to 98% for temperature. Further, besides the sub-daily interpolation of the climate data sets, we adapted our approach to increase the resolution of the Normalized difference vegetation index of Landsat (from 16-day to 5-day interval) using the LSTM model pre-trained from the Sentinel 2 Normalized difference vegetation index - that exists at a relatively higher temporal resolution. The explained variance between the predicted Landsat and Sentinel 1 data is 70% with a mean absolute error of 0.03. These results suggest that our method is particularly suitable for environmental datasets with less pronounced short-term variability, offering a promising tool for improving the resolution and utility of the data.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
利用深度学习和模型推理对环境数据进行插值处理
环境数据集的时间分辨率对于从数据中获取信息的粒度起着重要作用。在大多数情况下,需要不同的数据集具有共同的时间分辨率,以便在做出明智决策时对其进行一致的评估和应用。本研究利用深度学习的长短期记忆(LSTM)神经网络和模型推理来提高气候数据集的时间分辨率,特别是温度和降水量,从日尺度到亚日尺度。我们对模型进行了训练,以学习日数据和亚日数据之间的关系,随后将这一知识用于提高时间分辨率更粗的(日)单独数据集的分辨率。我们的研究结果表明,该模型对温度的预测具有很高的准确性,其实际值与亚日预测值之间的相关性为 0.99,平均绝对误差为 0.21 °C。相比之下,该方法对降水的效果较差,解释方差仅为 37%,而对气温的解释方差为 98%。此外,除了对气候数据集进行亚日插值外,我们还调整了方法,利用根据哨兵 2 号归一化差异植被指数预先训练的 LSTM 模型,提高了大地遥感卫星归一化差异植被指数的分辨率(从 16 天间隔提高到 5 天间隔)--后者的时间分辨率相对更高。预测的大地遥感卫星数据和哨兵 1 号数据之间的解释方差为 70%,平均绝对误差为 0.03。这些结果表明,我们的方法特别适用于短期变异性不明显的环境数据集,为提高数据的分辨率和实用性提供了一种有前途的工具。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
On the Benefit of Attention in Inverse Design of Thin Films Filters Predictive Models for Inorganic Materials Thermoelectric Properties with Machine Learning Benchmarking machine learning interatomic potentials via phonon anharmonicity Application of Deep Learning-based Fuzzy Systems to Analyze the Overall Risk of Mortality in Glioblastoma Multiforme Formation Energy Prediction of Neutral Single-Atom Impurities in 2D Materials using Tree-based Machine Learning
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1