Data-driven and knowledge-guided denoising diffusion probabilistic model for runoff uncertainty prediction

IF 5.9 1区 地球科学 Q1 ENGINEERING, CIVIL Journal of Hydrology Pub Date : 2024-07-01 DOI:10.1016/j.jhydrol.2024.131556
Pingping Shao , Jun Feng , Jiamin Lu , Zhixian Tang
{"title":"Data-driven and knowledge-guided denoising diffusion probabilistic model for runoff uncertainty prediction","authors":"Pingping Shao ,&nbsp;Jun Feng ,&nbsp;Jiamin Lu ,&nbsp;Zhixian Tang","doi":"10.1016/j.jhydrol.2024.131556","DOIUrl":null,"url":null,"abstract":"<div><p>The existing medium and long-term runoff prediction methods, which are based on data-driven and knowledge-guided methods, are associated with inherent limitations, and chaotic phenomena in runoff prediction models often leads to oscillation in the prediction error, affecting the robustness of the prediction. A knowledge-guided denoising diffusion probabilistic model (DK-RDDPM) that introduces physical theory to guide constraint quantification and obtain effective runoff uncertainty prediction results is therefore proposed in this study. The main advantage of this model is that the physical randomness in the runoff prediction process can be captured and combined with the Saint-Venant process to guide model optimization and realize more accurate medium- and long-term runoff prediction. The main contributions of this study are the establishment of a dynamic runoff probabilistic prediction model with stochastic quantification characteristics that includes the prediction uncertainty over time, and modelling of the physical constraint boundary of runoff prediction from the perspective of partial differentiation. The effectiveness of the DK-RDDPM was verified by predicting runoff in the Qijiang and Tunxi Basins in China. The results show that: 1) Encoding the physical random uncertainty operator in runoff prediction into the network of the denoising diffusion probabilistic model (DDPM) effectively captures the physically complex implicit randomness of the process, thus reducing the error that results from randomness in runoff prediction. 2) The constraint matrix that is formed using the Saint-Venant equation and the prediction matrix are layered and projected, with the fluctuation range of the constraints in each step adjusted in the optimization direction within a certain random threshold range. 3) The DK-RDDPM shows superior performance to the benchmark models, even under the influence of different noise interference factors.</p></div>","PeriodicalId":362,"journal":{"name":"Journal of Hydrology","volume":null,"pages":null},"PeriodicalIF":5.9000,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Hydrology","FirstCategoryId":"89","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0022169424009521","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, CIVIL","Score":null,"Total":0}
引用次数: 0

Abstract

The existing medium and long-term runoff prediction methods, which are based on data-driven and knowledge-guided methods, are associated with inherent limitations, and chaotic phenomena in runoff prediction models often leads to oscillation in the prediction error, affecting the robustness of the prediction. A knowledge-guided denoising diffusion probabilistic model (DK-RDDPM) that introduces physical theory to guide constraint quantification and obtain effective runoff uncertainty prediction results is therefore proposed in this study. The main advantage of this model is that the physical randomness in the runoff prediction process can be captured and combined with the Saint-Venant process to guide model optimization and realize more accurate medium- and long-term runoff prediction. The main contributions of this study are the establishment of a dynamic runoff probabilistic prediction model with stochastic quantification characteristics that includes the prediction uncertainty over time, and modelling of the physical constraint boundary of runoff prediction from the perspective of partial differentiation. The effectiveness of the DK-RDDPM was verified by predicting runoff in the Qijiang and Tunxi Basins in China. The results show that: 1) Encoding the physical random uncertainty operator in runoff prediction into the network of the denoising diffusion probabilistic model (DDPM) effectively captures the physically complex implicit randomness of the process, thus reducing the error that results from randomness in runoff prediction. 2) The constraint matrix that is formed using the Saint-Venant equation and the prediction matrix are layered and projected, with the fluctuation range of the constraints in each step adjusted in the optimization direction within a certain random threshold range. 3) The DK-RDDPM shows superior performance to the benchmark models, even under the influence of different noise interference factors.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
用于径流不确定性预测的数据驱动和知识指导去噪扩散概率模型
现有的基于数据驱动和知识引导的中长期径流预测方法存在固有的局限性,径流预测模型中的混沌现象往往会导致预测误差的振荡,影响预测的鲁棒性。因此,本研究提出了一种知识引导的去噪扩散概率模型(DK-RDDPM),引入物理理论指导约束量化,获得有效的径流不确定性预测结果。该模型的主要优点是可以捕捉径流预测过程中的物理随机性,并结合圣维南过程指导模型优化,实现更精确的中长期径流预测。本研究的主要贡献在于建立了包含预测不确定性随时间变化的具有随机量化特征的动态径流概率预测模型,并从偏微分的角度对径流预测的物理约束边界进行了建模。通过对中国綦江流域和屯溪流域的径流预测,验证了 DK-RDDPM 的有效性。结果表明1)将径流预测中的物理随机不确定性算子编码到去噪扩散概率模型(DDPM)的网络中,有效地捕捉了物理上复杂的隐含随机性过程,从而减少了径流预测中随机性导致的误差。2) 利用 Saint-Venant 方程形成的约束矩阵与预测矩阵分层投影,每一步约束条件的波动范围在一定的随机阈值范围内向优化方向调整。3) 即使在不同噪声干扰因素的影响下,DK-RDDPM 的性能也优于基准模型。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Journal of Hydrology
Journal of Hydrology 地学-地球科学综合
CiteScore
11.00
自引率
12.50%
发文量
1309
审稿时长
7.5 months
期刊介绍: The Journal of Hydrology publishes original research papers and comprehensive reviews in all the subfields of the hydrological sciences including water based management and policy issues that impact on economics and society. These comprise, but are not limited to the physical, chemical, biogeochemical, stochastic and systems aspects of surface and groundwater hydrology, hydrometeorology and hydrogeology. Relevant topics incorporating the insights and methodologies of disciplines such as climatology, water resource systems, hydraulics, agrohydrology, geomorphology, soil science, instrumentation and remote sensing, civil and environmental engineering are included. Social science perspectives on hydrological problems such as resource and ecological economics, environmental sociology, psychology and behavioural science, management and policy analysis are also invited. Multi-and interdisciplinary analyses of hydrological problems are within scope. The science published in the Journal of Hydrology is relevant to catchment scales rather than exclusively to a local scale or site.
期刊最新文献
Generation of root zone soil moisture from the integration of an all-weather satellite surface soil moisture estimates and an analytical model: A preliminary result in China DRSTF: A hybrid-approach framework for reservoir water temperature forecasting considering operation response Development of a modular distributed hydro-thermal coupled hydrological model for cold regions Vegetation greening mitigates the positive impacts of climate change on water availability in Northwest China Impacts of changing weather patterns on the dynamics of water pollutants in agricultural catchments: Insights from 11-year high temporal resolution data analysis
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1