首页 > 最新文献

Journal of Hydroinformatics最新文献

英文 中文
Investigating optimal 2D hydrodynamic modeling of a recent flash flood in a steep Norwegian river using high-performance computing 使用高性能计算研究挪威陡峭河流最近山洪暴发的最优二维流体动力学建模
IF 2.7 3区 工程技术 Q3 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2023-09-07 DOI: 10.2166/hydro.2023.012
A. Moraru, Nils Rüther, O. Bruland
Efficient flood risk assessment and communication are essential for responding to increasingly recurrent flash floods. However, access to high-end data center computing is limited for stakeholders. This study evaluates the accuracy-speed trade-off of a hydraulic model by (i) assessing the potential acceleration of high-performance computing in PCs versus server-CPUs and GPUs, (ii) examining computing time evaluation and prediction indicators, and (iii) identifying variables controlling the computing time and their impact on the 2D hydrodynamic models' accuracy using an actual flash flood event as a benchmark. GPU-computing is found to be 130× and 55× faster than standard and parallelized CPU-computing, respectively, saving up to 99.5% of the computing time. The model's number of elements had the most significant impact, with <150,000 cells showing the best accuracy-speed trade-off. Using a PC equipped with a GPU enables almost real-time hydrodynamic information, democratizing flood data and facilitating interactive flood risk analysis.
有效的洪水风险评估和沟通对于应对日益频繁的山洪暴发至关重要。然而,利益相关者对高端数据中心计算的访问是有限的。本研究通过(i)评估PC与服务器CPU和GPU中高性能计算的潜在加速,(ii)检查计算时间评估和预测指标,以及(iii)使用实际的山洪事件作为基准来识别控制计算时间及其对2D流体动力学模型准确性的影响的变量。GPU计算速度分别比标准和并行CPU计算快130倍和55倍,节省了高达99.5%的计算时间。该模型的元素数量影响最大,<150000个单元显示出最佳的精度-速度权衡。使用配备GPU的PC可以实现几乎实时的水动力信息,使洪水数据民主化,并促进交互式洪水风险分析。
{"title":"Investigating optimal 2D hydrodynamic modeling of a recent flash flood in a steep Norwegian river using high-performance computing","authors":"A. Moraru, Nils Rüther, O. Bruland","doi":"10.2166/hydro.2023.012","DOIUrl":"https://doi.org/10.2166/hydro.2023.012","url":null,"abstract":"\u0000 \u0000 Efficient flood risk assessment and communication are essential for responding to increasingly recurrent flash floods. However, access to high-end data center computing is limited for stakeholders. This study evaluates the accuracy-speed trade-off of a hydraulic model by (i) assessing the potential acceleration of high-performance computing in PCs versus server-CPUs and GPUs, (ii) examining computing time evaluation and prediction indicators, and (iii) identifying variables controlling the computing time and their impact on the 2D hydrodynamic models' accuracy using an actual flash flood event as a benchmark. GPU-computing is found to be 130× and 55× faster than standard and parallelized CPU-computing, respectively, saving up to 99.5% of the computing time. The model's number of elements had the most significant impact, with <150,000 cells showing the best accuracy-speed trade-off. Using a PC equipped with a GPU enables almost real-time hydrodynamic information, democratizing flood data and facilitating interactive flood risk analysis.","PeriodicalId":54801,"journal":{"name":"Journal of Hydroinformatics","volume":" ","pages":""},"PeriodicalIF":2.7,"publicationDate":"2023-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46127874","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A WaveNet-based convolutional neural network for river water level prediction 基于WaveNet的河流水位预测卷积神经网络
IF 2.7 3区 工程技术 Q3 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2023-09-06 DOI: 10.2166/hydro.2023.174
Jun Chen, Yan Huang, Teng Wu, Jing Yan
River water level prediction (WLP) plays an important role in flood control, navigation, and water supply. In this study, a WaveNet-based convolutional neural network (WCNN) with a lightweight structure and good parallelism was developed to improve the prediction accuracy and time effectiveness of WLP. It was applied to predict 1/2/3 days the water levels at the Waizhou gauging station of the Ganjiang River (GR) in China, and it was compared with two recurrent neural networks (long short-term memory (LSTM) and gated recurrent unit (GRU)). The results showed that the WCNN model achieved the best prediction performance with the fewest training parameters and time. Compared with the LSTM and GRU models in the 1-day ahead prediction, the training parameters were reduced from 73,851 and 55,851 to 32,937, respectively. The root mean square error (RMSE) was reduced from 0.071 and 0.076 to 0.057, respectively. The mean absolute error (MAE) was reduced from 0.052 and 0.059 to 0.038, respectively. The Nash–Sutcliffe efficiency (NSE) and coefficient of determination (R2) both increased to 0.998. This result indicated that the improved model was more efficient for WLP.
河流水位预测在防洪、航运和供水中发挥着重要作用。在本研究中,开发了一种基于WaveNet的卷积神经网络(WCNN),该网络具有轻量级结构和良好的并行性,以提高WLP的预测精度和时间有效性。将其应用于赣江外州水文站1/2/3天的水位预测,并与长短期记忆(LSTM)和门控递归单元(GRU)两种递归神经网络进行了比较。结果表明,WCNN模型以最少的训练参数和时间获得了最佳的预测性能。与1天预测中的LSTM和GRU模型相比,训练参数分别从73851和55851减少到32937。均方根误差(RMSE)分别从0.071和0.076降低到0.057。平均绝对误差(MAE)分别从0.052和0.059降低到0.038。纳什-萨克利夫效率(NSE)和决定系数(R2)均增至0.998。这一结果表明,改进的模型对WLP更有效。
{"title":"A WaveNet-based convolutional neural network for river water level prediction","authors":"Jun Chen, Yan Huang, Teng Wu, Jing Yan","doi":"10.2166/hydro.2023.174","DOIUrl":"https://doi.org/10.2166/hydro.2023.174","url":null,"abstract":"\u0000 \u0000 River water level prediction (WLP) plays an important role in flood control, navigation, and water supply. In this study, a WaveNet-based convolutional neural network (WCNN) with a lightweight structure and good parallelism was developed to improve the prediction accuracy and time effectiveness of WLP. It was applied to predict 1/2/3 days the water levels at the Waizhou gauging station of the Ganjiang River (GR) in China, and it was compared with two recurrent neural networks (long short-term memory (LSTM) and gated recurrent unit (GRU)). The results showed that the WCNN model achieved the best prediction performance with the fewest training parameters and time. Compared with the LSTM and GRU models in the 1-day ahead prediction, the training parameters were reduced from 73,851 and 55,851 to 32,937, respectively. The root mean square error (RMSE) was reduced from 0.071 and 0.076 to 0.057, respectively. The mean absolute error (MAE) was reduced from 0.052 and 0.059 to 0.038, respectively. The Nash–Sutcliffe efficiency (NSE) and coefficient of determination (R2) both increased to 0.998. This result indicated that the improved model was more efficient for WLP.","PeriodicalId":54801,"journal":{"name":"Journal of Hydroinformatics","volume":" ","pages":""},"PeriodicalIF":2.7,"publicationDate":"2023-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44375371","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Large-eddy simulation of free-surface turbulent flow in a non-prismatic channel 非棱柱形通道中自由表面湍流的大涡模拟
IF 2.7 3区 工程技术 Q3 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2023-09-06 DOI: 10.2166/hydro.2023.018
Ruirui Zeng, S. S. Li
Hydraulic engineering applications require a good knowledge of turbulent behaviour in non-prismatic channels. This paper aims to predict turbulent behaviour using the large-eddy simulation (LES) method. The model channel has a warped transition. We perform two-phase LES of free-surface flow and validate the results using experimental data and benchmark solution. We discuss rigorous strategies for model set-up, parameter selection and parametric value assignment, including parameters in the spectrum synthesiser (SS) and vortex method (VM) for inlet turbulence. The predicted flow displays complex structures due to eddy motions translated from upstream and locally generated by asymmetrical separation in the transition. The history of the flow dynamics may affect the flow development. The predicted velocity, energy spectrum, root-mean-square error, hit-rate and factor-of-two compare well with measurements and benchmark solution. Mapping mean-velocity distribution from experimental data, combined with SS, gives satisfactory inlet condition; alternatively, a 1/7th power-law for the mean-velocity, combined with VM, is acceptable. This paper uses the Okubo–Weiss parameter to delineate 3D instantaneous coherent structures. The LES methods are reliable, efficient and cost-effective. As compared to the simulation of prismatic channels, the flow dynamics in non-prismatic channels exhibit flow separation and turbulence interactions, which increase the flow-complexity, while offering results with crucial practical applications.
水利工程应用需要对非棱柱形通道中的湍流行为有很好的了解。本文旨在利用大涡模拟(LES)方法预测湍流行为。模型通道有一个扭曲的过渡。我们进行了自由表面流动的两相LES,并使用实验数据和基准解决方案验证了结果。我们讨论了模型建立、参数选择和参数值分配的严格策略,包括频谱合成器(SS)和涡旋方法(VM)中的参数。由于上游的涡流运动和过渡段的不对称分离在局部产生的涡流运动,预测的流动呈现复杂的结构。流动动力学的历史可能影响流动的发展。预测的速度、能谱、均方根误差、命中率和二系数与测量结果和基准解决方案比较良好。利用实验数据映射平均速度分布,结合SS,得到了满意的入口条件;或者,平均速度的1/7幂律,结合VM,是可以接受的。本文采用Okubo-Weiss参数来描述三维瞬态相干结构。LES方法可靠、高效、经济。与棱柱形通道的模拟相比,非棱柱形通道中的流动动力学表现出流动分离和湍流相互作用,这增加了流动的复杂性,同时提供了具有重要实际应用价值的结果。
{"title":"Large-eddy simulation of free-surface turbulent flow in a non-prismatic channel","authors":"Ruirui Zeng, S. S. Li","doi":"10.2166/hydro.2023.018","DOIUrl":"https://doi.org/10.2166/hydro.2023.018","url":null,"abstract":"\u0000 \u0000 Hydraulic engineering applications require a good knowledge of turbulent behaviour in non-prismatic channels. This paper aims to predict turbulent behaviour using the large-eddy simulation (LES) method. The model channel has a warped transition. We perform two-phase LES of free-surface flow and validate the results using experimental data and benchmark solution. We discuss rigorous strategies for model set-up, parameter selection and parametric value assignment, including parameters in the spectrum synthesiser (SS) and vortex method (VM) for inlet turbulence. The predicted flow displays complex structures due to eddy motions translated from upstream and locally generated by asymmetrical separation in the transition. The history of the flow dynamics may affect the flow development. The predicted velocity, energy spectrum, root-mean-square error, hit-rate and factor-of-two compare well with measurements and benchmark solution. Mapping mean-velocity distribution from experimental data, combined with SS, gives satisfactory inlet condition; alternatively, a 1/7th power-law for the mean-velocity, combined with VM, is acceptable. This paper uses the Okubo–Weiss parameter to delineate 3D instantaneous coherent structures. The LES methods are reliable, efficient and cost-effective. As compared to the simulation of prismatic channels, the flow dynamics in non-prismatic channels exhibit flow separation and turbulence interactions, which increase the flow-complexity, while offering results with crucial practical applications.","PeriodicalId":54801,"journal":{"name":"Journal of Hydroinformatics","volume":" ","pages":""},"PeriodicalIF":2.7,"publicationDate":"2023-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43510255","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Separation of pressure signals caused by waves traveling in opposite directions 由反方向波传播引起的压力信号分离
IF 2.7 3区 工程技术 Q3 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2023-09-05 DOI: 10.2166/hydro.2023.021
Marco Ferrante, Aaron Zecchin
Hydraulic transient analysis allows the condition assessment of pipeline systems by the measurement of a system's transient pressure response subject to input pressure excitations. The detection of a pressure wave's arrival time and amplitude at one or more sections can be used to detect unexpected anomalies, such as leaks, blockages, or corroded sections. Wave separation approaches, based on signal processing techniques involving two sensors, enable a directional attribution to any measured pressure perturbations. Being able to determine the direction of origin of a perturbation through a signal-splitting approach greatly facilitates anomaly detection through the resolution of this ambiguity. The signal-splitting procedure can be sensitive to the analysis conditions (i.e. the signal processing procedure used, the presence of noise within the signal, and the spacing of the sensors) and, as a result, produce spurious results. This paper explores this issue and proposes, and analyses, a range of strategies to improve the signal-splitting results. The strategies explored involve the consideration of alternative time and frequency-domain formulations; the use of filters and wavelet to condition the signal; and processing the time-shifted differenced signal as opposed to the original raw signal. Results are presented for a range of numerical and laboratory systems.
水力瞬态分析允许通过测量系统在输入压力激励下的瞬态压力响应来评估管道系统的状态。检测压力波在一个或多个段的到达时间和振幅,可用于检测意外异常,如泄漏、堵塞或腐蚀段。波分离方法基于涉及两个传感器的信号处理技术,可以对任何测量到的压力扰动进行定向归因。能够通过信号分裂方法确定扰动的起源方向,通过解决这种模糊性极大地促进了异常检测。信号分裂过程可能对分析条件(即所使用的信号处理过程、信号中噪声的存在以及传感器的间距)很敏感,因此会产生杂散结果。本文对这一问题进行了探讨,提出并分析了一系列改进信号分割效果的策略。所探索的策略包括考虑替代的时域和频域公式;利用滤波器和小波对信号进行调理;处理时移差分信号而不是原始信号。结果提出了一系列数值和实验室系统。
{"title":"Separation of pressure signals caused by waves traveling in opposite directions","authors":"Marco Ferrante, Aaron Zecchin","doi":"10.2166/hydro.2023.021","DOIUrl":"https://doi.org/10.2166/hydro.2023.021","url":null,"abstract":"\u0000 Hydraulic transient analysis allows the condition assessment of pipeline systems by the measurement of a system's transient pressure response subject to input pressure excitations. The detection of a pressure wave's arrival time and amplitude at one or more sections can be used to detect unexpected anomalies, such as leaks, blockages, or corroded sections. Wave separation approaches, based on signal processing techniques involving two sensors, enable a directional attribution to any measured pressure perturbations. Being able to determine the direction of origin of a perturbation through a signal-splitting approach greatly facilitates anomaly detection through the resolution of this ambiguity. The signal-splitting procedure can be sensitive to the analysis conditions (i.e. the signal processing procedure used, the presence of noise within the signal, and the spacing of the sensors) and, as a result, produce spurious results. This paper explores this issue and proposes, and analyses, a range of strategies to improve the signal-splitting results. The strategies explored involve the consideration of alternative time and frequency-domain formulations; the use of filters and wavelet to condition the signal; and processing the time-shifted differenced signal as opposed to the original raw signal. Results are presented for a range of numerical and laboratory systems.","PeriodicalId":54801,"journal":{"name":"Journal of Hydroinformatics","volume":" ","pages":""},"PeriodicalIF":2.7,"publicationDate":"2023-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42716531","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Modeling of truncated normal distribution for estimating hydraulic parameters in water distribution systems: taking nodal water demand as an example 配水系统水力参数估计的截断正态分布建模——以节点需水量为例
3区 工程技术 Q3 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2023-09-01 DOI: 10.2166/hydro.2023.250
Yu Shao, Kun Li, Tuqiao Zhang, Y. Jeffrey Yang, Shipeng Chu
Abstract The normal probability density function (PDF) is widely used in parameter estimation in the modeling of dynamic systems, assuming that the random variables are distributed at infinite intervals. However, in practice, these random variables are usually distributed in a finite region confined by the physical process and engineering practice. In this study, we address this issue through the application of truncated normal PDF. This method avoids a non-differentiable problem inherited in the truncated normal PDF at the truncation points, a limitation that can limit the use of analytical methods (e.g., Gaussian approximation). A data assimilation method with the derived formula is proposed to describe the probability of parameter and measurement noise in the truncated space. In application to a water distribution system (WDS), the proposed method leads to estimating nodal water demand and hydraulic pressure key to hydraulic and water quality model simulations. Application results to a hypothetical and a large field WDS clearly show the superiority of the proposed method in parameter estimation for WDS simulations. This improvement is essential for developing real-time hydraulic and water quality simulation and process control in field applications when the parameter and measurement noise are distributed in the finite region.
摘要正态概率密度函数(PDF)被广泛用于动态系统建模中的参数估计,它假设随机变量在无限区间内分布。然而,在实际应用中,这些随机变量通常受物理过程和工程实践的限制而分布在有限的区域内。在本研究中,我们通过应用截断的正常PDF来解决这个问题。该方法避免了截断的正态PDF在截断点处继承的不可微问题,这一限制可能限制解析方法(例如高斯近似)的使用。利用导出的公式,提出了一种数据同化方法来描述截断空间中参数噪声和测量噪声的概率。将该方法应用于配水系统(WDS),得到了节点需水量和水力压力的估计,这是水力和水质模型仿真的关键。对一个假设的大视场WDS的应用结果清楚地表明了该方法在WDS仿真参数估计方面的优越性。当参数和测量噪声分布在有限区域时,这种改进对于开发现场应用中的实时水力和水质模拟和过程控制至关重要。
{"title":"Modeling of truncated normal distribution for estimating hydraulic parameters in water distribution systems: taking nodal water demand as an example","authors":"Yu Shao, Kun Li, Tuqiao Zhang, Y. Jeffrey Yang, Shipeng Chu","doi":"10.2166/hydro.2023.250","DOIUrl":"https://doi.org/10.2166/hydro.2023.250","url":null,"abstract":"Abstract The normal probability density function (PDF) is widely used in parameter estimation in the modeling of dynamic systems, assuming that the random variables are distributed at infinite intervals. However, in practice, these random variables are usually distributed in a finite region confined by the physical process and engineering practice. In this study, we address this issue through the application of truncated normal PDF. This method avoids a non-differentiable problem inherited in the truncated normal PDF at the truncation points, a limitation that can limit the use of analytical methods (e.g., Gaussian approximation). A data assimilation method with the derived formula is proposed to describe the probability of parameter and measurement noise in the truncated space. In application to a water distribution system (WDS), the proposed method leads to estimating nodal water demand and hydraulic pressure key to hydraulic and water quality model simulations. Application results to a hypothetical and a large field WDS clearly show the superiority of the proposed method in parameter estimation for WDS simulations. This improvement is essential for developing real-time hydraulic and water quality simulation and process control in field applications when the parameter and measurement noise are distributed in the finite region.","PeriodicalId":54801,"journal":{"name":"Journal of Hydroinformatics","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135299871","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Machine learning-enabled calibration of river routing model parameters 机器学习实现了河道模型参数的校准
IF 2.7 3区 工程技术 Q3 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2023-09-01 DOI: 10.2166/hydro.2023.030
Ying Zhao, Mayank Chadha, Nicholas Olsen, Elissa Yeates, Josh Turner, Guga Gugaratshan, Gu Qian, Michael D. Todd, Zhen Hu
Streamflow prediction of rivers is crucial for making decisions in watershed and inland waterways management. The US Army Corps of Engineers (USACE) uses a river routing model called RAPID to predict water discharges for thousands of rivers in the network for watershed and inland waterways management. However, the calibration of hydrological streamflow parameters in RAPID is time-consuming and requires streamflow measurement data which may not be available for some ungauged locations. In this study, we aim to address the calibration aspect of the RAPID model by exploring machine learning (ML)-based methods to facilitate efficient calibration of hydrological model parameters without the need for streamflow measurements. Various ML models are constructed and compared to learn a relationship between hydrological model parameters and various river parameters, such as length, slope, catchment size, percentage of vegetation, and elevation contours. The studied ML models include Gaussian process regression, Gaussian mixture copula, Random Forest, and XGBoost. This study has shown that ML models that are carefully constructed by considering causal and sensitive input features offer a potential approach that not only obtains calibrated hydrological model parameters with reasonable accuracy but also bypasses the current calibration challenges.
河流流量预测对于流域和内陆水道管理决策至关重要。美国陆军工程兵团(USACE)使用一种名为RAPID的河流路径模型来预测流域和内陆水道管理网络中数千条河流的排水量。然而,RAPID中水文流量参数的校准是耗时的,并且需要流量测量数据,而这些数据可能无法用于某些未测量的位置。在这项研究中,我们旨在通过探索基于机器学习(ML)的方法来解决RAPID模型的校准方面,以促进水文模型参数的有效校准,而无需进行流量测量。构建并比较了各种ML模型,以了解水文模型参数与各种河流参数之间的关系,如长度、坡度、集水区大小、植被百分比和高程等值线。所研究的ML模型包括高斯过程回归、高斯混合copula、随机森林和XGBoost。这项研究表明,通过考虑因果和敏感输入特征精心构建的ML模型提供了一种潜在的方法,不仅可以以合理的精度获得校准的水文模型参数,而且可以绕过当前的校准挑战。
{"title":"Machine learning-enabled calibration of river routing model parameters","authors":"Ying Zhao, Mayank Chadha, Nicholas Olsen, Elissa Yeates, Josh Turner, Guga Gugaratshan, Gu Qian, Michael D. Todd, Zhen Hu","doi":"10.2166/hydro.2023.030","DOIUrl":"https://doi.org/10.2166/hydro.2023.030","url":null,"abstract":"\u0000 Streamflow prediction of rivers is crucial for making decisions in watershed and inland waterways management. The US Army Corps of Engineers (USACE) uses a river routing model called RAPID to predict water discharges for thousands of rivers in the network for watershed and inland waterways management. However, the calibration of hydrological streamflow parameters in RAPID is time-consuming and requires streamflow measurement data which may not be available for some ungauged locations. In this study, we aim to address the calibration aspect of the RAPID model by exploring machine learning (ML)-based methods to facilitate efficient calibration of hydrological model parameters without the need for streamflow measurements. Various ML models are constructed and compared to learn a relationship between hydrological model parameters and various river parameters, such as length, slope, catchment size, percentage of vegetation, and elevation contours. The studied ML models include Gaussian process regression, Gaussian mixture copula, Random Forest, and XGBoost. This study has shown that ML models that are carefully constructed by considering causal and sensitive input features offer a potential approach that not only obtains calibrated hydrological model parameters with reasonable accuracy but also bypasses the current calibration challenges.","PeriodicalId":54801,"journal":{"name":"Journal of Hydroinformatics","volume":"43 20","pages":""},"PeriodicalIF":2.7,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41247321","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Data-driven modeling of municipal water system responses to hydroclimate extremes 城市供水系统对极端水文气候响应的数据驱动建模
IF 2.7 3区 工程技术 Q3 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2023-09-01 DOI: 10.2166/hydro.2023.170
Ryan C. Johnson, S. J. Burian, C. Oroza, James Halgren, Trevor Irons, Danyal Aziz, Daniyal Hassan, Jiada Li, Carly Hansen, T. Kirkham, Jesse Stewart, Laura Briefer
Sustainable western US municipal water system (MWS) management depends on quantifying the impacts of supply and demand dynamics on system infrastructure reliability and vulnerability. Systems modeling can replicate the interactions but extensive parameterization, high complexity, and long development cycles present barriers to widespread adoption. To address these challenges, we develop the Machine Learning Water Systems Model (ML-WSM) – a novel application of data-driven modeling for MWS management. We apply the ML-WSM framework to the Salt Lake City, Utah water system, where we benchmark prediction performance on the seasonal response of reservoir levels, groundwater withdrawal, and imported water requests to climate anomalies at a daily resolution against an existing systems model. The ML-WSM accurately predicts the seasonal dynamics of all components; especially during supply-limiting conditions (KGE > 0.88, PBias < ±3%). Extreme wet conditions challenged model skill but the ML-WSM communicated the appropriate seasonal trends and relationships to component thresholds (e.g., reservoir dead pool). The model correctly classified nearly all instances of vulnerability (83%) and peak severity (100%), encouraging its use as a guidance tool that complements systems models for evaluating the influences of climate on MWS performance.
可持续的美国西部城市供水系统(MWS)管理依赖于量化供需动态对系统基础设施可靠性和脆弱性的影响。系统建模可以复制交互,但是广泛的参数化、高复杂性和长开发周期阻碍了广泛采用。为了应对这些挑战,我们开发了机器学习水系统模型(ML-WSM),这是一种用于MWS管理的数据驱动建模的新应用。我们将ML-WSM框架应用于犹他州盐湖城的供水系统,在那里我们对水库水位的季节性响应、地下水提取和对现有系统模型的每日分辨率的进口水请求的气候异常进行基准预测。ML-WSM能准确预测各分量的季节动态;特别是在供应受限条件下(KGE > 0.88, PBias <±3%)。极端潮湿条件对模型技能提出了挑战,但ML-WSM传达了适当的季节趋势和与组件阈值(例如,水库死池)的关系。该模型正确地分类了几乎所有的脆弱性(83%)和峰值严重程度(100%),鼓励将其作为一种指导工具,补充系统模型,以评估气候对MWS性能的影响。
{"title":"Data-driven modeling of municipal water system responses to hydroclimate extremes","authors":"Ryan C. Johnson, S. J. Burian, C. Oroza, James Halgren, Trevor Irons, Danyal Aziz, Daniyal Hassan, Jiada Li, Carly Hansen, T. Kirkham, Jesse Stewart, Laura Briefer","doi":"10.2166/hydro.2023.170","DOIUrl":"https://doi.org/10.2166/hydro.2023.170","url":null,"abstract":"\u0000 \u0000 Sustainable western US municipal water system (MWS) management depends on quantifying the impacts of supply and demand dynamics on system infrastructure reliability and vulnerability. Systems modeling can replicate the interactions but extensive parameterization, high complexity, and long development cycles present barriers to widespread adoption. To address these challenges, we develop the Machine Learning Water Systems Model (ML-WSM) – a novel application of data-driven modeling for MWS management. We apply the ML-WSM framework to the Salt Lake City, Utah water system, where we benchmark prediction performance on the seasonal response of reservoir levels, groundwater withdrawal, and imported water requests to climate anomalies at a daily resolution against an existing systems model. The ML-WSM accurately predicts the seasonal dynamics of all components; especially during supply-limiting conditions (KGE > 0.88, PBias < ±3%). Extreme wet conditions challenged model skill but the ML-WSM communicated the appropriate seasonal trends and relationships to component thresholds (e.g., reservoir dead pool). The model correctly classified nearly all instances of vulnerability (83%) and peak severity (100%), encouraging its use as a guidance tool that complements systems models for evaluating the influences of climate on MWS performance.","PeriodicalId":54801,"journal":{"name":"Journal of Hydroinformatics","volume":" ","pages":""},"PeriodicalIF":2.7,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44952209","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Economic comparison between an optimized and a traditional sewer system designs 优化下水道系统与传统下水道系统设计的经济比较
IF 2.7 3区 工程技术 Q3 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2023-08-31 DOI: 10.2166/hydro.2023.027
M. A. González, J. Saldarriaga
Sewage systems are essential for the efficient functioning of cities. Wastewater contains solids and organic matter that pose health risks, making it necessary to optimize the sewerage system design. In recent years, optimization tools have been introduced to minimize costs while still complying with regulations. Despite this, traditional designs still dominate, but the use of optimization methodologies can significantly reduce construction costs. For this reason, this research will compare the construction costs of a sewerage system designed optimally and one designed using traditional methods, to determine the cost difference between the two. In a sector of Bogota, Colombia, a sewerage system was already built and designed according to Colombian laws using traditional methodologies. The information from this area was used to implement the UTOPIA program, created by the Universidad de los Andes. This program uses the Shortest Path Problem with the Bellman-Ford algorithm to design the network and minimize costs. The results show that the optimized system was about 15% cheaper than the traditional one, and it ensured that all pipelines met the design restrictions. Optimized sewage systems are a useful alternative for ensuring universal access to safe drinking water, increasing sewerage coverage, and reducing problems associated with inadequate design.
污水处理系统对城市的高效运行至关重要。废水中含有固体和有机物,会对健康造成风险,因此有必要优化污水系统设计。近年来,已经引入了优化工具,以最大限度地降低成本,同时仍然遵守法规。尽管如此,传统设计仍然占主导地位,但使用优化方法可以显著降低施工成本。因此,本研究将比较优化设计的污水处理系统和使用传统方法设计的污水系统的建设成本,以确定两者之间的成本差异。在哥伦比亚波哥大的一个地区,已经根据哥伦比亚法律使用传统方法建造和设计了污水处理系统。该地区的信息被用于实施安第斯大学创建的UTOPIA计划。该程序使用最短路径问题和Bellman-Ford算法来设计网络并最小化成本。结果表明,优化后的系统比传统系统便宜15%左右,确保了所有管道都符合设计限制。优化的污水处理系统是确保普遍获得安全饮用水、增加污水处理覆盖率和减少与设计不足相关的问题的一种有用的替代方案。
{"title":"Economic comparison between an optimized and a traditional sewer system designs","authors":"M. A. González, J. Saldarriaga","doi":"10.2166/hydro.2023.027","DOIUrl":"https://doi.org/10.2166/hydro.2023.027","url":null,"abstract":"\u0000 \u0000 Sewage systems are essential for the efficient functioning of cities. Wastewater contains solids and organic matter that pose health risks, making it necessary to optimize the sewerage system design. In recent years, optimization tools have been introduced to minimize costs while still complying with regulations. Despite this, traditional designs still dominate, but the use of optimization methodologies can significantly reduce construction costs. For this reason, this research will compare the construction costs of a sewerage system designed optimally and one designed using traditional methods, to determine the cost difference between the two. In a sector of Bogota, Colombia, a sewerage system was already built and designed according to Colombian laws using traditional methodologies. The information from this area was used to implement the UTOPIA program, created by the Universidad de los Andes. This program uses the Shortest Path Problem with the Bellman-Ford algorithm to design the network and minimize costs. The results show that the optimized system was about 15% cheaper than the traditional one, and it ensured that all pipelines met the design restrictions. Optimized sewage systems are a useful alternative for ensuring universal access to safe drinking water, increasing sewerage coverage, and reducing problems associated with inadequate design.","PeriodicalId":54801,"journal":{"name":"Journal of Hydroinformatics","volume":" ","pages":""},"PeriodicalIF":2.7,"publicationDate":"2023-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41494985","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Optimal consequence management of pollution intrusion into water distribution network considering demand variation and pipelines' leakage: a case study 考虑需求变化和管道泄漏的配水管网污染入侵后果优化管理:一个案例研究
IF 2.7 3区 工程技术 Q3 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2023-08-31 DOI: 10.2166/hydro.2023.003
Seyed Ghasem Razavi, S. Nazif, M. Ghorbani
To ensure the preservation of public health during periods of water distribution network (WDN) contamination, implementing effective consequence management (CM) plans is crucial. This study aimed to minimize the number of operational interventions and mitigate adverse effects on public health by considering WDN leakage and demand changes during contamination events. Surveys conducted during the contamination period revealed an impressive 88% reduction in water consumption. Subsequently, a real case study focusing on a segment of Tehran's WDN in Iran's capital city was conducted, examining four scenarios to test the proposed method. Without employing leakage and demand reduction strategies, the total contamination exposure amounted to approximately 184 kg. However, by incorporating water demand reduction, leakage, and their simultaneous simulation, maximum contamination exposures of 154.4, 171, and 124.4 kg were respectively achieved. Furthermore, it was found that the optimal CM plan required significantly different valve configurations. Neglecting demand changes and leaks in the CM plan led to inaccurate calculations regarding hydraulic and quality status, pollution levels in the network, and contamination exposure for WDN users; therefore, erroneous decision-making.
为了确保在供水管网污染期间保护公众健康,实施有效的后果管理(CM)计划至关重要。本研究旨在通过考虑WDN泄漏和污染事件期间的需求变化,最大限度地减少操作干预的数量,减轻对公众健康的不利影响。在污染期间进行的调查显示,用水量减少了88%。随后,对伊朗首都德黑兰WDN的一个部分进行了实际案例研究,研究了四种情况来测试所提出的方法。在不采用泄漏和减少需求策略的情况下,总污染暴露量约为184公斤。然而,通过结合水需求减少、泄漏及其同时模拟,最大污染暴露分别达到154.4 kg、171 kg和124.4 kg。此外,发现最优的CM方案需要显着不同的阀门配置。忽略CM计划中的需求变化和泄漏导致对水力和质量状况、网络污染水平和WDN用户污染暴露的不准确计算;因此,错误的决策。
{"title":"Optimal consequence management of pollution intrusion into water distribution network considering demand variation and pipelines' leakage: a case study","authors":"Seyed Ghasem Razavi, S. Nazif, M. Ghorbani","doi":"10.2166/hydro.2023.003","DOIUrl":"https://doi.org/10.2166/hydro.2023.003","url":null,"abstract":"\u0000 \u0000 To ensure the preservation of public health during periods of water distribution network (WDN) contamination, implementing effective consequence management (CM) plans is crucial. This study aimed to minimize the number of operational interventions and mitigate adverse effects on public health by considering WDN leakage and demand changes during contamination events. Surveys conducted during the contamination period revealed an impressive 88% reduction in water consumption. Subsequently, a real case study focusing on a segment of Tehran's WDN in Iran's capital city was conducted, examining four scenarios to test the proposed method. Without employing leakage and demand reduction strategies, the total contamination exposure amounted to approximately 184 kg. However, by incorporating water demand reduction, leakage, and their simultaneous simulation, maximum contamination exposures of 154.4, 171, and 124.4 kg were respectively achieved. Furthermore, it was found that the optimal CM plan required significantly different valve configurations. Neglecting demand changes and leaks in the CM plan led to inaccurate calculations regarding hydraulic and quality status, pollution levels in the network, and contamination exposure for WDN users; therefore, erroneous decision-making.","PeriodicalId":54801,"journal":{"name":"Journal of Hydroinformatics","volume":" ","pages":""},"PeriodicalIF":2.7,"publicationDate":"2023-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48756240","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Prediction of multi-sectoral longitudinal water withdrawals using hierarchical machine learning models 利用分层机器学习模型预测多部门纵向取水
IF 2.7 3区 工程技术 Q3 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2023-08-31 DOI: 10.2166/hydro.2023.110
J. Shortridge
Accurate models of water withdrawal are crucial in anticipating the potential water use impacts of drought and climate change. Machine learning methods can simulate the complex, nonlinear relationship between water use and potential explanatory factors, but rarely incorporate the hierarchical nature of water use data. This work presents a novel approach for the prediction of water withdrawals across multiple usage sectors using an ensemble of models fit at different hierarchical levels. Models were fit at the facility and sectoral grouping levels, as well as across facility clusters defined by temporal water use characteristics. Using repeated holdout cross-validation and a dataset of over 300,000 observations of monthly water withdrawal across 1,509 facilities, it demonstrates that ensemble predictions led to statistically significant improvements in predictive performance in five of the eight sectors analyzed. The use of ensemble modeling resulted in lower predictive errors compared to facility models in 65% of facilities analyzed. The relative improvement gained by ensemble modeling was greatest for facilities with fewer observations and higher variance, indicating its potential value in predicting withdrawal for facilities with relatively short data records or data quality issues.
准确的取水模型对于预测干旱和气候变化对水资源利用的潜在影响至关重要。机器学习方法可以模拟用水和潜在解释因素之间复杂的非线性关系,但很少纳入用水数据的层次性质。这项工作提出了一种新的方法,用于预测跨多个使用部门的取水量,使用不同层次水平的模型集合。模型适用于设施和部门分组级别,以及按时间用水特征定义的设施集群。通过反复的交叉验证和对1509个设施每月取水量的30多万次观察数据集,该研究表明,在分析的8个部门中,有5个部门的集合预测在统计上显着提高了预测性能。在分析的65%的设施中,与设施模型相比,集成模型的使用导致了更低的预测误差。对于观测值较少、方差较大的设施,集成建模获得的相对改进最大,这表明它在预测数据记录相对较短或数据质量问题的设施撤离方面具有潜在价值。
{"title":"Prediction of multi-sectoral longitudinal water withdrawals using hierarchical machine learning models","authors":"J. Shortridge","doi":"10.2166/hydro.2023.110","DOIUrl":"https://doi.org/10.2166/hydro.2023.110","url":null,"abstract":"\u0000 Accurate models of water withdrawal are crucial in anticipating the potential water use impacts of drought and climate change. Machine learning methods can simulate the complex, nonlinear relationship between water use and potential explanatory factors, but rarely incorporate the hierarchical nature of water use data. This work presents a novel approach for the prediction of water withdrawals across multiple usage sectors using an ensemble of models fit at different hierarchical levels. Models were fit at the facility and sectoral grouping levels, as well as across facility clusters defined by temporal water use characteristics. Using repeated holdout cross-validation and a dataset of over 300,000 observations of monthly water withdrawal across 1,509 facilities, it demonstrates that ensemble predictions led to statistically significant improvements in predictive performance in five of the eight sectors analyzed. The use of ensemble modeling resulted in lower predictive errors compared to facility models in 65% of facilities analyzed. The relative improvement gained by ensemble modeling was greatest for facilities with fewer observations and higher variance, indicating its potential value in predicting withdrawal for facilities with relatively short data records or data quality issues.","PeriodicalId":54801,"journal":{"name":"Journal of Hydroinformatics","volume":" ","pages":""},"PeriodicalIF":2.7,"publicationDate":"2023-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43538207","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of Hydroinformatics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1