首页 > 最新文献

Journal of Hydroinformatics最新文献

英文 中文
Detecting and locating chemical intrusion in water distribution systems using 9-1-1 calls 利用 9-1-1 电话检测和定位输水系统中的化学物质入侵情况
Pub Date : 2024-03-27 DOI: 10.2166/hydro.2024.299
Ehsan Roshani, Pavel Popov, Yehuda Kleiner, Sina Sanjari, Andrew Colombo, Mostafa Bigdeli
Intentional chemical contamination of water distribution systems (WDSs) could have severe health consequences. High potency chemicals constituting, in essence, ‘super poisons’ have the potential to be used in such intrusion scenarios. Some of these contaminants are capable of killing the victim in less than hour. Due to their high toxicity levels and short period of time from exposure to the onset of symptoms, 9-1-1 call centers are likely the first point of contact for the victims or their families with the authorities. Information such as 9-1-1 calls could be used to identify the ongoing event and potential intrusion locations. In this way, such emergency calls could function as an intrusion warning system. This study employs network hydraulic modeling to synthesize the 9-1-1 call patterns in the aftermath of such events. It then defines the scenarios as a multi-label pattern recognition problem. The synthesized data then was used to train a convolutional neural network (CNN). The trained artificial intelligence (AI), was applied to a real-world WDS with approximately 4,000 km of pipe and 26,000 demand nodes. The results indicated that the CNN is capable of accurately recognizing the pattern and pinpointing the originating location of the intrusion with an accuracy greater than 93%.
蓄意对配水系统(WDS)造成化学污染可能会对健康造成严重后果。本质上构成 "超级毒药 "的高效力化学品有可能被用于此类入侵情况。其中一些污染物能够在一小时内杀死受害者。由于它们的毒性很强,而且从接触到出现症状的时间很短,9-1-1 呼叫中心很可能是受害者或其家人与当局联系的第一站。9-1-1 电话等信息可用于确定正在发生的事件和潜在的入侵地点。这样,此类紧急呼叫就可以作为入侵预警系统发挥作用。本研究采用网络水力模型来综合此类事件发生后的 9-1-1 呼叫模式。然后将这些场景定义为多标签模式识别问题。合成数据随后用于训练卷积神经网络(CNN)。训练好的人工智能(AI)被应用于现实世界中的 WDS,该 WDS 约有 4000 公里管道和 26000 个需求节点。结果表明,卷积神经网络能够准确识别入侵模式并精确定位入侵源位置,准确率超过 93%。
{"title":"Detecting and locating chemical intrusion in water distribution systems using 9-1-1 calls","authors":"Ehsan Roshani, Pavel Popov, Yehuda Kleiner, Sina Sanjari, Andrew Colombo, Mostafa Bigdeli","doi":"10.2166/hydro.2024.299","DOIUrl":"https://doi.org/10.2166/hydro.2024.299","url":null,"abstract":"\u0000 \u0000 Intentional chemical contamination of water distribution systems (WDSs) could have severe health consequences. High potency chemicals constituting, in essence, ‘super poisons’ have the potential to be used in such intrusion scenarios. Some of these contaminants are capable of killing the victim in less than hour. Due to their high toxicity levels and short period of time from exposure to the onset of symptoms, 9-1-1 call centers are likely the first point of contact for the victims or their families with the authorities. Information such as 9-1-1 calls could be used to identify the ongoing event and potential intrusion locations. In this way, such emergency calls could function as an intrusion warning system. This study employs network hydraulic modeling to synthesize the 9-1-1 call patterns in the aftermath of such events. It then defines the scenarios as a multi-label pattern recognition problem. The synthesized data then was used to train a convolutional neural network (CNN). The trained artificial intelligence (AI), was applied to a real-world WDS with approximately 4,000 km of pipe and 26,000 demand nodes. The results indicated that the CNN is capable of accurately recognizing the pattern and pinpointing the originating location of the intrusion with an accuracy greater than 93%.","PeriodicalId":507813,"journal":{"name":"Journal of Hydroinformatics","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-03-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140376116","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Decision trees in cost–benefit analysis for flood risk management plans 洪水风险管理计划成本效益分析中的决策树
Pub Date : 2024-03-25 DOI: 10.2166/hydro.2024.194
J. Napolitano, Massimo Di Francesco, G. Sechi
According to the European Directive 2007/60/CE, flood risk evaluation should include a cost–benefit analysis (CBA) on a long-term time horizon to evaluate the impact of mitigation measures. The standard CBA assumes to know in advance the events observed in the time horizon and a priori compares all mitigation measures by an economic metric. No change is supposed to be made to these measures throughout the time horizon. This modus operandi is not appropriate in the domain of flood risk management because several conditions are uncertain when the CBA is made (e.g., urban policies). This article faces these challenges by the integration of cost–benefit analysis and decision trees, to prescribe mitigation measures under uncertainty on the budget for mitigation actions because their funding can be modified after the conclusion of the CBA. The former integration is discussed in the real case of the lowland valley of the Coghinas River (Sardinia, Italy), for which the classical CBA compared five mitigation measures of infrastructural works. The integration into the decision tree also allows to evaluating mitigation measures with changes in infrastructural works and a lamination action. The outcomes advise to decreasing the maximum storage level and increase the peak lamination.
根据第 2007/60/CE 号欧洲指令,洪水风险评估应包括长期成本效益分析 (CBA),以评估减灾措施的影响。标准的成本效益分析假定预先知道在时间范围内观察到的事件,并预先用经济指标对所有减灾措施进行比较。在整个时间范围内,这些措施不应该有任何变化。这种工作方式不适合洪水风险管理领域,因为在进行成本效益分析时,有几种情况是不确定的(如城市政策)。本文通过成本效益分析与决策树的结合来应对这些挑战,在减灾行动预算不确定的情况下规定减灾措施,因为其资金在成本效益分析结束后可能会被修改。前者的整合在 Coghinas 河(意大利撒丁岛)低地河谷的实际案例中进行了讨论,经典的成本效益分析比较了基础设施工程的五项减缓措施。通过与决策树的结合,还可以对改变基础设施工程和层压行动的减缓措施进行评估。结果表明,应降低最大蓄水量并增加峰值层压。
{"title":"Decision trees in cost–benefit analysis for flood risk management plans","authors":"J. Napolitano, Massimo Di Francesco, G. Sechi","doi":"10.2166/hydro.2024.194","DOIUrl":"https://doi.org/10.2166/hydro.2024.194","url":null,"abstract":"\u0000 According to the European Directive 2007/60/CE, flood risk evaluation should include a cost–benefit analysis (CBA) on a long-term time horizon to evaluate the impact of mitigation measures. The standard CBA assumes to know in advance the events observed in the time horizon and a priori compares all mitigation measures by an economic metric. No change is supposed to be made to these measures throughout the time horizon. This modus operandi is not appropriate in the domain of flood risk management because several conditions are uncertain when the CBA is made (e.g., urban policies). This article faces these challenges by the integration of cost–benefit analysis and decision trees, to prescribe mitigation measures under uncertainty on the budget for mitigation actions because their funding can be modified after the conclusion of the CBA. The former integration is discussed in the real case of the lowland valley of the Coghinas River (Sardinia, Italy), for which the classical CBA compared five mitigation measures of infrastructural works. The integration into the decision tree also allows to evaluating mitigation measures with changes in infrastructural works and a lamination action. The outcomes advise to decreasing the maximum storage level and increase the peak lamination.","PeriodicalId":507813,"journal":{"name":"Journal of Hydroinformatics","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-03-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140382794","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Developing an innovative machine learning model for rainfall prediction in a Semi-Arid region 为半干旱地区降雨预测开发创新型机器学习模型
Pub Date : 2024-03-21 DOI: 10.2166/hydro.2024.014
S. Latif, Dyar Othman Mohammed, Alhassan Jaafar
Due to global climate change, managing water resources is one of the most critical challenges for most countries in the world, especially in the Middle East. In the Kurdistan Region of Iraq (KRI), there is a good amount of precipitation, surface-water, and groundwater, but the main issue is mismanagement of those sources. Rainfall is one of the major sources of water resources in KRI. In order to manage the available water resources and prevent natural disasters such as floods and droughts, there is a need for reliable models for forecasting rainfall. The current study focuses on developing a hybrid model namely, seasonal autoregressive integrated moving average combined with an artificial neural network (SARIMA-ANN) for forecasting monthly rainfall at Sulaymaniyah City for the duration of 1938–2012. For comparison purposes, a conventional machine learning model, namely, artificial neural networks (ANN) has been applied on the same data. Two different statistical measurements, namely, root mean square error (RMSE) and coefficient of determination (R2) have been used to check the accuracy of the proposed models. According to the findings, SARIMA-ANN outperformed ANN with RMSE = 11.5, RMSE = 51.002, R2 = 0.98, R2 = 0.43, respectively. The findings of the current study could contribute to sustainable development goal (SDG) 6.
由于全球气候变化,水资源管理成为世界上大多数国家,尤其是中东国家面临的最严峻挑战之一。伊拉克库尔德斯坦地区(KRI)拥有大量降水、地表水和地下水,但主要问题在于对这些水源的管理不善。降雨是库尔德地区水资源的主要来源之一。为了管理可用水资源并预防洪水和干旱等自然灾害,需要有可靠的降雨预报模型。本研究的重点是开发一种混合模型,即季节自回归综合移动平均值与人工神经网络(SARIMA-ANN)相结合的模型,用于预测苏莱曼尼亚市 1938-2012 年期间的月降雨量。为便于比较,还在相同数据上应用了传统的机器学习模型,即人工神经网络(ANN)。两种不同的统计测量方法,即均方根误差 (RMSE) 和判定系数 (R2) 被用来检验所提出模型的准确性。结果显示,SARIMA-ANN 的 RMSE = 11.5、RMSE = 51.002、R2 = 0.98、R2 = 0.43 分别优于 ANN。本研究的结果有助于实现可持续发展目标(SDG)6。
{"title":"Developing an innovative machine learning model for rainfall prediction in a Semi-Arid region","authors":"S. Latif, Dyar Othman Mohammed, Alhassan Jaafar","doi":"10.2166/hydro.2024.014","DOIUrl":"https://doi.org/10.2166/hydro.2024.014","url":null,"abstract":"\u0000 Due to global climate change, managing water resources is one of the most critical challenges for most countries in the world, especially in the Middle East. In the Kurdistan Region of Iraq (KRI), there is a good amount of precipitation, surface-water, and groundwater, but the main issue is mismanagement of those sources. Rainfall is one of the major sources of water resources in KRI. In order to manage the available water resources and prevent natural disasters such as floods and droughts, there is a need for reliable models for forecasting rainfall. The current study focuses on developing a hybrid model namely, seasonal autoregressive integrated moving average combined with an artificial neural network (SARIMA-ANN) for forecasting monthly rainfall at Sulaymaniyah City for the duration of 1938–2012. For comparison purposes, a conventional machine learning model, namely, artificial neural networks (ANN) has been applied on the same data. Two different statistical measurements, namely, root mean square error (RMSE) and coefficient of determination (R2) have been used to check the accuracy of the proposed models. According to the findings, SARIMA-ANN outperformed ANN with RMSE = 11.5, RMSE = 51.002, R2 = 0.98, R2 = 0.43, respectively. The findings of the current study could contribute to sustainable development goal (SDG) 6.","PeriodicalId":507813,"journal":{"name":"Journal of Hydroinformatics","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-03-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140223054","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Characterization of groundwater potability and irrigation potential in Uttar Pradesh, India using water quality index and multivariate statistics 利用水质指数和多元统计分析印度北方邦地下水可饮用性和灌溉潜力的特征
Pub Date : 2024-03-19 DOI: 10.2166/hydro.2024.291
Supriya Chaudhary, G. Singh, Deepak Gupta, Suruchi Singh Maunas, V. Mishra
This study includes groundwater quality data from 290 monitoring sites from 69 districts of Uttar Pradesh, India. The analysis of the data showed that 1.3, 75.52, 47.93, and 31.03% of groundwater samples had concentrations of electrical conductivity (EC), total hardness (TH), Mg2+, and HCO3−, respectively, higher than the maximum permissible limit. Groundwater quality index (GWQI) was calculated for these 290 monitoring sites which revealed that 21 sites (7.24%) had inappropriate GWQI for drinking water, and 18 sites (7.24%) had an unsuitable index for irrigation. Most of the sampling sites (98.97%) showed high EC contents in groundwater with a mean value of 999.33 μS/cm. Fluoride content was found within the permissible limits in 95.52% of the samples, while 4.48% had high concentrations. The use of hierarchical cluster analysis differentiated all the sites into two clusters: one with high pollution and the other with low pollution. Significant correlations exist between physicochemical and irrigation indicators in the correlation matrix. High loadings of EC, TH, Ca2+, Mg2+, Na+, Cl−, and SO42− were identified in the first principal component, which are thought to be pollution-controlled processes from anthropogenic sources. According to the Chadha diagram, CaHCO3 and Ca–Mg–HCl were the two most prevalent chemicals in the water.
本研究包括来自印度北方邦 69 个县 290 个监测点的地下水质量数据。数据分析显示,分别有 1.3%、75.52%、47.93% 和 31.03% 的地下水样本的电导率 (EC)、总硬度 (TH)、Mg2+ 和 HCO3- 浓度高于最高允许限值。对这 290 个监测点的地下水质量指数(GWQI)进行了计算,结果显示,21 个监测点(7.24%)的地下水质量指数不适合作为饮用水,18 个监测点(7.24%)的地下水质量指数不适合作为灌溉用水。大多数采样点(98.97%)的地下水导电率含量较高,平均值为 999.33 μS/cm。95.52% 的样本氟含量在允许范围内,4.48% 的样本氟含量较高。采用分层聚类分析法将所有地点分为两组:一组污染严重,另一组污染较轻。在相关矩阵中,理化指标和灌溉指标之间存在显著的相关性。在第一个主成分中,EC、TH、Ca2+、Mg2+、Na+、Cl- 和 SO42- 的载荷较高,这被认为是人为来源的污染控制过程。根据 Chadha 图,CaHCO3 和 Ca-Mg-HCl 是水中最常见的两种化学物质。
{"title":"Characterization of groundwater potability and irrigation potential in Uttar Pradesh, India using water quality index and multivariate statistics","authors":"Supriya Chaudhary, G. Singh, Deepak Gupta, Suruchi Singh Maunas, V. Mishra","doi":"10.2166/hydro.2024.291","DOIUrl":"https://doi.org/10.2166/hydro.2024.291","url":null,"abstract":"\u0000 \u0000 This study includes groundwater quality data from 290 monitoring sites from 69 districts of Uttar Pradesh, India. The analysis of the data showed that 1.3, 75.52, 47.93, and 31.03% of groundwater samples had concentrations of electrical conductivity (EC), total hardness (TH), Mg2+, and HCO3−, respectively, higher than the maximum permissible limit. Groundwater quality index (GWQI) was calculated for these 290 monitoring sites which revealed that 21 sites (7.24%) had inappropriate GWQI for drinking water, and 18 sites (7.24%) had an unsuitable index for irrigation. Most of the sampling sites (98.97%) showed high EC contents in groundwater with a mean value of 999.33 μS/cm. Fluoride content was found within the permissible limits in 95.52% of the samples, while 4.48% had high concentrations. The use of hierarchical cluster analysis differentiated all the sites into two clusters: one with high pollution and the other with low pollution. Significant correlations exist between physicochemical and irrigation indicators in the correlation matrix. High loadings of EC, TH, Ca2+, Mg2+, Na+, Cl−, and SO42− were identified in the first principal component, which are thought to be pollution-controlled processes from anthropogenic sources. According to the Chadha diagram, CaHCO3 and Ca–Mg–HCl were the two most prevalent chemicals in the water.","PeriodicalId":507813,"journal":{"name":"Journal of Hydroinformatics","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-03-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140231084","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Application of real-time water temperature prediction system in winter for long-distance water diversion projects 长距离引水工程冬季水温实时预测系统的应用
Pub Date : 2024-03-18 DOI: 10.2166/hydro.2024.064
Zepeng Xu, Mengkai Liu, Minghai Huang, Letian Wen, Xinlei Guo
Water diversion projects in high-latitude areas often reduce the risk of ice jams in winter by reducing the water transfer flow, which might cause the waste of water transfer benefits. This paper establishes a real-time prediction system of water temperature in winter, which can predict the change in water temperature by inputting the air temperature forecast data and the current hydraulic data. Taking the middle route of the south-to-north water diversion project as the background, the model parameters calibration and system application testing at different time periods are carried out. The results show that the prediction errors of water temperature for the 1- and 7-day are relatively small, and the prediction errors of water temperature at four observation stations can be controlled within ±0.3 and ±0.6 °C, with the root mean square error (RMSE) ranging from 0.07 to 0.25 and 0.12 to 0.36, respectively. The 15-day water temperature prediction results are greatly affected by air temperature input conditions. The prediction errors for the first 7 days are relatively small, ranging from −0.59 to 0.36 °C, and the errors for the last 8 days increase as the accuracy of the air temperature forecast decreases, ranging from −2.42 to 0.22 °C.
高纬度地区的引水工程往往通过减少输水流量来降低冬季冰堵风险,这可能造成输水效益的浪费。本文建立了冬季水温实时预测系统,通过输入气温预报数据和当前水力数据,可以预测水温的变化。以南水北调中线工程为背景,进行了不同时段的模型参数校核和系统应用测试。结果表明,1 天和 7 天的水温预测误差较小,4 个观测站的水温预测误差可控制在 ±0.3 和 ±0.6 ℃以内,均方根误差分别为 0.07~0.25 和 0.12~0.36 ℃。15 天水温预测结果受气温输入条件的影响很大。前 7 天的预报误差相对较小,在-0.59 至 0.36 ℃之间,而后 8 天的误差则随着气温预报精度的降低而增大,在-2.42 至 0.22 ℃之间。
{"title":"Application of real-time water temperature prediction system in winter for long-distance water diversion projects","authors":"Zepeng Xu, Mengkai Liu, Minghai Huang, Letian Wen, Xinlei Guo","doi":"10.2166/hydro.2024.064","DOIUrl":"https://doi.org/10.2166/hydro.2024.064","url":null,"abstract":"\u0000 \u0000 Water diversion projects in high-latitude areas often reduce the risk of ice jams in winter by reducing the water transfer flow, which might cause the waste of water transfer benefits. This paper establishes a real-time prediction system of water temperature in winter, which can predict the change in water temperature by inputting the air temperature forecast data and the current hydraulic data. Taking the middle route of the south-to-north water diversion project as the background, the model parameters calibration and system application testing at different time periods are carried out. The results show that the prediction errors of water temperature for the 1- and 7-day are relatively small, and the prediction errors of water temperature at four observation stations can be controlled within ±0.3 and ±0.6 °C, with the root mean square error (RMSE) ranging from 0.07 to 0.25 and 0.12 to 0.36, respectively. The 15-day water temperature prediction results are greatly affected by air temperature input conditions. The prediction errors for the first 7 days are relatively small, ranging from −0.59 to 0.36 °C, and the errors for the last 8 days increase as the accuracy of the air temperature forecast decreases, ranging from −2.42 to 0.22 °C.","PeriodicalId":507813,"journal":{"name":"Journal of Hydroinformatics","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-03-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140234727","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Monitoring domestic water consumption: a comparative study of model-based and data-driven end-use disaggregation methods 监测生活用水量:基于模型和数据的最终用途分类方法比较研究
Pub Date : 2024-03-18 DOI: 10.2166/hydro.2024.120
Pavlos Vryoni Pavlou, S. Filippou, Solon Solonos, Stelios G. Vrachimis, Kleanthis Malialis, Demetrios G. Eliades, Theocharis Theocarides, Marios M. Polycarpou
Monitoring the water usage of different appliances and informing consumers about it has been shown to have an impact on their behavior toward drinking water conservation. The most practical and cost-effective way to accomplish this is through a non-intrusive approach, that locally analyzes data received from a flow sensor at the main water supply pipe of a household. In this work, we present two different methods addressing the challenges of disaggregating end-use consumption and classifying consumption events. The first method is model-based (MB) and uses a combination of dynamic time wrapping and statistical bounds to analyze four water end-use characteristics. The second, learning-based (LB) method is data-driven and formulates the problem as a time-series classification problem without relying on a priori identification of events. We perform an extensive computational study that includes a comparison between an MB and an LB method, as well as an experimental study to demonstrate the application of the LB method on an edge computing device. Both methods achieve similar F1 scores (LB: 71.73%, MB: 71.04%) with the LB being more precise. The embedded LB method achieves a slightly higher score (72.01%) while enhancing on-site real-time processing, improving security, and privacy and enabling cost savings.
事实证明,监测不同器具的用水量并告知消费者,会对他们节约饮用水的行为产生影响。实现这一目标的最实用、最具成本效益的方法是采用非侵入式方法,对家庭主供水管上的流量传感器接收到的数据进行本地分析。在这项工作中,我们提出了两种不同的方法来应对终端用水量分解和用水事件分类的挑战。第一种方法基于模型(MB),结合使用动态时间包装和统计边界来分析四种水的终端使用特征。第二种方法是基于学习(LB)的方法,以数据为驱动,将问题表述为时间序列分类问题,而不依赖于事件的先验识别。我们进行了广泛的计算研究,包括 MB 方法和 LB 方法的比较,以及在边缘计算设备上应用 LB 方法的实验研究。两种方法都获得了相似的 F1 分数(LB:71.73%,MB:71.04%),其中 LB 更为精确。嵌入式 LB 方法得分略高(72.01%),同时增强了现场实时处理能力,提高了安全性和隐私性,并节省了成本。
{"title":"Monitoring domestic water consumption: a comparative study of model-based and data-driven end-use disaggregation methods","authors":"Pavlos Vryoni Pavlou, S. Filippou, Solon Solonos, Stelios G. Vrachimis, Kleanthis Malialis, Demetrios G. Eliades, Theocharis Theocarides, Marios M. Polycarpou","doi":"10.2166/hydro.2024.120","DOIUrl":"https://doi.org/10.2166/hydro.2024.120","url":null,"abstract":"\u0000 Monitoring the water usage of different appliances and informing consumers about it has been shown to have an impact on their behavior toward drinking water conservation. The most practical and cost-effective way to accomplish this is through a non-intrusive approach, that locally analyzes data received from a flow sensor at the main water supply pipe of a household. In this work, we present two different methods addressing the challenges of disaggregating end-use consumption and classifying consumption events. The first method is model-based (MB) and uses a combination of dynamic time wrapping and statistical bounds to analyze four water end-use characteristics. The second, learning-based (LB) method is data-driven and formulates the problem as a time-series classification problem without relying on a priori identification of events. We perform an extensive computational study that includes a comparison between an MB and an LB method, as well as an experimental study to demonstrate the application of the LB method on an edge computing device. Both methods achieve similar F1 scores (LB: 71.73%, MB: 71.04%) with the LB being more precise. The embedded LB method achieves a slightly higher score (72.01%) while enhancing on-site real-time processing, improving security, and privacy and enabling cost savings.","PeriodicalId":507813,"journal":{"name":"Journal of Hydroinformatics","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-03-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140233349","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Machine learning rather than trial and error to close morphodynamical tuneable parameters: application to a two-phase/two-layer model 通过机器学习而非反复试验来关闭形态动力学可调参数:应用于双相/双层模型
Pub Date : 2024-03-14 DOI: 10.2166/hydro.2024.183
R. Meurice, S. Soares-Frazão
Physics-based numerical models often depend on several parameters to close. Some of them can be expressed using established theoretical or empirical closure formulations. However, some others aggregate complex physical processes and are hence left as tuneable parameters, and can only be calibrated by trial and error. Yet, calibration data are not always available to do so, which prevents these models from being applied to wide ranges of laboratory or river flows. We hence propose a machine learning-based methodology to close any group of unclosed and correlated parameters, applied here to a two-phase/two-layer (2P2L) morphodynamical model. The methodology combines a numerical experiment with a known theoretical result and machine learning. It is applied to the considered model to close two friction parameters for which generalizable and vastly acknowledged closure formulations lack in the literature. The resulting hybrid model, combining the original 2P2L model and the closure models, is tested against two laboratory dam break test cases. Despite excessive smoothness and underestimation of the concentration in sediment, the hybrid model performed similarly to other models from the literature requiring trial and error calibration and showed high stability and accuracy regarding the estimation of the water-sediment mixture's inertia.
基于物理学的数值模型通常依赖于多个参数来闭合。其中一些参数可以用既定的理论或经验闭合公式来表示。然而,其他一些参数则汇集了复杂的物理过程,因此只能作为可调整参数,通过试验和错误来校准。然而,校准数据并不总是可用的,这就使得这些模型无法应用于范围广泛的实验室或河流流量。因此,我们提出了一种基于机器学习的方法来关闭任何一组未关闭的相关参数,并将其应用于两相/两层(2P2L)形态动力学模型。该方法结合了数值实验、已知理论结果和机器学习。该方法适用于所考虑的模型,以关闭两个摩擦参数,而文献中缺乏可通用且广受认可的关闭公式。结合原始 2P2L 模型和闭合模型得出的混合模型在两个实验室溃坝试验案例中进行了测试。尽管过度平滑和低估了泥沙中的浓度,但混合模型的表现与文献中需要试验和误差校准的其他模型类似,并且在估计水沙混合物的惯性方面表现出很高的稳定性和准确性。
{"title":"Machine learning rather than trial and error to close morphodynamical tuneable parameters: application to a two-phase/two-layer model","authors":"R. Meurice, S. Soares-Frazão","doi":"10.2166/hydro.2024.183","DOIUrl":"https://doi.org/10.2166/hydro.2024.183","url":null,"abstract":"\u0000 \u0000 Physics-based numerical models often depend on several parameters to close. Some of them can be expressed using established theoretical or empirical closure formulations. However, some others aggregate complex physical processes and are hence left as tuneable parameters, and can only be calibrated by trial and error. Yet, calibration data are not always available to do so, which prevents these models from being applied to wide ranges of laboratory or river flows. We hence propose a machine learning-based methodology to close any group of unclosed and correlated parameters, applied here to a two-phase/two-layer (2P2L) morphodynamical model. The methodology combines a numerical experiment with a known theoretical result and machine learning. It is applied to the considered model to close two friction parameters for which generalizable and vastly acknowledged closure formulations lack in the literature. The resulting hybrid model, combining the original 2P2L model and the closure models, is tested against two laboratory dam break test cases. Despite excessive smoothness and underestimation of the concentration in sediment, the hybrid model performed similarly to other models from the literature requiring trial and error calibration and showed high stability and accuracy regarding the estimation of the water-sediment mixture's inertia.","PeriodicalId":507813,"journal":{"name":"Journal of Hydroinformatics","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140243070","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Temporal and spatial satellite data augmentation for deep learning-based rainfall nowcasting 基于深度学习的降雨预报的时空卫星数据扩增
Pub Date : 2024-03-13 DOI: 10.2166/hydro.2024.235
Özlem Baydaroğlu Yeşilköy, I. Demir
The significance of improving rainfall prediction methods has escalated due to climate change-induced flash floods and severe flooding. In this study, rainfall nowcasting has been studied utilizing NASA Giovanni (Goddard Interactive Online Visualization and Analysis Infrastructure) satellite-derived precipitation products and the convolutional long short-term memory (ConvLSTM) approach. The goal of the study is to assess the impact of data augmentation on flood nowcasting. Due to data requirements of deep learning-based prediction methods, data augmentation is performed using eight different interpolation techniques. Spatial, temporal, and spatio-temporal interpolated rainfall data are used to conduct a comparative analysis of the results obtained through nowcasting rainfall. This research examines two catastrophic floods that transpired in the Türkiye Marmara Region in 2009 and the Central Black Sea Region in 2021, which are selected as the focal case studies. The Marmara and Black Sea regions are prone to frequent flooding, which, due to the dense population, has devastating consequences. Furthermore, these regions exhibit distinct topographical characteristics and precipitation patterns, and the frontal systems that impact them are also dissimilar. The nowcast results for the two regions exhibit a significant difference. Although data augmentation significantly reduced the error values by 59% for one region, it did not yield the same effectiveness for the other region.
由于气候变化导致的山洪暴发和严重洪灾,改进降雨预测方法的意义日益凸显。本研究利用 NASA Giovanni(戈达德交互式在线可视化和分析基础设施)卫星降水产品和卷积长短期记忆(ConvLSTM)方法对降雨预报进行了研究。研究的目的是评估数据增强对洪水预报的影响。由于基于深度学习的预测方法对数据有要求,因此使用八种不同的插值技术进行数据扩增。使用空间、时间和时空插值降雨数据,对通过降雨预报获得的结果进行比较分析。本研究选择 2009 年在土耳其马尔马拉地区和 2021 年在黑海中部地区发生的两次灾难性洪灾作为重点案例研究。马尔马拉和黑海地区经常发生洪灾,由于人口密集,洪灾造成了破坏性后果。此外,这两个地区的地形特点和降水模式截然不同,影响它们的锋面系统也不尽相同。这两个地区的预报结果显示出显著差异。虽然数据扩增将一个地区的误差值大幅降低了 59%,但对另一个地区却没有产生同样的效果。
{"title":"Temporal and spatial satellite data augmentation for deep learning-based rainfall nowcasting","authors":"Özlem Baydaroğlu Yeşilköy, I. Demir","doi":"10.2166/hydro.2024.235","DOIUrl":"https://doi.org/10.2166/hydro.2024.235","url":null,"abstract":"\u0000 The significance of improving rainfall prediction methods has escalated due to climate change-induced flash floods and severe flooding. In this study, rainfall nowcasting has been studied utilizing NASA Giovanni (Goddard Interactive Online Visualization and Analysis Infrastructure) satellite-derived precipitation products and the convolutional long short-term memory (ConvLSTM) approach. The goal of the study is to assess the impact of data augmentation on flood nowcasting. Due to data requirements of deep learning-based prediction methods, data augmentation is performed using eight different interpolation techniques. Spatial, temporal, and spatio-temporal interpolated rainfall data are used to conduct a comparative analysis of the results obtained through nowcasting rainfall. This research examines two catastrophic floods that transpired in the Türkiye Marmara Region in 2009 and the Central Black Sea Region in 2021, which are selected as the focal case studies. The Marmara and Black Sea regions are prone to frequent flooding, which, due to the dense population, has devastating consequences. Furthermore, these regions exhibit distinct topographical characteristics and precipitation patterns, and the frontal systems that impact them are also dissimilar. The nowcast results for the two regions exhibit a significant difference. Although data augmentation significantly reduced the error values by 59% for one region, it did not yield the same effectiveness for the other region.","PeriodicalId":507813,"journal":{"name":"Journal of Hydroinformatics","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140247051","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Using statistical and machine learning approaches to describe estuarine tidal dynamics 使用统计和机器学习方法描述河口潮汐动态
Pub Date : 2024-03-13 DOI: 10.2166/hydro.2024.294
Franziska Lauer, Frank Kösters
Estuaries are ecologically valuable regions where tidal forces move large volumes of water. To understand the ongoing physical processes in such dynamic systems, a series of estuarine monitoring stations is required. Based on the measurements, estuarine dynamics can be described by key values, so-called tidal characteristics. The reconstruction and prediction of tidal characteristics by suitable approaches is essential to discover natural or anthropogenic changes. Therefore, it is of interest to inter- and extrapolate measured values in time and to investigate the spatial relationship between different stations. Normally, such system analyses are performed by deterministic numerical models. However, to facilitate long-term investigations also, statistical and machine learning approaches are good options. For a Weser estuary case study, we implemented three approaches (linear, non-linear, and artificial neural network regression) with the same database to enable the prediction of tidal extrema. Thereby we achieve an accuracy of 0.4–2.5% derivation (based on the RMSEs) while approximating measured values over 19 years. This proves that the approaches can be used for hindcast studies as well as for future analysis of system changes. Our work can be understood as a proof of concept for the practical potential of neural networks in estuarine system analysis.
河口是具有生态价值的地区,潮汐力量在此推动大量水流。为了了解这种动态系统中正在进行的物理过程,需要建立一系列河口监测站。根据测量结果,可以用关键值(即所谓的潮汐特征)来描述河口动态。采用适当的方法重建和预测潮汐特征对于发现自然或人为变化至关重要。因此,对测量值进行时间上的相互推断和外推,并研究不同站点之间的空间关系,是非常有意义的。通常,这种系统分析是通过确定性数值模型进行的。不过,为了便于长期研究,统计和机器学习方法也是不错的选择。在威悉河口案例研究中,我们使用同一个数据库,采用了三种方法(线性、非线性和人工神经网络回归)来预测潮汐极值。因此,在近似 19 年的测量值的同时,我们实现了 0.4-2.5% 的推导精度(基于均方根误差)。这证明这些方法可用于后报研究以及未来的系统变化分析。我们的工作可以理解为神经网络在河口系统分析中的实用潜力的概念验证。
{"title":"Using statistical and machine learning approaches to describe estuarine tidal dynamics","authors":"Franziska Lauer, Frank Kösters","doi":"10.2166/hydro.2024.294","DOIUrl":"https://doi.org/10.2166/hydro.2024.294","url":null,"abstract":"\u0000 Estuaries are ecologically valuable regions where tidal forces move large volumes of water. To understand the ongoing physical processes in such dynamic systems, a series of estuarine monitoring stations is required. Based on the measurements, estuarine dynamics can be described by key values, so-called tidal characteristics. The reconstruction and prediction of tidal characteristics by suitable approaches is essential to discover natural or anthropogenic changes. Therefore, it is of interest to inter- and extrapolate measured values in time and to investigate the spatial relationship between different stations. Normally, such system analyses are performed by deterministic numerical models. However, to facilitate long-term investigations also, statistical and machine learning approaches are good options. For a Weser estuary case study, we implemented three approaches (linear, non-linear, and artificial neural network regression) with the same database to enable the prediction of tidal extrema. Thereby we achieve an accuracy of 0.4–2.5% derivation (based on the RMSEs) while approximating measured values over 19 years. This proves that the approaches can be used for hindcast studies as well as for future analysis of system changes. Our work can be understood as a proof of concept for the practical potential of neural networks in estuarine system analysis.","PeriodicalId":507813,"journal":{"name":"Journal of Hydroinformatics","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140245654","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Leveraging historic streamflow and weather data with deep learning for enhanced streamflow predictions 利用历史数据和天气数据进行深度学习,增强对流量的预测能力
Pub Date : 2024-02-28 DOI: 10.2166/hydro.2024.268
Christiaan Schutte, M. van der Laan, B. J. van der Merwe
Streamflow information is crucial for effectively managing water resources. The declining number of active gauging stations in many rivers is a global concern, necessitating the need for reliable streamflow estimates. Deep learning techniques offer potential solutions, but their application in southern Africa remains largely underexplored. To fill this gap, this study evaluated the predictive performance of gated recurrent unit (GRU) and long short-term memory (LSTM) networks using two headwater catchments of the Steelpoort River, South Africa, as case studies. The model inputs included rainfall, maximum, and minimum temperature, as well as past streamflow, which was utilized in an autoregressive sense. The inclusion of streamflow in this way allowed for the incorporation of simulated streamflow values into the look-back window for predicting the streamflow of the testing set. Two modifications were required to the GRU and LSTM architectures to ensure physically consistent predictions, including a change in the activation function of the GRU/LSTM cells in the final hidden layer, and a non-negative constraint that was used in the dense layer. Models trained using commercial weather station data produced reliable streamflow estimates, while moderately accurate predictions were obtained using freely available gridded weather data.
溪流信息对于有效管理水资源至关重要。许多河流的有效测量站数量不断减少,这是一个全球关注的问题,因此有必要进行可靠的流量估算。深度学习技术提供了潜在的解决方案,但其在南部非洲的应用在很大程度上仍未得到充分探索。为了填补这一空白,本研究以南非钢波特河的两个上游集水区为案例,评估了门控递归单元(GRU)和长短期记忆(LSTM)网络的预测性能。模型输入包括降雨量、最高气温和最低气温,以及过去的溪流流量,并在自回归意义上加以利用。通过这种方式,可以将模拟流量值纳入预测测试集流量的回溯窗口。为了确保预测结果的物理一致性,需要对 GRU 和 LSTM 架构进行两处修改,包括改变 GRU/LSTM 单元在最终隐藏层中的激活函数,以及在密集层中使用非负约束。使用商业气象站数据训练的模型可得出可靠的流量估计值,而使用免费提供的网格气象数据则可获得中等精度的预测值。
{"title":"Leveraging historic streamflow and weather data with deep learning for enhanced streamflow predictions","authors":"Christiaan Schutte, M. van der Laan, B. J. van der Merwe","doi":"10.2166/hydro.2024.268","DOIUrl":"https://doi.org/10.2166/hydro.2024.268","url":null,"abstract":"\u0000 \u0000 Streamflow information is crucial for effectively managing water resources. The declining number of active gauging stations in many rivers is a global concern, necessitating the need for reliable streamflow estimates. Deep learning techniques offer potential solutions, but their application in southern Africa remains largely underexplored. To fill this gap, this study evaluated the predictive performance of gated recurrent unit (GRU) and long short-term memory (LSTM) networks using two headwater catchments of the Steelpoort River, South Africa, as case studies. The model inputs included rainfall, maximum, and minimum temperature, as well as past streamflow, which was utilized in an autoregressive sense. The inclusion of streamflow in this way allowed for the incorporation of simulated streamflow values into the look-back window for predicting the streamflow of the testing set. Two modifications were required to the GRU and LSTM architectures to ensure physically consistent predictions, including a change in the activation function of the GRU/LSTM cells in the final hidden layer, and a non-negative constraint that was used in the dense layer. Models trained using commercial weather station data produced reliable streamflow estimates, while moderately accurate predictions were obtained using freely available gridded weather data.","PeriodicalId":507813,"journal":{"name":"Journal of Hydroinformatics","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-02-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140417210","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of Hydroinformatics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1