首页 > 最新文献

Environmental Modelling & Software最新文献

英文 中文
A probabilistic approach to training machine learning models using noisy data 利用噪声数据训练机器学习模型的概率方法
IF 4.8 2区 环境科学与生态学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-07-02 DOI: 10.1016/j.envsoft.2024.106133
Ayman H. Alzraiee , Richard G. Niswonger

Machine learning (ML) models are increasingly popular in environmental and hydrologic modeling, but they typically contain uncertainties resulting from noisy data (erroneous or outlier data). This paper presents a novel probabilistic approach that combines ML and Markov Chain Monte Carlo simulation to (1) detect and underweight likely noisy data, (2) develop an approach capable of detecting noisy data during model deployment, and (3) interpret the reasons why a data point is deemed noisy to help heuristically distinguish between outliers and erroneous data. The new algorithm recognizes that there is no unique way to split the training data into noisy and clean data, and thus produces an ensemble of plausible splits. The algorithm successfully detected noisy data in synthetic benchmark problems with varying complexity and a real-world public supply water withdrawal dataset. The algorithm is generic and flexible, making it suitable for application across a broad range of hydrologic and environmental disciplines.

机器学习(ML)模型在环境和水文建模中越来越受欢迎,但它们通常包含由噪声数据(错误或离群数据)导致的不确定性。本文介绍了一种新颖的概率方法,该方法结合了 ML 和马尔可夫链蒙特卡罗模拟,用于:(1)检测可能存在的噪声数据并降低其权重;(2)开发一种能够在模型部署过程中检测噪声数据的方法;以及(3)解释数据点被视为噪声的原因,以帮助启发式地区分异常值和错误数据。新算法认识到,将训练数据拆分为噪声数据和干净数据的方法并不唯一,因此会产生一系列合理的拆分。该算法在不同复杂度的合成基准问题和现实世界的公共供水取水数据集中成功检测出了噪声数据。该算法具有通用性和灵活性,适用于广泛的水文和环境学科。
{"title":"A probabilistic approach to training machine learning models using noisy data","authors":"Ayman H. Alzraiee ,&nbsp;Richard G. Niswonger","doi":"10.1016/j.envsoft.2024.106133","DOIUrl":"https://doi.org/10.1016/j.envsoft.2024.106133","url":null,"abstract":"<div><p>Machine learning (ML) models are increasingly popular in environmental and hydrologic modeling, but they typically contain uncertainties resulting from noisy data (erroneous or outlier data). This paper presents a novel probabilistic approach that combines ML and Markov Chain Monte Carlo simulation to (1) detect and underweight likely noisy data, (2) develop an approach capable of detecting noisy data during model deployment, and (3) interpret the reasons why a data point is deemed noisy to help heuristically distinguish between outliers and erroneous data. The new algorithm recognizes that there is no unique way to split the training data into noisy and clean data, and thus produces an ensemble of plausible splits. The algorithm successfully detected noisy data in synthetic benchmark problems with varying complexity and a real-world public supply water withdrawal dataset. The algorithm is generic and flexible, making it suitable for application across a broad range of hydrologic and environmental disciplines.</p></div>","PeriodicalId":310,"journal":{"name":"Environmental Modelling & Software","volume":null,"pages":null},"PeriodicalIF":4.8,"publicationDate":"2024-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1364815224001944/pdfft?md5=e1e87f0b5ef16de980acb3594e5d21d5&pid=1-s2.0-S1364815224001944-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141594469","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Finite element software for calculating fluid flow and heat transport for seamounts 计算海山流体流动和热传输的有限元软件
IF 4.8 2区 环境科学与生态学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-07-02 DOI: 10.1016/j.envsoft.2024.106129
V.C. Manea , E.G. Sewell , M. Manea , S. Yoshioka , N. Suenaga , E.J. Moreno

A large number of bathymetric discontinuities mark the bottom of the oceans. Among these features, seamounts protruding the sedimentary layer can play a major role in establishing a continuous exchange of fluids and heat between the oceanic lithosphere and the ocean. Here we present finite element codes for calculating the flow, temperature and pressure distributions inside seamounts using a general-purpose finite element solver. We solve the coupled equations of continuity, Darcy equation, and energy conservation equation in 2-D. We present a numerical axisymmetrical model tailored to the real geometry of the Grizzly Bare seamount located on the Juan de Fuca plate. The surface heat flow shows a good correlation between our models and in-situ available observations. In this work we provide complete open access to numerical codes which are intended to be simple and easy to adapt for a wide range of seamounts shapes and sizes.

海洋底部有大量不连续的测深地貌。在这些地貌中,突出沉积层的海山在建立大洋岩石圈与海洋之间持续的流体和热量交换方面发挥着重要作用。在此,我们介绍了使用通用有限元求解器计算海山内部流动、温度和压力分布的有限元代码。我们求解了二维连续性耦合方程、达西方程和能量守恒方程。我们根据胡安-德富卡板块上灰熊裸海山的实际几何形状,提出了一个轴对称数值模型。表面热流显示,我们的模型与现场观测结果之间具有良好的相关性。在这项工作中,我们提供了完全开放的数字代码,旨在使其简单易用,适用于各种形状和大小的海山。
{"title":"Finite element software for calculating fluid flow and heat transport for seamounts","authors":"V.C. Manea ,&nbsp;E.G. Sewell ,&nbsp;M. Manea ,&nbsp;S. Yoshioka ,&nbsp;N. Suenaga ,&nbsp;E.J. Moreno","doi":"10.1016/j.envsoft.2024.106129","DOIUrl":"https://doi.org/10.1016/j.envsoft.2024.106129","url":null,"abstract":"<div><p>A large number of bathymetric discontinuities mark the bottom of the oceans. Among these features, seamounts protruding the sedimentary layer can play a major role in establishing a continuous exchange of fluids and heat between the oceanic lithosphere and the ocean. Here we present finite element codes for calculating the flow, temperature and pressure distributions inside seamounts using a general-purpose finite element solver. We solve the coupled equations of continuity, Darcy equation, and energy conservation equation in 2-D. We present a numerical axisymmetrical model tailored to the real geometry of the Grizzly Bare seamount located on the Juan de Fuca plate. The surface heat flow shows a good correlation between our models and in-situ available observations. In this work we provide complete open access to numerical codes which are intended to be simple and easy to adapt for a wide range of seamounts shapes and sizes.</p></div>","PeriodicalId":310,"journal":{"name":"Environmental Modelling & Software","volume":null,"pages":null},"PeriodicalIF":4.8,"publicationDate":"2024-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1364815224001907/pdfft?md5=52e21be2ca3aa08174790df04d6491eb&pid=1-s2.0-S1364815224001907-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141594471","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
UIDS: A Matlab-based urban flood model considering rainfall-induced and surcharge-induced inundations UIDS:基于 Matlab 的城市洪水模型,考虑降雨引起的洪水和附加荷载引起的洪水
IF 4.8 2区 环境科学与生态学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-07-02 DOI: 10.1016/j.envsoft.2024.106132
Vinh Ngoc Tran , Jongho Kim

The Urban Inundation-Drainage Simulator (UIDS) is a new coupled model for simulating urban flooding dynamics, developed as an open-source, MATLAB-based platform. It integrates a rainfall-runoff model with a two-dimensional overland flow model (OFM) and a one-dimensional sewer flow model (SFM). Unlike conventional models limited to either rainfall-induced or sewer surcharge-induced flooding, UIDS captures bidirectional surface-underground interactions to simulate both processes simultaneously. The OFM employs an explicit time-stepping scheme and robust wet-dry front treatment, while a weir equation describes roof-to-ground flow exchange for numerical stability. Timing synchronization facilitates continuous OFM-SFM coupling. Benchmarking and case studies of Gangnam flood events demonstrate UIDS's ability to accurately simulate urban flooding, particularly subcritical flows. The open-source nature of UIDS allows user flexibility in accessing and modifying the MATLAB code. Ultimately, UIDS is expected to serve as an accessible and adaptable tool for urban flood modeling and risk assessment.

城市淹没-排水模拟器(UIDS)是一个用于模拟城市洪水动态的新型耦合模型,是一个基于 MATLAB 的开源平台。它将降雨-径流模型与二维陆地流模型(OFM)和一维下水道流模型(SFM)集成在一起。与局限于降雨引发的洪水或下水道溢流引发的洪水的传统模型不同,UIDS 可捕捉地表与地下的双向相互作用,同时模拟这两个过程。OFM 采用显式时间步进方案和稳健的干湿前沿处理,而堰式方程则描述了屋顶到地面的水流交换,以实现数值稳定性。时间同步促进了 OFM-SFM 的连续耦合。基准测试和江南洪水事件案例研究表明,UIDS 能够准确模拟城市洪水,尤其是次临界流。UIDS 的开源性质允许用户灵活访问和修改 MATLAB 代码。最终,UIDS 可望成为城市洪水建模和风险评估的可访问、可调整的工具。
{"title":"UIDS: A Matlab-based urban flood model considering rainfall-induced and surcharge-induced inundations","authors":"Vinh Ngoc Tran ,&nbsp;Jongho Kim","doi":"10.1016/j.envsoft.2024.106132","DOIUrl":"https://doi.org/10.1016/j.envsoft.2024.106132","url":null,"abstract":"<div><p>The Urban Inundation-Drainage Simulator (UIDS) is a new coupled model for simulating urban flooding dynamics, developed as an open-source, MATLAB-based platform. It integrates a rainfall-runoff model with a two-dimensional overland flow model (OFM) and a one-dimensional sewer flow model (SFM). Unlike conventional models limited to either rainfall-induced or sewer surcharge-induced flooding, UIDS captures bidirectional surface-underground interactions to simulate both processes simultaneously. The OFM employs an explicit time-stepping scheme and robust wet-dry front treatment, while a weir equation describes roof-to-ground flow exchange for numerical stability. Timing synchronization facilitates continuous OFM-SFM coupling. Benchmarking and case studies of Gangnam flood events demonstrate UIDS's ability to accurately simulate urban flooding, particularly subcritical flows. The open-source nature of UIDS allows user flexibility in accessing and modifying the MATLAB code. Ultimately, UIDS is expected to serve as an accessible and adaptable tool for urban flood modeling and risk assessment.</p></div>","PeriodicalId":310,"journal":{"name":"Environmental Modelling & Software","volume":null,"pages":null},"PeriodicalIF":4.8,"publicationDate":"2024-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141541802","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Global optimization-based calibration algorithm for a 2D distributed hydrologic-hydrodynamic and water quality model 基于全局优化的二维分布式水文-水动力和水质模型校准算法
IF 4.8 2区 环境科学与生态学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-07-02 DOI: 10.1016/j.envsoft.2024.106128
Marcus Nóbrega Gomes Jr. , Marcio Hofheinz Giacomoni , Fabricio Alonso Richmond Navarro , Eduardo Mario Mendiondo

Hydrodynamic models with rain-on-the-grid capabilities are usually computationally expensive for automatic parameter estimation. In this paper, we present a global optimization-based algorithm to calibrate a fully distributed hydrologic-hydrodynamic and water quality model (HydroPol2D) using observed data (i.e., discharge, or pollutant concentration) as input. The algorithm finds near-optimal set of parameters to explain observed gauged data. This framework, although applied in a poorly-gauged urban catchment, is adapted for catchments with more detailed observations. The results of the automatic calibration indicate NSE = 0.99 for the V-Tilted catchment, RMSE = 830 mg L-1 for salt concentration pollutograph in a wooden-plane (i.e., 8.3% of the event mean concentration), and NSE = 0.89 in a urban real-world catchment. This paper also explores the issue of equifinality (i.e., multiple parameters giving the same calibration performance) in model calibration indicating the performance variation of calibrating only with an outlet gauge or with multiple gauges within the catchment.

具有随网降雨功能的水动力模型在自动参数估计方面通常计算成本较高。在本文中,我们提出了一种基于全局优化的算法,利用观测数据(即排水量或污染物浓度)作为输入,校准全分布式水文-水动力和水质模型(HydroPol2D)。该算法可找到近乎最佳的参数集来解释观测到的测量数据。这一框架虽然适用于测量数据较少的城市集水区,但也适用于有更详细观测数据的集水区。自动校准结果表明,V 型倾斜集水区的 NSE = 0.99,木质平面中盐浓度轮廓图的 RMSE = 830 mg L-1(即事件平均浓度的 8.3%),城市实际集水区的 NSE = 0.89。本文还探讨了模型校准中的等效性问题(即多个参数具有相同的校准性能),指出仅使用出口测量仪校准或使用集水区内多个测量仪校准的性能差异。
{"title":"Global optimization-based calibration algorithm for a 2D distributed hydrologic-hydrodynamic and water quality model","authors":"Marcus Nóbrega Gomes Jr. ,&nbsp;Marcio Hofheinz Giacomoni ,&nbsp;Fabricio Alonso Richmond Navarro ,&nbsp;Eduardo Mario Mendiondo","doi":"10.1016/j.envsoft.2024.106128","DOIUrl":"https://doi.org/10.1016/j.envsoft.2024.106128","url":null,"abstract":"<div><p>Hydrodynamic models with rain-on-the-grid capabilities are usually computationally expensive for automatic parameter estimation. In this paper, we present a global optimization-based algorithm to calibrate a fully distributed hydrologic-hydrodynamic and water quality model (HydroPol2D) using observed data (i.e., discharge, or pollutant concentration) as input. The algorithm finds near-optimal set of parameters to explain observed gauged data. This framework, although applied in a poorly-gauged urban catchment, is adapted for catchments with more detailed observations. The results of the automatic calibration indicate NSE <span><math><mo>=</mo></math></span> 0.99 for the V-Tilted catchment, RMSE <span><math><mo>=</mo></math></span> 830 mg L<sup>-1</sup> for salt concentration pollutograph in a wooden-plane (i.e., 8.3% of the event mean concentration), and NSE <span><math><mo>=</mo></math></span> 0.89 in a urban real-world catchment. This paper also explores the issue of equifinality (i.e., multiple parameters giving the same calibration performance) in model calibration indicating the performance variation of calibrating only with an outlet gauge or with multiple gauges within the catchment.</p></div>","PeriodicalId":310,"journal":{"name":"Environmental Modelling & Software","volume":null,"pages":null},"PeriodicalIF":4.8,"publicationDate":"2024-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141607522","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Deep learning prediction of rainfall-driven debris flows considering the similar critical thresholds within comparable background conditions 考虑到类似背景条件下的临界阈值,对降雨驱动的泥石流进行深度学习预测
IF 4.8 2区 环境科学与生态学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-06-28 DOI: 10.1016/j.envsoft.2024.106130
Hu Jiang , Qiang Zou , Yunqiang Zhu , Yong Li , Bin Zhou , Wentao Zhou , Shunyu Yao , Xiaoliang Dai , Hongkun Yao , Siyu Chen

Machine learning has been widely applied to predict the spatial or temporal likelihood of debris flows by leveraging its powerful capability to fit nonlinear features and uncover underlying patterns or rules in the complex formation mechanisms of debris flows. However, traditional approaches, including some current machine learning-based prediction models, still have limitations when used for debris flow prediction. These include the lack of a specific network structure or model to consider the updating of debris flow critical conditions in relation to geographical background conditions, limiting the universality of prediction models when transferring them to different places. In this study, this article proposes a deep learning network designed to predict the spatiotemporal probability of rainfall-induced debris flows, incorporating the Similarity Mechanism of Debris Flow Critical Conditions (SM-DFCC). The model comprehensively integrates the mining of rainfall-triggering features and couples them with geographical background features to fit the nonlinear relationship with debris flow formation. The model underwent training using data on various historical debris flows triggered by different storms across Liangshan Prefecture from 2020 to 2022. The results indicated that: (i) the method is effective in predicting the spatiotemporal likelihood of debris flows under catchment units, with accuracy scores (ACC) ranging from 0.724 to 0.835; (ii) after optimization using the AVOA algorithm, the predictive performance of the model significantly improved, with an increase of 27.24% in ACC scores for SVC and 8.81% for XGBoost; and (iii) factor importance analysis revealed that rainfall triggering factors have higher cumulative contribution rates when distinguishing between the occurrence and non-occurrence of debris flows. In addition, taking a rainfall storm on 06, September 2020 as a case, this research quantitatively revealed the pattern of debris flow formation, where high-frequency disaster areas exhibit lower rainfall thresholds of debris flows, represented by absolute energy (AE). Despite these findings, the accuracy and reliability of rainfall data still remain the most challenging obstacle in basin/regional-scale debris flow prediction when applying this method. The integration of multiple sources of rainfall data, including station data, satellite rainfall, radar rainfall, etc., is necessary to accurately quantify the impact of rainfall on debris flow formation when applying this method to debris flow monitoring and early warning tasks. Overall, this method shows great potential in providing a scientific reference for the construction of debris flow monitoring and early warning systems in the future.

机器学习利用其强大的非线性特征拟合能力,揭示碎片流复杂形成机制中的潜在模式或规则,已被广泛应用于预测碎片流的空间或时间可能性。然而,传统方法,包括目前一些基于机器学习的预测模型,在用于泥石流预测时仍有局限性。其中包括缺乏特定的网络结构或模型来考虑泥石流临界条件与地理背景条件的更新关系,从而限制了预测模型在移植到不同地方时的通用性。在本研究中,本文结合泥石流临界条件相似性机制(SM-DFCC),提出了一种旨在预测降雨诱发泥石流时空概率的深度学习网络。该模型全面整合了降雨触发特征的挖掘,并将其与地理背景特征相结合,以拟合与泥石流形成的非线性关系。该模型利用 2020 年至 2022 年凉山州不同暴雨引发的各种历史泥石流数据进行了训练。结果表明(i) 该方法能有效预测汇水单元下泥石流发生的时空可能性,准确度得分(ACC)在 0.724 到 0.835 之间;(ii) 使用 AVOA 算法优化后,模型的预测性能显著提高,ACC 得分(ACC)提高了 27.SVC的ACC得分提高了27.24%,XGBoost的ACC得分提高了8.81%;(iii) 因子重要性分析表明,在区分泥石流发生与否时,降雨触发因子具有更高的累积贡献率。此外,以 2020 年 9 月 6 日的一场暴雨为例,该研究定量揭示了泥石流形成的规律,即高频灾区表现出较低的泥石流降雨阈值,以绝对能量(AE)表示。尽管有这些发现,但降雨数据的准确性和可靠性仍是应用该方法进行流域/区域尺度泥石流预测的最大障碍。将该方法应用于泥石流监测和预警任务时,需要整合多种来源的降雨数据,包括站点数据、卫星降雨、雷达降雨等,以准确量化降雨对泥石流形成的影响。总之,该方法在为未来泥石流监测和预警系统建设提供科学参考方面显示出巨大潜力。
{"title":"Deep learning prediction of rainfall-driven debris flows considering the similar critical thresholds within comparable background conditions","authors":"Hu Jiang ,&nbsp;Qiang Zou ,&nbsp;Yunqiang Zhu ,&nbsp;Yong Li ,&nbsp;Bin Zhou ,&nbsp;Wentao Zhou ,&nbsp;Shunyu Yao ,&nbsp;Xiaoliang Dai ,&nbsp;Hongkun Yao ,&nbsp;Siyu Chen","doi":"10.1016/j.envsoft.2024.106130","DOIUrl":"https://doi.org/10.1016/j.envsoft.2024.106130","url":null,"abstract":"<div><p>Machine learning has been widely applied to predict the spatial or temporal likelihood of debris flows by leveraging its powerful capability to fit nonlinear features and uncover underlying patterns or rules in the complex formation mechanisms of debris flows. However, traditional approaches, including some current machine learning-based prediction models, still have limitations when used for debris flow prediction. These include the lack of a specific network structure or model to consider the updating of debris flow critical conditions in relation to geographical background conditions, limiting the universality of prediction models when transferring them to different places. In this study, this article proposes a deep learning network designed to predict the spatiotemporal probability of rainfall-induced debris flows, incorporating the Similarity Mechanism of Debris Flow Critical Conditions (SM-DFCC). The model comprehensively integrates the mining of rainfall-triggering features and couples them with geographical background features to fit the nonlinear relationship with debris flow formation. The model underwent training using data on various historical debris flows triggered by different storms across Liangshan Prefecture from 2020 to 2022. The results indicated that: (i) the method is effective in predicting the spatiotemporal likelihood of debris flows under catchment units, with accuracy scores (ACC) ranging from 0.724 to 0.835; (ii) after optimization using the AVOA algorithm, the predictive performance of the model significantly improved, with an increase of 27.24% in ACC scores for SVC and 8.81% for XGBoost; and (iii) factor importance analysis revealed that rainfall triggering factors have higher cumulative contribution rates when distinguishing between the occurrence and non-occurrence of debris flows. In addition, taking a rainfall storm on 06, September 2020 as a case, this research quantitatively revealed the pattern of debris flow formation, where high-frequency disaster areas exhibit lower rainfall thresholds of debris flows, represented by absolute energy (AE). Despite these findings, the accuracy and reliability of rainfall data still remain the most challenging obstacle in basin/regional-scale debris flow prediction when applying this method. The integration of multiple sources of rainfall data, including station data, satellite rainfall, radar rainfall, etc., is necessary to accurately quantify the impact of rainfall on debris flow formation when applying this method to debris flow monitoring and early warning tasks. Overall, this method shows great potential in providing a scientific reference for the construction of debris flow monitoring and early warning systems in the future.</p></div>","PeriodicalId":310,"journal":{"name":"Environmental Modelling & Software","volume":null,"pages":null},"PeriodicalIF":4.8,"publicationDate":"2024-06-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141479833","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Long-term drought prediction using deep neural networks based on geospatial weather data 利用基于地理空间气象数据的深度神经网络进行长期干旱预测
IF 4.8 2区 环境科学与生态学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-06-28 DOI: 10.1016/j.envsoft.2024.106127
Alexander Marusov , Vsevolod Grabar , Yury Maximov , Nazar Sotiriadi , Alexander Bulkin , Alexey Zaytsev

The problem of high-quality drought forecasting up to a year in advance is critical for agriculture planning and insurance. Yet, it is still unsolved with reasonable accuracy due to data complexity and aridity stochasticity. We tackle drought data by introducing an end-to-end approach that adopts a spatio-temporal neural network model with accessible open monthly climate data as the input. Our systematic research employs diverse proposed models and five distinct environmental regions as a testbed to evaluate the efficacy of the Palmer Drought Severity Index (PDSI) prediction. Key aggregated findings are the exceptional performance of a Transformer model, EarthFormer, in making accurate short-term (up to six months) forecasts. At the same time, the Convolutional LSTM excels in longer-term forecasting. Both models achieved high ROC AUC scores: 0.948 for one month ahead and 0.617 for twelve months ahead forecasts, becoming closer to perfect ROC-AUC by 54% and 16%, respectively, c.t. classic approaches.

提前一年进行高质量的干旱预测对于农业规划和保险至关重要。然而,由于数据的复杂性和干旱的随机性,这一问题仍未得到合理准确的解决。我们通过引入一种端到端的方法来解决干旱数据问题,该方法采用时空神经网络模型,并以可获取的公开月度气候数据作为输入。我们的系统研究采用了不同的拟议模型和五个不同的环境区域作为试验平台,以评估帕尔默干旱严重程度指数(PDSI)预测的有效性。主要的综合研究结果表明,Transformer 模型 EarthFormer 在进行准确的短期(长达 6 个月)预测方面表现出色。同时,卷积 LSTM 在长期预测方面表现出色。两个模型都获得了较高的 ROC AUC 分数:提前一个月预测的 ROC AUC 得分为 0.948,提前十二个月预测的 ROC AUC 得分为 0.617,与传统方法相比,分别接近完美 ROC AUC 的 54% 和 16%。
{"title":"Long-term drought prediction using deep neural networks based on geospatial weather data","authors":"Alexander Marusov ,&nbsp;Vsevolod Grabar ,&nbsp;Yury Maximov ,&nbsp;Nazar Sotiriadi ,&nbsp;Alexander Bulkin ,&nbsp;Alexey Zaytsev","doi":"10.1016/j.envsoft.2024.106127","DOIUrl":"https://doi.org/10.1016/j.envsoft.2024.106127","url":null,"abstract":"<div><p>The problem of high-quality drought forecasting up to a year in advance is critical for agriculture planning and insurance. Yet, it is still unsolved with reasonable accuracy due to data complexity and aridity stochasticity. We tackle drought data by introducing an end-to-end approach that adopts a spatio-temporal neural network model with accessible open monthly climate data as the input. Our systematic research employs diverse proposed models and five distinct environmental regions as a testbed to evaluate the efficacy of the Palmer Drought Severity Index (PDSI) prediction. Key aggregated findings are the exceptional performance of a Transformer model, EarthFormer, in making accurate short-term (up to six months) forecasts. At the same time, the Convolutional LSTM excels in longer-term forecasting. Both models achieved high ROC AUC scores: 0.948 for one month ahead and 0.617 for twelve months ahead forecasts, becoming closer to perfect ROC-AUC by 54% and 16%, respectively, c.t. classic approaches.</p></div>","PeriodicalId":310,"journal":{"name":"Environmental Modelling & Software","volume":null,"pages":null},"PeriodicalIF":4.8,"publicationDate":"2024-06-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141594472","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
On the global parameterization of a 1DV hydromorphodynamic model of estuaries, the case of the Ems estuary 关于河口一维水文动力学模型的全球参数化,以埃姆斯河口为例
IF 4.8 2区 环境科学与生态学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-06-27 DOI: 10.1016/j.envsoft.2024.106125
Keivan Kaveh, Andreas Malcherek

Each submodel in a hydro-morphodynamic model has its own local calibration parameters, leading to a high degree of uncertainty in their application. This paper proposes a global parameterization framework of hydro-morphodynamic models, which involves the development and implementation of submodels that share some common calibration parameters. The proposed model reduces the total number of adjustable parameters while helping to better understand the physics of the problem. As a case study, a holistic 1D vertical numerical simulation of the Ems estuary has been established. This simulation is proficient in qualitatively reproducing observed profiles of vertical velocity, concentration, and velocity shear. Using the proposed global parameterization, the model is calibrated using only measured rheological data from the Ems estuary, with these parameters universally applied to all submodels, eliminating the need for separate calibration for other submodels. The simulation demonstrates a commendable agreement with measurements while concurrently reducing the number of calibration parameters.

水文地貌动力学模型中的每个子模型都有自己的局部校准参数,导致其应用的高度不确定性。本文提出了水文流态动力学模型的全局参数化框架,包括开发和实施共享某些共同校准参数的子模型。建议的模型减少了可调整参数的总数,同时有助于更好地理解问题的物理原理。作为案例研究,我们建立了埃姆斯河口的整体一维垂直数值模拟。该模拟能够很好地定性再现观测到的垂直速度、浓度和速度切变剖面。利用所提出的全局参数化方法,该模型仅使用埃姆斯河口的流变学测量数据进行校准,这些参数普遍适用于所有子模型,无需对其他子模型进行单独校准。模拟结果表明,模型与测量数据的一致性值得称赞,同时还减少了校准参数的数量。
{"title":"On the global parameterization of a 1DV hydromorphodynamic model of estuaries, the case of the Ems estuary","authors":"Keivan Kaveh,&nbsp;Andreas Malcherek","doi":"10.1016/j.envsoft.2024.106125","DOIUrl":"https://doi.org/10.1016/j.envsoft.2024.106125","url":null,"abstract":"<div><p>Each submodel in a hydro-morphodynamic model has its own local calibration parameters, leading to a high degree of uncertainty in their application. This paper proposes a global parameterization framework of hydro-morphodynamic models, which involves the development and implementation of submodels that share some common calibration parameters. The proposed model reduces the total number of adjustable parameters while helping to better understand the physics of the problem. As a case study, a holistic 1D vertical numerical simulation of the Ems estuary has been established. This simulation is proficient in qualitatively reproducing observed profiles of vertical velocity, concentration, and velocity shear. Using the proposed global parameterization, the model is calibrated using only measured rheological data from the Ems estuary, with these parameters universally applied to all submodels, eliminating the need for separate calibration for other submodels. The simulation demonstrates a commendable agreement with measurements while concurrently reducing the number of calibration parameters.</p></div>","PeriodicalId":310,"journal":{"name":"Environmental Modelling & Software","volume":null,"pages":null},"PeriodicalIF":4.8,"publicationDate":"2024-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1364815224001865/pdfft?md5=cb56d341b9589e46adb7dd42e6319581&pid=1-s2.0-S1364815224001865-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141479819","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A novel insight on input variable and time lag selection in daily streamflow forecasting using deep learning models 利用深度学习模型对日流量预报中输入变量和时滞选择的新见解
IF 4.8 2区 环境科学与生态学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-06-25 DOI: 10.1016/j.envsoft.2024.106126
Amina Khatun , M.N. Nisha , Siddharth Chatterjee , Venkataramana Sridhar

This study investigates the feasibility of using hybrid models namely Convolutional Neural Network (CNN)-Long Short-Term Memory (LSTM) and Convolutional Neural Network (CNN)-Gated Recurrent Unit (GRU), for short-to-medium range streamflow forecasting in the Mahanadi River basin in India. The performance of these hybrid models is compared with that of standalone models. It investigates the impact of selected parameters and associated time lags on the model performance and offers valuable insights into the use of hybrid models for runoff simulation. The hybrid CNN-LSTM model proves to be robust in capturing the overall time series and the typical high peak flows in both the correlation-based and constant lag cases. Also, the upstream discharges play a significant role in improving the streamflow forecasting. Furthermore, the consideration of all input variables with a constant time lag equal to the basin lag time may yield better flood forecasts, even in cases where computational resources are limited.

本研究探讨了使用混合模型(即卷积神经网络(CNN)-长短期记忆(LSTM)和卷积神经网络(CNN)-门控递归单元(GRU))进行印度马哈纳迪河流域中短期流量预报的可行性。将这些混合模型的性能与独立模型的性能进行了比较。它研究了所选参数和相关时滞对模型性能的影响,并为将混合模型用于径流模拟提供了有价值的见解。事实证明,在基于相关性和恒定滞后的情况下,混合 CNN-LSTM 模型都能稳健地捕捉整体时间序列和典型的高峰流量。此外,上游排水量在改善流量预测方面也发挥了重要作用。此外,考虑到所有输入变量的恒定时滞等于流域时滞,即使在计算资源有限的情况下,也能获得更好的洪水预报。
{"title":"A novel insight on input variable and time lag selection in daily streamflow forecasting using deep learning models","authors":"Amina Khatun ,&nbsp;M.N. Nisha ,&nbsp;Siddharth Chatterjee ,&nbsp;Venkataramana Sridhar","doi":"10.1016/j.envsoft.2024.106126","DOIUrl":"https://doi.org/10.1016/j.envsoft.2024.106126","url":null,"abstract":"<div><p>This study investigates the feasibility of using hybrid models namely Convolutional Neural Network (CNN)-Long Short-Term Memory (LSTM) and Convolutional Neural Network (CNN)-Gated Recurrent Unit (GRU), for short-to-medium range streamflow forecasting in the Mahanadi River basin in India. The performance of these hybrid models is compared with that of standalone models. It investigates the impact of selected parameters and associated time lags on the model performance and offers valuable insights into the use of hybrid models for runoff simulation. The hybrid CNN-LSTM model proves to be robust in capturing the overall time series and the typical high peak flows in both the correlation-based and constant lag cases. Also, the upstream discharges play a significant role in improving the streamflow forecasting. Furthermore, the consideration of all input variables with a constant time lag equal to the basin lag time may yield better flood forecasts, even in cases where computational resources are limited.</p></div>","PeriodicalId":310,"journal":{"name":"Environmental Modelling & Software","volume":null,"pages":null},"PeriodicalIF":4.8,"publicationDate":"2024-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141479834","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A spatial machine learning model developed from noisy data requires multiscale performance evaluation: Predicting depth to bedrock in the Delaware river basin, USA 根据噪声数据开发的空间机器学习模型需要进行多尺度性能评估:预测美国特拉华河流域的基岩深度
IF 4.8 2区 环境科学与生态学 Q1 Environmental Science Pub Date : 2024-06-21 DOI: 10.1016/j.envsoft.2024.106124
P. Goodling , K. Belitz , P. Stackelberg , B. Fleming

Spatial machine learning models can be developed from observations with substantial unexplainable variability, sometimes called ‘noise’. Traditional point-scale metrics (e.g., R2) alone can be misleading when evaluating these models. We present a multi-scale performance evaluation (MPE) using two additional scales (distributional and geostatistical). We apply the MPE framework to predictions of depth to bedrock (DTB) in the Delaware River Basin. Geostatistical analysis shows that approximately one third of the DTB variance is at spatial scale smaller than 2 km. Hence, we interpret our point-scale R2 of 0.3 (testing data) to be sufficient for regional-scale modelling. Bias-correction methods improve performance at two of the three MPE scales: point-scale change is negligible, while distributional and geostatistical performance improves. In contrast, bias correction applied to a global DTB model does not improve MPE performance. This work encourages scale-appropriate performance evaluations to enable effective model intercomparison.

空间机器学习模型可以从具有大量无法解释的变异性(有时称为 "噪声")的观测结果中开发出来。在评估这些模型时,仅采用传统的点尺度指标(如 R2)可能会产生误导。我们提出了一种多尺度性能评估(MPE),使用了两个额外的尺度(分布尺度和地质统计尺度)。我们将 MPE 框架应用于特拉华河流域基岩深度(DTB)的预测。地质统计分析显示,约有三分之一的 DTB 变量的空间尺度小于 2 千米。因此,我们认为 0.3 的点尺度 R2(测试数据)足以用于区域尺度建模。偏差校正方法提高了三个 MPE 尺度中两个尺度的性能:点尺度的变化可以忽略不计,而分布和地质统计性能则有所提高。相比之下,对全球 DTB 模型进行偏差校正并不能提高 MPE 性能。这项工作鼓励进行适合尺度的性能评估,以便进行有效的模型相互比较。
{"title":"A spatial machine learning model developed from noisy data requires multiscale performance evaluation: Predicting depth to bedrock in the Delaware river basin, USA","authors":"P. Goodling ,&nbsp;K. Belitz ,&nbsp;P. Stackelberg ,&nbsp;B. Fleming","doi":"10.1016/j.envsoft.2024.106124","DOIUrl":"https://doi.org/10.1016/j.envsoft.2024.106124","url":null,"abstract":"<div><p>Spatial machine learning models can be developed from observations with substantial unexplainable variability, sometimes called ‘noise’. Traditional point-scale metrics (e.g., R<sup>2</sup>) alone can be misleading when evaluating these models. We present a multi-scale performance evaluation (MPE) using two additional scales (distributional and geostatistical). We apply the MPE framework to predictions of depth to bedrock (DTB) in the Delaware River Basin. Geostatistical analysis shows that approximately one third of the DTB variance is at spatial scale smaller than 2 km. Hence, we interpret our point-scale R<sup>2</sup> of 0.3 (testing data) to be sufficient for regional-scale modelling. Bias-correction methods improve performance at two of the three MPE scales: point-scale change is negligible, while distributional and geostatistical performance improves. In contrast, bias correction applied to a global DTB model does not improve MPE performance. This work encourages scale-appropriate performance evaluations to enable effective model intercomparison.</p></div>","PeriodicalId":310,"journal":{"name":"Environmental Modelling & Software","volume":null,"pages":null},"PeriodicalIF":4.8,"publicationDate":"2024-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1364815224001853/pdfft?md5=7fedebb9a98cc4eebaa6f029bad61dfe&pid=1-s2.0-S1364815224001853-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141444188","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Commentary on “Cloud-based urgent computing for forest fire spread prediction” by Fraga et al. 对 Fraga 等人撰写的 "基于云的林火蔓延预测紧急计算 "的评论。
IF 4.8 2区 环境科学与生态学 Q1 Environmental Science Pub Date : 2024-06-20 DOI: 10.1016/j.envsoft.2024.106113
Robertas Damaševičius
{"title":"Commentary on “Cloud-based urgent computing for forest fire spread prediction” by Fraga et al.","authors":"Robertas Damaševičius","doi":"10.1016/j.envsoft.2024.106113","DOIUrl":"https://doi.org/10.1016/j.envsoft.2024.106113","url":null,"abstract":"","PeriodicalId":310,"journal":{"name":"Environmental Modelling & Software","volume":null,"pages":null},"PeriodicalIF":4.8,"publicationDate":"2024-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141439145","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Environmental Modelling & Software
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1