A2DWQPE:自适应和自动化数据驱动的水质参数估计

IF 5.9 1区 地球科学 Q1 ENGINEERING, CIVIL Journal of Hydrology Pub Date : 2023-11-01 DOI:10.1016/j.jhydrol.2023.130363
Yiyun Hu, Fangling Pu, Chuishun Kong, Rui Yang, Hongjia Chen, Xin Xu
{"title":"A2DWQPE:自适应和自动化数据驱动的水质参数估计","authors":"Yiyun Hu,&nbsp;Fangling Pu,&nbsp;Chuishun Kong,&nbsp;Rui Yang,&nbsp;Hongjia Chen,&nbsp;Xin Xu","doi":"10.1016/j.jhydrol.2023.130363","DOIUrl":null,"url":null,"abstract":"<div><p><span><span><span>Accurate remote sensing estimation of </span>inland water quality parameters (WQPs) plays a crucial role in guiding </span>water resource management<span><span><span>. To achieve this, researchers have explored various data-driven approaches utilizing machine learning (ML) techniques. However, there are two major challenges in WQPs estimation for inland waters. Firstly, current data-driven approaches focus on building a unified estimation model for an entire study area, which underestimates the complex dynamics of water constituents and optical properties. Secondly, ML models, particularly </span>neural networks, require extensive hyperparameter tuning and are not user-friendly for researchers lacking relevant background and experience. In this paper, we propose an innovative method called adaptive and automated data-driven water quality parameter estimation (A2DWQPE) to address both challenges. Our method operates under the assumption that water bodies with similar spectral characteristics should share the same WQP estimation model. A2DWQPE is composed of three phases. Firstly, water types are automatedly classified by unsupervised hierarchical clustering according to spectral similarity. Then, optimal Deep Neural Network (DNN) models for estimating WQPs from multi-spectral satellite images are customized for each water type utilizing </span>Bayesian optimization<span><span> (BO). Finally, the target WQP is estimated based on the type-specific estimates and degree of membership of each water type. To evaluate the effectiveness of A2DWQPE, we applied it to estimate Secchi disk depth (SDD) in </span>Lake Erie<span> with in situ measurements<span> and Moderate Resolution Imaging Spectroradiometer (MODIS) images. The results demonstrate that A2DWQPE outperforms the traditional approaches of developing a unified model for the entire study area. A2DWQPE achieved high accuracy with coefficient of determination (</span></span></span></span></span><span><math><msup><mrow><mi>R</mi></mrow><mrow><mn>2</mn></mrow></msup></math></span><span><span>) over 0.72 and root mean square error (RMSE) below 1.4 m. Our method also outperforms the methods that applied Genetic Algorithm (GA) and Particle </span>Swarm<span> Optimization (PSO) instead of BO, and several traditional ML algorithms. We firmly believe that A2DWQPE holds great potential for accurate inland water quality estimation and will contribute significantly to various applications in water quality monitoring and pollution prevention.</span></span></p></div>","PeriodicalId":362,"journal":{"name":"Journal of Hydrology","volume":"626 ","pages":"Article 130363"},"PeriodicalIF":5.9000,"publicationDate":"2023-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A2DWQPE: Adaptive and automated data-driven water quality parameter estimation\",\"authors\":\"Yiyun Hu,&nbsp;Fangling Pu,&nbsp;Chuishun Kong,&nbsp;Rui Yang,&nbsp;Hongjia Chen,&nbsp;Xin Xu\",\"doi\":\"10.1016/j.jhydrol.2023.130363\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p><span><span><span>Accurate remote sensing estimation of </span>inland water quality parameters (WQPs) plays a crucial role in guiding </span>water resource management<span><span><span>. To achieve this, researchers have explored various data-driven approaches utilizing machine learning (ML) techniques. However, there are two major challenges in WQPs estimation for inland waters. Firstly, current data-driven approaches focus on building a unified estimation model for an entire study area, which underestimates the complex dynamics of water constituents and optical properties. Secondly, ML models, particularly </span>neural networks, require extensive hyperparameter tuning and are not user-friendly for researchers lacking relevant background and experience. In this paper, we propose an innovative method called adaptive and automated data-driven water quality parameter estimation (A2DWQPE) to address both challenges. Our method operates under the assumption that water bodies with similar spectral characteristics should share the same WQP estimation model. A2DWQPE is composed of three phases. Firstly, water types are automatedly classified by unsupervised hierarchical clustering according to spectral similarity. Then, optimal Deep Neural Network (DNN) models for estimating WQPs from multi-spectral satellite images are customized for each water type utilizing </span>Bayesian optimization<span><span> (BO). Finally, the target WQP is estimated based on the type-specific estimates and degree of membership of each water type. To evaluate the effectiveness of A2DWQPE, we applied it to estimate Secchi disk depth (SDD) in </span>Lake Erie<span> with in situ measurements<span> and Moderate Resolution Imaging Spectroradiometer (MODIS) images. The results demonstrate that A2DWQPE outperforms the traditional approaches of developing a unified model for the entire study area. A2DWQPE achieved high accuracy with coefficient of determination (</span></span></span></span></span><span><math><msup><mrow><mi>R</mi></mrow><mrow><mn>2</mn></mrow></msup></math></span><span><span>) over 0.72 and root mean square error (RMSE) below 1.4 m. Our method also outperforms the methods that applied Genetic Algorithm (GA) and Particle </span>Swarm<span> Optimization (PSO) instead of BO, and several traditional ML algorithms. We firmly believe that A2DWQPE holds great potential for accurate inland water quality estimation and will contribute significantly to various applications in water quality monitoring and pollution prevention.</span></span></p></div>\",\"PeriodicalId\":362,\"journal\":{\"name\":\"Journal of Hydrology\",\"volume\":\"626 \",\"pages\":\"Article 130363\"},\"PeriodicalIF\":5.9000,\"publicationDate\":\"2023-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Hydrology\",\"FirstCategoryId\":\"89\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0022169423013057\",\"RegionNum\":1,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, CIVIL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Hydrology","FirstCategoryId":"89","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0022169423013057","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, CIVIL","Score":null,"Total":0}
引用次数: 0

摘要

内陆水质参数的精确遥感估算对指导水资源管理具有重要意义。为了实现这一目标,研究人员利用机器学习(ML)技术探索了各种数据驱动的方法。然而,在内陆水域WQPs估算中存在两个主要挑战。首先,目前的数据驱动方法侧重于建立整个研究区域的统一估算模型,低估了水组分和光学性质的复杂动态。其次,机器学习模型,特别是神经网络,需要大量的超参数调整,并且对于缺乏相关背景和经验的研究人员来说并不友好。在本文中,我们提出了一种称为自适应和自动化数据驱动水质参数估计(A2DWQPE)的创新方法来解决这两个挑战。我们的方法是在假设具有相似光谱特征的水体应该共享相同的WQP估计模型的情况下运行的。A2DWQPE由三相组成。首先,根据谱相似度,采用无监督分层聚类方法自动分类水的类型;然后,利用贝叶斯优化(BO),针对不同类型的水体,定制了用于多光谱卫星图像WQPs估计的最优深度神经网络(DNN)模型。最后,根据每种水类型的特定类型估计值和隶属度估算目标WQP。为了评估A2DWQPE的有效性,我们利用原位测量和中分辨率成像光谱仪(MODIS)图像对伊利湖的塞奇盘深度(SDD)进行了估算。结果表明,A2DWQPE优于为整个研究区域建立统一模型的传统方法。A2DWQPE具有较高的准确度,决定系数(R2)大于0.72,均方根误差(RMSE)小于1.4 m。该方法也优于采用遗传算法(GA)和粒子群优化(PSO)代替BO的方法,以及几种传统的机器学习算法。我们坚信,A2DWQPE在准确估计内陆水质方面具有巨大潜力,将在水质监测和污染防治的各种应用中发挥重要作用。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

摘要图片

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
A2DWQPE: Adaptive and automated data-driven water quality parameter estimation

Accurate remote sensing estimation of inland water quality parameters (WQPs) plays a crucial role in guiding water resource management. To achieve this, researchers have explored various data-driven approaches utilizing machine learning (ML) techniques. However, there are two major challenges in WQPs estimation for inland waters. Firstly, current data-driven approaches focus on building a unified estimation model for an entire study area, which underestimates the complex dynamics of water constituents and optical properties. Secondly, ML models, particularly neural networks, require extensive hyperparameter tuning and are not user-friendly for researchers lacking relevant background and experience. In this paper, we propose an innovative method called adaptive and automated data-driven water quality parameter estimation (A2DWQPE) to address both challenges. Our method operates under the assumption that water bodies with similar spectral characteristics should share the same WQP estimation model. A2DWQPE is composed of three phases. Firstly, water types are automatedly classified by unsupervised hierarchical clustering according to spectral similarity. Then, optimal Deep Neural Network (DNN) models for estimating WQPs from multi-spectral satellite images are customized for each water type utilizing Bayesian optimization (BO). Finally, the target WQP is estimated based on the type-specific estimates and degree of membership of each water type. To evaluate the effectiveness of A2DWQPE, we applied it to estimate Secchi disk depth (SDD) in Lake Erie with in situ measurements and Moderate Resolution Imaging Spectroradiometer (MODIS) images. The results demonstrate that A2DWQPE outperforms the traditional approaches of developing a unified model for the entire study area. A2DWQPE achieved high accuracy with coefficient of determination (R2) over 0.72 and root mean square error (RMSE) below 1.4 m. Our method also outperforms the methods that applied Genetic Algorithm (GA) and Particle Swarm Optimization (PSO) instead of BO, and several traditional ML algorithms. We firmly believe that A2DWQPE holds great potential for accurate inland water quality estimation and will contribute significantly to various applications in water quality monitoring and pollution prevention.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Hydrology
Journal of Hydrology 地学-地球科学综合
CiteScore
11.00
自引率
12.50%
发文量
1309
审稿时长
7.5 months
期刊介绍: The Journal of Hydrology publishes original research papers and comprehensive reviews in all the subfields of the hydrological sciences including water based management and policy issues that impact on economics and society. These comprise, but are not limited to the physical, chemical, biogeochemical, stochastic and systems aspects of surface and groundwater hydrology, hydrometeorology and hydrogeology. Relevant topics incorporating the insights and methodologies of disciplines such as climatology, water resource systems, hydraulics, agrohydrology, geomorphology, soil science, instrumentation and remote sensing, civil and environmental engineering are included. Social science perspectives on hydrological problems such as resource and ecological economics, environmental sociology, psychology and behavioural science, management and policy analysis are also invited. Multi-and interdisciplinary analyses of hydrological problems are within scope. The science published in the Journal of Hydrology is relevant to catchment scales rather than exclusively to a local scale or site.
期刊最新文献
Assessing the efficacy of Permeable Interlocking Concrete Pavers (PICP) in managing stormwater runoff under climate change and land use scenarios Groundwater flow and salinity dynamics in swash Zones: Combined effects of Evaporation, Waves, and geologic heterogeneity Disentangling the contributions of water vapor, albedo and evapotranspiration variations to the temperature effect of vegetation greening over the Arctic The role of mobile-immobile sorbents on flow and colloid-facilitated contaminant transport through porous media: Two-dimensional modeling A Multi-Objective Simulation-Optimization framework for water resources management in canal-well conjunctive irrigation area based on nexus perspective
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1