对比或多样性:城市洪水易感性模型中的非洪水采样

IF 7.3 1区 地球科学 Q1 ENGINEERING, CIVIL Journal of Hydrology Pub Date : 2025-08-01 Epub Date: 2025-03-10 DOI:10.1016/j.jhydrol.2025.133053
Huabing Huang, Zhiwen Tao, Jiayin Zhan, Changpeng Wang
{"title":"对比或多样性:城市洪水易感性模型中的非洪水采样","authors":"Huabing Huang,&nbsp;Zhiwen Tao,&nbsp;Jiayin Zhan,&nbsp;Changpeng Wang","doi":"10.1016/j.jhydrol.2025.133053","DOIUrl":null,"url":null,"abstract":"<div><div>Flood susceptibility modeling is a typical imbalanced problem in which the amount of flood data is much smaller than that of non-flood data. To ensure balanced learning, only a small fraction of non-flood data is selected for machine learning. Traditional sampling methods, such as Random Sampling (RS) and Stratified Sampling (SS), neglect abundant information within non-flood data and its relationship with flood data. This neglect leads to insufficient binary classification performance and biased susceptibility estimation, both of which are influenced by sample contrast and diversity, respectively. Unfortunately, these two objectives cannot be achieved simultaneously due to the trade-off between sample contrast and diversity. This dual-objective optimization requires a trade-off between contrast and diversity in sample quality. This study proposed a Distance-Based Sampling (DBS) framework that connects non-flood samples to flood data using Euclidean distance. Ten DBS scenarios with varying contrast and diversity levels (from 0.0 to 1.0 to 0.9–1.0) were designed for systematic evaluation. The best DBS scenario was further compared with RS, SS, and Inverse-Occurrence Sampling (IOS). To derive robust results, four machine learning techniques—Artificial Neural Network (ANN), Random Forest (RF), Support Vector Machine (SVM), and eXtreme Gradient Boosting (XGBoost)—were employed in two heterogeneous urban districts in Guangzhou, China, along with multiple indices, i.e. Area Under the Curve (AUC), mean susceptibility, standard deviation of susceptibility, and flood density order. The main findings of this study were as follows: (1) High sample contrast led to excellent binary classification performance but resulted in an overestimation of flood susceptibility. (2) High sample diversity resulted in insufficient binary classification performance and an underestimation of flood susceptibility. (3) Under the DBS framework, the performance curve of the dual-objective problem is unimodal. The best performance was achieved at a trade-off between contrast and diversity, specifically in the DBS scenario 0.3–1.0. (4) The DBS scenario 0.3–1.0 outperformed RS, SS, and IOS. Finally, this study underscores the critical role of non-flood sample quality and the balance between sample contrast and diversity in flood susceptibility modeling. The proposed DBS framework is objective and flexible, and can be applied to negative sampling in susceptibility modeling for other hazards, such as landslides and wildfires.</div></div>","PeriodicalId":362,"journal":{"name":"Journal of Hydrology","volume":"656 ","pages":"Article 133053"},"PeriodicalIF":7.3000,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Contrast or Diversity: Non-Flood sampling in urban flood susceptibility modelling\",\"authors\":\"Huabing Huang,&nbsp;Zhiwen Tao,&nbsp;Jiayin Zhan,&nbsp;Changpeng Wang\",\"doi\":\"10.1016/j.jhydrol.2025.133053\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Flood susceptibility modeling is a typical imbalanced problem in which the amount of flood data is much smaller than that of non-flood data. To ensure balanced learning, only a small fraction of non-flood data is selected for machine learning. Traditional sampling methods, such as Random Sampling (RS) and Stratified Sampling (SS), neglect abundant information within non-flood data and its relationship with flood data. This neglect leads to insufficient binary classification performance and biased susceptibility estimation, both of which are influenced by sample contrast and diversity, respectively. Unfortunately, these two objectives cannot be achieved simultaneously due to the trade-off between sample contrast and diversity. This dual-objective optimization requires a trade-off between contrast and diversity in sample quality. This study proposed a Distance-Based Sampling (DBS) framework that connects non-flood samples to flood data using Euclidean distance. Ten DBS scenarios with varying contrast and diversity levels (from 0.0 to 1.0 to 0.9–1.0) were designed for systematic evaluation. The best DBS scenario was further compared with RS, SS, and Inverse-Occurrence Sampling (IOS). To derive robust results, four machine learning techniques—Artificial Neural Network (ANN), Random Forest (RF), Support Vector Machine (SVM), and eXtreme Gradient Boosting (XGBoost)—were employed in two heterogeneous urban districts in Guangzhou, China, along with multiple indices, i.e. Area Under the Curve (AUC), mean susceptibility, standard deviation of susceptibility, and flood density order. The main findings of this study were as follows: (1) High sample contrast led to excellent binary classification performance but resulted in an overestimation of flood susceptibility. (2) High sample diversity resulted in insufficient binary classification performance and an underestimation of flood susceptibility. (3) Under the DBS framework, the performance curve of the dual-objective problem is unimodal. The best performance was achieved at a trade-off between contrast and diversity, specifically in the DBS scenario 0.3–1.0. (4) The DBS scenario 0.3–1.0 outperformed RS, SS, and IOS. Finally, this study underscores the critical role of non-flood sample quality and the balance between sample contrast and diversity in flood susceptibility modeling. The proposed DBS framework is objective and flexible, and can be applied to negative sampling in susceptibility modeling for other hazards, such as landslides and wildfires.</div></div>\",\"PeriodicalId\":362,\"journal\":{\"name\":\"Journal of Hydrology\",\"volume\":\"656 \",\"pages\":\"Article 133053\"},\"PeriodicalIF\":7.3000,\"publicationDate\":\"2025-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Hydrology\",\"FirstCategoryId\":\"89\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0022169425003919\",\"RegionNum\":1,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/3/10 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, CIVIL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Hydrology","FirstCategoryId":"89","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0022169425003919","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/3/10 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"ENGINEERING, CIVIL","Score":null,"Total":0}
引用次数: 0

摘要

洪水敏感性建模是典型的洪水数据量远小于非洪水数据量的不平衡问题。为了保证均衡学习,只选择一小部分非泛洪数据进行机器学习。传统的抽样方法,如随机抽样(Random sampling, RS)和分层抽样(Stratified sampling, SS),忽略了非洪水数据中丰富的信息及其与洪水数据之间的关系。这种忽视导致二值分类性能不足和敏感性估计偏倚,两者分别受到样本对比度和多样性的影响。不幸的是,由于样本对比度和多样性之间的权衡,这两个目标不能同时实现。这种双目标优化需要在样品质量的对比度和多样性之间进行权衡。本研究提出了一种基于距离的采样(DBS)框架,利用欧几里得距离将非洪水样本与洪水数据连接起来。设计了10个不同对比度和多样性水平(0.0 ~ 1.0和0.9 ~ 1.0)的DBS场景进行系统评价。将最佳DBS方案与RS、SS和逆发生抽样(IOS)进行比较。采用人工神经网络(ANN)、随机森林(RF)、支持向量机(SVM)和极限梯度增强(XGBoost)四种机器学习技术,结合曲线下面积(AUC)、平均易感度、易感度标准差和洪水密度顺序等多个指标,对广州两个异质城区进行了研究。研究结果表明:(1)高样本对比度导致二元分类性能优异,但导致洪水敏感性高估。(2)高样本多样性导致二元分类性能不足,低估了洪水敏感性。(3)在DBS框架下,双目标问题的性能曲线是单峰的。最好的性能是在对比度和多样性之间进行权衡,特别是在DBS场景0.3-1.0中。(4) DBS场景0.3-1.0优于RS、SS、IOS。最后,本研究强调了非洪水样本质量以及样本对比和多样性之间的平衡在洪水敏感性模型中的关键作用。提出的DBS框架具有客观和灵活的特点,可以应用于其他灾害(如滑坡和野火)敏感性建模中的负抽样。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

摘要图片

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Contrast or Diversity: Non-Flood sampling in urban flood susceptibility modelling
Flood susceptibility modeling is a typical imbalanced problem in which the amount of flood data is much smaller than that of non-flood data. To ensure balanced learning, only a small fraction of non-flood data is selected for machine learning. Traditional sampling methods, such as Random Sampling (RS) and Stratified Sampling (SS), neglect abundant information within non-flood data and its relationship with flood data. This neglect leads to insufficient binary classification performance and biased susceptibility estimation, both of which are influenced by sample contrast and diversity, respectively. Unfortunately, these two objectives cannot be achieved simultaneously due to the trade-off between sample contrast and diversity. This dual-objective optimization requires a trade-off between contrast and diversity in sample quality. This study proposed a Distance-Based Sampling (DBS) framework that connects non-flood samples to flood data using Euclidean distance. Ten DBS scenarios with varying contrast and diversity levels (from 0.0 to 1.0 to 0.9–1.0) were designed for systematic evaluation. The best DBS scenario was further compared with RS, SS, and Inverse-Occurrence Sampling (IOS). To derive robust results, four machine learning techniques—Artificial Neural Network (ANN), Random Forest (RF), Support Vector Machine (SVM), and eXtreme Gradient Boosting (XGBoost)—were employed in two heterogeneous urban districts in Guangzhou, China, along with multiple indices, i.e. Area Under the Curve (AUC), mean susceptibility, standard deviation of susceptibility, and flood density order. The main findings of this study were as follows: (1) High sample contrast led to excellent binary classification performance but resulted in an overestimation of flood susceptibility. (2) High sample diversity resulted in insufficient binary classification performance and an underestimation of flood susceptibility. (3) Under the DBS framework, the performance curve of the dual-objective problem is unimodal. The best performance was achieved at a trade-off between contrast and diversity, specifically in the DBS scenario 0.3–1.0. (4) The DBS scenario 0.3–1.0 outperformed RS, SS, and IOS. Finally, this study underscores the critical role of non-flood sample quality and the balance between sample contrast and diversity in flood susceptibility modeling. The proposed DBS framework is objective and flexible, and can be applied to negative sampling in susceptibility modeling for other hazards, such as landslides and wildfires.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Hydrology
Journal of Hydrology 地学-地球科学综合
CiteScore
11.00
自引率
12.50%
发文量
1309
审稿时长
7.5 months
期刊介绍: The Journal of Hydrology publishes original research papers and comprehensive reviews in all the subfields of the hydrological sciences including water based management and policy issues that impact on economics and society. These comprise, but are not limited to the physical, chemical, biogeochemical, stochastic and systems aspects of surface and groundwater hydrology, hydrometeorology and hydrogeology. Relevant topics incorporating the insights and methodologies of disciplines such as climatology, water resource systems, hydraulics, agrohydrology, geomorphology, soil science, instrumentation and remote sensing, civil and environmental engineering are included. Social science perspectives on hydrological problems such as resource and ecological economics, environmental sociology, psychology and behavioural science, management and policy analysis are also invited. Multi-and interdisciplinary analyses of hydrological problems are within scope. The science published in the Journal of Hydrology is relevant to catchment scales rather than exclusively to a local scale or site.
期刊最新文献
Open canal evaporation in an arid urban environment in Arizona estimated with measurements of water isotopes Soil moisture retrieval using multi-system GNSS-IR with a marginal improvement threshold for satellite combination optimization Effective risks and dominant factors of drought-flood abrupt alternation events to global socio-ecological systems An efficient fracture network reduction method for characterizing flow and mass transport in three-dimensional fracture networks Applicability of an analytical probabilistic stormwater management model for large rural watersheds
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1