Improving the explainability of CNN-LSTM-based flood prediction with integrating SHAP technique

IF 5.8 2区 环境科学与生态学 Q1 ECOLOGY Ecological Informatics Pub Date : 2024-11-17 DOI:10.1016/j.ecoinf.2024.102904
Hao Huang , Zhaoli Wang , Yaoxing Liao , Weizhi Gao , Chengguang Lai , Xushu Wu , Zhaoyang Zeng
{"title":"Improving the explainability of CNN-LSTM-based flood prediction with integrating SHAP technique","authors":"Hao Huang ,&nbsp;Zhaoli Wang ,&nbsp;Yaoxing Liao ,&nbsp;Weizhi Gao ,&nbsp;Chengguang Lai ,&nbsp;Xushu Wu ,&nbsp;Zhaoyang Zeng","doi":"10.1016/j.ecoinf.2024.102904","DOIUrl":null,"url":null,"abstract":"<div><div>Convolutional neural networks (CNNs) and long short-term memory networks (LSTMs) are popular deep learning architectures currently used for rapid flood simulations. However, deep learning algorithms are difficult to explain, like a “black box” that lacks insight. In order to reveal the intrinsic mechanism of prediction by such architectures, we adopted a coupled CNN-LSTM model based on the explainability technique SHapley Additive exPlanations (SHAP) to predict the rainfall-runoff process and identify key input feature factors, and took the Beijiang River Basin in China as an example, so as to improve the explainability and credibility of this black-box model. The results show that the coupled CNN-LSTM model performs better than the flood predictions compared to the individual CNN or LSTM models under the longest foresight period of 25 h. In particular, the Nash-Sutcliffe Efficiency (NSE) of the former model reaches 0.838, while those of the latter two models are 0.737 and 0.745, respectively. The coupled CNN-LSTM model has a high-accuracy prediction capability, consistently exhibiting NSEs greater than 0.8 for different input time steps and foresight periods. The prediction accuracy is mainly influenced by the observed runoff at the downstream hydrological station from previous time points, while the effects of the input time step length and the foresight period are comparatively negligible. This study provides a new perspective for understanding the potential physical mechanism of black-box models for rainfall-runoff prediction and emphasizes the importance and prospect of the application of explainability techniques.</div></div>","PeriodicalId":51024,"journal":{"name":"Ecological Informatics","volume":"84 ","pages":"Article 102904"},"PeriodicalIF":5.8000,"publicationDate":"2024-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ecological Informatics","FirstCategoryId":"93","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1574954124004461","RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ECOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Convolutional neural networks (CNNs) and long short-term memory networks (LSTMs) are popular deep learning architectures currently used for rapid flood simulations. However, deep learning algorithms are difficult to explain, like a “black box” that lacks insight. In order to reveal the intrinsic mechanism of prediction by such architectures, we adopted a coupled CNN-LSTM model based on the explainability technique SHapley Additive exPlanations (SHAP) to predict the rainfall-runoff process and identify key input feature factors, and took the Beijiang River Basin in China as an example, so as to improve the explainability and credibility of this black-box model. The results show that the coupled CNN-LSTM model performs better than the flood predictions compared to the individual CNN or LSTM models under the longest foresight period of 25 h. In particular, the Nash-Sutcliffe Efficiency (NSE) of the former model reaches 0.838, while those of the latter two models are 0.737 and 0.745, respectively. The coupled CNN-LSTM model has a high-accuracy prediction capability, consistently exhibiting NSEs greater than 0.8 for different input time steps and foresight periods. The prediction accuracy is mainly influenced by the observed runoff at the downstream hydrological station from previous time points, while the effects of the input time step length and the foresight period are comparatively negligible. This study provides a new perspective for understanding the potential physical mechanism of black-box models for rainfall-runoff prediction and emphasizes the importance and prospect of the application of explainability techniques.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
利用 SHAP 技术提高基于 CNN-LSTM 的洪水预测的可解释性
卷积神经网络(CNN)和长短期记忆网络(LSTM)是目前用于快速洪水模拟的流行深度学习架构。然而,深度学习算法很难解释,就像一个缺乏洞察力的 "黑盒子"。为了揭示这类架构预测的内在机理,我们采用了基于可解释性技术SHapley Additive exPlanations(SHAP)的耦合CNN-LSTM模型来预测降雨径流过程,识别关键输入特征因子,并以中国北江流域为例,以提高这一黑箱模型的可解释性和可信度。结果表明,与单独的 CNN 或 LSTM 模型相比,耦合 CNN-LSTM 模型在最长预报期 25 h 的洪水预报中表现更好,其中前者的 Nash-Sutcliffe 效率(NSE)达到 0.838,而后两者分别为 0.737 和 0.745。耦合 CNN-LSTM 模型具有高精度预测能力,在不同输入时间步长和预测周期下,NSE 均大于 0.8。预测精度主要受下游水文站前几个时间点观测到的径流量影响,而输入时间步长和预见期的影响相对较小。这项研究为理解降雨-径流预测黑箱模型的潜在物理机制提供了一个新的视角,并强调了可解释性技术应用的重要性和前景。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Ecological Informatics
Ecological Informatics 环境科学-生态学
CiteScore
8.30
自引率
11.80%
发文量
346
审稿时长
46 days
期刊介绍: The journal Ecological Informatics is devoted to the publication of high quality, peer-reviewed articles on all aspects of computational ecology, data science and biogeography. The scope of the journal takes into account the data-intensive nature of ecology, the growing capacity of information technology to access, harness and leverage complex data as well as the critical need for informing sustainable management in view of global environmental and climate change. The nature of the journal is interdisciplinary at the crossover between ecology and informatics. It focuses on novel concepts and techniques for image- and genome-based monitoring and interpretation, sensor- and multimedia-based data acquisition, internet-based data archiving and sharing, data assimilation, modelling and prediction of ecological data.
期刊最新文献
A novel model for mapping soil organic matter: Integrating temporal and spatial characteristics A deep learning model for detecting and classifying multiple marine mammal species from passive acoustic data Impact of discharge regulation on zooplankton communities regarding indicator species and their thresholds in the cascade weirs of the Yeongsan River Study of underwater sound propagation and attenuation characteristics at the Yangjiang offshore wind farma Spatiotemporal analysis of ocean primary productivity in Bohai Sea estimated using improved DINEOF reconstructed MODIS data
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1