Hybrid physics-AI outperforms numerical weather prediction for extreme precipitation nowcasting

Puja Das, August Posch, Nathan Barber, Michael Hicks, Thomas J. Vandal, Kate Duffy, Debjani Singh, Katie van Werkhoven, Auroop R. Ganguly
{"title":"Hybrid physics-AI outperforms numerical weather prediction for extreme precipitation nowcasting","authors":"Puja Das, August Posch, Nathan Barber, Michael Hicks, Thomas J. Vandal, Kate Duffy, Debjani Singh, Katie van Werkhoven, Auroop R. Ganguly","doi":"arxiv-2407.11317","DOIUrl":null,"url":null,"abstract":"Precipitation nowcasting, critical for flood emergency and river management,\nhas remained challenging for decades, although recent developments in deep\ngenerative modeling (DGM) suggest the possibility of improvements. River\nmanagement centers, such as the Tennessee Valley Authority, have been using\nNumerical Weather Prediction (NWP) models for nowcasting but have struggled\nwith missed detections even from best-in-class NWP models. While decades of\nprior research achieved limited improvements beyond advection and localized\nevolution, recent attempts have shown progress from physics-free machine\nlearning (ML) methods and even greater improvements from physics-embedded ML\napproaches. Developers of DGM for nowcasting have compared their approaches\nwith optical flow (a variant of advection) and meteorologists' judgment but not\nwith NWP models. Further, they have not conducted independent co-evaluations\nwith water resources and river managers. Here, we show that the\nstate-of-the-art physics-embedded deep generative model, specifically\nNowcastNet, outperforms the High-Resolution Rapid Refresh (HRRR) model, the\nlatest generation of NWP, along with advection and persistence, especially for\nheavy precipitation events. For grid-cell extremes over 16 mm/h, NowcastNet\ndemonstrated a median critical success index (CSI) of 0.30, compared with a\nmedian CSI of 0.04 for HRRR. However, despite hydrologically relevant\nimprovements in point-by-point forecasts from NowcastNet, caveats include the\noverestimation of spatially aggregated precipitation over longer lead times.\nOur co-evaluation with ML developers, hydrologists, and river managers suggests\nthe possibility of improved flood emergency response and hydropower management.","PeriodicalId":501166,"journal":{"name":"arXiv - PHYS - Atmospheric and Oceanic Physics","volume":"35 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-07-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - PHYS - Atmospheric and Oceanic Physics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2407.11317","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Precipitation nowcasting, critical for flood emergency and river management, has remained challenging for decades, although recent developments in deep generative modeling (DGM) suggest the possibility of improvements. River management centers, such as the Tennessee Valley Authority, have been using Numerical Weather Prediction (NWP) models for nowcasting but have struggled with missed detections even from best-in-class NWP models. While decades of prior research achieved limited improvements beyond advection and localized evolution, recent attempts have shown progress from physics-free machine learning (ML) methods and even greater improvements from physics-embedded ML approaches. Developers of DGM for nowcasting have compared their approaches with optical flow (a variant of advection) and meteorologists' judgment but not with NWP models. Further, they have not conducted independent co-evaluations with water resources and river managers. Here, we show that the state-of-the-art physics-embedded deep generative model, specifically NowcastNet, outperforms the High-Resolution Rapid Refresh (HRRR) model, the latest generation of NWP, along with advection and persistence, especially for heavy precipitation events. For grid-cell extremes over 16 mm/h, NowcastNet demonstrated a median critical success index (CSI) of 0.30, compared with a median CSI of 0.04 for HRRR. However, despite hydrologically relevant improvements in point-by-point forecasts from NowcastNet, caveats include the overestimation of spatially aggregated precipitation over longer lead times. Our co-evaluation with ML developers, hydrologists, and river managers suggests the possibility of improved flood emergency response and hydropower management.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
物理-人工智能混合技术在极端降水预报方面优于数值天气预报
降水预报对洪水应急和河流管理至关重要,几十年来一直面临挑战,尽管最近在深源建模(DGM)方面取得的进展表明有可能改进降水预报。田纳西流域管理局等河流管理中心一直在使用数值天气预报 (NWP) 模型进行预报,但即使是最好的 NWP 模型也难以发现漏报现象。虽然数十年来的研究在平流和局部演变之外取得了有限的改进,但最近的尝试表明,无物理的机器学习(ML)方法取得了进展,而嵌入物理的 ML 方法取得了更大的改进。用于预报的 DGM 的开发者将他们的方法与光流(平流的一种变体)和气象学家的判断进行了比较,但没有与 NWP 模型进行比较。此外,他们还没有与水资源和河流管理人员进行独立的共同评估。在这里,我们展示了最先进的物理嵌入式深度生成模型,特别是 NowcastNet,在平流和持续性方面优于最新一代 NWP 的高分辨率快速刷新(HRRR)模型,尤其是在强降水事件中。对于超过 16 毫米/小时的网格单元极端降水,NowcastNet 的临界成功指数 (CSI) 中值为 0.30,而 HRRR 的临界成功指数中值为 0.04。我们与 ML 开发人员、水文学家和河流管理者共同进行了评估,结果表明,NowcastNet 的逐点预报在水文方面有所改进,但仍存在一些问题,包括在较长的准备时间内对空间聚合降水的估计不足。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Harnessing AI data-driven global weather models for climate attribution: An analysis of the 2017 Oroville Dam extreme atmospheric river Super Resolution On Global Weather Forecasts Can Transfer Learning be Used to Identify Tropical State-Dependent Bias Relevant to Midlatitude Subseasonal Predictability? Using Generative Models to Produce Realistic Populations of the United Kingdom Windstorms Integrated nowcasting of convective precipitation with Transformer-based models using multi-source data
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1