Combinations of distributional regression algorithms with application in uncertainty estimation of corrected satellite precipitation products

IF 4.9 Machine learning with applications Pub Date : 2025-03-01 Epub Date: 2024-12-16 DOI:10.1016/j.mlwa.2024.100615
Georgia Papacharalampous, Hristos Tyralis, Nikolaos Doulamis, Anastasios Doulamis
{"title":"Combinations of distributional regression algorithms with application in uncertainty estimation of corrected satellite precipitation products","authors":"Georgia Papacharalampous,&nbsp;Hristos Tyralis,&nbsp;Nikolaos Doulamis,&nbsp;Anastasios Doulamis","doi":"10.1016/j.mlwa.2024.100615","DOIUrl":null,"url":null,"abstract":"<div><div>To facilitate effective decision-making, precipitation datasets should include uncertainty estimates. Quantile regression with machine learning has been proposed for issuing such estimates. Distributional regression offers distinct advantages over quantile regression, including the ability to model intermittency as well as a stronger ability to extrapolate beyond the training data, which is critical for predicting extreme precipitation. Therefore, here, we introduce the concept of distributional regression in precipitation dataset creation, specifically for the spatial prediction task of correcting satellite precipitation products. Building upon this concept, we formulated new ensemble learning methods that can be valuable not only for spatial prediction but also for other prediction problems. These methods exploit conditional zero-adjusted probability distributions estimated with generalized additive models for location, scale and shape (GAMLSS), spline-based GAMLSS and distributional regression forests as well as their ensembles (stacking based on quantile regression and equal-weight averaging). To identify the most effective methods for our specific problem, we compared them to benchmarks using a large, multi-source precipitation dataset. Stacking was shown to be superior to individual methods at most quantile levels when evaluated with the quantile loss function. Moreover, while the relative ranking of the methods varied across different quantile levels, stacking methods, and to a lesser extent mean combiners, exhibited lower variance in their performance across different quantiles compared to individual methods that occasionally ranked extremely low. Overall, a task-specific combination of multiple distributional regression algorithms could yield significant benefits in terms of stability.</div></div>","PeriodicalId":74093,"journal":{"name":"Machine learning with applications","volume":"19 ","pages":"Article 100615"},"PeriodicalIF":4.9000,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Machine learning with applications","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666827024000914","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/12/16 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

To facilitate effective decision-making, precipitation datasets should include uncertainty estimates. Quantile regression with machine learning has been proposed for issuing such estimates. Distributional regression offers distinct advantages over quantile regression, including the ability to model intermittency as well as a stronger ability to extrapolate beyond the training data, which is critical for predicting extreme precipitation. Therefore, here, we introduce the concept of distributional regression in precipitation dataset creation, specifically for the spatial prediction task of correcting satellite precipitation products. Building upon this concept, we formulated new ensemble learning methods that can be valuable not only for spatial prediction but also for other prediction problems. These methods exploit conditional zero-adjusted probability distributions estimated with generalized additive models for location, scale and shape (GAMLSS), spline-based GAMLSS and distributional regression forests as well as their ensembles (stacking based on quantile regression and equal-weight averaging). To identify the most effective methods for our specific problem, we compared them to benchmarks using a large, multi-source precipitation dataset. Stacking was shown to be superior to individual methods at most quantile levels when evaluated with the quantile loss function. Moreover, while the relative ranking of the methods varied across different quantile levels, stacking methods, and to a lesser extent mean combiners, exhibited lower variance in their performance across different quantiles compared to individual methods that occasionally ranked extremely low. Overall, a task-specific combination of multiple distributional regression algorithms could yield significant benefits in terms of stability.

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
分布回归算法的组合及其在校正卫星降水产品不确定性估计中的应用
为了促进有效决策,降水数据集应包括不确定性估计。使用机器学习的分位数回归已经被提议用于发布这样的估计。与分位数回归相比,分布回归具有明显的优势,包括间歇性建模的能力,以及更强的训练数据外推能力,这对于预测极端降水至关重要。因此,我们在降水数据集创建中引入了分布回归的概念,特别是针对卫星降水产品校正的空间预测任务。在这个概念的基础上,我们制定了新的集成学习方法,不仅对空间预测有价值,而且对其他预测问题也有价值。这些方法利用位置、规模和形状的广义加性模型(GAMLSS)、基于样条的GAMLSS和分布回归森林及其集合(基于分位数回归和等权平均的叠加)估计的条件零调整概率分布。为了确定针对特定问题的最有效方法,我们将它们与使用大型多源降水数据集的基准进行了比较。当用分位数损失函数评估时,在大多数分位数水平上,堆叠显示优于单个方法。此外,虽然方法的相对排名在不同分位数水平上有所不同,但与偶尔排名极低的个别方法相比,堆叠方法和较小程度上的平均组合方法在不同分位数上的表现差异较小。总的来说,多个分布回归算法的特定任务组合可以在稳定性方面产生显著的好处。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Machine learning with applications
Machine learning with applications Management Science and Operations Research, Artificial Intelligence, Computer Science Applications
自引率
0.00%
发文量
0
审稿时长
98 days
期刊最新文献
Quantum-inspired bi-level neuro-swarm optimization for UAV-based disaster recognition and response An unsupervised pipeline for class-agnostic object detection using self-supervised vision transformers and Kolmogorov–Arnold Networks Group-based learning on label-free phase-contrast images across dose and exposure time improves bioactive compound classification A deep reinforcement learning approach for emotion recognition from unaligned multimodal inputs Optimizing investment horizons: Machine learning applications in technical analysis of the WIG20 index
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1