首页 > 最新文献

International Journal of Forecasting最新文献

英文 中文
On memory-augmented gated recurrent unit network 关于记忆增强型门控递归单元网络
IF 7.9 2区 经济学 Q1 ECONOMICS Pub Date : 2024-08-31 DOI: 10.1016/j.ijforecast.2024.07.008
Maolin Yang, Muyi Li, Guodong Li
This paper addresses the challenge of forecasting multivariate long-memory time series. While statistical models such as the autoregressive fractionally integrated moving average (ARFIMA) and hyperbolic generalized autoregressive conditional heteroscedasticity (HYGARCH) can capture long-memory effects in time series data, they are often limited by dimensionality and parametric specification. Alternatively, recurrent neural networks (RNNs) are popular tools for approximating complex structures in sequential data. However, the lack of long-memory effect of these networks has been justified from a statistical perspective. In this paper, we propose a new network process called the memory-augmented gated recurrent unit (MGRU), which incorporates a fractionally integrated filter into the original GRU structure. We investigate the long-memory effect of the MGRU process, and demonstrate its effectiveness at capturing long-range dependence in real applications. Our findings illustrate that the proposed MGRU network outperforms existing models, indicating its potential as a promising tool for long-memory time series forecasting.
本文探讨了预测多元长记忆时间序列所面临的挑战。虽然自回归分数积分移动平均(ARFIMA)和双曲广义自回归条件异方差(HYGARCH)等统计模型可以捕捉时间序列数据中的长记忆效应,但它们往往受到维度和参数规范的限制。另外,递归神经网络(RNN)也是近似序列数据复杂结构的常用工具。然而,从统计学的角度来看,这些网络缺乏长记忆效应是有道理的。在本文中,我们提出了一种名为 "记忆增强门控递归单元(MGRU)"的新网络过程,它将一个分数集成滤波器纳入原始 GRU 结构中。我们研究了 MGRU 流程的长记忆效应,并展示了它在实际应用中捕捉长程依赖性的有效性。我们的研究结果表明,所提出的 MGRU 网络优于现有模型,表明它有潜力成为长记忆时间序列预测的理想工具。
{"title":"On memory-augmented gated recurrent unit network","authors":"Maolin Yang, Muyi Li, Guodong Li","doi":"10.1016/j.ijforecast.2024.07.008","DOIUrl":"https://doi.org/10.1016/j.ijforecast.2024.07.008","url":null,"abstract":"This paper addresses the challenge of forecasting multivariate long-memory time series. While statistical models such as the autoregressive fractionally integrated moving average (ARFIMA) and hyperbolic generalized autoregressive conditional heteroscedasticity (HYGARCH) can capture long-memory effects in time series data, they are often limited by dimensionality and parametric specification. Alternatively, recurrent neural networks (RNNs) are popular tools for approximating complex structures in sequential data. However, the lack of long-memory effect of these networks has been justified from a statistical perspective. In this paper, we propose a new network process called the memory-augmented gated recurrent unit (MGRU), which incorporates a fractionally integrated filter into the original GRU structure. We investigate the long-memory effect of the MGRU process, and demonstrate its effectiveness at capturing long-range dependence in real applications. Our findings illustrate that the proposed MGRU network outperforms existing models, indicating its potential as a promising tool for long-memory time series forecasting.","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":null,"pages":null},"PeriodicalIF":7.9,"publicationDate":"2024-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142190563","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A framework for timely and accessible long-term forecasting of shale gas production based on time series pattern matching 基于时间序列模式匹配的页岩气产量长期及时预测框架
IF 7.9 2区 经济学 Q1 ECONOMICS Pub Date : 2024-08-24 DOI: 10.1016/j.ijforecast.2024.07.009
Yilun Dong, Youzhi Hao, Detang Lu
Shale gas production forecasting is an important research topic in the gas industry. A common shale gas block includes dozens or even thousands of wells and therefore has a great number of historical production series. However, most existing methods apply single-well modelling. This cannot exploit data from other wells and requires a long production history from the target well, so the forecasting timeliness is compromised. Moreover, the parameters required by many of the existing methods are difficult to collect in practice, so the forecasting accessibility is compromised. Therefore, this study presents a shale gas production forecasting framework with improved timeliness and accessibility. To ensure timeliness, the proposed approach utilises historical data from existing wells and only requires a short production history from the target well. To ensure accessibility, the proposed approach only requires past daily production time and gas yield. The performance of the proposed method is demonstrated through a comparison with baseline methods. The results regarding cumulative gas production forecasting indicate that the proposed method has an average overall mean absolute percentage error (OMAPE) of 0.210, outperforming an artificial neural network with an average OMAPE of 0.241 and ARIMA with an average OMAPE of more than 2.
页岩气产量预测是天然气行业的一个重要研究课题。一个普通的页岩气区块包括几十口甚至上千口井,因此有大量的历史产量序列。然而,现有方法大多采用单井建模。这种方法无法利用其他油井的数据,而且需要目标油井有较长的生产历史,因此预测的及时性大打折扣。此外,许多现有方法所需的参数在实践中很难收集,因此预测的可及性也大打折扣。因此,本研究提出了一种具有更强时效性和可及性的页岩气产量预测框架。为确保及时性,所提出的方法利用现有油井的历史数据,只需要目标油井的简短生产历史数据。为确保可访问性,建议的方法只需要过去的日生产时间和天然气产量。通过与基准方法的比较,证明了所提方法的性能。有关累积天然气产量预测的结果表明,拟议方法的平均总平均绝对百分比误差(OMAPE)为 0.210,优于平均 OMAPE 为 0.241 的人工神经网络和平均 OMAPE 超过 2 的 ARIMA 方法。
{"title":"A framework for timely and accessible long-term forecasting of shale gas production based on time series pattern matching","authors":"Yilun Dong, Youzhi Hao, Detang Lu","doi":"10.1016/j.ijforecast.2024.07.009","DOIUrl":"https://doi.org/10.1016/j.ijforecast.2024.07.009","url":null,"abstract":"Shale gas production forecasting is an important research topic in the gas industry. A common shale gas block includes dozens or even thousands of wells and therefore has a great number of historical production series. However, most existing methods apply single-well modelling. This cannot exploit data from other wells and requires a long production history from the target well, so the forecasting timeliness is compromised. Moreover, the parameters required by many of the existing methods are difficult to collect in practice, so the forecasting accessibility is compromised. Therefore, this study presents a shale gas production forecasting framework with improved timeliness and accessibility. To ensure timeliness, the proposed approach utilises historical data from existing wells and only requires a short production history from the target well. To ensure accessibility, the proposed approach only requires past daily production time and gas yield. The performance of the proposed method is demonstrated through a comparison with baseline methods. The results regarding cumulative gas production forecasting indicate that the proposed method has an average overall mean absolute percentage error (OMAPE) of 0.210, outperforming an artificial neural network with an average OMAPE of 0.241 and ARIMA with an average OMAPE of more than 2.","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":null,"pages":null},"PeriodicalIF":7.9,"publicationDate":"2024-08-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142190564","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Light-touch forecasting: A novel method to combine human judgment with statistical algorithms 轻触式预测:将人类判断与统计算法相结合的新方法
IF 7.9 2区 经济学 Q1 Business, Management and Accounting Pub Date : 2024-05-01 DOI: 10.1016/j.ijforecast.2024.04.003
B.B.J.P.J. van der Staak, R.J.I. Basten, P.P.F.M. van de Calseyde, E. Demerouti, A.G. de Kok
{"title":"Light-touch forecasting: A novel method to combine human judgment with statistical algorithms","authors":"B.B.J.P.J. van der Staak, R.J.I. Basten, P.P.F.M. van de Calseyde, E. Demerouti, A.G. de Kok","doi":"10.1016/j.ijforecast.2024.04.003","DOIUrl":"https://doi.org/10.1016/j.ijforecast.2024.04.003","url":null,"abstract":"","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":null,"pages":null},"PeriodicalIF":7.9,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141057009","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Forecasting interest rates with shifting endpoints: The role of the functional demographic age distribution 预测端点移动的利率:功能性人口年龄分布的作用
IF 7.9 2区 经济学 Q1 Business, Management and Accounting Pub Date : 2024-05-01 DOI: 10.1016/j.ijforecast.2024.04.006
Jiazi Chen, Zhiwu Hong, Linlin Niu
{"title":"Forecasting interest rates with shifting endpoints: The role of the functional demographic age distribution","authors":"Jiazi Chen, Zhiwu Hong, Linlin Niu","doi":"10.1016/j.ijforecast.2024.04.006","DOIUrl":"https://doi.org/10.1016/j.ijforecast.2024.04.006","url":null,"abstract":"","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":null,"pages":null},"PeriodicalIF":7.9,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141031213","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Locally tail-scale invariant scoring rules for evaluation of extreme value forecasts 评估极值预测的局部尾尺度不变评分规则
IF 6.9 2区 经济学 Q1 ECONOMICS Pub Date : 2024-04-04 DOI: 10.1016/j.ijforecast.2024.02.007

Statistical analysis of extremes can be used to predict the probability of future extreme events, such as large rainfalls or devastating windstorms. The quality of these forecasts can be measured through scoring rules. Locally scale invariant scoring rules give equal importance to the forecasts at different locations regardless of differences in the prediction uncertainty. This is a useful feature when computing average scores but can be an unnecessarily strict requirement when one is mostly concerned with extremes. We propose the concept of local weight-scale invariance, describing scoring rules fulfilling local scale invariance in a certain region of interest, and as a special case, local tail-scale invariance for large events. Moreover, a new version of the weighted continuous ranked probability score (wCRPS) called the scaled wCRPS (swCRPS) that possesses this property is developed and studied. The score is a suitable alternative for scoring extreme value models over areas with a varying scale of extreme events, and we derive explicit formulas of the score for the generalised extreme value distribution. The scoring rules are compared through simulations, and their usage is illustrated by modelling extreme water levels and annual maximum rainfall, and in an application to non-extreme forecasts for the prediction of air pollution.

对极端事件的统计分析可用于预测未来极端事件(如暴雨或毁灭性风暴)的发生概率。这些预测的质量可以通过评分规则来衡量。局部尺度不变的评分规则对不同地点的预测给予同等重视,而不考虑预测不确定性的差异。在计算平均分数时,这是一个有用的特征,但在主要关注极端情况时,这可能是一个不必要的严格要求。我们提出了 "局部权重尺度不变性 "的概念,描述了在特定关注区域内满足局部尺度不变性的评分规则,作为一种特例,还描述了大型事件的局部尾部尺度不变性。此外,还开发并研究了具有这一特性的加权连续排序概率得分(wCRPS)的新版本,即缩放 wCRPS(swCRPS)。对于极端事件规模不等的地区,该评分是对极值模型进行评分的合适替代方案,我们为广义极值分布推导出了明确的评分公式。我们通过模拟对评分规则进行了比较,并通过模拟极端水位和年最大降雨量以及应用于空气污染预测的非极端预测来说明其用途。
{"title":"Locally tail-scale invariant scoring rules for evaluation of extreme value forecasts","authors":"","doi":"10.1016/j.ijforecast.2024.02.007","DOIUrl":"10.1016/j.ijforecast.2024.02.007","url":null,"abstract":"<div><p>Statistical analysis of extremes can be used to predict the probability of future extreme events, such as large rainfalls or devastating windstorms. The quality of these forecasts can be measured through scoring rules. Locally scale invariant scoring rules give equal importance to the forecasts at different locations regardless of differences in the prediction uncertainty. This is a useful feature when computing average scores but can be an unnecessarily strict requirement when one is mostly concerned with extremes. We propose the concept of local weight-scale invariance, describing scoring rules fulfilling local scale invariance in a certain region of interest, and as a special case, local tail-scale invariance for large events. Moreover, a new version of the weighted continuous ranked probability score (wCRPS) called the scaled wCRPS (swCRPS) that possesses this property is developed and studied. The score is a suitable alternative for scoring extreme value models over areas with a varying scale of extreme events, and we derive explicit formulas of the score for the generalised extreme value distribution. The scoring rules are compared through simulations, and their usage is illustrated by modelling extreme water levels and annual maximum rainfall, and in an application to non-extreme forecasts for the prediction of air pollution.</p></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":null,"pages":null},"PeriodicalIF":6.9,"publicationDate":"2024-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0169207024000128/pdfft?md5=0dc152533b3e57e00ccdf1336680c44d&pid=1-s2.0-S0169207024000128-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142098321","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Conditionally optimal weights and forward-looking approaches to combining forecasts 结合预测的条件最优权重和前瞻性方法
IF 6.9 2区 经济学 Q1 ECONOMICS Pub Date : 2024-04-04 DOI: 10.1016/j.ijforecast.2024.03.002

In forecasting, there is a tradeoff between in-sample fit and out-of-sample forecast accuracy. Parsimonious model specifications typically outperform richer model specifications. Consequently, information is often withheld from a forecast to prevent over-fitting the data. We show that one way to exploit this information is through forecast combination. Optimal combination weights in this environment minimize the conditional mean squared error that balances the conditional bias and the conditional variance of the combination. The bias-adjusted conditionally optimal forecast weights are time varying and forward looking. Real-time tests of conditionally optimal combinations of model-based forecasts and surveys of professional forecasters show significant gains in forecast accuracy relative to standard benchmarks for inflation and other macroeconomic variables.

在预测中,样本内拟合度与样本外预测准确度之间存在权衡。简约的模型规格通常优于丰富的模型规格。因此,为了防止过度拟合数据,预测中往往会保留一些信息。我们表明,利用这些信息的一种方法是通过预测组合。在这种环境下,最优组合权重可使条件均方误差最小化,从而平衡组合的条件偏差和条件方差。偏差调整后的条件最优预测权重具有时变性和前瞻性。对基于模型的条件最优预测组合进行的实时测试和对专业预测人员的调查显示,相对于通货膨胀和其他宏观经济变量的标准基准,条件最优预测组合的预测准确性显著提高。
{"title":"Conditionally optimal weights and forward-looking approaches to combining forecasts","authors":"","doi":"10.1016/j.ijforecast.2024.03.002","DOIUrl":"10.1016/j.ijforecast.2024.03.002","url":null,"abstract":"<div><p>In forecasting, there is a tradeoff between in-sample fit and out-of-sample forecast accuracy. Parsimonious model specifications typically outperform richer model specifications. Consequently, information is often withheld from a forecast to prevent over-fitting the data. We show that one way to exploit this information is through forecast combination. Optimal combination weights in this environment minimize the conditional mean squared error that balances the conditional bias and the conditional variance of the combination. The bias-adjusted conditionally optimal forecast weights are time varying and forward looking. Real-time tests of conditionally optimal combinations of model-based forecasts and surveys of professional forecasters show significant gains in forecast accuracy relative to standard benchmarks for inflation and other macroeconomic variables.</p></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":null,"pages":null},"PeriodicalIF":6.9,"publicationDate":"2024-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S016920702400027X/pdfft?md5=a9a2fe1ffd1994772550f8bd88d4ead2&pid=1-s2.0-S016920702400027X-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142098323","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A loss discounting framework for model averaging and selection in time series models 用于时间序列模型平均化和选择的损失贴现框架
IF 6.9 2区 经济学 Q1 ECONOMICS Pub Date : 2024-03-27 DOI: 10.1016/j.ijforecast.2024.03.001

We introduce a loss discounting framework for model and forecast combination, which generalises and combines Bayesian model synthesis and generalized Bayes methodologies. We use a loss function to score the performance of different models and introduce a multilevel discounting scheme that allows for a flexible specification of the dynamics of the model weights. This novel and simple model combination approach can be easily applied to large-scale model averaging/selection, handle unusual features such as sudden regime changes and be tailored to different forecasting problems. We compare our method to established and state-of-the-art methods for several macroeconomic forecasting examples. The proposed method offers an attractive, computationally efficient alternative to the benchmark methodologies and often outperforms more complex techniques.

我们为模型和预测组合引入了一个损失贴现框架,该框架将贝叶斯模型综合法和广义贝叶斯方法进行了概括和结合。我们使用损失函数对不同模型的性能进行评分,并引入了一种多级贴现方案,允许灵活指定模型权重的动态变化。这种新颖而简单的模型组合方法可以轻松地应用于大规模模型平均/选择,处理不寻常的特征(如突然的制度变化),并适用于不同的预测问题。我们针对几个宏观经济预测实例,将我们的方法与现有的最先进方法进行了比较。所提出的方法提供了一种有吸引力、计算效率高的替代基准方法,其性能往往优于更复杂的技术。
{"title":"A loss discounting framework for model averaging and selection in time series models","authors":"","doi":"10.1016/j.ijforecast.2024.03.001","DOIUrl":"10.1016/j.ijforecast.2024.03.001","url":null,"abstract":"<div><p>We introduce a loss discounting framework for model and forecast combination, which generalises and combines Bayesian model synthesis and generalized Bayes methodologies. We use a loss function to score the performance of different models and introduce a multilevel discounting scheme that allows for a flexible specification of the dynamics of the model weights. This novel and simple model combination approach can be easily applied to large-scale model averaging/selection, handle unusual features such as sudden regime changes and be tailored to different forecasting problems. We compare our method to established and state-of-the-art methods for several macroeconomic forecasting examples. The proposed method offers an attractive, computationally efficient alternative to the benchmark methodologies and often outperforms more complex techniques.</p></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":null,"pages":null},"PeriodicalIF":6.9,"publicationDate":"2024-03-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0169207024000268/pdfft?md5=e82af80360f437576bd13d36da34ea30&pid=1-s2.0-S0169207024000268-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142098322","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Hierarchical forecasting at scale 大规模分层预测
IF 6.9 2区 经济学 Q1 ECONOMICS Pub Date : 2024-03-22 DOI: 10.1016/j.ijforecast.2024.02.006

Hierarchical forecasting techniques allow for the creation of forecasts that are coherent with respect to a pre-specified hierarchy of the underlying time series. This targets a key problem in e-commerce, where we often find millions of products across many product hierarchies, and forecasts must be made for individual products and product aggregations. However, existing hierarchical forecasting techniques scale poorly when the number of time series increases, which limits their applicability at a scale of millions of products.

In this paper, we propose to learn a coherent forecast for millions of products with a single bottom-level forecast model by using a loss function that directly optimizes the hierarchical product structure. We implement our loss function using sparse linear algebra, such that the number of operations in our loss function scales quadratically rather than cubically with the number of products and levels in the hierarchical structure. The benefit of our sparse hierarchical loss function is that it provides practitioners with a method of producing bottom-level forecasts that are coherent to any chosen cross-sectional or temporal hierarchy. In addition, removing the need for a post-processing step as required in traditional hierarchical forecasting techniques reduces the computational cost of the prediction phase in the forecasting pipeline and its deployment complexity.

In our tests on the public M5 dataset, our sparse hierarchical loss function performs up to 10% better as measured by RMSE and MAE than the baseline loss function. Next, we implement our sparse hierarchical loss function within a gradient boosting-based forecasting model at bol.com, a large European e-commerce platform. At bol.com, each day, a forecast for the weekly demand of every product for the next twelve weeks is required. In this setting, our sparse hierarchical loss resulted in an improved forecasting performance as measured by RMSE of about 2% at the product level, compared to the baseline model, and an improvement of about 10% at the product level as measured by MAE. Finally, we found an increase in forecasting performance of about 5%–10% (both RMSE and MAE) when evaluating the forecasting performance across the cross-sectional hierarchies we defined. These results demonstrate the usefulness of our sparse hierarchical loss applied to a production forecasting system at a major e-commerce platform.

分层预测技术允许创建与预先指定的基础时间序列层次相一致的预测。这针对的是电子商务中的一个关键问题,在电子商务中,我们经常会发现数以百万计的产品横跨许多产品层次,因此必须对单个产品和产品集合进行预测。然而,现有的分层预测技术在时间序列数量增加时扩展性较差,这限制了它们在数百万产品规模上的适用性。在本文中,我们建议使用直接优化分层产品结构的损失函数,通过单个底层预测模型学习数百万产品的一致性预测。我们使用稀疏线性代数来实现我们的损失函数,这样损失函数中的运算次数就会随着分层结构中的产品数量和层级数量的增加而呈二次方而非三次方缩放。我们的稀疏分层损失函数的好处在于,它为从业人员提供了一种生成底层预测的方法,这种预测与任何选定的横截面或时间分层结构都是一致的。此外,由于省去了传统分层预测技术所需的后处理步骤,因此降低了预测管道中预测阶段的计算成本及其部署复杂性。在对公共 M5 数据集的测试中,我们的稀疏分层损失函数在 RMSE 和 MAE 方面的表现比基准损失函数好 10%。接下来,我们在欧洲大型电子商务平台 bol.com 基于梯度提升的预测模型中实施了稀疏分层损失函数。在 bol.com,每天都需要对未来 12 周内每种产品的周需求量进行预测。在这种情况下,与基线模型相比,我们的稀疏分层损失模型在产品层面的预测性能(以 RMSE 计)提高了约 2%,在产品层面的预测性能(以 MAE 计)提高了约 10%。最后,在评估我们定义的横截面层次的预测性能时,我们发现预测性能提高了约 5%-10%(均方根误差和 MAE)。这些结果表明,我们的稀疏分层损失法适用于一家大型电子商务平台的生产预测系统。
{"title":"Hierarchical forecasting at scale","authors":"","doi":"10.1016/j.ijforecast.2024.02.006","DOIUrl":"10.1016/j.ijforecast.2024.02.006","url":null,"abstract":"<div><p>Hierarchical forecasting techniques allow for the creation of forecasts that are coherent with respect to a pre-specified hierarchy of the underlying time series. This targets a key problem in e-commerce, where we often find millions of products across many product hierarchies, and forecasts must be made for individual products and product aggregations. However, existing hierarchical forecasting techniques scale poorly when the number of time series increases, which limits their applicability at a scale of millions of products.</p><p>In this paper, we propose to learn a coherent forecast for millions of products with a single bottom-level forecast model by using a loss function that directly optimizes the hierarchical product structure. We implement our loss function using sparse linear algebra, such that the number of operations in our loss function scales quadratically rather than cubically with the number of products and levels in the hierarchical structure. The benefit of our sparse hierarchical loss function is that it provides practitioners with a method of producing bottom-level forecasts that are coherent to any chosen cross-sectional or temporal hierarchy. In addition, removing the need for a post-processing step as required in traditional hierarchical forecasting techniques reduces the computational cost of the prediction phase in the forecasting pipeline and its deployment complexity.</p><p>In our tests on the public M5 dataset, our sparse hierarchical loss function performs up to 10% better as measured by RMSE and MAE than the baseline loss function. Next, we implement our sparse hierarchical loss function within a gradient boosting-based forecasting model at bol.com, a large European e-commerce platform. At bol.com, each day, a forecast for the weekly demand of every product for the next twelve weeks is required. In this setting, our sparse hierarchical loss resulted in an improved forecasting performance as measured by RMSE of about 2% at the product level, compared to the baseline model, and an improvement of about 10% at the product level as measured by MAE. Finally, we found an increase in forecasting performance of about 5%–10% (both RMSE and MAE) when evaluating the forecasting performance across the cross-sectional hierarchies we defined. These results demonstrate the usefulness of our sparse hierarchical loss applied to a production forecasting system at a major e-commerce platform.</p></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":null,"pages":null},"PeriodicalIF":6.9,"publicationDate":"2024-03-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0169207024000116/pdfft?md5=9360c19bcfcd3805bc4065518de97167&pid=1-s2.0-S0169207024000116-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142098320","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Factor-augmented forecasting in big data 大数据中的因子增强预测
IF 6.9 2区 经济学 Q1 ECONOMICS Pub Date : 2024-03-16 DOI: 10.1016/j.ijforecast.2024.02.004

This paper evaluates the predictive performance of various factor estimation methods in big data. Extensive forecasting experiments are examined using seven factor estimation methods with 13 decision rules determining the number of factors. The out-of-sample forecasting results show that the first Partial Least Squares factor (1-PLS) tends to be the best-performing method among all the possible alternatives. This finding is prevalent in many target variables under different forecasting horizons and models. This significant improvement can be explained by the PLS factor estimation strategy that considers the covariance with the target variable. Second, using a consistently estimated number of factors may not necessarily improve forecasting performance. The greatest predictive gain often derives from decision rules that do not consistently estimate the true number of factors.

本文评估了大数据中各种因素估计方法的预测性能。使用七种因子估计方法和 13 条决定因子数量的决策规则进行了广泛的预测实验。样本外预测结果表明,在所有可能的替代方法中,第一个偏最小二乘法因子(1-PLS)往往是表现最好的方法。这一发现在不同预测期限和预测模型下的许多目标变量中都很普遍。这种明显改善的原因在于 PLS 因子估计策略考虑了与目标变量的协方差。其次,使用一致估计的因子数不一定能提高预测性能。最大的预测收益往往来自于决策规则,而决策规则并不能始终如一地估算出真正的因子数量。
{"title":"Factor-augmented forecasting in big data","authors":"","doi":"10.1016/j.ijforecast.2024.02.004","DOIUrl":"10.1016/j.ijforecast.2024.02.004","url":null,"abstract":"<div><p>This paper evaluates the predictive performance of various factor estimation methods in big data. Extensive forecasting experiments are examined using seven factor estimation methods with 13 decision rules determining the number of factors. The out-of-sample forecasting results show that the first Partial Least Squares factor (1-PLS) tends to be the best-performing method among all the possible alternatives. This finding is prevalent in many target variables under different forecasting horizons and models. This significant improvement can be explained by the PLS factor estimation strategy that considers the covariance with the target variable. Second, using a consistently estimated number of factors may not necessarily improve forecasting performance. The greatest predictive gain often derives from decision rules that do not consistently estimate the true number of factors.</p></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":null,"pages":null},"PeriodicalIF":6.9,"publicationDate":"2024-03-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0169207024000098/pdfft?md5=bc3f0812065997cb8e01528b63ed0435&pid=1-s2.0-S0169207024000098-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140151749","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Improving forecasts for heterogeneous time series by “averaging”, with application to food demand forecasts 用 "平均法 "改进异质时间序列的预测,并应用于粮食需求预测
IF 6.9 2区 经济学 Q1 ECONOMICS Pub Date : 2024-03-14 DOI: 10.1016/j.ijforecast.2024.02.002

A common forecasting setting in real-world applications considers a set of possibly heterogeneous time series of the same domain. Due to the different properties of each time series, such as length, obtaining forecasts for each individual time series in a straightforward way is challenging. This paper proposes a general framework utilizing a similarity measure in dynamic time warping to find similar time series to build neighborhoods in a k-nearest neighbor fashion and improve forecasts of possibly simple models by averaging. Several ways of performing the averaging are suggested, and theoretical arguments underline the usefulness of averaging for forecasting. Additionally, diagnostic tools are proposed for a deep understanding of the procedure.

实际应用中常见的预测环境是同一领域的一组可能不同的时间序列。由于每个时间序列的属性(如长度)各不相同,因此以直接的方式获取每个单独时间序列的预测结果具有挑战性。本文提出了一个通用框架,利用动态时间扭曲中的相似度量来寻找相似的时间序列,从而以最近邻的方式建立邻域,并通过平均化来改进可能是简单模型的预测。文中提出了几种进行平均化的方法,并从理论上论证了平均化对预测的有用性。此外,还提出了一些诊断工具,以便深入了解该程序。
{"title":"Improving forecasts for heterogeneous time series by “averaging”, with application to food demand forecasts","authors":"","doi":"10.1016/j.ijforecast.2024.02.002","DOIUrl":"10.1016/j.ijforecast.2024.02.002","url":null,"abstract":"<div><p>A common forecasting setting in real-world applications considers a set of possibly heterogeneous time series of the same domain. Due to the different properties of each time series, such as length, obtaining forecasts for each individual time series in a straightforward way is challenging. This paper proposes a general framework utilizing a similarity measure in dynamic time warping to find similar time series to build neighborhoods in a <span><math><mi>k</mi></math></span>-nearest neighbor fashion and improve forecasts of possibly simple models by averaging. Several ways of performing the averaging are suggested, and theoretical arguments underline the usefulness of averaging for forecasting. Additionally, diagnostic tools are proposed for a deep understanding of the procedure.</p></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":null,"pages":null},"PeriodicalIF":6.9,"publicationDate":"2024-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0169207024000074/pdfft?md5=9d271047270035c3248727ce86799d68&pid=1-s2.0-S0169207024000074-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140150894","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
International Journal of Forecasting
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1