首页 > 最新文献

International Journal of Forecasting最新文献

英文 中文
Avoiding overconfidence: Evidence from the M6 financial competition 避免过度自信:来自M6金融竞争的证据
IF 7.1 2区 经济学 Q1 ECONOMICS Pub Date : 2025-10-01 Epub Date: 2024-11-04 DOI: 10.1016/j.ijforecast.2024.10.001
Spyros Makridakis , Evangelos Spiliotis , Maria Michailidis
The M6 competition aimed to identify methods that can accurately forecast asset returns and exploit such forecasts to make efficient investments. Specifically, the forecasting track of the competition required participants to estimate the probability that each of the 100 selected assets would be ranked within the first, second, third, fourth, or fifth quintile with regards to their relative percentage returns. Overall, less than 25% of the teams managed to estimate the probabilities more precisely than a benchmark that assumed equal probabilities for all quintiles. Moreover, those that did so reported inconsistent performance across the 12 submission points and minor forecast accuracy improvements. We identify price volatility as a key driver of forecast deterioration and show that avoiding overconfidence by assuming similar probabilities for symmetric quintiles can improve both forecast accuracy and portfolio efficiency. Interestingly, our findings hold true even when simple methods are employed to estimate the base predictions and investment weights.
M6竞赛旨在确定能够准确预测资产回报的方法,并利用这种预测进行有效投资。具体地说,比赛的预测轨迹要求参与者估计100个选定资产中的每一个在其相对百分比回报方面排名在第一、第二、第三、第四或第五个五分位数内的概率。总的来说,只有不到25%的团队能够比假设所有五分之一的概率相等的基准更精确地估计概率。此外,那些这样做的公司报告说,在12个提交点上的表现不一致,预测的准确性只有很小的提高。我们将价格波动确定为预测恶化的关键驱动因素,并表明通过假设对称五分位数的相似概率来避免过度自信可以提高预测准确性和投资组合效率。有趣的是,即使采用简单的方法来估计基本预测和投资权重,我们的发现也成立。
{"title":"Avoiding overconfidence: Evidence from the M6 financial competition","authors":"Spyros Makridakis ,&nbsp;Evangelos Spiliotis ,&nbsp;Maria Michailidis","doi":"10.1016/j.ijforecast.2024.10.001","DOIUrl":"10.1016/j.ijforecast.2024.10.001","url":null,"abstract":"<div><div>The M6 competition aimed to identify methods that can accurately forecast asset returns and exploit such forecasts to make efficient investments. Specifically, the forecasting track of the competition required participants to estimate the probability that each of the 100 selected assets would be ranked within the first, second, third, fourth, or fifth quintile with regards to their relative percentage returns. Overall, less than 25% of the teams managed to estimate the probabilities more precisely than a benchmark that assumed equal probabilities for all quintiles. Moreover, those that did so reported inconsistent performance across the 12 submission points and minor forecast accuracy improvements. We identify price volatility as a key driver of forecast deterioration and show that avoiding overconfidence by assuming similar probabilities for symmetric quintiles can improve both forecast accuracy and portfolio efficiency. Interestingly, our findings hold true even when simple methods are employed to estimate the base predictions and investment weights.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 4","pages":"Pages 1395-1403"},"PeriodicalIF":7.1,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145020559","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Designing time-series models with hypernetworks and adversarial portfolios 设计具有超网络和对抗性组合的时间序列模型
IF 7.1 2区 经济学 Q1 ECONOMICS Pub Date : 2025-10-01 Epub Date: 2025-02-25 DOI: 10.1016/j.ijforecast.2025.01.005
Filip Staněk
This article describes the methods that achieved fourth and sixth place in the forecasting and investment challenges, respectively, of the M6 competition, ultimately securing first place in the overall duathlon ranking. In the forecasting challenge, we tested a novel meta-learning model that utilizes hypernetworks to design a parametric model tailored to a specific family of forecasting tasks. This approach allowed us to leverage similarities observed across individual forecasting tasks (i.e., assets) while also acknowledging potential heterogeneity in their data generating processes. The model’s training can be directly performed with backpropagation, eliminating the need to rely on higher-order derivatives, and is equivalent to a simultaneous search over the space of parametric functions and their optimal parameter values. The proposed model’s capabilities extend beyond M6, demonstrating superiority over state-of-the-art meta-learning methods in the sinusoidal regression task and outperforming conventional parametric models on time series from the M4 forecasting competition. In the investment challenge, we adjusted portfolio weights to induce greater or smaller correlation between our submission and that of other participants, depending on the current ranking, aiming to maximize the probability of achieving a good rank. While this portfolio strategy can increase the probability of securing a favorable rank, it paradoxically exhibits negative expected returns.
本文介绍了在M6比赛的预测和投资挑战中分别获得第四名和第六名的方法,最终确保了两项全能总排名的第一名。在预测挑战中,我们测试了一种新的元学习模型,该模型利用超网络设计了一个针对特定预测任务的参数化模型。这种方法允许我们利用在单个预测任务(例如,资产)中观察到的相似性,同时也承认其数据生成过程中的潜在异质性。模型的训练可以直接通过反向传播进行,不需要依赖高阶导数,相当于同时搜索参数函数及其最优参数值的空间。该模型的功能超出M6,在正弦回归任务中优于最先进的元学习方法,并且在M4预测竞争中的时间序列上优于传统参数模型。在投资挑战中,我们根据当前排名调整投资组合权重,以诱导我们的提交与其他参与者的提交之间或大或小的相关性,旨在最大限度地提高获得好排名的可能性。虽然这种投资组合策略可以增加获得有利排名的可能性,但它自相矛盾地表现出负的预期回报。
{"title":"Designing time-series models with hypernetworks and adversarial portfolios","authors":"Filip Staněk","doi":"10.1016/j.ijforecast.2025.01.005","DOIUrl":"10.1016/j.ijforecast.2025.01.005","url":null,"abstract":"<div><div><span>This article describes the methods that achieved fourth and sixth place in the forecasting and investment challenges, respectively, of the M6 competition, ultimately securing first place in the overall duathlon ranking. In the forecasting challenge, we tested a novel meta-learning model that utilizes hypernetworks to design a parametric model tailored to a specific family of forecasting tasks. This approach allowed us to leverage similarities observed across individual forecasting tasks (i.e., assets) while also acknowledging potential heterogeneity in their data generating processes. The model’s training can be directly performed with </span>backpropagation<span>, eliminating the need to rely on higher-order derivatives, and is equivalent to a simultaneous search over the space of parametric functions and their optimal parameter values. The proposed model’s capabilities extend beyond M6, demonstrating superiority over state-of-the-art meta-learning methods in the sinusoidal regression task and outperforming conventional parametric models on time series from the M4 forecasting competition. In the investment challenge, we adjusted portfolio weights to induce greater or smaller correlation between our submission and that of other participants, depending on the current ranking, aiming to maximize the probability of achieving a good rank. While this portfolio strategy can increase the probability of securing a favorable rank, it paradoxically exhibits negative expected returns.</span></div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 4","pages":"Pages 1461-1476"},"PeriodicalIF":7.1,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145020564","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
On forecast stability 论预报稳定性
IF 7.1 2区 经济学 Q1 ECONOMICS Pub Date : 2025-10-01 Epub Date: 2025-02-25 DOI: 10.1016/j.ijforecast.2025.01.006
Rakshitha Godahewa , Christoph Bergmeir , Zeynep Erkin Baz , Chengjun Zhu , Zhangdi Song , Salvador García , Dario Benavides
Forecasts are typically produced in a business context on a regular basis to make downstream decisions. Here, forecasts should not only be as accurate as possible, but also should not change arbitrarily, and be stable in some sense. In this paper, we explore two types of forecast stability that we call vertical stability (for forecasts from different origins for the same target) and horizontal stability (for forecasts from the same origin for different targets). Existing works in the literature are only applicable to certain base models and can only stabilise forecasts vertically. We propose a simple linear-interpolation-based approach to stabilise the forecasts provided by any base model, both vertically and horizontally. Our method makes the trade-off between stability and accuracy explicit, producing forecasts at any point in the spectrum of this trade-off. We used N-BEATS, pooled regression, LightGBM, ETS, and ARIMA as base models in our evaluation across different error and stability measures on four publicly available datasets. On some datasets, the proposed framework achieved forecasts that were both more accurate and stable than the base forecasts. On the others, we achieved forecasts that were slightly less accurate but much more stable.
预测通常在业务上下文中定期生成,以做出下游决策。在这里,预测不仅要尽可能准确,而且不能随意改变,在某种意义上要稳定。在本文中,我们探讨了两种类型的预测稳定性,我们称之为垂直稳定性(对于同一目标的不同来源的预测)和水平稳定性(对于来自同一来源的不同目标的预测)。现有文献中的工作只适用于某些基本模型,并且只能垂直稳定预测。我们提出了一种简单的基于线性插值的方法来稳定任何基本模型提供的预测,包括垂直和水平。我们的方法在稳定性和准确性之间做出了明确的权衡,在这种权衡的范围内的任何一点产生预测。我们使用N-BEATS、pooled regression、LightGBM、ETS和ARIMA作为基础模型,在四个公开可用的数据集上对不同的误差和稳定性进行评估。在一些数据集上,提出的框架实现了比基本预测更准确和更稳定的预测。在其他方面,我们的预测准确度略低,但稳定得多。
{"title":"On forecast stability","authors":"Rakshitha Godahewa ,&nbsp;Christoph Bergmeir ,&nbsp;Zeynep Erkin Baz ,&nbsp;Chengjun Zhu ,&nbsp;Zhangdi Song ,&nbsp;Salvador García ,&nbsp;Dario Benavides","doi":"10.1016/j.ijforecast.2025.01.006","DOIUrl":"10.1016/j.ijforecast.2025.01.006","url":null,"abstract":"<div><div>Forecasts are typically produced in a business context on a regular basis to make downstream decisions. Here, forecasts should not only be as accurate as possible, but also should not change arbitrarily, and be stable in some sense. In this paper, we explore two types of forecast stability that we call vertical stability (for forecasts from different origins for the same target) and horizontal stability (for forecasts from the same origin for different targets). Existing works in the literature are only applicable to certain base models and can only stabilise forecasts vertically. We propose a simple linear-interpolation-based approach to stabilise the forecasts provided by any base model, both vertically and horizontally. Our method makes the trade-off between stability and accuracy explicit, producing forecasts at any point in the spectrum of this trade-off. We used N-BEATS, pooled regression, LightGBM, ETS, and ARIMA as base models in our evaluation across different error and stability measures on four publicly available datasets. On some datasets, the proposed framework achieved forecasts that were both more accurate and stable than the base forecasts. On the others, we achieved forecasts that were slightly less accurate but much more stable.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 4","pages":"Pages 1539-1558"},"PeriodicalIF":7.1,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145020569","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The M6 forecasting competition: Bridging the gap between forecasting and investment decisions M6预测竞赛:弥合预测和投资决策之间的差距
IF 7.1 2区 经济学 Q1 ECONOMICS Pub Date : 2025-10-01 Epub Date: 2024-11-30 DOI: 10.1016/j.ijforecast.2024.11.002
Spyros Makridakis , Evangelos Spiliotis , Ross Hollyman , Fotios Petropoulos , Norman Swanson , Anil Gaba
The M6 forecasting competition, the sixth in the Makridakis competition sequence, focused on financial forecasting. A key objective of the M6 competition was to contribute to the debate surrounding the Efficient Market Hypothesis by examining how and why market participants make investment decisions. To address these objectives, the M6 competition investigated forecasting accuracy and investment performance in a universe of 100 publicly traded assets. The competition employed live evaluation on real data across multiple periods, a cross-sectional setting where participants predicted asset performance relative to that of other assets, and a direct evaluation of the utility of forecasts. In this way, we were able to measure the benefits of accurate forecasting and assess the importance of forecasting when making investment decisions. Our findings highlight the challenges that participants faced when attempting to accurately forecast the relative performance of assets, the great difficulty associated with trying to consistently outperform the market, the limited connection between submitted forecasts and investment decisions, the value added by information exchange and the “wisdom of crowds”, and the value of utilizing risk models when attempting to connect prediction and investing decisions.
M6预测竞赛是Makridakis竞赛序列中的第六个竞赛,重点是财务预测。M6竞赛的一个关键目标是通过研究市场参与者如何以及为什么做出投资决策,为围绕有效市场假说的辩论做出贡献。为了实现这些目标,M6竞赛调查了100种公开交易资产的预测准确性和投资表现。该竞赛采用了对多个时期真实数据的实时评估,参与者预测相对于其他资产的资产表现的横断面设置,以及对预测效用的直接评估。通过这种方式,我们能够衡量准确预测的好处,并在做出投资决策时评估预测的重要性。我们的研究结果强调了参与者在试图准确预测资产的相对表现时所面临的挑战,试图持续超越市场的巨大困难,提交的预测与投资决策之间的有限联系,信息交换和“群体智慧”的附加价值,以及在试图将预测与投资决策联系起来时利用风险模型的价值。
{"title":"The M6 forecasting competition: Bridging the gap between forecasting and investment decisions","authors":"Spyros Makridakis ,&nbsp;Evangelos Spiliotis ,&nbsp;Ross Hollyman ,&nbsp;Fotios Petropoulos ,&nbsp;Norman Swanson ,&nbsp;Anil Gaba","doi":"10.1016/j.ijforecast.2024.11.002","DOIUrl":"10.1016/j.ijforecast.2024.11.002","url":null,"abstract":"<div><div>The M6 forecasting competition, the sixth in the Makridakis competition sequence, focused on financial forecasting. A key objective of the M6 competition was to contribute to the debate surrounding the Efficient Market Hypothesis by examining how and why market participants make investment decisions. To address these objectives, the M6 competition investigated forecasting accuracy and investment performance in a universe of 100 publicly traded assets. The competition employed live evaluation on real data across multiple periods, a cross-sectional setting where participants predicted asset performance relative to that of other assets, and a direct evaluation of the utility of forecasts. In this way, we were able to measure the benefits of accurate forecasting and assess the importance of forecasting when making investment decisions. Our findings highlight the challenges that participants faced when attempting to accurately forecast the relative performance of assets, the great difficulty associated with trying to consistently outperform the market, the limited connection between submitted forecasts and investment decisions, the value added by information exchange and the “wisdom of crowds”, and the value of utilizing risk models when attempting to connect prediction and investing decisions.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 4","pages":"Pages 1315-1354"},"PeriodicalIF":7.1,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145019329","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Individual foresight: Concept, operationalization, and correlates 个人远见:概念、操作化和相关关系
IF 7.1 2区 经济学 Q1 ECONOMICS Pub Date : 2025-10-01 Epub Date: 2025-02-08 DOI: 10.1016/j.ijforecast.2025.01.003
Benedikt Alexander Schuler , Johann Peter Murmann , Marie Beisemann , Ville Satopää
Judgmental forecasting research on superforecasters has demonstrated that individuals differ in their foresight. However, the concept underlying this work focuses on accuracy and does not fully incorporate the time dimension of foresight. We reconceptualize foresight as the ability to predict future states of the world accurately, where accuracy becomes continuously more important over time. To operationalize foresight in forecasting tournaments, we propose various strictly proper scoring rules and compare them with existing scoring rules using a simulation study and real-world forecasting data consisting of 414,168 scores for 9694 forecasters on 498 questions from a four-year geopolitical forecasting tournament. The results suggest that the linear time-weighted Brier score should be the default operationalization of foresight and that probability training and teaming interventions as proposed by prior research may not improve foresight as we conceptualize it. We contribute to judgmental forecasting research by clarifying the concept, operationalization, and correlates of foresight.
对超级预测者的判断预测研究表明,个体的预测能力是不同的。然而,这项工作的基本概念侧重于准确性,并没有充分纳入预见的时间维度。我们将远见重新定义为准确预测世界未来状态的能力,随着时间的推移,准确性变得越来越重要。为了在预测比赛中实现预见性,我们提出了各种严格适当的评分规则,并使用模拟研究和现实世界的预测数据将它们与现有的评分规则进行比较,这些预测数据由9694名预测员在四年地缘政治预测比赛的498个问题上的414,168个分数组成。结果表明,线性时间加权Brier分数应该是预见性的默认操作化,而先前研究提出的概率训练和团队干预可能不会像我们概念化的那样提高预见性。我们通过澄清预测的概念、操作和相关关系,为判断预测的研究做出贡献。
{"title":"Individual foresight: Concept, operationalization, and correlates","authors":"Benedikt Alexander Schuler ,&nbsp;Johann Peter Murmann ,&nbsp;Marie Beisemann ,&nbsp;Ville Satopää","doi":"10.1016/j.ijforecast.2025.01.003","DOIUrl":"10.1016/j.ijforecast.2025.01.003","url":null,"abstract":"<div><div>Judgmental forecasting research on superforecasters has demonstrated that individuals differ in their foresight. However, the concept underlying this work focuses on accuracy and does not fully incorporate the time dimension of foresight. We reconceptualize foresight as the ability to predict future states of the world accurately, where accuracy becomes continuously more important over time. To operationalize foresight in forecasting tournaments, we propose various strictly proper scoring rules and compare them with existing scoring rules using a simulation study and real-world forecasting data consisting of 414,168 scores for 9694 forecasters on 498 questions from a four-year geopolitical forecasting tournament. The results suggest that the linear time-weighted Brier score should be the default operationalization of foresight and that probability training and teaming interventions as proposed by prior research may not improve foresight as we conceptualize it. We contribute to judgmental forecasting research by clarifying the concept, operationalization, and correlates of foresight.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 4","pages":"Pages 1521-1538"},"PeriodicalIF":7.1,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145020568","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
SCORE: A convolutional approach for football event forecasting SCORE:一个用于足球赛事预测的卷积方法
IF 7.1 2区 经济学 Q1 ECONOMICS Pub Date : 2025-10-01 Epub Date: 2025-03-05 DOI: 10.1016/j.ijforecast.2025.02.004
Rodrigo Alves
Football (also known as soccer or association football) is the most popular sport in the world. It is a blend of skill and luck, making it highly unpredictable. To address this unpredictability, there has been a surge in popularity over the past decade in employing machine learning techniques for forecasting football-related features. This trend aligns with the growing professionalism in football analytics. Despite this progress, the existing body of work remains in its early stages, lacking the depth required to capture the intricate nuances of the sport. In this study, we introduce a convolutional approach designed to predict the occurrence of the next event in a football match, such as a goal or a corner kick, relying solely on easy-to-access past events for predictions. Our methodology adopts an online approach, meaning predictions can be computed during a live match. To validate our approach, we conduct a comprehensive evaluation against five baseline models, utilizing data from various elite European football leagues. Additionally, an ablation study is performed to understand the underlying mechanisms of our method. Finally, we present practical applications and interpretable aspects of our proposed approach.
足球(也被称为足球或协会足球)是世界上最受欢迎的运动。它是技巧和运气的结合,这使得它非常不可预测。为了解决这种不可预测性,在过去十年中,利用机器学习技术来预测足球相关特征的流行程度激增。这一趋势与足球分析日益职业化的趋势相一致。尽管取得了这些进展,但现有的工作仍处于早期阶段,缺乏捕捉这项运动复杂细微差别所需的深度。在这项研究中,我们引入了一种卷积方法,旨在预测足球比赛中下一个事件的发生,例如进球或角球,仅依赖于易于访问的过去事件进行预测。我们的方法采用在线方法,这意味着可以在现场比赛中计算预测结果。为了验证我们的方法,我们利用来自各个欧洲精英足球联赛的数据,对五个基线模型进行了全面的评估。此外,还进行了消融研究,以了解我们方法的潜在机制。最后,我们介绍了我们提出的方法的实际应用和可解释方面。
{"title":"SCORE: A convolutional approach for football event forecasting","authors":"Rodrigo Alves","doi":"10.1016/j.ijforecast.2025.02.004","DOIUrl":"10.1016/j.ijforecast.2025.02.004","url":null,"abstract":"<div><div>Football (also known as soccer or association football) is the most popular sport in the world. It is a blend of skill and luck, making it highly unpredictable. To address this unpredictability, there has been a surge in popularity over the past decade in employing machine learning techniques<span><span> for forecasting football-related features. This trend aligns with the growing professionalism in football analytics. Despite this progress, the existing body of work remains in its early stages, lacking the depth required to capture the intricate nuances of the sport. In this study, we introduce a convolutional approach designed to predict the occurrence of the next event in a football match, such as a goal or a corner kick, relying solely on easy-to-access past events for predictions. Our methodology adopts an online approach, meaning predictions can be computed during a live match. To validate our approach, we conduct a comprehensive evaluation against five </span>baseline models, utilizing data from various elite European football leagues. Additionally, an ablation study is performed to understand the underlying mechanisms of our method. Finally, we present practical applications and interpretable aspects of our proposed approach.</span></div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 4","pages":"Pages 1636-1652"},"PeriodicalIF":7.1,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145019322","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Unraveling the effect of engagement and consistency in the results of the M6 forecasting competition 在M6预测竞赛结果中揭示参与和一致性的影响
IF 7.1 2区 经济学 Q1 ECONOMICS Pub Date : 2025-10-01 Epub Date: 2025-05-14 DOI: 10.1016/j.ijforecast.2025.04.002
Anastasios Kaltsounis, Evangelos Theodorou, Evangelos Spiliotis, Vassilios Assimakopoulos
The M6 competition evaluated investment performance over a period of one year, contributing to the efficient market hypothesis debate. This paper provides further insights into the outcomes of the competition by unraveling the effect that team engagement and performance consistency had on the final results. First, we identify three different types of engagement and investigate their relationship with portfolio efficiency, also making useful observations about the learning effect implied by a re-submission process. Then, we analyze the monthly performance of the teams and determine whether it aligned with their global performance or was affected significantly by extreme instances. Our results suggest that consistency is more important than engagement for making profitable investments. Nevertheless, we identify many cases where both regular portfolio updates and luck provided an advantage.
M6竞赛评估了一年内的投资表现,促进了有效市场假说的辩论。本文通过揭示团队参与和绩效一致性对最终结果的影响,提供了对比赛结果的进一步见解。首先,我们确定了三种不同类型的参与,并调查了它们与投资组合效率的关系,同时也对重新提交过程所隐含的学习效应进行了有用的观察。然后,我们分析团队的月度绩效,并确定它是否与他们的全球绩效一致,还是受到极端情况的显著影响。我们的研究结果表明,在进行有利可图的投资时,一致性比参与度更重要。然而,我们发现在许多情况下,定期的投资组合更新和运气都提供了优势。
{"title":"Unraveling the effect of engagement and consistency in the results of the M6 forecasting competition","authors":"Anastasios Kaltsounis,&nbsp;Evangelos Theodorou,&nbsp;Evangelos Spiliotis,&nbsp;Vassilios Assimakopoulos","doi":"10.1016/j.ijforecast.2025.04.002","DOIUrl":"10.1016/j.ijforecast.2025.04.002","url":null,"abstract":"<div><div>The M6 competition evaluated investment performance over a period of one year, contributing to the efficient market hypothesis debate. This paper provides further insights into the outcomes of the competition by unraveling the effect that team engagement and performance consistency had on the final results. First, we identify three different types of engagement and investigate their relationship with portfolio efficiency, also making useful observations about the learning effect implied by a re-submission process. Then, we analyze the monthly performance of the teams and determine whether it aligned with their global performance or was affected significantly by extreme instances. Our results suggest that consistency is more important than engagement for making profitable investments. Nevertheless, we identify many cases where both regular portfolio updates and luck provided an advantage.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 4","pages":"Pages 1404-1412"},"PeriodicalIF":7.1,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145020560","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Forecasting macroeconomic data with Bayesian VARs: Sparse or dense? It depends! 用贝叶斯var预测宏观经济数据:稀疏还是密集?视情况而定!
IF 7.1 2区 经济学 Q1 ECONOMICS Pub Date : 2025-10-01 Epub Date: 2025-02-26 DOI: 10.1016/j.ijforecast.2025.02.001
Luis Gruber, Gregor Kastner
Vector autoregressions (VARs) are widely applied when it comes to modeling and forecasting macroeconomic variables. In high dimensions, however, they are prone to overfitting. Bayesian methods—more concretely, shrinkage priors—have been shown to be successful at improving prediction performance. In the present paper, we introduce the semi-global framework, in which we replace the traditional global shrinkage parameter with group-specific shrinkage parameters. We show how this framework can be applied to various shrinkage priors, such as global–local priors and stochastic search variable selection priors. We demonstrate the virtues of the proposed framework in an extensive simulation study and in an empirical application forecasting data on the US economy. Further, we shed more light on the ongoing ‘illusion of sparsity’ debate, finding that forecasting performances under sparse/dense priors vary across evaluated economic variables and across time frames. Dynamic model averaging, however, can combine the merits of both worlds.
向量自回归(var)在宏观经济变量建模和预测方面有着广泛的应用。然而,在高维情况下,它们容易出现过拟合。贝叶斯方法——更具体地说,收缩先验——已被证明在提高预测性能方面是成功的。在本文中,我们引入了半全局框架,在该框架中,我们用特定于群体的收缩参数取代了传统的全局收缩参数。我们展示了该框架如何应用于各种收缩先验,例如全局-局部先验和随机搜索变量选择先验。我们在广泛的模拟研究和美国经济预测数据的实证应用中证明了所提出框架的优点。此外,我们进一步阐明了正在进行的“稀疏性错觉”辩论,发现稀疏/密集先验下的预测性能在评估的经济变量和时间框架中有所不同。然而,动态模型平均可以将两者的优点结合起来。
{"title":"Forecasting macroeconomic data with Bayesian VARs: Sparse or dense? It depends!","authors":"Luis Gruber,&nbsp;Gregor Kastner","doi":"10.1016/j.ijforecast.2025.02.001","DOIUrl":"10.1016/j.ijforecast.2025.02.001","url":null,"abstract":"<div><div>Vector autoregressions (VARs) are widely applied when it comes to modeling and forecasting macroeconomic variables. In high dimensions, however, they are prone to overfitting. Bayesian methods—more concretely, shrinkage priors—have been shown to be successful at improving prediction performance. In the present paper, we introduce the semi-global framework, in which we replace the traditional global shrinkage parameter with group-specific shrinkage parameters. We show how this framework can be applied to various shrinkage priors, such as global–local priors and stochastic search variable selection priors. We demonstrate the virtues of the proposed framework in an extensive simulation study and in an empirical application forecasting data on the US economy. Further, we shed more light on the ongoing ‘illusion of sparsity’ debate, finding that forecasting performances under sparse/dense priors vary across evaluated economic variables and across time frames. Dynamic model averaging, however, can combine the merits of both worlds.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 4","pages":"Pages 1589-1619"},"PeriodicalIF":7.1,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145019320","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Probabilistic forecasting of cross-sectional returns: A Bayesian dynamic factor model with heteroskedasticity 横截面回报的概率预测:具有异方差性的贝叶斯动态因子模型
IF 7.1 2区 经济学 Q1 ECONOMICS Pub Date : 2025-10-01 Epub Date: 2024-07-12 DOI: 10.1016/j.ijforecast.2024.06.007
Dan Weitzenfeld
The M6 Financial Forecasting Competition forecasting track required probabilistic forecasting of monthly returns for a universe of 100 assets. This paper describes a Bayesian dynamic factor model with heteroskedasticity that was used to win the year-long forecasting track. The model’s strengths include modularity, handling of missing data, and regularization through hierarchical distributions. Probability modeling and recent advances in probabilistic programming languages make defining such models and performing inference straightforward.
M6金融预测竞赛预测轨道要求对100种资产的月回报进行概率预测。本文描述了一种具有异方差的贝叶斯动态因子模型,并将其用于一年的预测轨迹。该模型的优势包括模块化、缺失数据的处理以及通过分层分布的正则化。概率建模和概率编程语言的最新进展使得定义这样的模型和执行推理变得简单明了。
{"title":"Probabilistic forecasting of cross-sectional returns: A Bayesian dynamic factor model with heteroskedasticity","authors":"Dan Weitzenfeld","doi":"10.1016/j.ijforecast.2024.06.007","DOIUrl":"10.1016/j.ijforecast.2024.06.007","url":null,"abstract":"<div><div><span>The M6 Financial Forecasting Competition forecasting track required probabilistic forecasting of monthly returns for a universe of 100 assets. This paper describes a Bayesian dynamic factor model with </span>heteroskedasticity<span> that was used to win the year-long forecasting track. The model’s strengths include modularity, handling of missing data, and regularization through hierarchical distributions. Probability modeling and recent advances in probabilistic programming languages make defining such models and performing inference straightforward.</span></div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 4","pages":"Pages 1477-1484"},"PeriodicalIF":7.1,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141703433","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Adaptive forecasting in dynamic markets: An evaluation of AutoTS within the M6 competition 动态市场中的自适应预测:AutoTS在M6竞争中的评价
IF 7.1 2区 经济学 Q1 ECONOMICS Pub Date : 2025-10-01 Epub Date: 2025-08-28 DOI: 10.1016/j.ijforecast.2025.08.004
Colin Catlin
In contemporary forecasting, the challenges of navigating the intricacies of erratic human-induced patterns combine with the challenges of navigating the overwhelming number of methods and models available to manage these data. The M6 Competition, which emphasized repeated, real-time monthly forecasting of stock markets, featured many of these difficulties. Here, AutoTS, an open-source Python package designed specifically for probabilistic time series predictions, is evaluated within the context of this competition. AutoTS includes an extensive repertoire of models, augmented by robust data preprocessing utilities, and employs genetic algorithms to fine-tune model parameters, contingent upon user-delineated evaluation metrics. This study describes the deployment of AutoTS in the M6 Competition, which won the investment decision challenge, and outlines the model selection pipeline and the process of converting forecasts into decisions which produced this result. Although a single definitive model remains elusive, these findings underscore the potential value of methodologies that are dynamic and largely autonomous.
在当代的预测中,驾驭不稳定的人为模式的复杂性的挑战与驾驭大量可用的方法和模型来管理这些数据的挑战相结合。强调重复、实时的月度股市预测的M6竞赛,就有许多这样的困难。在这里,AutoTS,一个专门为概率时间序列预测设计的开源Python包,将在本次竞赛的背景下进行评估。AutoTS包括广泛的模型库,通过强大的数据预处理工具增强,并采用遗传算法微调模型参数,根据用户描述的评估指标。本研究描述了AutoTS在M6竞赛中的部署,该竞赛赢得了投资决策挑战,并概述了模型选择管道和将预测转化为产生此结果的决策的过程。虽然单一的确定模型仍然难以捉摸,但这些发现强调了动态和很大程度上自主的方法的潜在价值。
{"title":"Adaptive forecasting in dynamic markets: An evaluation of AutoTS within the M6 competition","authors":"Colin Catlin","doi":"10.1016/j.ijforecast.2025.08.004","DOIUrl":"10.1016/j.ijforecast.2025.08.004","url":null,"abstract":"<div><div>In contemporary forecasting, the challenges of navigating the intricacies of erratic human-induced patterns combine with the challenges of navigating the overwhelming number of methods and models available to manage these data. The M6 Competition, which emphasized repeated, real-time monthly forecasting of stock markets, featured many of these difficulties. Here, AutoTS, an open-source Python package designed specifically for probabilistic time series predictions, is evaluated within the context of this competition. AutoTS includes an extensive repertoire of models, augmented by robust data preprocessing utilities, and employs genetic algorithms to fine-tune model parameters, contingent upon user-delineated evaluation metrics. This study describes the deployment of AutoTS in the M6 Competition, which won the investment decision challenge, and outlines the model selection pipeline and the process of converting forecasts into decisions which produced this result. Although a single definitive model remains elusive, these findings underscore the potential value of methodologies that are dynamic and largely autonomous.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 4","pages":"Pages 1485-1493"},"PeriodicalIF":7.1,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145020565","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
International Journal of Forecasting
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1