Econometric analysis typically focuses on the statistical properties of fixed estimators and ignores researcher choices. In this article, I instead approach the analysis of experimental data as a mechanism-design problem that acknowledges that researchers choose between estimators, sometimes based on the data and often according to their own preferences. Specifically, I focus on covariate adjustments, which can increase the precision of a treatment-effect estimate, but open the door to bias when researchers engage in specification searches. First, I establish that unbiasedness as a requirement on the estimation of the average treatment effect can align researchers' preferences with the minimization of the mean-squared error relative to the truth, and that fixing the bias can yield an optimal restriction in a minimax sense. Second, I provide a constructive characterization of treatment-effect estimators with fixed bias as sample-splitting procedures. Third, I discuss the implementation of second-best estimators that leave room for beneficial specification searches.
{"title":"Optimal Estimation When Researcher and Social Preferences Are Misaligned","authors":"Jann Spiess","doi":"10.3982/ECTA18640","DOIUrl":"https://doi.org/10.3982/ECTA18640","url":null,"abstract":"<p>Econometric analysis typically focuses on the statistical properties of fixed estimators and ignores researcher choices. In this article, I instead approach the analysis of experimental data as a mechanism-design problem that acknowledges that researchers choose between estimators, sometimes based on the data and often according to their own preferences. Specifically, I focus on covariate adjustments, which can increase the precision of a treatment-effect estimate, but open the door to bias when researchers engage in specification searches. First, I establish that unbiasedness as a requirement on the estimation of the average treatment effect can align researchers' preferences with the minimization of the mean-squared error relative to the truth, and that fixing the bias can yield an optimal restriction in a minimax sense. Second, I provide a constructive characterization of treatment-effect estimators with fixed bias as sample-splitting procedures. Third, I discuss the implementation of second-best estimators that leave room for beneficial specification searches.</p>","PeriodicalId":50556,"journal":{"name":"Econometrica","volume":"93 5","pages":"1779-1810"},"PeriodicalIF":7.1,"publicationDate":"2025-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145101679","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
We thank Man Chon Iao—a Ph.D. student at NYU—for bringing to our attention that we had a mistake in our code that generated the results in the published version of our paper. In this erratum, we: (1) discuss the mistake, (2) highlight the changes we made to our code in response to the mistake, and (3) reproduce all the relevant tables and figures of the paper after correcting the mistake. In particular, Section 2 of this erratum discusses the mistake, Section 3 updates the paper's core tables and figures, and Section 4 updates all remaining motivating and robustness tables and figures. Any table or figure we did not reproduce means the table/figure was unchanged compared to the original.
In summary, the magnitudes of the reported estimates change, although the qualitative results remain.
At the heart of the empirical component of our paper is the creation of state level wage measures during the period surrounding the Great Recession. When we initially made our composition adjusted state level wage measures, we summed over the wages for those working in each of our detailed demographic groups within each state for each year using repeated cross-sectional data from the American Community Survey. We then divided the total wages paid in each state-demographic group-year cell by the total number of individuals within each state-demographic group-year cell. This step produced a measure of the average wage for each demographic group in each state in each year. We then aggregated the state level demographic groups in each year—holding the group weights fixed at some initial time period level—to make our measure of demographically adjusted state wages in each year. Our mistake stems from the fact that we should have divided by the total number of “working” individuals within each group instead of the total number of individuals (unconditional on work status) within each group.
The main empirical result in the paper is the estimation of a state level New Keynesian Wage Phillips Curve (Table V, Section 5). The main quantitative results are the implications for aggregate business cycles of incorporating regional data when estimating a DSGE model (Figures 4 and 5, Section 7). We update these results below.
Below, we present the updated results for Figure 1, Figures 3, 3, 4, 5, Appendix A5–A6, and Tables I, II, and IV, V, VI, VII, VIII of the main paper. All other tables and figures are unaffected by our changes.
我们感谢纽约大学的一名博士生Man Chon iao,他让我们注意到,我们的代码中有一个错误,导致了我们论文发表版本的结果。在这个勘误表中,我们:(1)讨论了错误,(2)突出了我们针对错误对代码所做的更改,(3)在纠正错误后重现了论文的所有相关表格和图表。特别是,本勘误的第2节讨论了错误,第3节更新了论文的核心表格和图表,第4节更新了所有剩余的激励和稳健性表格和图表。任何我们没有复制的表格或图表都意味着该表格/图表与原始表格/图表相比没有变化。总而言之,虽然质量结果不变,但所报告的估计数的数量有所变化。本文实证部分的核心是大衰退期间州一级工资指标的创建。当我们最初做出调整后的州一级工资指标时,我们使用美国社区调查(American Community Survey)的重复横截面数据,对每个州每年每个详细人口群体中工作人员的工资进行了汇总。然后,我们将每个州-人口统计组-年单元格中支付的总工资除以每个州-人口统计组-年单元格中的总人数。这一步产生了每个州每年每个人口群体的平均工资。然后,我们每年汇总州一级的人口群体——将群体权重固定在某个初始时期的水平上——以衡量每年经过人口统计调整的州工资。我们的错误源于这样一个事实,即我们应该除以每个组中“工作”个人的总数,而不是每个组中个人的总数(无条件的工作状态)。本文的主要实证结果是对州一级新凯恩斯工资菲利普斯曲线的估计(表V,第5节)。主要的定量结果是在估计DSGE模型时纳入区域数据对总商业周期的影响(图4和5,第7节)。我们在下面更新这些结果。下面,我们给出了图1、图3、图3、图4、图5、附录A5-A6以及主论文的表1、表2、表4、表5、表6、表7、表8的更新结果。所有其他表格和数字不受我们更改的影响。
{"title":"Erratum: The Aggregate Implications of Regional Business Cycles","authors":"Martin Beraja, Erik Hurst, Juan Ospina","doi":"10.3982/ECTA23148","DOIUrl":"https://doi.org/10.3982/ECTA23148","url":null,"abstract":"<p><span>We thank Man Chon Iao</span>—a Ph.D. student at NYU—for bringing to our attention that we had a mistake in our code that generated the results in the published version of our paper. In this erratum, we: (1) discuss the mistake, (2) highlight the changes we made to our code in response to the mistake, and (3) reproduce all the relevant tables and figures of the paper after correcting the mistake. In particular, Section 2 of this erratum discusses the mistake, Section 3 updates the paper's core tables and figures, and Section 4 updates all remaining motivating and robustness tables and figures. Any table or figure we did not reproduce means the table/figure was unchanged compared to the original.</p><p>In summary, the magnitudes of the reported estimates change, although the qualitative results remain.</p><p>At the heart of the empirical component of our paper is the creation of state level wage measures during the period surrounding the Great Recession. When we initially made our composition adjusted state level wage measures, we summed over the wages for those working in each of our detailed demographic groups within each state for each year using repeated cross-sectional data from the American Community Survey. We then divided the total wages paid in each state-demographic group-year cell by the <i>total number of individuals</i> within each state-demographic group-year cell. This step produced a measure of the average wage for each demographic group in each state in each year. We then aggregated the state level demographic groups in each year—holding the group weights fixed at some initial time period level—to make our measure of demographically adjusted state wages in each year. Our mistake stems from the fact that we should have divided by the <i>total number of “working” individuals</i> within each group instead of the total number of individuals (unconditional on work status) within each group.</p><p>The main empirical result in the paper is the estimation of a state level New Keynesian Wage Phillips Curve (Table V, Section 5). The main quantitative results are the implications for aggregate business cycles of incorporating regional data when estimating a DSGE model (Figures 4 and 5, Section 7). We update these results below.</p><p>Below, we present the updated results for Figure 1, Figures 3, 3, 4, 5, Appendix A5–A6, and Tables I, II, and IV, V, VI, VII, VIII of the main paper. All other tables and figures are unaffected by our changes.</p>","PeriodicalId":50556,"journal":{"name":"Econometrica","volume":"93 5","pages":"1-14"},"PeriodicalIF":7.1,"publicationDate":"2025-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.3982/ECTA23148","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145101683","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Policymakers often test expensive new programs on relatively small samples. Formally incorporating informative Bayesian priors into impact evaluation offers the promise to learn more from these experiments. We evaluate a Colombian program for 200 firms which aimed to increase exporting. Priors were elicited from academics, policymakers, and firms. Contrary to these priors, frequentist estimation cannot reject null effects in 2019, and finds some negative impacts in 2020. For binary outcomes like whether firms export, frequentist estimates are relatively precise, and Bayesian posterior intervals update to overlap almost completely with standard confidence intervals. For outcomes like increasing export variety, where the priors align with the data, the value of these priors is seen in posterior intervals that are considerably narrower than the confidence intervals. Finally, for noisy outcomes like export value, posterior intervals show almost no updating from priors, highlighting how uninformative the data are about such outcomes. Future policy experiments could use these posteriors as priors in a Bayesian or empirical Bayesian analysis.
{"title":"Bayesian Impact Evaluation With Informative Priors: An Application to a Colombian Management and Export Improvement Program","authors":"Leonardo Iacovone, David McKenzie, Rachael Meager","doi":"10.3982/ECTA21567","DOIUrl":"https://doi.org/10.3982/ECTA21567","url":null,"abstract":"<p>Policymakers often test expensive new programs on relatively small samples. Formally incorporating informative Bayesian priors into impact evaluation offers the promise to learn more from these experiments. We evaluate a Colombian program for 200 firms which aimed to increase exporting. Priors were elicited from academics, policymakers, and firms. Contrary to these priors, frequentist estimation cannot reject null effects in 2019, and finds some negative impacts in 2020. For binary outcomes like whether firms export, frequentist estimates are relatively precise, and Bayesian posterior intervals update to overlap almost completely with standard confidence intervals. For outcomes like increasing export variety, where the priors align with the data, the value of these priors is seen in posterior intervals that are considerably narrower than the confidence intervals. Finally, for noisy outcomes like export value, posterior intervals show almost no updating from priors, highlighting how uninformative the data are about such outcomes. Future policy experiments could use these posteriors as priors in a Bayesian or empirical Bayesian analysis.</p>","PeriodicalId":50556,"journal":{"name":"Econometrica","volume":"93 5","pages":"1915-1935"},"PeriodicalIF":7.1,"publicationDate":"2025-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145101646","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Government debt can be rolled over forever without primary surpluses in some stochastic economies, including some economies that are dynamically efficient. In an overlapping-generations model with constant growth rate, g, of labor-augmenting productivity, and with shocks to the durability of capital, we show that along a balanced growth path, the maximum sustainable ratio of bonds to capital is attained when the risk-free interest rate, rf, equals g. Furthermore, this maximal ratio maximizes utility per capita along a balanced growth path and ensures that the economy is dynamically efficient.
{"title":"Running Primary Deficits Forever in a Dynamically Efficient Economy: Feasibility and Optimality","authors":"Andrew B. Abel, Stavros Panageas","doi":"10.3982/ECTA22749","DOIUrl":"https://doi.org/10.3982/ECTA22749","url":null,"abstract":"<p>Government debt can be rolled over forever without primary surpluses in some stochastic economies, including some economies that are dynamically efficient. In an overlapping-generations model with constant growth rate, <i>g</i>, of labor-augmenting productivity, and with shocks to the durability of capital, we show that along a balanced growth path, the maximum sustainable ratio of bonds to capital is attained when the risk-free interest rate, <i>r</i><sub><i>f</i></sub>, equals <i>g</i>. Furthermore, this maximal ratio maximizes utility per capita along a balanced growth path and ensures that the economy is dynamically efficient.</p>","PeriodicalId":50556,"journal":{"name":"Econometrica","volume":"93 5","pages":"1601-1633"},"PeriodicalIF":7.1,"publicationDate":"2025-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.3982/ECTA22749","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145101675","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Giorgio Chiovelli, Stelios Michalopoulos, Elias Papaioannou
Landmines affect the lives of millions in many conflict-ridden communities long after the end of hostilities. However, there is little research on the role of demining. We examine the economic consequences of landmine removal in Mozambique, the only country to transition from heavily contaminated in 1992 to mine-free in 2015. First, we present the self-assembled georeferenced catalog of areas suspected of contamination, along with a detailed record of demining operations. Second, the event-study analysis reveals a robust association between demining activities and subsequent local economic performance, reflected in luminosity. Economic activity does not pick up in the years leading up to clearance, nor does it increase when operators investigate areas mistakenly marked as contaminated in prior surveys. Third, recognizing that landmine removal reshapes transportation access, we use a market-access approach to explore direct and indirect effects. To advance on identification, we isolate changes in market access caused by removing landmines in previously considered safe areas, far from earlier nationwide surveys. Fourth, policy simulations reveal the substantial economywide dividends of clearance, but only when factoring in market-access effects, which dwarf direct productivity links. Additionally, policy counterfactuals uncover significant aggregate costs when demining does not prioritize the unblocking of transportation routes. These results offer insights into the design of demining programs in Ukraine and elsewhere, highlighting the need for centralized coordination and prioritization of areas facilitating commerce.
{"title":"Landmines and Spatial Development","authors":"Giorgio Chiovelli, Stelios Michalopoulos, Elias Papaioannou","doi":"10.3982/ECTA17951","DOIUrl":"https://doi.org/10.3982/ECTA17951","url":null,"abstract":"<p>Landmines affect the lives of millions in many conflict-ridden communities long after the end of hostilities. However, there is little research on the role of demining. We examine the economic consequences of landmine removal in Mozambique, the only country to transition from heavily contaminated in 1992 to mine-free in 2015. First, we present the self-assembled georeferenced catalog of areas suspected of contamination, along with a detailed record of demining operations. Second, the event-study analysis reveals a robust association between demining activities and subsequent local economic performance, reflected in luminosity. Economic activity does not pick up in the years leading up to clearance, nor does it increase when operators investigate areas mistakenly marked as contaminated in prior surveys. Third, recognizing that landmine removal reshapes transportation access, we use a market-access approach to explore direct and indirect effects. To advance on identification, we isolate changes in market access caused by removing landmines in previously considered safe areas, far from earlier nationwide surveys. Fourth, policy simulations reveal the substantial economywide dividends of clearance, but only when factoring in market-access effects, which dwarf direct productivity links. Additionally, policy counterfactuals uncover significant aggregate costs when demining does not prioritize the unblocking of transportation routes. These results offer insights into the design of demining programs in Ukraine and elsewhere, highlighting the need for centralized coordination and prioritization of areas facilitating commerce.</p>","PeriodicalId":50556,"journal":{"name":"Econometrica","volume":"93 5","pages":"1739-1778"},"PeriodicalIF":7.1,"publicationDate":"2025-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.3982/ECTA17951","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145101678","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
We develop and estimate a model of consumer search with spatial learning. Consumers make inferences from previously searched objects to unsearched objects that are nearby in attribute space, generating path dependence in search sequences. The estimated model rationalizes patterns in data on online consumer search paths: search tends to converge to the chosen product in attribute space, and consumers take larger steps away from rarely purchased products. Eliminating spatial learning reduces consumer welfare by 12%: cross-product inferences allow consumers to locate better products in a shorter time. Spatial learning has important implications for product recommendations on retail platforms. We show that consumer welfare can be reduced by unrepresentative product recommendations and that consumer-optimal product recommendations depend on both consumer learning and competition between platforms.
{"title":"You Can Lead a Horse to Water: Spatial Learning and Path Dependence in Consumer Search","authors":"Charles Hodgson, Gregory Lewis","doi":"10.3982/ECTA19576","DOIUrl":"https://doi.org/10.3982/ECTA19576","url":null,"abstract":"<p>We develop and estimate a model of consumer search with spatial learning. Consumers make inferences from previously searched objects to unsearched objects that are nearby in attribute space, generating path dependence in search sequences. The estimated model rationalizes patterns in data on online consumer search paths: search tends to converge to the chosen product in attribute space, and consumers take larger steps away from rarely purchased products. Eliminating spatial learning reduces consumer welfare by 12%: cross-product inferences allow consumers to locate better products in a shorter time. Spatial learning has important implications for product recommendations on retail platforms. We show that consumer welfare can be reduced by unrepresentative product recommendations and that consumer-optimal product recommendations depend on both consumer learning and competition between platforms.</p>","PeriodicalId":50556,"journal":{"name":"Econometrica","volume":"93 4","pages":"1299-1332"},"PeriodicalIF":7.1,"publicationDate":"2025-07-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144740149","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
We use the martingale construction of Luedtke and van der Laan (2016) to develop tests for the presence of treatment heterogeneity. The resulting sequential validation approach can be instantiated using various validation metrics, such as BLPs, GATES, QINI curves, etc., and provides an alternative to cross-validation-like cross-fold application of these metrics. This note was prepared as a comment on the Fisher–Schultz paper by Chernozhukov, Demirer, Duflo, and Fernández-Val, forthcoming in Econometrica.
我们使用Luedtke和van der Laan(2016)的鞅结构来开发治疗异质性存在的测试。由此产生的顺序验证方法可以使用各种验证指标(如blp、GATES、QINI曲线等)进行实例化,并为这些指标的交叉验证提供了一种替代方案。本文是对Chernozhukov、Demirer、Duflo和Fernández-Val发表在《计量经济学》上的Fisher-Schultz论文的评论。
{"title":"A Comment on: “Fisher–Schultz Lecture: Generic Machine Learning Inference on Heterogeneous Treatment Effects in Randomized Experiments, With an Application to Immunization in India” by Victor Chernozhukov, Mert Demirer, Esther Duflo, and Iván Fernández-Val","authors":"Stefan Wager","doi":"10.3982/ECTA23293","DOIUrl":"https://doi.org/10.3982/ECTA23293","url":null,"abstract":"<p>We use the martingale construction of Luedtke and van der Laan (2016) to develop tests for the presence of treatment heterogeneity. The resulting sequential validation approach can be instantiated using various validation metrics, such as BLPs, GATES, QINI curves, etc., and provides an alternative to cross-validation-like cross-fold application of these metrics. This note was prepared as a comment on the Fisher–Schultz paper by Chernozhukov, Demirer, Duflo, and Fernández-Val, forthcoming in Econometrica.</p>","PeriodicalId":50556,"journal":{"name":"Econometrica","volume":"93 4","pages":"1171-1176"},"PeriodicalIF":7.1,"publicationDate":"2025-07-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144740471","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}