{"title":"谨慎预测:平行趋势测试后的事件研究估计","authors":"J. Roth","doi":"10.1257/aeri.20210236","DOIUrl":null,"url":null,"abstract":"This paper discusses two important limitations of the common practice of testing for preexisting differences in trends (“ pre-trends”) when using difference-in-differences and related methods. First, conventional pre-trends tests may have low power. Second, conditioning the analysis on the result of a pretest can distort estimation and inference, potentially exacerbating the bias of point estimates and under-coverage of confidence intervals. I analyze these issues both in theory and in simulations calibrated to a survey of recent papers in leading economics journals, which suggest that these limitations are important in practice. I conclude with practical recommendations for mitigating these issues. (JEL A14, C23, C51)","PeriodicalId":29954,"journal":{"name":"American Economic Review-Insights","volume":"1 1","pages":""},"PeriodicalIF":8.1000,"publicationDate":"2022-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"212","resultStr":"{\"title\":\"Pretest with Caution: Event-Study Estimates after Testing for Parallel Trends\",\"authors\":\"J. Roth\",\"doi\":\"10.1257/aeri.20210236\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This paper discusses two important limitations of the common practice of testing for preexisting differences in trends (“ pre-trends”) when using difference-in-differences and related methods. First, conventional pre-trends tests may have low power. Second, conditioning the analysis on the result of a pretest can distort estimation and inference, potentially exacerbating the bias of point estimates and under-coverage of confidence intervals. I analyze these issues both in theory and in simulations calibrated to a survey of recent papers in leading economics journals, which suggest that these limitations are important in practice. I conclude with practical recommendations for mitigating these issues. (JEL A14, C23, C51)\",\"PeriodicalId\":29954,\"journal\":{\"name\":\"American Economic Review-Insights\",\"volume\":\"1 1\",\"pages\":\"\"},\"PeriodicalIF\":8.1000,\"publicationDate\":\"2022-09-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"212\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"American Economic Review-Insights\",\"FirstCategoryId\":\"96\",\"ListUrlMain\":\"https://doi.org/10.1257/aeri.20210236\",\"RegionNum\":1,\"RegionCategory\":\"经济学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ECONOMICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"American Economic Review-Insights","FirstCategoryId":"96","ListUrlMain":"https://doi.org/10.1257/aeri.20210236","RegionNum":1,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ECONOMICS","Score":null,"Total":0}
Pretest with Caution: Event-Study Estimates after Testing for Parallel Trends
This paper discusses two important limitations of the common practice of testing for preexisting differences in trends (“ pre-trends”) when using difference-in-differences and related methods. First, conventional pre-trends tests may have low power. Second, conditioning the analysis on the result of a pretest can distort estimation and inference, potentially exacerbating the bias of point estimates and under-coverage of confidence intervals. I analyze these issues both in theory and in simulations calibrated to a survey of recent papers in leading economics journals, which suggest that these limitations are important in practice. I conclude with practical recommendations for mitigating these issues. (JEL A14, C23, C51)
期刊介绍:
The journal American Economic Review: Insights (AER: Insights) is a publication that caters to a wide audience interested in economics. It shares the same standards of quality and significance as the American Economic Review (AER) but focuses specifically on papers that offer important insights communicated concisely. AER: Insights releases four issues annually, covering a diverse range of topics in economics.