{"title":"大学补救效果的外部有效性:模糊--不连续设计中有关异常值的注意事项","authors":"Lucy Cordes, Patrick McEwan, Akila Weerapana","doi":"10.1162/edfp_a_00426","DOIUrl":null,"url":null,"abstract":"\n Fuzzy regression-discontinuity evaluations of college remediation often find negative and null estimates of local average treatments effects (LATEs), but with substantial heterogeneity. We find that a remedial quantitative skills course at Wellesley College has a modestly positive LATE on participation in STEEM courses. Yet, LATEs are a weighted average of average causal effects (at the passing cutoff) in two principal strata: students who voluntarily comply with remediation, and those who are coerced to comply after scoring below the cutoff on an optional retest. In the retest sample, we show that average causal effects are close to zero among (1) coerced compliers, and (2) never-takers. By implication, there are even larger effects among a smaller group of voluntary compliers at the cutoff. The results help interpret the mixed findings in the literature—in which compliance varies widely—and demonstrate methods for assessing external validity in fuzzy-discontinuity designs.","PeriodicalId":46870,"journal":{"name":"Education Finance and Policy","volume":null,"pages":null},"PeriodicalIF":1.7000,"publicationDate":"2024-02-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The External Validity of College Remediation Effects: Caveats about Compliers in Fuzzy-Discontinuity Designs\",\"authors\":\"Lucy Cordes, Patrick McEwan, Akila Weerapana\",\"doi\":\"10.1162/edfp_a_00426\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"\\n Fuzzy regression-discontinuity evaluations of college remediation often find negative and null estimates of local average treatments effects (LATEs), but with substantial heterogeneity. We find that a remedial quantitative skills course at Wellesley College has a modestly positive LATE on participation in STEEM courses. Yet, LATEs are a weighted average of average causal effects (at the passing cutoff) in two principal strata: students who voluntarily comply with remediation, and those who are coerced to comply after scoring below the cutoff on an optional retest. In the retest sample, we show that average causal effects are close to zero among (1) coerced compliers, and (2) never-takers. By implication, there are even larger effects among a smaller group of voluntary compliers at the cutoff. The results help interpret the mixed findings in the literature—in which compliance varies widely—and demonstrate methods for assessing external validity in fuzzy-discontinuity designs.\",\"PeriodicalId\":46870,\"journal\":{\"name\":\"Education Finance and Policy\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.7000,\"publicationDate\":\"2024-02-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Education Finance and Policy\",\"FirstCategoryId\":\"95\",\"ListUrlMain\":\"https://doi.org/10.1162/edfp_a_00426\",\"RegionNum\":3,\"RegionCategory\":\"教育学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ECONOMICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Education Finance and Policy","FirstCategoryId":"95","ListUrlMain":"https://doi.org/10.1162/edfp_a_00426","RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ECONOMICS","Score":null,"Total":0}
引用次数: 0
摘要
对大学补习课程进行模糊回归-不连续评估时,经常会发现局部平均治疗效果(LATE)的估计值为负或为零,但存在很大的异质性。我们发现,韦尔斯利学院的定量技能补习课程对参加 STEEM 课程的 LATE 有适度的正向影响。然而,LATEs 是平均因果效应(在及格线上)在两个主要阶层的加权平均值:自愿接受补习的学生和在可选重测中得分低于及格线而被迫接受补习的学生。在重测样本中,我们发现以下两类学生的平均因果效应接近于零:(1) 被迫接受补习的学生;(2) 从未接受补习的学生。这意味着,在截止日期的一小部分自愿服从者中,因果效应甚至更大。这些结果有助于解释文献中参差不齐的研究结果--遵守情况差异很大--并展示了在模糊不连续设计中评估外部有效性的方法。
The External Validity of College Remediation Effects: Caveats about Compliers in Fuzzy-Discontinuity Designs
Fuzzy regression-discontinuity evaluations of college remediation often find negative and null estimates of local average treatments effects (LATEs), but with substantial heterogeneity. We find that a remedial quantitative skills course at Wellesley College has a modestly positive LATE on participation in STEEM courses. Yet, LATEs are a weighted average of average causal effects (at the passing cutoff) in two principal strata: students who voluntarily comply with remediation, and those who are coerced to comply after scoring below the cutoff on an optional retest. In the retest sample, we show that average causal effects are close to zero among (1) coerced compliers, and (2) never-takers. By implication, there are even larger effects among a smaller group of voluntary compliers at the cutoff. The results help interpret the mixed findings in the literature—in which compliance varies widely—and demonstrate methods for assessing external validity in fuzzy-discontinuity designs.