Pub Date : 2022-10-03DOI: 10.3102/01623737221120578
L. Mayger
Recognizing the need for scientific fidelity and balanced representation in the evidence that informs public policy, this study investigates technical and issue bias in 43 policy briefs and state handbooks that provided information about the use of Student Learning Objectives to evaluate teachers’ performance. The author uses multiple qualitative methods to categorize the contributors to the focal documents, identify the evidence they drew upon, and determine how they represented the information to their targeted audiences. The study reinforces the findings of prior research by documenting the outsized impact of advocacy groups in a policy-related evidence base. The results make an important addition to the scholarly literature by cataloging an array of technical assistance providers that translated and disseminated evidence to decision makers and spotlighting the various ways biased information appeared in the publications. Throughout, the study reinforces how incentives and timing shape evidence production and use in policymaking.
{"title":"Evaluating Technical and Issue Bias in Teacher Evaluation Policy Briefs and State Handbooks","authors":"L. Mayger","doi":"10.3102/01623737221120578","DOIUrl":"https://doi.org/10.3102/01623737221120578","url":null,"abstract":"Recognizing the need for scientific fidelity and balanced representation in the evidence that informs public policy, this study investigates technical and issue bias in 43 policy briefs and state handbooks that provided information about the use of Student Learning Objectives to evaluate teachers’ performance. The author uses multiple qualitative methods to categorize the contributors to the focal documents, identify the evidence they drew upon, and determine how they represented the information to their targeted audiences. The study reinforces the findings of prior research by documenting the outsized impact of advocacy groups in a policy-related evidence base. The results make an important addition to the scholarly literature by cataloging an array of technical assistance providers that translated and disseminated evidence to decision makers and spotlighting the various ways biased information appeared in the publications. Throughout, the study reinforces how incentives and timing shape evidence production and use in policymaking.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":"45 1","pages":"336 - 364"},"PeriodicalIF":3.4,"publicationDate":"2022-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43112707","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-08-29DOI: 10.3102/01623737221111800
Tasminda K. Dhaliwal, Ijun Lai, Katharine O. Strunk
Research on teacher churn has produced conflicting conclusions as to its impact on students and teachers. We bring clarity to this work by combining and expanding on analytical approaches used in earlier research to determine how and when different types of churn (i.e., grade, school) impact teacher effectiveness and attendance. Using data from the Los Angeles Unified School District, our results suggest differences based on analytical approach but ultimately show that changing schools and grades may be less of an issue than previously reported. In addition, in the case of school churn, a beneficial match in their new school sites may matter more for teacher outcomes than potential disruptive effects of churn. We conclude with implications for policy and future research.
{"title":"Round and Round They Go: The Relationship Between Changing Grades and Schools and Teacher Quality and Absence Rates","authors":"Tasminda K. Dhaliwal, Ijun Lai, Katharine O. Strunk","doi":"10.3102/01623737221111800","DOIUrl":"https://doi.org/10.3102/01623737221111800","url":null,"abstract":"Research on teacher churn has produced conflicting conclusions as to its impact on students and teachers. We bring clarity to this work by combining and expanding on analytical approaches used in earlier research to determine how and when different types of churn (i.e., grade, school) impact teacher effectiveness and attendance. Using data from the Los Angeles Unified School District, our results suggest differences based on analytical approach but ultimately show that changing schools and grades may be less of an issue than previously reported. In addition, in the case of school churn, a beneficial match in their new school sites may matter more for teacher outcomes than potential disruptive effects of churn. We conclude with implications for policy and future research.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":"45 1","pages":"285 - 310"},"PeriodicalIF":3.4,"publicationDate":"2022-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44786857","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-08-22DOI: 10.3102/01623737221113576
Kathrin Albrecht, L. Nielsen, Lydia Wuorinen
Colleges and universities are legally required to attempt to prevent and redress sexual violations on campus. Neo-institutional theory suggests that the implementation of law by compliance professionals rarely achieves law’s goals. It is critical in claims-based systems that those who are potential claimants understand the law. This article demonstrates that (a) intended subjects of the law (colleges and universities) interpret and frame the law in very similar ways; (b) resultant policies are complex and difficult to navigate; and (c) university undergraduates in an experimental setting are not able to comprehend the Title IX policies designed to protect them. These findings suggest that current implementations of Title IX policies leave them structurally ineffective to combat sexual assaults on campus.
{"title":"Misunderstanding Law: Undergraduates’ Analysis of Campus Title IX Policies","authors":"Kathrin Albrecht, L. Nielsen, Lydia Wuorinen","doi":"10.3102/01623737221113576","DOIUrl":"https://doi.org/10.3102/01623737221113576","url":null,"abstract":"Colleges and universities are legally required to attempt to prevent and redress sexual violations on campus. Neo-institutional theory suggests that the implementation of law by compliance professionals rarely achieves law’s goals. It is critical in claims-based systems that those who are potential claimants understand the law. This article demonstrates that (a) intended subjects of the law (colleges and universities) interpret and frame the law in very similar ways; (b) resultant policies are complex and difficult to navigate; and (c) university undergraduates in an experimental setting are not able to comprehend the Title IX policies designed to protect them. These findings suggest that current implementations of Title IX policies leave them structurally ineffective to combat sexual assaults on campus.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":"45 1","pages":"247 - 267"},"PeriodicalIF":3.4,"publicationDate":"2022-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47422134","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-08-22DOI: 10.3102/01623737221111807
Adam Kho, G. Henry, L. D. Pham, R. Zimmer
Many districts and states have implemented incentives to recruit teachers to low-performing schools, and previous research has found evidence that these incentives are effective at attracting teachers. However, effects on the schools and students these teachers leave behind have not been examined. This study focuses on the spillover effects of recruiting effective teachers to Tennessee’s Innovation Zone (iZone) schools. We find the short-term effects of losing these teachers range from −0.04 to −0.12 SDs in student test score gains, with larger negative effects when more effective teachers leave. However, combining both these negative effects in schools teachers leave and the positive effects in iZone schools yields overall net positive effects.
{"title":"Spillover Effects of Recruiting Teachers for School Turnaround: Evidence From Tennessee","authors":"Adam Kho, G. Henry, L. D. Pham, R. Zimmer","doi":"10.3102/01623737221111807","DOIUrl":"https://doi.org/10.3102/01623737221111807","url":null,"abstract":"Many districts and states have implemented incentives to recruit teachers to low-performing schools, and previous research has found evidence that these incentives are effective at attracting teachers. However, effects on the schools and students these teachers leave behind have not been examined. This study focuses on the spillover effects of recruiting effective teachers to Tennessee’s Innovation Zone (iZone) schools. We find the short-term effects of losing these teachers range from −0.04 to −0.12 SDs in student test score gains, with larger negative effects when more effective teachers leave. However, combining both these negative effects in schools teachers leave and the positive effects in iZone schools yields overall net positive effects.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":"45 1","pages":"268 - 284"},"PeriodicalIF":3.4,"publicationDate":"2022-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45463418","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-08-22DOI: 10.3102/01623737221113575
T. Dee, S. Loeb, Ying Shi
Philanthropic initiatives incorporating prescriptive practices have become prominent in K–12 education. This study provides evidence on the reach, character, and impact of the Broad Superintendents Academy, a controversial initiative designed to transform district leadership. A novel data set on Broad trainees linked to data on large districts over 20 years shows that Broad superintendents have had extensive reach, serving nearly 3 million students at their peak, and that, for districts that hired Broad trainees, Broad superintendents were 40% more likely to be Black than non-Broad superintendents, although they had significantly shorter tenures. Estimates provide evidence that Broad-trained leaders had little effect on several district outcomes including enrollment, spending, and student completion. However, they initiated a trend toward increased charter school enrollment.
{"title":"Public-Sector Leadership and Philanthropy: The Case of Broad Superintendents","authors":"T. Dee, S. Loeb, Ying Shi","doi":"10.3102/01623737221113575","DOIUrl":"https://doi.org/10.3102/01623737221113575","url":null,"abstract":"Philanthropic initiatives incorporating prescriptive practices have become prominent in K–12 education. This study provides evidence on the reach, character, and impact of the Broad Superintendents Academy, a controversial initiative designed to transform district leadership. A novel data set on Broad trainees linked to data on large districts over 20 years shows that Broad superintendents have had extensive reach, serving nearly 3 million students at their peak, and that, for districts that hired Broad trainees, Broad superintendents were 40% more likely to be Black than non-Broad superintendents, although they had significantly shorter tenures. Estimates provide evidence that Broad-trained leaders had little effect on several district outcomes including enrollment, spending, and student completion. However, they initiated a trend toward increased charter school enrollment.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":"45 1","pages":"220 - 246"},"PeriodicalIF":3.4,"publicationDate":"2022-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45818825","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-08-15DOI: 10.3102/01623737221111403
Lindsay C. Page, Bruce I. Sacerdote, Sara Goldrick-Rab, Benjamin L. Castleman
Despite high prices, many college students do not re-file the Free Application for Federal Student Aid (FAFSA) or file late, making college less affordable. Low-cost technological interventions delivering personalized information and/or advising may improve refiling and academic outcomes, but questions remain regarding the efficacy of this approach at scale. This multi-pronged randomized experiment tested informational and framing text message interventions for a national sample of approximately 10,000 undergraduates. The text outreach caused earlier FAFSA re-filing for some students. However, gains in re-filing during the active intervention period were not sustained after the intervention concluded and did not translate into additional federal financial aid or improved postsecondary persistence or attainment. Implications for the scaling and targeting of nudging are discussed.
{"title":"Financial Aid Nudges: A National Experiment With Informational Interventions","authors":"Lindsay C. Page, Bruce I. Sacerdote, Sara Goldrick-Rab, Benjamin L. Castleman","doi":"10.3102/01623737221111403","DOIUrl":"https://doi.org/10.3102/01623737221111403","url":null,"abstract":"Despite high prices, many college students do not re-file the Free Application for Federal Student Aid (FAFSA) or file late, making college less affordable. Low-cost technological interventions delivering personalized information and/or advising may improve refiling and academic outcomes, but questions remain regarding the efficacy of this approach at scale. This multi-pronged randomized experiment tested informational and framing text message interventions for a national sample of approximately 10,000 undergraduates. The text outreach caused earlier FAFSA re-filing for some students. However, gains in re-filing during the active intervention period were not sustained after the intervention concluded and did not translate into additional federal financial aid or improved postsecondary persistence or attainment. Implications for the scaling and targeting of nudging are discussed.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":"45 1","pages":"195 - 219"},"PeriodicalIF":3.4,"publicationDate":"2022-08-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46364394","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-08-15DOI: 10.3102/01623737221103842
Walter G. Ecton, Shaun Dougherty
High school Career and Technical Education (CTE) has received increased attention from policymakers and researchers in recent years. This study fills a needed gap in the growing research base by examining heterogeneity within the wide range of programs falling under the broad moniker of CTE, highlighting the need for nuance in research and policy conversations that often consider CTE as monolithic. Using student-level course-taking records, unemployment insurance, and National Student Clearinghouse data, we examine outcomes including earnings, postsecondary education, and poverty avoidance. We find substantial differences for students in fields as diverse as health care, Information Technology (IT), and construction. We also highlight heterogeneity for student populations historically overrepresented in CTE, and we find large differences in outcomes for CTE students, particularly by gender.
{"title":"Heterogeneity in High School Career and Technical Education Outcomes","authors":"Walter G. Ecton, Shaun Dougherty","doi":"10.3102/01623737221103842","DOIUrl":"https://doi.org/10.3102/01623737221103842","url":null,"abstract":"High school Career and Technical Education (CTE) has received increased attention from policymakers and researchers in recent years. This study fills a needed gap in the growing research base by examining heterogeneity within the wide range of programs falling under the broad moniker of CTE, highlighting the need for nuance in research and policy conversations that often consider CTE as monolithic. Using student-level course-taking records, unemployment insurance, and National Student Clearinghouse data, we examine outcomes including earnings, postsecondary education, and poverty avoidance. We find substantial differences for students in fields as diverse as health care, Information Technology (IT), and construction. We also highlight heterogeneity for student populations historically overrepresented in CTE, and we find large differences in outcomes for CTE students, particularly by gender.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":"45 1","pages":"157 - 181"},"PeriodicalIF":3.4,"publicationDate":"2022-08-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41633726","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-07-18DOI: 10.3102/01623737221107928
Jesse Margolis, Daniel Dench, Shirin Hashim
New York City’s school system is among the most diverse and segregated in the United States. Using difference-in-differences and placebo tests, we evaluate two desegregation policies in two geographic districts in New York City, District 3 and District 15. Both districts attempted to lower economic segregation within their district while maintaining school choice, prioritizing economically disadvantaged students for middle school seats in advance of the 2019–2020 school year. District 15, however, set more ambitious prioritization targets and also chose to eliminate academic screens from all middle schools. We find that District 15’s policy lowered economic segregation in sixth grade by 55% and racial segregation by 38%, while District 3’s policy led to no significant change in segregation.
{"title":"Economic and Racial Integration Through School Choice in New York City","authors":"Jesse Margolis, Daniel Dench, Shirin Hashim","doi":"10.3102/01623737221107928","DOIUrl":"https://doi.org/10.3102/01623737221107928","url":null,"abstract":"New York City’s school system is among the most diverse and segregated in the United States. Using difference-in-differences and placebo tests, we evaluate two desegregation policies in two geographic districts in New York City, District 3 and District 15. Both districts attempted to lower economic segregation within their district while maintaining school choice, prioritizing economically disadvantaged students for middle school seats in advance of the 2019–2020 school year. District 15, however, set more ambitious prioritization targets and also chose to eliminate academic screens from all middle schools. We find that District 15’s policy lowered economic segregation in sixth grade by 55% and racial segregation by 38%, while District 3’s policy led to no significant change in segregation.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":"45 1","pages":"182 - 190"},"PeriodicalIF":3.4,"publicationDate":"2022-07-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44185847","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-07-11DOI: 10.3102/01623737221093374
N. Honey, Alejandro Carrasco
Chile is known for universal school choice policies and a high level of economic segregation. In part, segregation has been linked to selective school admission policies. Chile implemented a centralized school admission system (New School Admission System), where PK–12 schools must accept any applicant, and lottery assignment is used for oversubscription. We exploit a natural experiment due to the phased implementation across grades and regions to attempt to detect any effects of this policy on access for and representation of low-income students using grade-within-school and year fixed effects. Eliminating admissions barriers may contribute to increased educational opportunity, but the impact may be limited by the multiple structural factors shaping inequality in Chile. We find little short-term change in access for low-income students.
{"title":"A New Admission System in Chile and Its Foreseen Moderate Impact on Access for Low-Income Students","authors":"N. Honey, Alejandro Carrasco","doi":"10.3102/01623737221093374","DOIUrl":"https://doi.org/10.3102/01623737221093374","url":null,"abstract":"Chile is known for universal school choice policies and a high level of economic segregation. In part, segregation has been linked to selective school admission policies. Chile implemented a centralized school admission system (New School Admission System), where PK–12 schools must accept any applicant, and lottery assignment is used for oversubscription. We exploit a natural experiment due to the phased implementation across grades and regions to attempt to detect any effects of this policy on access for and representation of low-income students using grade-within-school and year fixed effects. Eliminating admissions barriers may contribute to increased educational opportunity, but the impact may be limited by the multiple structural factors shaping inequality in Chile. We find little short-term change in access for low-income students.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":"45 1","pages":"108 - 133"},"PeriodicalIF":3.4,"publicationDate":"2022-07-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48326329","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-07-04DOI: 10.3102/01623737221090264
Terry-Ann L Craigie
In Rhode Island, out-of-school suspensions were excessively and disproportionately used to penalize low-level infractions. To address this problem, the Rhode Island General Assembly passed legislation, effective May 2012, prohibiting out-of-school suspensions for attendance-specific infractions. Four years later, the Assembly passed additional legislation to curb out-of-school suspensions for disruption-specific infractions. This study examines the impact of these suspension reforms on out-of-school suspension outcomes for treatment infractions and corresponding racial-ethnic disparities. To execute the analyses, the study uses student-level administrative data (AY 2009–2010 to AY 2017–2018) from the Rhode Island Department of Education, along with quasi-experimental estimation. The study finds that only the first reform lowers out-of-school suspension outcomes for attendance-specific infractions and corresponding racial-ethnic disparities.
在罗德岛州，校外停学被过度和不成比例地用于惩罚轻度违规行为。为了解决这个问题，罗德岛州议会(Rhode Island General Assembly)通过了一项立法，禁止因出勤违规而进行校外停学，该立法于2012年5月生效。四年后，议会通过了额外的立法，以遏制因扰乱社会秩序而被停学的行为。本研究考察了这些停学改革对治疗违规的校外停学结果和相应的种族-民族差异的影响。为了进行分析，该研究使用了罗德岛教育部的学生级行政数据(2009-2010年至2017-2018年)以及准实验估计。研究发现，只有第一项改革降低了因出勤违规而被停学的结果和相应的种族-民族差异。
{"title":"Do School Suspension Reforms Work? Evidence From Rhode Island","authors":"Terry-Ann L Craigie","doi":"10.3102/01623737221090264","DOIUrl":"https://doi.org/10.3102/01623737221090264","url":null,"abstract":"In Rhode Island, out-of-school suspensions were excessively and disproportionately used to penalize low-level infractions. To address this problem, the Rhode Island General Assembly passed legislation, effective May 2012, prohibiting out-of-school suspensions for attendance-specific infractions. Four years later, the Assembly passed additional legislation to curb out-of-school suspensions for disruption-specific infractions. This study examines the impact of these suspension reforms on out-of-school suspension outcomes for treatment infractions and corresponding racial-ethnic disparities. To execute the analyses, the study uses student-level administrative data (AY 2009–2010 to AY 2017–2018) from the Rhode Island Department of Education, along with quasi-experimental estimation. The study finds that only the first reform lowers out-of-school suspension outcomes for attendance-specific infractions and corresponding racial-ethnic disparities.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":"44 1","pages":"667 - 688"},"PeriodicalIF":3.4,"publicationDate":"2022-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43427761","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：