In this article, we explore whether the evaluation instruments used in the teacher selection process in Peru are good predictors of teacher effectiveness. To this end, we estimate teacher value-added (TVA) measures for public primary school teachers and test their relationship with Peru’s results of two rounds of the teacher evaluation (i.e., a centralized national stage and a decentralized stage performed at the school level). Our findings indicate that among the instruments that comprise the national stage of the process, the logical reasoning and curricular and pedagogical knowledge subtests have the strongest relationship with the TVA measure, while the weakest relationship is found with the reading comprehension component. Also, we find that the weighted aggregate score has a higher relationship with estimated TVA than the specific subtests. At the school-level stage, we find no significant relationships with our measures of TVA for math, as well as a nonrobust relationship for the classroom observation and interview evaluation instruments for reading. Moreover, we find relationships between our TVA measure and several teacher characteristics: TVA is higher for female teachers and for those at higher salary levels while it is lower for teachers with temporary contracts. These results provide lessons for the design and implementation of evaluation instruments in teacher hiring processes around the world.
{"title":"Teacher Selection Instruments and Teacher Value-Added: Evidence From Peru","authors":"Eleonora Bertoni, Gregory Elacqua, Carolina Méndez, Humberto Santos","doi":"10.3102/01623737221149417","DOIUrl":"https://doi.org/10.3102/01623737221149417","url":null,"abstract":"In this article, we explore whether the evaluation instruments used in the teacher selection process in Peru are good predictors of teacher effectiveness. To this end, we estimate teacher value-added (TVA) measures for public primary school teachers and test their relationship with Peru’s results of two rounds of the teacher evaluation (i.e., a centralized national stage and a decentralized stage performed at the school level). Our findings indicate that among the instruments that comprise the national stage of the process, the logical reasoning and curricular and pedagogical knowledge subtests have the strongest relationship with the TVA measure, while the weakest relationship is found with the reading comprehension component. Also, we find that the weighted aggregate score has a higher relationship with estimated TVA than the specific subtests. At the school-level stage, we find no significant relationships with our measures of TVA for math, as well as a nonrobust relationship for the classroom observation and interview evaluation instruments for reading. Moreover, we find relationships between our TVA measure and several teacher characteristics: TVA is higher for female teachers and for those at higher salary levels while it is lower for teachers with temporary contracts. These results provide lessons for the design and implementation of evaluation instruments in teacher hiring processes around the world.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":" ","pages":""},"PeriodicalIF":3.4,"publicationDate":"2023-02-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47197177","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-02-13DOI: 10.3102/01623737221144320
Ilana M. Umansky, Manuel Vazquez Cano, Lorna M. Porter
Federal law defines eligibility for English learner (EL) classification differently for Indigenous students compared with non-Indigenous students. To be EL-eligible, non-Indigenous students are required to have a non-English primary language. Indigenous students, by contrast, can be English-dominant or English monolingual. A critical question, therefore, is how EL classification impacts Indigenous students’ educational outcomes. This study explores this question for Alaska Native students, drawing on data from five Alaska school districts. Using a regression discontinuity design, we find preliminary evidence that among students who score near the EL classification threshold in kindergarten, EL classification has a large negative impact on Alaska Native students’ academic outcomes in the third and fourth grades. Negative impacts are not found for non–Alaska Native students.
{"title":"Resource for Self-Determination or Perpetuation of Linguistic Imposition: Effects of English Learner Classification Among Alaska Native Students*","authors":"Ilana M. Umansky, Manuel Vazquez Cano, Lorna M. Porter","doi":"10.3102/01623737221144320","DOIUrl":"https://doi.org/10.3102/01623737221144320","url":null,"abstract":"Federal law defines eligibility for English learner (EL) classification differently for Indigenous students compared with non-Indigenous students. To be EL-eligible, non-Indigenous students are required to have a non-English primary language. Indigenous students, by contrast, can be English-dominant or English monolingual. A critical question, therefore, is how EL classification impacts Indigenous students’ educational outcomes. This study explores this question for Alaska Native students, drawing on data from five Alaska school districts. Using a regression discontinuity design, we find preliminary evidence that among students who score near the EL classification threshold in kindergarten, EL classification has a large negative impact on Alaska Native students’ academic outcomes in the third and fourth grades. Negative impacts are not found for non–Alaska Native students.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":" ","pages":""},"PeriodicalIF":3.4,"publicationDate":"2023-02-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43410277","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-02-13DOI: 10.3102/01623737221137903
Kari Dalane, Dave E. Marcotte
The share of students attending charter schools has been rising. There is evidence that charter school growth has increased socioeconomic segregation of students between schools. In this paper, we assess whether charter school growth affects how students are organized within nearby traditional public schools (TPS). We use administrative data from North Carolina to estimate the impact of charter school openings on segregation by income within nearby TPS. Our models exploit variation in the presence and location of charter schools over time between 2007 and 2014 for students in Grades 3 to 8. We find limited evidence that the segregation of students by income at the classroom level increases when charters open nearby. We find some evidence of increasing segregation in third grade and fourth grade math and third grade ELA classrooms at TPS within 2 miles of new charters in large urban districts schools. Our results vary somewhat depending on how we control for underlying trends and measure segregation. We find no effect of charter school growth on income segregation in higher grades.
{"title":"Charter Schools and the Segregation of Students by Income","authors":"Kari Dalane, Dave E. Marcotte","doi":"10.3102/01623737221137903","DOIUrl":"https://doi.org/10.3102/01623737221137903","url":null,"abstract":"The share of students attending charter schools has been rising. There is evidence that charter school growth has increased socioeconomic segregation of students between schools. In this paper, we assess whether charter school growth affects how students are organized within nearby traditional public schools (TPS). We use administrative data from North Carolina to estimate the impact of charter school openings on segregation by income within nearby TPS. Our models exploit variation in the presence and location of charter schools over time between 2007 and 2014 for students in Grades 3 to 8. We find limited evidence that the segregation of students by income at the classroom level increases when charters open nearby. We find some evidence of increasing segregation in third grade and fourth grade math and third grade ELA classrooms at TPS within 2 miles of new charters in large urban districts schools. Our results vary somewhat depending on how we control for underlying trends and measure segregation. We find no effect of charter school growth on income segregation in higher grades.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-02-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135901840","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-01-30DOI: 10.3102/01623737221141415
Jason Burns, Erica Harbatkin, Katharine O. Strunk, Chris Torres, Aliyah Mcilwain, Sandy Frost Waldron
The recent Every Student Succeeds Act (ESSA) requires states to identify and turn around their lowest performing schools, but it breaks somewhat from prior policies by granting states significant autonomy over how they identify and turn around these schools. This mixed-methods study, which draws on administrative, qualitative, and survey data, examines the effectiveness of Michigan’s approach to school turnaround under ESSA. We find that students in turnaround schools experienced significant achievement gains in math and to a lesser extent in English language arts (ELA), with effects concentrated among the lowest achieving students. Analyses of qualitative and survey data suggest that these outcomes were influenced by state-level supports, strategic planning, the threat of accountability for continued low performance, and improved leadership quality in turnaround schools.
{"title":"The Efficacy and Implementation of Michigan’s Partnership Model of School and District Turnaround: Mixed-Methods Evidence From the First 2 Years of Reform Implementation","authors":"Jason Burns, Erica Harbatkin, Katharine O. Strunk, Chris Torres, Aliyah Mcilwain, Sandy Frost Waldron","doi":"10.3102/01623737221141415","DOIUrl":"https://doi.org/10.3102/01623737221141415","url":null,"abstract":"The recent Every Student Succeeds Act (ESSA) requires states to identify and turn around their lowest performing schools, but it breaks somewhat from prior policies by granting states significant autonomy over how they identify and turn around these schools. This mixed-methods study, which draws on administrative, qualitative, and survey data, examines the effectiveness of Michigan’s approach to school turnaround under ESSA. We find that students in turnaround schools experienced significant achievement gains in math and to a lesser extent in English language arts (ELA), with effects concentrated among the lowest achieving students. Analyses of qualitative and survey data suggest that these outcomes were influenced by state-level supports, strategic planning, the threat of accountability for continued low performance, and improved leadership quality in turnaround schools.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":" ","pages":""},"PeriodicalIF":3.4,"publicationDate":"2023-01-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48741382","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-01-20DOI: 10.3102/01623737221134528
Douglas N. Harris, Matthew F. Larsen
Prior research suggests that families prefer schools with higher test scores, shorter distances from home, and certain student demographics. We build on this using data from New Orleans, a context well suited to identification of parent preferences because of its deferred acceptance algorithm and extensive, standardized, and broadly accessible school information. This allows us to study revealed preferences for a richer set of characteristics. We find that families prefer schools with higher school value-added, more extracurricular activities, and after-school childcare. We also find heterogeneity by family income that is more consistent with income constraints than preference heterogeneity. Finally, we show how methodology and data shape the results.
{"title":"What Schools Do Families Want (and Why)? Evidence on Revealed Preferences From New Orleans","authors":"Douglas N. Harris, Matthew F. Larsen","doi":"10.3102/01623737221134528","DOIUrl":"https://doi.org/10.3102/01623737221134528","url":null,"abstract":"Prior research suggests that families prefer schools with higher test scores, shorter distances from home, and certain student demographics. We build on this using data from New Orleans, a context well suited to identification of parent preferences because of its deferred acceptance algorithm and extensive, standardized, and broadly accessible school information. This allows us to study revealed preferences for a richer set of characteristics. We find that families prefer schools with higher school value-added, more extracurricular activities, and after-school childcare. We also find heterogeneity by family income that is more consistent with income constraints than preference heterogeneity. Finally, we show how methodology and data shape the results.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":"45 1","pages":"496 - 519"},"PeriodicalIF":3.4,"publicationDate":"2023-01-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46253023","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-01-16DOI: 10.3102/01623737221143133
D. Oliver
The role of racial diversity at colleges has been debated for over more than a half a century with limited quasi-experimental evidence from classrooms. To fill this void, I estimate the extent that classmate racial compositions affect Hispanic and African American students at a large and oversubscribed California community college where they are minorities. I find that when minority students are exposed to a greater share of same-race classmates, they are more likely to complete the class with a pass and are more likely to enroll in a same-subject course the subsequent term. The findings are robust to first-time students with the lowest registration priority versus all students and different combinations of fixed effects (e.g., student, class, and instructor race).
{"title":"Underrepresented Minority Students in College: The Role of Classmates","authors":"D. Oliver","doi":"10.3102/01623737221143133","DOIUrl":"https://doi.org/10.3102/01623737221143133","url":null,"abstract":"The role of racial diversity at colleges has been debated for over more than a half a century with limited quasi-experimental evidence from classrooms. To fill this void, I estimate the extent that classmate racial compositions affect Hispanic and African American students at a large and oversubscribed California community college where they are minorities. I find that when minority students are exposed to a greater share of same-race classmates, they are more likely to complete the class with a pass and are more likely to enroll in a same-subject course the subsequent term. The findings are robust to first-time students with the lowest registration priority versus all students and different combinations of fixed effects (e.g., student, class, and instructor race).","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":" ","pages":""},"PeriodicalIF":3.4,"publicationDate":"2023-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44702665","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-12-26DOI: 10.3102/01623737221138041
Marcus A. Winters
Prior research substantially overstates the cost of retention under test-based promotion policies to both taxpayers and students who delay labor market entry because it omits two important factors. First, there is a delay between the intervention and the taxpayer’s expenditure. Second, on average, the treatment leads to less than a full year of additional schooling. I provide formulas for calculating the cost of grade retention within a test-based promotion policy and illustrate using data from Florida. Retaining a third-grade student under Florida’s policy was about 45% less costly to taxpayers and about 37% less costly to retained students than would be suggested by prior authors.
{"title":"The Cost of Retention Under a Test-Based Promotion Policy for Taxpayers and Students","authors":"Marcus A. Winters","doi":"10.3102/01623737221138041","DOIUrl":"https://doi.org/10.3102/01623737221138041","url":null,"abstract":"Prior research substantially overstates the cost of retention under test-based promotion policies to both taxpayers and students who delay labor market entry because it omits two important factors. First, there is a delay between the intervention and the taxpayer’s expenditure. Second, on average, the treatment leads to less than a full year of additional schooling. I provide formulas for calculating the cost of grade retention within a test-based promotion policy and illustrate using data from Florida. Retaining a third-grade student under Florida’s policy was about 45% less costly to taxpayers and about 37% less costly to retained students than would be suggested by prior authors.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":" ","pages":""},"PeriodicalIF":3.4,"publicationDate":"2022-12-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49038168","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-12-19DOI: 10.3102/01623737221139493
Michael J. Weiss, H. Bloom, Kriti Singh
This article provides evidence about predictive relationships between features of community college interventions and their impacts on student progress. This evidence is based on analyses of student-level data from large-scale randomized trials of 39 (mostly) community college interventions. Specifically, the evidence consistently indicates that impacts tend to be larger as the number of intervention components increases and with the degree to which interventions promote full-time enrollment in fall and spring and/or summer enrollment. Less consistent evidence suggests that impacts tend to be larger for interventions that increase advising, tutoring, and, to a lesser extent, financial support. These results provide food for thought about the design of future community college innovations to be tested by researchers or tried by practitioners.
{"title":"What 20 Years of MDRC RCTs Suggest About Predictive Relationships Between Intervention Features and Intervention Impacts for Community College Students","authors":"Michael J. Weiss, H. Bloom, Kriti Singh","doi":"10.3102/01623737221139493","DOIUrl":"https://doi.org/10.3102/01623737221139493","url":null,"abstract":"This article provides evidence about predictive relationships between features of community college interventions and their impacts on student progress. This evidence is based on analyses of student-level data from large-scale randomized trials of 39 (mostly) community college interventions. Specifically, the evidence consistently indicates that impacts tend to be larger as the number of intervention components increases and with the degree to which interventions promote full-time enrollment in fall and spring and/or summer enrollment. Less consistent evidence suggests that impacts tend to be larger for interventions that increase advising, tutoring, and, to a lesser extent, financial support. These results provide food for thought about the design of future community college innovations to be tested by researchers or tried by practitioners.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":" ","pages":""},"PeriodicalIF":3.4,"publicationDate":"2022-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48808040","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-12-12DOI: 10.3102/01623737221139285
Dan Goldhaber, Roddy Theobald
We contextualize the magnitude of teacher attrition during the pandemic, including from the 2020–2021 school year to the 2021–2022 school year, using longitudinal data on teachers in Washington since the 1984–1985 school year. The teacher attrition rate after the 2020–2021 school year (7.3%) increased by almost one percentage point from the attrition rate after the 2019–2020 school year (6.4%), but these rates are well within the range of turnover rates observed during pre-pandemic years. The increase in turnover during the pandemic was also smaller than pre-pandemic differences in turnover between high- and low-poverty classrooms in the state, and these inequities in turnover between high- and low-poverty classrooms decreased during the pandemic relative to pre-pandemic years.
{"title":"Teacher Attrition and Mobility in the Pandemic","authors":"Dan Goldhaber, Roddy Theobald","doi":"10.3102/01623737221139285","DOIUrl":"https://doi.org/10.3102/01623737221139285","url":null,"abstract":"We contextualize the magnitude of teacher attrition during the pandemic, including from the 2020–2021 school year to the 2021–2022 school year, using longitudinal data on teachers in Washington since the 1984–1985 school year. The teacher attrition rate after the 2020–2021 school year (7.3%) increased by almost one percentage point from the attrition rate after the 2019–2020 school year (6.4%), but these rates are well within the range of turnover rates observed during pre-pandemic years. The increase in turnover during the pandemic was also smaller than pre-pandemic differences in turnover between high- and low-poverty classrooms in the state, and these inequities in turnover between high- and low-poverty classrooms decreased during the pandemic relative to pre-pandemic years.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":"1 1","pages":""},"PeriodicalIF":3.4,"publicationDate":"2022-12-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43769427","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-12-05DOI: 10.3102/01623737221136101
Jesse Bruhn, Nathan D. Jones, Y. Kanno, Marcus A. Winters
We apply a difference-in-difference design to measure the causal effect of a teacher obtaining an endorsement in Sheltered English Immersion under Massachusetts’s Rethinking Equity in the Teaching of English Language Learners initiative on student’s learning outcomes. More than 35,000 in-service public school teachers completed the semester-long course. We find no effect on English learners’ (ELs) average test scores, but modest positive spillovers for students with disabilities and other non-EL students. Training benefited teachers recently hired by their district but had no effect on longer serving teachers.
{"title":"Professional Development at Scale: The Causal Effect of Obtaining an SEI Endorsement Under Massachusetts’s RETELL Initiative","authors":"Jesse Bruhn, Nathan D. Jones, Y. Kanno, Marcus A. Winters","doi":"10.3102/01623737221136101","DOIUrl":"https://doi.org/10.3102/01623737221136101","url":null,"abstract":"We apply a difference-in-difference design to measure the causal effect of a teacher obtaining an endorsement in Sheltered English Immersion under Massachusetts’s Rethinking Equity in the Teaching of English Language Learners initiative on student’s learning outcomes. More than 35,000 in-service public school teachers completed the semester-long course. We find no effect on English learners’ (ELs) average test scores, but modest positive spillovers for students with disabilities and other non-EL students. Training benefited teachers recently hired by their district but had no effect on longer serving teachers.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":" ","pages":""},"PeriodicalIF":3.4,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46068834","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：