Pub Date : 2023-10-23DOI: 10.3102/01623737231200234
Beth E. Schueler, Katherine E. Larned
Few interventions reduce inequality in reading achievement, let alone higher-order thinking skills, among adolescents. We study policy debate—an extracurricular activity focused on improving middle and high schoolers’ critical thinking, argumentation, and policy analysis skills—in Boston schools serving large concentrations of economically disadvantaged students of color. Student fixed effects estimates show debate had positive impacts on English Language Arts (ELA) test scores of 0.13 SD, equivalent to 68% of a full year of average ninth-grade learning. Gains were concentrated on analytical more than rote subskills. We find no harm to math, attendance, or disciplinary records, and evidence of positive effects on high school graduation and postsecondary enrollment. Impacts were largest among students who were lowest achieving prior to joining debate.
{"title":"Interscholastic Policy Debate Promotes Critical Thinking and College-Going: Evidence From Boston Public Schools","authors":"Beth E. Schueler, Katherine E. Larned","doi":"10.3102/01623737231200234","DOIUrl":"https://doi.org/10.3102/01623737231200234","url":null,"abstract":"Few interventions reduce inequality in reading achievement, let alone higher-order thinking skills, among adolescents. We study policy debate—an extracurricular activity focused on improving middle and high schoolers’ critical thinking, argumentation, and policy analysis skills—in Boston schools serving large concentrations of economically disadvantaged students of color. Student fixed effects estimates show debate had positive impacts on English Language Arts (ELA) test scores of 0.13 SD, equivalent to 68% of a full year of average ninth-grade learning. Gains were concentrated on analytical more than rote subskills. We find no harm to math, attendance, or disciplinary records, and evidence of positive effects on high school graduation and postsecondary enrollment. Impacts were largest among students who were lowest achieving prior to joining debate.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":"52 10","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135366646","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-10-16DOI: 10.3102/01623737231200202
David M. Quinn
Frames shape public opinion on policy issues, with implications for policy adoption and agenda-setting. What impact do common issue frames for racial equity in education have on voters’ support for racially equitable education policy? Across survey experiments with two independent representative polls of California voters, framing effects were moderated by voters’ prior policy preferences. Among respondents concerned with tax policy, a frame emphasizing the economic benefits of equity elicited higher priority for racial equity in education. Among respondents concerned with social justice, an “equal opportunity” frame elicited higher priority ratings. However, exploratory analyses showed frames only mattered when respondents held mixed policy preferences. Among respondents who (a) valued both tax policy and social justice issues, or who (b) valued neither, both frames were equally impactful.
{"title":"Framing Effects and the Public’s Attitudes Toward Racial Equity in Education Policy","authors":"David M. Quinn","doi":"10.3102/01623737231200202","DOIUrl":"https://doi.org/10.3102/01623737231200202","url":null,"abstract":"Frames shape public opinion on policy issues, with implications for policy adoption and agenda-setting. What impact do common issue frames for racial equity in education have on voters’ support for racially equitable education policy? Across survey experiments with two independent representative polls of California voters, framing effects were moderated by voters’ prior policy preferences. Among respondents concerned with tax policy, a frame emphasizing the economic benefits of equity elicited higher priority for racial equity in education. Among respondents concerned with social justice, an “equal opportunity” frame elicited higher priority ratings. However, exploratory analyses showed frames only mattered when respondents held mixed policy preferences. Among respondents who (a) valued both tax policy and social justice issues, or who (b) valued neither, both frames were equally impactful.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":"76 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136114717","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-10-11DOI: 10.3102/01623737231197639
NaYoung Hwang, Cory Koedel
We evaluate the effects of grade retention on students’ academic, attendance, and disciplinary outcomes in Indiana. Using a regression discontinuity design, we show that third-grade retention increases achievement in English Language Arts (ELA) and math immediately and substantially, and the effects persist into middle school. We find no evidence of grade retention effects on student attendance or disciplinary incidents, again into middle school. Our findings combine to show that Indiana’s third-grade retention policy improves achievement for retained students without adverse impacts along (measured) nonacademic dimensions.
{"title":"Helping or Hurting: The Effects of Retention in the Third Grade on Student Outcomes","authors":"NaYoung Hwang, Cory Koedel","doi":"10.3102/01623737231197639","DOIUrl":"https://doi.org/10.3102/01623737231197639","url":null,"abstract":"We evaluate the effects of grade retention on students’ academic, attendance, and disciplinary outcomes in Indiana. Using a regression discontinuity design, we show that third-grade retention increases achievement in English Language Arts (ELA) and math immediately and substantially, and the effects persist into middle school. We find no evidence of grade retention effects on student attendance or disciplinary incidents, again into middle school. Our findings combine to show that Indiana’s third-grade retention policy improves achievement for retained students without adverse impacts along (measured) nonacademic dimensions.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":"41 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136063795","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-10-02DOI: 10.3102/01623737231197434
Marcus Pietsch, Burak Aydin, Sedat Gümüş
Aggregated data meta-analyses indicate a correlation between instructional leadership and student achievement. However, it is unclear to what extent this relationship can be generalized across cultural contexts, as most primary studies stem from Anglophone regions. Drawing on international large-scale assessment data, this 3-level individual participant data (IPD) meta-analysis examines this relationship over a 6-year period using a sample of 1.5 million students in more than 50,000 schools from 75 countries. The findings show that the mean correlation is close to 0 and that the relationship between instructional leadership and student achievement varies significantly across contexts. This is mainly due to the level of human development and cultural factors. Implications for policy, practice, and education research are discussed.
{"title":"Putting the Instructional Leadership–Student Achievement Relation in Context: A Meta-Analytical Big Data Study Across Cultures and Time","authors":"Marcus Pietsch, Burak Aydin, Sedat Gümüş","doi":"10.3102/01623737231197434","DOIUrl":"https://doi.org/10.3102/01623737231197434","url":null,"abstract":"Aggregated data meta-analyses indicate a correlation between instructional leadership and student achievement. However, it is unclear to what extent this relationship can be generalized across cultural contexts, as most primary studies stem from Anglophone regions. Drawing on international large-scale assessment data, this 3-level individual participant data (IPD) meta-analysis examines this relationship over a 6-year period using a sample of 1.5 million students in more than 50,000 schools from 75 countries. The findings show that the mean correlation is close to 0 and that the relationship between instructional leadership and student achievement varies significantly across contexts. This is mainly due to the level of human development and cultural factors. Implications for policy, practice, and education research are discussed.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":"140 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135829664","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-25DOI: 10.3102/01623737231197683
Xiaodan Hu, Frank Fernandez
This study examines whether the National Science Foundation’s ADVANCE-IT grant program identifies and funds institutions that improve faculty gender equity. By using matching procedures and a two-way fixed-effect event study, we find that when universities received ADVANCE-IT grants, their proportion and headcount of women faculty as full-time new-hire, overall faculty, and tenured and tenure-track faculty are not different from multiple comparison groups of universities—including universities that received other types of ADVANCE grants. Drawing on the concept of intersectionality, we further disaggregate women faculty into subracial/ethnic groups. We did not find consistent evidence supporting that ADVANCE-IT universities increase the proportion or headcount of women faculty in subracial/ethnic groups. We discuss implications for federal grantmaking and diversifying higher education faculty.
{"title":"An ADVANCE for Whom? A National Study of Initiatives to Improve Faculty Gender Equity","authors":"Xiaodan Hu, Frank Fernandez","doi":"10.3102/01623737231197683","DOIUrl":"https://doi.org/10.3102/01623737231197683","url":null,"abstract":"This study examines whether the National Science Foundation’s ADVANCE-IT grant program identifies and funds institutions that improve faculty gender equity. By using matching procedures and a two-way fixed-effect event study, we find that when universities received ADVANCE-IT grants, their proportion and headcount of women faculty as full-time new-hire, overall faculty, and tenured and tenure-track faculty are not different from multiple comparison groups of universities—including universities that received other types of ADVANCE grants. Drawing on the concept of intersectionality, we further disaggregate women faculty into subracial/ethnic groups. We did not find consistent evidence supporting that ADVANCE-IT universities increase the proportion or headcount of women faculty in subracial/ethnic groups. We discuss implications for federal grantmaking and diversifying higher education faculty.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135814473","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-12DOI: 10.3102/01623737231195887
Jilli Jung, Maithreyi Gopalan
Youth voter turnout remains stubbornly low and unresponsive to civic education. Rigorous evaluations of the effects of adopting civics tests for high school graduation by some states on youth voter turnout remain limited. We estimate the impact of a recent, state-mandated civics test policy—the Civics Education Initiative (CEI)—on youth voter turnout by exploiting spatial and temporal variation in the adoption of CEI across states. Using nationally representative data from the 1996 to 2020 Current Population Survey and a difference-in-differences analysis, we find that CEI does not significantly affect youth voter turnout. Our null results, largely insensitive to a variety of alternative specifications and robustness checks, provide evidence regarding the lack of efficacy of civics test policies when it comes to youth voter participation.
{"title":"The Stubborn Unresponsiveness of Youth Voter Turnout to Civic Education: Quasi-Experimental Evidence From State-Mandated Civics Tests","authors":"Jilli Jung, Maithreyi Gopalan","doi":"10.3102/01623737231195887","DOIUrl":"https://doi.org/10.3102/01623737231195887","url":null,"abstract":"Youth voter turnout remains stubbornly low and unresponsive to civic education. Rigorous evaluations of the effects of adopting civics tests for high school graduation by some states on youth voter turnout remain limited. We estimate the impact of a recent, state-mandated civics test policy—the Civics Education Initiative (CEI)—on youth voter turnout by exploiting spatial and temporal variation in the adoption of CEI across states. Using nationally representative data from the 1996 to 2020 Current Population Survey and a difference-in-differences analysis, we find that CEI does not significantly affect youth voter turnout. Our null results, largely insensitive to a variety of alternative specifications and robustness checks, provide evidence regarding the lack of efficacy of civics test policies when it comes to youth voter participation.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135879193","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-08-28DOI: 10.3102/01623737231192487
Kaitlin P. Anderson
Black and Latinx students are underrepresented in advanced placement (AP) and dual enrollment (DE), and implicit bias of educators has been discussed as one potential contributor. This study tests whether aggregate measures of implicit and explicit racial bias are related to AP and DE participation and racial/ethnic gaps in participation, controlling for contextual factors. The results indicate a relationship between implicit racial bias and disparate AP participation for Black students relative to White students, and suggestive evidence of a relationship between explicit racial bias and disparate DE participation between Black and White students. Furthermore, more explicitly biased communities have lower AP participation overall. Implications for school leaders regarding interventions to address systemic inequities in access are discussed.
{"title":"Biased Opportunities: The Role of Implicit and Explicit Bias in Advanced Placement and Dual Enrollment","authors":"Kaitlin P. Anderson","doi":"10.3102/01623737231192487","DOIUrl":"https://doi.org/10.3102/01623737231192487","url":null,"abstract":"Black and Latinx students are underrepresented in advanced placement (AP) and dual enrollment (DE), and implicit bias of educators has been discussed as one potential contributor. This study tests whether aggregate measures of implicit and explicit racial bias are related to AP and DE participation and racial/ethnic gaps in participation, controlling for contextual factors. The results indicate a relationship between implicit racial bias and disparate AP participation for Black students relative to White students, and suggestive evidence of a relationship between explicit racial bias and disparate DE participation between Black and White students. Furthermore, more explicitly biased communities have lower AP participation overall. Implications for school leaders regarding interventions to address systemic inequities in access are discussed.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":" ","pages":""},"PeriodicalIF":3.4,"publicationDate":"2023-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48152612","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-08-21DOI: 10.3102/01623737231189478
Heather N. McCambly, Quinn Mulroy
In this critical, political discourse analysis, we trace how two concepts, equity and quality, became discursively linked and contested in the administration of postsecondary education policy over time (1968–1994)—a developmental process we refer to as (e)quality politics. By engaging in a historical analysis, we investigate (a) the racialized political origins and discursive processes by which arguments over educational “quality” are advanced as part of an antiequity policy paradigm and (b) how this paradigm reinscribes racial inequity into administrative and organizational action over time. We illustrate how, once an (e)quality politics paradigm is established, racialized policy designs can persist, even in the absence of explicit references to racialized social constructions of target populations in later periods of policy development.
{"title":"Constructing an Educational “Quality” Crisis: (E)quality Politics and Racialization Beyond Target Beneficiaries","authors":"Heather N. McCambly, Quinn Mulroy","doi":"10.3102/01623737231189478","DOIUrl":"https://doi.org/10.3102/01623737231189478","url":null,"abstract":"In this critical, political discourse analysis, we trace how two concepts, equity and quality, became discursively linked and contested in the administration of postsecondary education policy over time (1968–1994)—a developmental process we refer to as (e)quality politics. By engaging in a historical analysis, we investigate (a) the racialized political origins and discursive processes by which arguments over educational “quality” are advanced as part of an antiequity policy paradigm and (b) how this paradigm reinscribes racial inequity into administrative and organizational action over time. We illustrate how, once an (e)quality politics paradigm is established, racialized policy designs can persist, even in the absence of explicit references to racialized social constructions of target populations in later periods of policy development.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":" ","pages":""},"PeriodicalIF":3.4,"publicationDate":"2023-08-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45844767","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-08-07DOI: 10.3102/01623737231188366
Megan Duff, Joshua L. Glazer, Matthew Shirrell, Dryw Freed
Although research alliances (RAs) have long been seen as mutualistic and reciprocal, RAs face numerous obstacles navigating stakeholders’ differing goals, incentives, and information. This longitudinal, comparative case study of two RAs uses principal-agent theory to analyze these interdependent challenges and their relationship to RA strategy and design. Findings suggest that while some RAs may be better designed to balance the competing interests of various stakeholders, increasingly contested definitions of RA effectiveness among those stakeholders have muddled RA identities. As a result, RA researchers are now often held to expectations that their organizations were not originally designed to meet. We argue that this has implications for how RAs are funded, designed, and, ultimately, evaluated.
{"title":"Walking a Tightrope: Navigating Principal-Agent Dilemmas in Research-Practice Partnerships","authors":"Megan Duff, Joshua L. Glazer, Matthew Shirrell, Dryw Freed","doi":"10.3102/01623737231188366","DOIUrl":"https://doi.org/10.3102/01623737231188366","url":null,"abstract":"Although research alliances (RAs) have long been seen as mutualistic and reciprocal, RAs face numerous obstacles navigating stakeholders’ differing goals, incentives, and information. This longitudinal, comparative case study of two RAs uses principal-agent theory to analyze these interdependent challenges and their relationship to RA strategy and design. Findings suggest that while some RAs may be better designed to balance the competing interests of various stakeholders, increasingly contested definitions of RA effectiveness among those stakeholders have muddled RA identities. As a result, RA researchers are now often held to expectations that their organizations were not originally designed to meet. We argue that this has implications for how RAs are funded, designed, and, ultimately, evaluated.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":"48 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135903333","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-07-24DOI: 10.3102/01623737231182751
Elizabeth K. Jeffers, Adrienne Dixson
Education research has often overlooked how the long durée of resistance for Black education has shaped current educational policy. We complicate notions of Black public school closures in two case studies from extensive ethnographic research in post-Katrina New Orleans through our reading of the plantation. Findings suggest these institutions have served as linchpins for the transferal of the blues. Data analysis also indicates that traditional public school closures have functioned as a plantation management device. We encourage future inquiries into portfolio governance models, school “choice,” and school closures to consider the plantation complex and to recognize that post-Katrina education reforms were not isolated policy enactments.
{"title":"The Plantation “All Charter” Model and the Long Durée of Resistance for Black Public High Schools in New Orleans","authors":"Elizabeth K. Jeffers, Adrienne Dixson","doi":"10.3102/01623737231182751","DOIUrl":"https://doi.org/10.3102/01623737231182751","url":null,"abstract":"Education research has often overlooked how the long durée of resistance for Black education has shaped current educational policy. We complicate notions of Black public school closures in two case studies from extensive ethnographic research in post-Katrina New Orleans through our reading of the plantation. Findings suggest these institutions have served as linchpins for the transferal of the blues. Data analysis also indicates that traditional public school closures have functioned as a plantation management device. We encourage future inquiries into portfolio governance models, school “choice,” and school closures to consider the plantation complex and to recognize that post-Katrina education reforms were not isolated policy enactments.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":" ","pages":""},"PeriodicalIF":3.4,"publicationDate":"2023-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47925569","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：