{"title":"How Big Are Effect Sizes in International Education Studies?","authors":"David K. Evans, Fei Yuan","doi":"10.3102/01623737221079646","DOIUrl":null,"url":null,"abstract":"A growing literature measures the impact of education interventions in low- and middle-income countries on both access and learning outcomes. But how should one contextualize the size of impacts? This article provides the distribution of standardized effect sizes on learning and access from 234 studies in low- and middle-income countries. We identify a median effect size of 0.10 standard deviations on learning and 0.07 standard deviations on access among randomized controlled trials. Effect sizes are similar for quasi-experimental studies. Effects are larger and demonstrate higher variance for small-scale studies than for large-scale studies. The distribution of existing effects can help researchers and policymakers to situate new findings within current knowledge and design new studies with sufficient statistical power to identify effects.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":null,"pages":null},"PeriodicalIF":2.4000,"publicationDate":"2022-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"47","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Educational Evaluation and Policy Analysis","FirstCategoryId":"95","ListUrlMain":"https://doi.org/10.3102/01623737221079646","RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 47
Abstract
A growing literature measures the impact of education interventions in low- and middle-income countries on both access and learning outcomes. But how should one contextualize the size of impacts? This article provides the distribution of standardized effect sizes on learning and access from 234 studies in low- and middle-income countries. We identify a median effect size of 0.10 standard deviations on learning and 0.07 standard deviations on access among randomized controlled trials. Effect sizes are similar for quasi-experimental studies. Effects are larger and demonstrate higher variance for small-scale studies than for large-scale studies. The distribution of existing effects can help researchers and policymakers to situate new findings within current knowledge and design new studies with sufficient statistical power to identify effects.
期刊介绍:
Educational Evaluation and Policy Analysis (EEPA) publishes manuscripts of theoretical or practical interest to those engaged in educational evaluation or policy analysis, including economic, demographic, financial, and political analyses of education policies, and significant meta-analyses or syntheses that address issues of current concern. The journal seeks high-quality research on how reforms and interventions affect educational outcomes; research on how multiple educational policy and reform initiatives support or conflict with each other; and research that informs pending changes in educational policy at the federal, state, and local levels, demonstrating an effect on early childhood through early adulthood.