Educational Research with Real-World Data: Reducing Selection Bias with Propensity Scores.

Abstract

Often it is infeasible or unethical to use random assignment in educational settings to study important constructs and questions. Hence, educational research often uses observational data, such as large-scale secondary data sets and state and school district data, and quasi-experimental designs. One method of reducing selection bias in estimations of treatment effects is propensity score analysis. This method reduces a large number of pretreatment covariates to a single scalar function and allows researchers to compare subjects with similar probability to receive the treatment. This article provides an introduction to propensity score analysis and stratification, an example illustrating its use, and suggestions for using propensity score analysis in educational research.