How do Test Scores at the Ceiling Affect Value-Added Estimates?

IF 1.5 Q2 SOCIAL SCIENCES, MATHEMATICAL METHODS Statistics and Public Policy Pub Date : 2018-01-01 DOI:10.1080/2330443X.2018.1460226
Alexandra M. Resch, Eric Isenberg
{"title":"How do Test Scores at the Ceiling Affect Value-Added Estimates?","authors":"Alexandra M. Resch, Eric Isenberg","doi":"10.1080/2330443X.2018.1460226","DOIUrl":null,"url":null,"abstract":"ABSTRACT Some educators are concerned that students with test scores at top of the test score distribution will negatively affect the value-added estimates of teachers of those students. A conventional wisdom has sprung up suggesting that students with very high test scores have “no room to grow,” so value-added estimates for teachers with high-performing students will be depressed even for highly effective teachers. Using empirical data, we show that under normal circumstances, in which few students score at the ceiling, a teacher of high-performing students—even with many students scoring at the ceiling on the pre-test—can have a high value-added estimate. To understand how more extreme ceiling effects can change value-added estimates, we simulate a low ceiling, causing student test achievement data of high-scoring students to become less precise when a single score represents a large range of possible achievement. We find that the problem of test score ceilings for an evaluation system is not that it pushes the value added of every teacher of high-achieving students toward the bottom of the distribution of teachers, but rather shrinks it toward the middle.","PeriodicalId":43397,"journal":{"name":"Statistics and Public Policy","volume":" ","pages":"1 - 6"},"PeriodicalIF":1.5000,"publicationDate":"2018-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/2330443X.2018.1460226","citationCount":"8","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Statistics and Public Policy","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/2330443X.2018.1460226","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"SOCIAL SCIENCES, MATHEMATICAL METHODS","Score":null,"Total":0}
引用次数: 8

Abstract

ABSTRACT Some educators are concerned that students with test scores at top of the test score distribution will negatively affect the value-added estimates of teachers of those students. A conventional wisdom has sprung up suggesting that students with very high test scores have “no room to grow,” so value-added estimates for teachers with high-performing students will be depressed even for highly effective teachers. Using empirical data, we show that under normal circumstances, in which few students score at the ceiling, a teacher of high-performing students—even with many students scoring at the ceiling on the pre-test—can have a high value-added estimate. To understand how more extreme ceiling effects can change value-added estimates, we simulate a low ceiling, causing student test achievement data of high-scoring students to become less precise when a single score represents a large range of possible achievement. We find that the problem of test score ceilings for an evaluation system is not that it pushes the value added of every teacher of high-achieving students toward the bottom of the distribution of teachers, but rather shrinks it toward the middle.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
最高测试分数如何影响增值估计?
摘要一些教育工作者担心,考试成绩在考试成绩分布中名列前茅的学生会对教师对这些学生的增值估计产生负面影响。一种传统观点认为,考试成绩很高的学生“没有成长的空间”,因此,即使是高效的教师,对成绩优异的教师的增值估计也会降低。使用实证数据,我们表明,在很少有学生达到最高分数的正常情况下,一个表现优异的学生的老师——即使有很多学生在预考中达到了最高分数——也可以做出高附加值的估计。为了了解更极端的上限效应如何改变增值估计,我们模拟了一个低上限,当一个分数代表一个大范围的可能成绩时,导致高分学生的学生测试成绩数据变得不那么精确。我们发现,评估系统的考试分数上限问题并不在于它将每一位成绩优异的学生的教师的附加值推向教师分布的底部,而是将其缩小到中间。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Statistics and Public Policy
Statistics and Public Policy SOCIAL SCIENCES, MATHEMATICAL METHODS-
CiteScore
3.20
自引率
6.20%
发文量
13
审稿时长
32 weeks
期刊最新文献
State-Building through Public Land Disposal? An Application of Matrix Completion for Counterfactual Prediction Clusters of Jail Incarcerations in US Counties: 2010-2018 Comment on ‘What protects the autonomy of the Federal Statistics Agencies? An Assessment of the Procedures in Place That Protect the Independence and Objectivity of Official Statistics” by Pierson et al. On Coping in a Non-Binary World: Rejoinder to Biedermann and Kotsoglou Commentary on “Three-Way ROCs for Forensic Decision Making” by Nicholas Scurich and Richard S. John (in: Statistics and Public Policy)
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1