Value-Added and Student Growth Percentile Models: What Drives Differences in Estimated Classroom Effects?

IF 1.5 Q2 SOCIAL SCIENCES, MATHEMATICAL METHODS Statistics and Public Policy Pub Date : 2018-01-01 DOI:10.1080/2330443X.2018.1438938
Michael Kurtz
{"title":"Value-Added and Student Growth Percentile Models: What Drives Differences in Estimated Classroom Effects?","authors":"Michael Kurtz","doi":"10.1080/2330443X.2018.1438938","DOIUrl":null,"url":null,"abstract":"ABSTRACT This study shows value-added models (VAM) and student growth percentile (SGP) models fundamentally disagree regarding estimated teacher effectiveness when the classroom distribution of test scores conditional on prior achievement is skewed (i.e., when a teacher serves a disproportionate number of high- or low-growth students). While conceptually similar, the two models differ in estimation method which can lead to sizable differences in estimated teacher effects. Moreover, the magnitude of conditional skewness needed to drive VAM and SGP models apart often by three and up to 6 deciles is within the ranges observed in actual data. The same teacher may appear weak using one model and strong with the other. Using a simulation, I evaluate the relationship under controllable conditions. I then verify that the results persist in observed student–teacher data from North Carolina.","PeriodicalId":43397,"journal":{"name":"Statistics and Public Policy","volume":" ","pages":"1 - 8"},"PeriodicalIF":1.5000,"publicationDate":"2018-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/2330443X.2018.1438938","citationCount":"11","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Statistics and Public Policy","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/2330443X.2018.1438938","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"SOCIAL SCIENCES, MATHEMATICAL METHODS","Score":null,"Total":0}
引用次数: 11

Abstract

ABSTRACT This study shows value-added models (VAM) and student growth percentile (SGP) models fundamentally disagree regarding estimated teacher effectiveness when the classroom distribution of test scores conditional on prior achievement is skewed (i.e., when a teacher serves a disproportionate number of high- or low-growth students). While conceptually similar, the two models differ in estimation method which can lead to sizable differences in estimated teacher effects. Moreover, the magnitude of conditional skewness needed to drive VAM and SGP models apart often by three and up to 6 deciles is within the ranges observed in actual data. The same teacher may appear weak using one model and strong with the other. Using a simulation, I evaluate the relationship under controllable conditions. I then verify that the results persist in observed student–teacher data from North Carolina.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
增值和学生增长百分比模型:是什么导致了估计课堂效果的差异?
摘要本研究表明,当以先前成绩为条件的考试成绩的课堂分布出现偏差时(即,当教师为不成比例的高增长或低增长学生服务时),增值模型(VAM)和学生增长百分位(SGP)模型在估计教师有效性方面存在根本分歧。虽然这两个模型在概念上相似,但估计方法不同,这可能导致估计的教师效应存在相当大的差异。此外,通常将VAM和SGP模型分开三个十分位数甚至六个十分位数所需的条件偏度大小在实际数据中观察到的范围内。同一位老师在使用一种模式时可能显得软弱,而在使用另一种模式后可能显得坚强。通过模拟,我评估了可控条件下的关系。然后,我在北卡罗来纳州观察到的学生和教师数据中验证了这一结果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Statistics and Public Policy
Statistics and Public Policy SOCIAL SCIENCES, MATHEMATICAL METHODS-
CiteScore
3.20
自引率
6.20%
发文量
13
审稿时长
32 weeks
期刊最新文献
State-Building through Public Land Disposal? An Application of Matrix Completion for Counterfactual Prediction Clusters of Jail Incarcerations in US Counties: 2010-2018 Comment on ‘What protects the autonomy of the Federal Statistics Agencies? An Assessment of the Procedures in Place That Protect the Independence and Objectivity of Official Statistics” by Pierson et al. On Coping in a Non-Binary World: Rejoinder to Biedermann and Kotsoglou Commentary on “Three-Way ROCs for Forensic Decision Making” by Nicholas Scurich and Richard S. John (in: Statistics and Public Policy)
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1