Cumulative Ordering as Evidence of Construct Validity for Assessments of Developmental Attributes

IF 1.5 4区 心理学 Q3 PSYCHOLOGY, EDUCATIONAL Journal of Psychoeducational Assessment Pub Date : 2023-09-07 DOI:10.1177/07342829231199007
Stephen M. Humphry, Paul Montuoro, Carolyn Maxwell
{"title":"Cumulative Ordering as Evidence of Construct Validity for Assessments of Developmental Attributes","authors":"Stephen M. Humphry, Paul Montuoro, Carolyn Maxwell","doi":"10.1177/07342829231199007","DOIUrl":null,"url":null,"abstract":"This article builds upon a proiminent definition of construct validity that focuses on variation in attributes causing variation in measurement outcomes. This article synthesizes the defintion and uses Rasch measurement modeling to explicate a modified conceptualization of construct validity for assessments of developmental attributes. If attributes are conceived as developmental, hypotheses about how new knowledge builds cumulatively upon the cognitive capacity afforded by prior knowledge can be developed. This cumulative ordering of knowledge required to accomplish test items constitutes evidence of a specific form of construct validity. Examples of cumulative ordering appear in the extant literature, but they are rare and confined to the early literature. Furthermore, cumulative ordering has never been explicated, especially its relationship to construct validity. This article describes three of the most complete examples of cumulative ordering in the literature. These examples are used to synthesize a method for assessing cumulative ordering, in which the Rasch model is used to assess the progression of item difficulties which are, in turn, used to review developmental theories and hypotheses, and the tests themselves. We discuss how this conceptualization of construct validity can lead to a more direct relationship between developmental theories and tests which, for practitioners, should result in a clearer understanding of what tests results actually mean. Finally, we discuss how cumulative ordering can be used to facilitate decisions about consequential validity.","PeriodicalId":51446,"journal":{"name":"Journal of Psychoeducational Assessment","volume":null,"pages":null},"PeriodicalIF":1.5000,"publicationDate":"2023-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Psychoeducational Assessment","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1177/07342829231199007","RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"PSYCHOLOGY, EDUCATIONAL","Score":null,"Total":0}
引用次数: 0

Abstract

This article builds upon a proiminent definition of construct validity that focuses on variation in attributes causing variation in measurement outcomes. This article synthesizes the defintion and uses Rasch measurement modeling to explicate a modified conceptualization of construct validity for assessments of developmental attributes. If attributes are conceived as developmental, hypotheses about how new knowledge builds cumulatively upon the cognitive capacity afforded by prior knowledge can be developed. This cumulative ordering of knowledge required to accomplish test items constitutes evidence of a specific form of construct validity. Examples of cumulative ordering appear in the extant literature, but they are rare and confined to the early literature. Furthermore, cumulative ordering has never been explicated, especially its relationship to construct validity. This article describes three of the most complete examples of cumulative ordering in the literature. These examples are used to synthesize a method for assessing cumulative ordering, in which the Rasch model is used to assess the progression of item difficulties which are, in turn, used to review developmental theories and hypotheses, and the tests themselves. We discuss how this conceptualization of construct validity can lead to a more direct relationship between developmental theories and tests which, for practitioners, should result in a clearer understanding of what tests results actually mean. Finally, we discuss how cumulative ordering can be used to facilitate decisions about consequential validity.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
累积排序:发展属性评价的构念效度证据
本文建立在构造效度的一个突出定义之上,该定义关注导致测量结果变化的属性的变化。本文综合了构式效度的定义,并利用Rasch测量模型阐述了一种改进的构式效度概念,用于发展属性的评估。如果属性被认为是发展的,那么关于新知识如何在先验知识提供的认知能力上积累的假设就可以发展起来。完成测试项目所需的知识的累积顺序构成了特定形式的构念效度的证据。累积排序的例子出现在现存文献中,但它们是罕见的,仅限于早期文献。此外,累积排序与建构效度的关系从未得到明确的解释。本文描述了文献中三个最完整的累积排序示例。这些例子被用来综合一种评估累积排序的方法,其中Rasch模型被用来评估项目难度的进展,反过来,用于审查发展理论和假设,以及测试本身。我们将讨论构造效度的概念化如何导致发展理论和测试之间更直接的关系,对于从业者来说,应该更清楚地理解测试结果的实际含义。最后,我们讨论了如何使用累积排序来促进对结果效度的决策。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Journal of Psychoeducational Assessment
Journal of Psychoeducational Assessment PSYCHOLOGY, EDUCATIONAL-
CiteScore
3.30
自引率
5.90%
发文量
61
期刊介绍: The Journal of Psychoeducational Assessment (JPA) publishes contemporary and important information focusing on psychological and educational assessment research and evidence-based practices as well as assessment instrumentation. JPA is well known internationally for the quality of published assessment-related research, theory and practice papers, and book and test reviews. The methodologically sound and impiricially-based studies and critical test and book reviews will be of particular interest to all assessment specialists including practicing psychologists, psychoeducational consultants, educational diagnosticians and special educators.
期刊最新文献
Resolving Dimensionality Issues of the Utretch Work Engagement Scale for Students Using an Integrative Data-Analytic Framework Psychometric Properties of the School Support Scale (SSS) for a Sample of Chilean Adolescents Interpretation Evidence for the Multidimensional Test Anxiety Scale: A Brief Report Perceived School Belonging Among Youth with Chronic Physical Illness Florence Bullying-Victimization Scales: Validation Study and Victimization Associations With Well-Being and Social Self-Efficacy
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1