Process Data in Computer-Based Assessment

IF 3.2 3区 心理学 Q2 PSYCHOLOGY, APPLIED European Journal of Psychological Assessment Pub Date : 2023-07-01 DOI:10.1027/1015-5759/a000790
M. A. Lindner, Samuel Greiff
{"title":"Process Data in Computer-Based Assessment","authors":"M. A. Lindner, Samuel Greiff","doi":"10.1027/1015-5759/a000790","DOIUrl":null,"url":null,"abstract":"Abstract: This editorial provides a comprehensive framework and overview of potential uses and next steps in research on process data in computer-based assessments, expanding toward broad perspectives on the field and an exploration of future directions and emerging trends. After briefly reflecting on the evolution of process data use in research and assessment practice, we discuss three key challenges, namely (1) the theoretical grounding and validation of process data indicators, (2) assessment design for process data, and (3) ethical standards. By considering best practice approaches in all three areas and current discussions in the literature, we conclude that a focus is needed on the following three areas: (1) strong, holistic theoretical frameworks for validating process data, (2) reliable, standardized data collections, preferably with a top-down approach to developing test items and preregistered hypotheses, and (3) ethical norms for data collection, data use, and guidelines for responsible inference, including restraints in decisions based on process data.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":" ","pages":""},"PeriodicalIF":3.2000,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"European Journal of Psychological Assessment","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1027/1015-5759/a000790","RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"PSYCHOLOGY, APPLIED","Score":null,"Total":0}
引用次数: 0

Abstract

Abstract: This editorial provides a comprehensive framework and overview of potential uses and next steps in research on process data in computer-based assessments, expanding toward broad perspectives on the field and an exploration of future directions and emerging trends. After briefly reflecting on the evolution of process data use in research and assessment practice, we discuss three key challenges, namely (1) the theoretical grounding and validation of process data indicators, (2) assessment design for process data, and (3) ethical standards. By considering best practice approaches in all three areas and current discussions in the literature, we conclude that a focus is needed on the following three areas: (1) strong, holistic theoretical frameworks for validating process data, (2) reliable, standardized data collections, preferably with a top-down approach to developing test items and preregistered hypotheses, and (3) ethical norms for data collection, data use, and guidelines for responsible inference, including restraints in decisions based on process data.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
计算机评估中的过程数据
摘要:这篇社论提供了一个全面的框架,概述了计算机评估中过程数据研究的潜在用途和下一步行动,扩展了对该领域的广泛看法,并探索了未来的方向和新趋势。在简要回顾了研究和评估实践中过程数据使用的演变之后,我们讨论了三个关键挑战,即(1)过程数据指标的理论基础和验证,(2)过程数据的评估设计,以及(3)伦理标准。通过考虑所有三个领域的最佳实践方法和文献中的当前讨论,我们得出结论,需要关注以下三个领域:(1)用于验证过程数据的强大、全面的理论框架;(2)可靠、标准化的数据收集,最好采用自上而下的方法来开发测试项目和预先注册的假设,以及(3)数据收集、数据使用的道德规范和负责任推理的指导方针,包括基于过程数据的决策中的约束。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
6.40
自引率
4.00%
发文量
71
期刊介绍: The main purpose of the EJPA is to present important articles which provide seminal information on both theoretical and applied developments in this field. Articles reporting the construction of new measures or an advancement of an existing measure are given priority. The journal is directed to practitioners as well as to academicians: The conviction of its editors is that the discipline of psychological assessment should, necessarily and firmly, be attached to the roots of psychological science, while going deeply into all the consequences of its applied, practice-oriented development.
期刊最新文献
The Potential of Machine Learning Methods in Psychological Assessment and Test Construction An Examination of the Role of Inverted Dark Tetrad Items on Structural Properties and Construct Validity Evaluating the Psychometric Properties of the Romanian Version of Thriving at Work Scale Development and Validation of the Work Orientation Questionnaire Short-Form (WOQ-SF) Seeing the Light in Self-Reported Glare
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1