Practical validation framework for competence measurement in VET: a validation study of an instrument for measuring basic commercial knowledge and skills in Switzerland

IF 1.6 Q2 EDUCATION & EDUCATIONAL RESEARCH Empirical Research in Vocational Education and Training Pub Date : 2021-08-12 DOI:10.1186/s40461-021-00122-2
Rohr-Mentele, Silja, Forster-Heinzer, Sarah
{"title":"Practical validation framework for competence measurement in VET: a validation study of an instrument for measuring basic commercial knowledge and skills in Switzerland","authors":"Rohr-Mentele, Silja, Forster-Heinzer, Sarah","doi":"10.1186/s40461-021-00122-2","DOIUrl":null,"url":null,"abstract":"<p>Competence development and measurement are of great interest to vocational education and training (VET). Although there are many instruments available for measuring competence in diverse settings, in many cases, the completed steps of validation are neither documented nor made transparent in a comprehensible manner. Understanding what an instrument actually measures is extremely important, inter alia, for evaluating test results, for conducting replication studies and for enforcing adaptation intentions. Therefore, more thorough and qualitative validation studies are required. This paper presents an approach to facilitate validation studies using the example of the <i>simuLINCA</i> test. The approach to validation applied in this study was developed in the field of medicine; nevertheless, it provides a promising means of assessing the validity of (computer-based) instruments in VET. We present the approach in detail along a newly developed computer-based simulation (<i>simuLINCA</i>) that measures basic commercial knowledge and skills of apprentices in Switzerland. The strength of the presented approach is that it provides practical guidelines that help perform the measurement process and support an increase in transparency. Still, it is flexible enough to allow different concepts to test development and validity. The approach applied proved to be practicable for VET and the measurement of occupational competence. After extending and slightly modifying the approach, a practical validation framework, including the description of each step and questions to support the application of it, is available for the VET context. The computer-based test instrument, <i>simuLINCA</i>, provides insights into how a computer-based test for measuring competence in various occupational fields can be developed and validated. <i>SimuLINCA</i> showed satisfying evidence for a valid measurement instrument. It could, however, be further developed, revised and extended.</p>","PeriodicalId":38550,"journal":{"name":"Empirical Research in Vocational Education and Training","volume":null,"pages":null},"PeriodicalIF":1.6000,"publicationDate":"2021-08-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Empirical Research in Vocational Education and Training","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1186/s40461-021-00122-2","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0

Abstract

Competence development and measurement are of great interest to vocational education and training (VET). Although there are many instruments available for measuring competence in diverse settings, in many cases, the completed steps of validation are neither documented nor made transparent in a comprehensible manner. Understanding what an instrument actually measures is extremely important, inter alia, for evaluating test results, for conducting replication studies and for enforcing adaptation intentions. Therefore, more thorough and qualitative validation studies are required. This paper presents an approach to facilitate validation studies using the example of the simuLINCA test. The approach to validation applied in this study was developed in the field of medicine; nevertheless, it provides a promising means of assessing the validity of (computer-based) instruments in VET. We present the approach in detail along a newly developed computer-based simulation (simuLINCA) that measures basic commercial knowledge and skills of apprentices in Switzerland. The strength of the presented approach is that it provides practical guidelines that help perform the measurement process and support an increase in transparency. Still, it is flexible enough to allow different concepts to test development and validity. The approach applied proved to be practicable for VET and the measurement of occupational competence. After extending and slightly modifying the approach, a practical validation framework, including the description of each step and questions to support the application of it, is available for the VET context. The computer-based test instrument, simuLINCA, provides insights into how a computer-based test for measuring competence in various occupational fields can be developed and validated. SimuLINCA showed satisfying evidence for a valid measurement instrument. It could, however, be further developed, revised and extended.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
职业技术培训能力测量的实用验证框架:对瑞士基本商业知识和技能测量工具的验证研究
胜任力的开发与测量是职业教育与培训研究的热点问题。虽然有许多工具可用于在不同的环境中测量能力,但在许多情况下,完成的验证步骤既没有记录,也没有以可理解的方式透明。除其他外,了解一项仪器实际测量的内容对于评估测试结果、进行重复性研究和执行适应意图极为重要。因此,需要更彻底和定性的验证研究。本文以simuLINCA测试为例,提出了一种促进验证研究的方法。本研究中应用的验证方法是在医学领域开发的;然而,它提供了一种很有前途的方法来评估(基于计算机的)VET仪器的有效性。我们详细介绍了一种新开发的基于计算机的模拟(simuLINCA)方法,该方法可以测量瑞士学徒的基本商业知识和技能。所提出的方法的优势在于它提供了实用的指导方针,帮助执行度量过程并支持透明度的增加。尽管如此,它仍然足够灵活,可以允许不同的概念测试开发和有效性。实践证明,该方法在职业技能培训和职业能力测评中是切实可行的。在扩展和稍微修改方法之后,一个实际的验证框架,包括每个步骤的描述和支持它的应用的问题,可用于VET环境。基于计算机的测试仪器,simuLINCA,提供了如何开发和验证基于计算机的测试来衡量不同职业领域的能力的见解。SimuLINCA是一种有效的测量仪器。但是,它可以进一步发展、修订和扩大。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
3.40
自引率
7.70%
发文量
9
审稿时长
13 weeks
期刊介绍: The main focus of this journal is to provide a platform for original empirical investigations in the field of professional, vocational and technical education, comparing the effectiveness, efficiency and equity of different vocational education systems at the school, company and systemic level. The journal fills a gap in the existing literature focusing on empirically-oriented academic research and stimulating the interest in strengthening the vocational part of the educational system, both at the basic and higher education level.
期刊最新文献
Different dropout directions in vocational education and training: the role of the initiating party and trainees’ reasons for dropping out Compromises in occupational choice and premature termination of vocational education and training: gender type, prestige, and occupational interests in focus The discourse on technological literacy: exploring visual representations enabled by the visual cultures of four Swedish vocational education and training programmes A network model of stress contagion: evidence from the vocational classroom Examining career and technical education (CTE) pathways in historically Black colleges and universities (HBCUs)
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1