OSVE or multiple-choice test: Is that a relevant question?

IF 2.4 4区医学 Q2 MEDICINE, GENERAL & INTERNAL Clinics Pub Date : 2025-01-01 Epub Date: 2025-01-27 DOI:10.1016/j.clinsp.2024.100519

Francine Jomara Lopes , Renato Fraga Righetti , Matheus Belloni Torsani , Gustavo Silva Azevedo , Fernando Mauad Sacramento , Iolanda de Fátima Lopes Calvo Tibério

{"title":"OSVE or multiple-choice test: Is that a relevant question?","authors":"Francine Jomara Lopes , Renato Fraga Righetti , Matheus Belloni Torsani , Gustavo Silva Azevedo , Fernando Mauad Sacramento , Iolanda de Fátima Lopes Calvo Tibério","doi":"10.1016/j.clinsp.2024.100519","DOIUrl":null,"url":null,"abstract":"<div><h3>Introduction</h3><div>The OSCE has been a robust tool for assessing clinical skills in medical education, adaptable across various clinical domains and stages. The COVID-19 pandemic, however, posed significant challenges to traditional assessment methods. This led to the development of the OSVE as an alternative.</div></div><div><h3>Objective</h3><div>This study aimed to correlate OSVE results with MCT scores and Grade Point Average (GPA) of clerkship.</div></div><div><h3>Methods</h3><div>This cross-sectional study involved 129 clerkships. It compared two OSVEs and two MCTs, covering content from the 5th and 6th years of the curriculum, against final graduation grades.</div></div><div><h3>Results</h3><div>The score of GPA was 8.13 ± 0.43. The authors compared OSVE-5th (7.13 ± 0.93) and OSVE-6th (7.23 ± 0.83, NS), MCT-5th (7.08 ± 0.91) vs. MCT-6th (7.68 ± 1.21, <em>p</em> < 0.001), OSVE-5th (7.13 ± 0.93) and MCT-5th (7.08 ± 0.91, NS), OSVE-6th (7.23 ± 0.83) and MCT-6th (7.68 ± 1.21, <em>p</em> < 0.001) OSVE-5th (7.13 ± 0.93) and MCT-6th (7.68 ± 1.21, <em>p</em> < 0.001), OSVE-6th (7.23 ± 0.83) and MCT-5th (7.08 ± 0.91, NS), OSVE-5th (7.13 ± 0.93) and GPA (8.13 ± 0.43, <em>p</em> < 0.001), OSVE-6th (7.23 ± 0.83) and GPA (8.13 ± 0.43, <em>p</em> < 0.001), MCT-5th (7.08 ± 0.91) and GPA (8.13 ± 0.43, <em>p</em> < 0.001), and MCT-6th (7.68 ± 1.21) and GPA (8.13 ± 0.43, <em>p</em> < 0.001). There were positive correlations between OSVE-5th and OSVE-6th (<em>R</em> = 0.418, <em>p</em> < 0.05), OSVE-5th and MCT-5th (<em>R</em> = 0.475, <em>p</em> < 0.05), MCT-5th, OSVE-6th and MCT-6th (<em>R</em> = 0,180, <em>p</em> < 0.05), MCT-6th (<em>R</em> = 0.227, <em>p</em> < 0.05), with OSVE-6th and MCT-5th (<em>R</em> = 0.478, <em>p</em> < 0.05), OSVE-5th and GPA (<em>R</em> = 0.481, <em>p</em> < 0.05), OSVE-6th and GPA (<em>R</em> = 0,439, <em>p</em> < 0.05), MCT-5th and GPA (<em>R</em> = 0.681, <em>p</em> < 0.05) and MCT-6th and GPA (<em>R</em> = 0.195, <em>p</em> < 0.05), no correlation was found between OSVE-6th and MCT-6th (<em>R</em> = 0.070, NS).</div></div><div><h3>Conclusions</h3><div>The correlations between the assessments revealed mild to moderate, suggesting that the assessments can be used interchangeably in the context of formative assessment. These results indicate the feasibility of using both OSVE and multiple-choice tests as effective tools to enhance intern training and monitoring<strong>.</strong></div></div>","PeriodicalId":10472,"journal":{"name":"Clinics","volume":"80 ","pages":"Article 100519"},"PeriodicalIF":2.4000,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Clinics","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1807593224001960","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/27 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"MEDICINE, GENERAL & INTERNAL","Score":null,"Total":0}

引用次数: 0

Abstract

Introduction

The OSCE has been a robust tool for assessing clinical skills in medical education, adaptable across various clinical domains and stages. The COVID-19 pandemic, however, posed significant challenges to traditional assessment methods. This led to the development of the OSVE as an alternative.

Objective

This study aimed to correlate OSVE results with MCT scores and Grade Point Average (GPA) of clerkship.

Methods

This cross-sectional study involved 129 clerkships. It compared two OSVEs and two MCTs, covering content from the 5th and 6th years of the curriculum, against final graduation grades.

Results

The score of GPA was 8.13 ± 0.43. The authors compared OSVE-5th (7.13 ± 0.93) and OSVE-6th (7.23 ± 0.83, NS), MCT-5th (7.08 ± 0.91) vs. MCT-6th (7.68 ± 1.21, p < 0.001), OSVE-5th (7.13 ± 0.93) and MCT-5th (7.08 ± 0.91, NS), OSVE-6th (7.23 ± 0.83) and MCT-6th (7.68 ± 1.21, p < 0.001) OSVE-5th (7.13 ± 0.93) and MCT-6th (7.68 ± 1.21, p < 0.001), OSVE-6th (7.23 ± 0.83) and MCT-5th (7.08 ± 0.91, NS), OSVE-5th (7.13 ± 0.93) and GPA (8.13 ± 0.43, p < 0.001), OSVE-6th (7.23 ± 0.83) and GPA (8.13 ± 0.43, p < 0.001), MCT-5th (7.08 ± 0.91) and GPA (8.13 ± 0.43, p < 0.001), and MCT-6th (7.68 ± 1.21) and GPA (8.13 ± 0.43, p < 0.001). There were positive correlations between OSVE-5th and OSVE-6th (R = 0.418, p < 0.05), OSVE-5th and MCT-5th (R = 0.475, p < 0.05), MCT-5th, OSVE-6th and MCT-6th (R = 0,180, p < 0.05), MCT-6th (R = 0.227, p < 0.05), with OSVE-6th and MCT-5th (R = 0.478, p < 0.05), OSVE-5th and GPA (R = 0.481, p < 0.05), OSVE-6th and GPA (R = 0,439, p < 0.05), MCT-5th and GPA (R = 0.681, p < 0.05) and MCT-6th and GPA (R = 0.195, p < 0.05), no correlation was found between OSVE-6th and MCT-6th (R = 0.070, NS).

Conclusions

The correlations between the assessments revealed mild to moderate, suggesting that the assessments can be used interchangeably in the context of formative assessment. These results indicate the feasibility of using both OSVE and multiple-choice tests as effective tools to enhance intern training and monitoring.

查看原文

微信好友朋友圈 QQ好友复制链接

本刊更多论文

OSVE或多项选择题：这是一个相关的问题吗？

简介：欧安组织一直是评估医学教育临床技能的有力工具，适用于各种临床领域和阶段。然而，2019冠状病毒病大流行对传统评估方法提出了重大挑战。这导致了OSVE作为替代方案的发展。目的：本研究旨在探讨OSVE结果与实习生MCT成绩和平均绩点（GPA）的相关性。方法：对129名办事员进行横断面研究。它比较了两个osve和两个mct，涵盖了5年级和6年级的课程内容，以及最终的毕业成绩。结果：平均分为8.13±0.43分。作者OSVE-5th相比(7.13±0.93)和OSVE-6th(7.23±0.83,NS) MCT-5th(7.08±0.91)与MCT-6th(7.68±1.21,p < 0.001), OSVE-5th(7.13±0.93)和MCT-5th(7.08±0.91,NS) OSVE-6th(7.23±0.83)和MCT-6th(7.68±1.21,p < 0.001) OSVE-5th(7.13±0.93)和MCT-6th(7.68±1.21,p < 0.001), OSVE-6th(7.23±0.83)和MCT-5th(7.08±0.91,NS) OSVE-5th GPA(7.13±0.93)和(8.13±0.43,p < 0.001), OSVE-6th GPA(7.23±0.83)和(8.13±0.43,p < 0.001),mct -5（7.08±0.91）和GPA(8.13±0.43,p < 0.001), mct -6（7.68±1.21）和GPA（8.13±0.43,p < 0.001）。OSVE-5th和OSVE-6th之间有正相关性(R = 0.418, p < 0.05), OSVE-5th和MCT-5th (R = 0.475, p < 0.05), MCT-5th, OSVE-6th MCT-6th (R = 0180, p < 0.05), MCT-6th (R = 0.227, p < 0.05),与OSVE-6th MCT-5th (R = 0.478, p < 0.05), OSVE-5th和GPA (R = 0.481, p < 0.05), OSVE-6th和GPA (R = 0439, p < 0.05), MCT-5th和GPA (R = 0.681, p < 0.05)和MCT-6th和GPA (R = 0.195, p < 0.05), OSVE-6th和MCT-6th之间不存在相关性(R = 0.070, NS)。结论：评估之间的相关性显示为轻度到中度，表明评估可以在形成性评估的背景下互换使用。这些结果表明，使用OSVE和选择题测试作为加强实习生培训和监督的有效工具是可行的。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文去求助

来源期刊

Clinics 医学-医学：内科

CiteScore

4.10

自引率

3.70%

发文量

129

审稿时长

52 days

期刊介绍： CLINICS is an electronic journal that publishes peer-reviewed articles in continuous flow, of interest to clinicians and researchers in the medical sciences. CLINICS complies with the policies of funding agencies which request or require deposition of the published articles that they fund into publicly available databases. CLINICS supports the position of the International Committee of Medical Journal Editors (ICMJE) on trial registration.