OSVE or multiple-choice test: Is that a relevant question?

IF 2.2 4区医学 Q2 MEDICINE, GENERAL & INTERNAL Clinics Pub Date : 2025-01-25 DOI:10.1016/j.clinsp.2024.100519

Francine Jomara Lopes, Renato Fraga Righetti, Matheus Belloni Torsani, Gustavo Silva Azevedo, Fernando Mauad Sacramento, Iolanda de Fátima Lopes Calvo Tibério

{"title":"OSVE or multiple-choice test: Is that a relevant question?","authors":"Francine Jomara Lopes, Renato Fraga Righetti, Matheus Belloni Torsani, Gustavo Silva Azevedo, Fernando Mauad Sacramento, Iolanda de Fátima Lopes Calvo Tibério","doi":"10.1016/j.clinsp.2024.100519","DOIUrl":null,"url":null,"abstract":"Introduction: The OSCE has been a robust tool for assessing clinical skills in medical education, adaptable across various clinical domains and stages. The COVID-19 pandemic, however, posed significant challenges to traditional assessment methods. This led to the development of the OSVE as an alternative.Objective: This study aimed to correlate OSVE results with MCT scores and Grade Point Average (GPA) of clerkship.Methods: This cross-sectional study involved 129 clerkships. It compared two OSVEs and two MCTs, covering content from the 5th and 6th years of the curriculum, against final graduation grades.Results: The score of GPA was 8.13 ± 0.43. The authors compared OSVE-5th (7.13 ± 0.93) and OSVE-6th (7.23 ± 0.83, NS), MCT-5th (7.08 ± 0.91) vs. MCT-6th (7.68 ± 1.21, p < 0.001), OSVE-5th (7.13 ± 0.93) and MCT-5th (7.08 ± 0.91, NS), OSVE-6th (7.23 ± 0.83) and MCT-6th (7.68 ± 1.21, p < 0.001) OSVE-5th (7.13 ± 0.93) and MCT-6th (7.68 ± 1.21, p < 0.001), OSVE-6th (7.23 ± 0.83) and MCT-5th (7.08 ± 0.91, NS), OSVE-5th (7.13 ± 0.93) and GPA (8.13 ± 0.43, p < 0.001), OSVE-6th (7.23 ± 0.83) and GPA (8.13 ± 0.43, p < 0.001), MCT-5th (7.08 ± 0.91) and GPA (8.13 ± 0.43, p < 0.001), and MCT-6th (7.68 ± 1.21) and GPA (8.13 ± 0.43, p < 0.001). There were positive correlations between OSVE-5th and OSVE-6th (R = 0.418, p < 0.05), OSVE-5th and MCT-5th (R = 0.475, p < 0.05), MCT-5th, OSVE-6th and MCT-6th (R = 0,180, p < 0.05), MCT-6th (R = 0.227, p < 0.05), with OSVE-6th and MCT-5th (R = 0.478, p < 0.05), OSVE-5th and GPA (R = 0.481, p < 0.05), OSVE-6th and GPA (R = 0,439, p < 0.05), MCT-5th and GPA (R = 0.681, p < 0.05) and MCT-6th and GPA (R = 0.195, p < 0.05), no correlation was found between OSVE-6th and MCT-6th (R = 0.070, NS).Conclusions: The correlations between the assessments revealed mild to moderate, suggesting that the assessments can be used interchangeably in the context of formative assessment. These results indicate the feasibility of using both OSVE and multiple-choice tests as effective tools to enhance intern training and monitoring.","PeriodicalId":10472,"journal":{"name":"Clinics","volume":"80 ","pages":"100519"},"PeriodicalIF":2.2000,"publicationDate":"2025-01-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Clinics","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.clinsp.2024.100519","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MEDICINE, GENERAL & INTERNAL","Score":null,"Total":0}

引用次数: 0

Abstract

Introduction: The OSCE has been a robust tool for assessing clinical skills in medical education, adaptable across various clinical domains and stages. The COVID-19 pandemic, however, posed significant challenges to traditional assessment methods. This led to the development of the OSVE as an alternative.

Objective: This study aimed to correlate OSVE results with MCT scores and Grade Point Average (GPA) of clerkship.

Methods: This cross-sectional study involved 129 clerkships. It compared two OSVEs and two MCTs, covering content from the 5th and 6th years of the curriculum, against final graduation grades.

Results: The score of GPA was 8.13 ± 0.43. The authors compared OSVE-5th (7.13 ± 0.93) and OSVE-6th (7.23 ± 0.83, NS), MCT-5th (7.08 ± 0.91) vs. MCT-6th (7.68 ± 1.21, p < 0.001), OSVE-5th (7.13 ± 0.93) and MCT-5th (7.08 ± 0.91, NS), OSVE-6th (7.23 ± 0.83) and MCT-6th (7.68 ± 1.21, p < 0.001) OSVE-5th (7.13 ± 0.93) and MCT-6th (7.68 ± 1.21, p < 0.001), OSVE-6th (7.23 ± 0.83) and MCT-5th (7.08 ± 0.91, NS), OSVE-5th (7.13 ± 0.93) and GPA (8.13 ± 0.43, p < 0.001), OSVE-6th (7.23 ± 0.83) and GPA (8.13 ± 0.43, p < 0.001), MCT-5th (7.08 ± 0.91) and GPA (8.13 ± 0.43, p < 0.001), and MCT-6th (7.68 ± 1.21) and GPA (8.13 ± 0.43, p < 0.001). There were positive correlations between OSVE-5th and OSVE-6th (R = 0.418, p < 0.05), OSVE-5th and MCT-5th (R = 0.475, p < 0.05), MCT-5th, OSVE-6th and MCT-6th (R = 0,180, p < 0.05), MCT-6th (R = 0.227, p < 0.05), with OSVE-6th and MCT-5th (R = 0.478, p < 0.05), OSVE-5th and GPA (R = 0.481, p < 0.05), OSVE-6th and GPA (R = 0,439, p < 0.05), MCT-5th and GPA (R = 0.681, p < 0.05) and MCT-6th and GPA (R = 0.195, p < 0.05), no correlation was found between OSVE-6th and MCT-6th (R = 0.070, NS).

Conclusions: The correlations between the assessments revealed mild to moderate, suggesting that the assessments can be used interchangeably in the context of formative assessment. These results indicate the feasibility of using both OSVE and multiple-choice tests as effective tools to enhance intern training and monitoring.

查看原文

微信好友朋友圈 QQ好友复制链接

本刊更多论文

求助全文

约1分钟内获得全文去求助

来源期刊

Clinics 医学-医学：内科

CiteScore

4.10

自引率

3.70%

发文量

129

审稿时长

52 days

期刊介绍： CLINICS is an electronic journal that publishes peer-reviewed articles in continuous flow, of interest to clinicians and researchers in the medical sciences. CLINICS complies with the policies of funding agencies which request or require deposition of the published articles that they fund into publicly available databases. CLINICS supports the position of the International Committee of Medical Journal Editors (ICMJE) on trial registration.