Evaluating the Novel Use of Unmanned Video Objective Structured Clinical Examination Stations in Pediatric Resident Training: Results and Insights

Abstract

Objective structured clinical examination (OSCE) is vital in assessing medical trainees’ clinical competence. Unlike the traditional resource-intensive OSCE, video-based OSCE has advantages like asynchronous assessment and more immediate feedback. However, their applicability and effectiveness in pediatric residency training are less explored. This study aims to evaluate the feasibility and outcomes of using unmanned video OSCE stations in pediatric residency training. A cross-sectional study was conducted with 79 pediatric residents participating in OSCE mock stations. Video clips showing real-life clinical scenarios were played. Residents then responded electronically to scenario-related multiple-choice questions. Descriptive statistics were employed to analyze residents’ responses to multiple-choice questions. In a study of 79 physicians, the majority were female (63.3%) and under 34 years old (62%), with most receiving their training outside Riyadh (79.7%). Their clinical understanding, assessed through a nonmanned OSCE video, varied: 16.5% accurately diagnosed spinal muscular atrophy in infants, while 48.1% correctly identified laryngomalacia in 2-month-olds. The average knowledge score was 2.89 out of 7, with a standard deviation of 1.19. Notably, 43% answered three scenarios correctly. Analysis showed no significant correlation between the physicians’ gender, age, or training location and their knowledge scores, indicating diverse expertise levels irrespective of these demographic factors. Unmanned video OSCE stations show promise in enhancing pediatric residency training assessments by providing instant feedback and streamlining the evaluation process. However, challenges and the need for targeted interventions should be considered. Future research should focus on refining technology integration and assessing long-term impacts on residents’ clinical skills and patient care outcomes. Ensuring the privacy and security of video recordings is essential in this technologically evolving landscape.