Evaluation of Applying Standardized Patients in Certification Assessment of Clinical Practice Ability Standardized Training for Psychiatric Resident Physicians.

Abstract

Objective: The aim of this study was to explore the application of standardized patient (SP) in the certification assessment of clinical practice ability standardized training for psychiatric resident physicians.

Methods: Candidates and examiners who participated in the graduation examination of clinical practice ability standardized training for psychiatric resident physicians in Guangdong Province from 2020 to 2023 were selected as the research participants. The assessment scores of candidates were collected. Questionnaires about satisfaction degree and SP application evaluation were designed and filled out by the examiners and candidates to evaluate their satisfaction with the clinical practice ability certification assessment.

Results: The average annual score of the practical skills certification assessment is 83.88 ± 5.78 (P<0.001). There is no evident change in the second station (81.50 ± 6.81, P=0.0825), while the scores of the other stations fluctuate significantly (83.77 ± 6.80, 84.46 ± 6.70, and 88.31 ± 7.82; P<0.05). A total of 185 valid questionnaires were collected, of which 97.87% of the examiners and 92.03% of the candidates are satisfied with SP, respectively, both higher than their overall satisfaction levels (97.87% vs 89.36%; 92.03% vs 85.51). Examiners are highly consistent with their evaluation of SP satisfaction (Kendall=0.829, P<0.001), while candidates have low consistency in their evaluation of SP (Kendall=0.012, P=0.04). The differences in SP evaluation between different identities mainly include appearance, intonation, physical movements, language accuracy, and use of medical terminologies (P<0.05).

Conclusion: The satisfaction with the application of SP in the certification assessment of clinical practice ability standardized training for psychiatric resident physicians is high. However, it has inconsistent evaluations from examiners and candidates in terms of appearance, pronunciation and intonation, physical movements, language accuracy, and use of medical terminologies. Enhancing the SP level can promote the stability of the assessment.