Development and Validation of a Performance Assessment Checklist Scale for Vaccine Administration

Abstract

Objective Vaccination technique is a crucial skill for medical trainees to learn, especially in the current coronavirus disease 2019 pandemic. To this end, validated assessment tools are essential in teaching appropriate techniques. However, valid instruments for assessing vaccine administration skills have not yet been developed. We therefore explored the development and validation of an assessment tool for vaccination techniques based on expert consensus. Methods We implemented a modified Delphi process to develop a vaccination technique assessment tool. We then conducted a validation study to establish the reliability and validity of the tool. Results Two rounds of the modified Delphi process were performed to generate a 19-item, vaccination performance assessment checklist. In the validation study, the linear weighted kappa value for inter-rater reliability of the overall checklist score was 0.725. Spearman's correlation coefficient between the mean checklist score and the global rating was 0.98 (p<0.01). Conclusions This is a pioneering study examining the development and validation of an assessment tool for vaccine administration techniques. The tool will be widely used in vaccination-related education.