The Performance Diagnostic Checklist–Human Services (1.1): An initial assessment of validity and reliability

Abstract

The Performance Diagnostic Checklist—Human Services (PDC-HS) is an assessment used to identify variables contributing to staff performance concerns in human-service settings. In the current study, we introduce and assess the test validity, interrater reliability, and test–retest reliability of the PDC-HS (1.1), a revised version of the assessment that included revised instructions, questions, and intervention planning references. We measured the psychometric properties of the revised assessment by analyzing answers obtained from watching video vignettes of simulated interviews between consultants and a supervisor. Twenty-one participants watched the vignettes and completed the PDC-HS (1.1) based on the answers provided during the interview. We also included an item analysis to identify questions on which participants made errors and an intervention selection task to assess whether participants selected an appropriate intervention to target the indicated domain. The results support the use of the PDC-HS (1.1) in human services settings.