Evaluating Social Validity to Inform Intervention Development: Qualitative Analysis of Caregiver Interviews

Abstract

Evaluating social validity of interventions is paramount to the applied dimension of applied behavior analysis, but in research contexts, social validity is frequently assessed only after an intervention has concluded. The present study sought to evaluate the social validity of a proposed intervention prior to intervention development through qualitative analysis of interviews with stakeholders. We interviewed ten caregivers of children with autism about their experiences and challenges engaging in play with their children. We also solicited their opinions on the proposed components of the intervention, including (1) video models; (2) smart speaker prompts; and (3) feedback and coaching via video chat. Qualitative analysis of the interview transcripts revealed several domains related to caregivers’ experiences, including challenges with social communication, openness to learning skills, and desires to build connections with one’s child. Opinions about the proposed intervention components were largely positive, citing the convenience of using technology to access the mostly asynchronous intervention. Some participants expressed hesitation or discomfort surrounding feedback and coaching via video chat. Participants made several helpful suggestions regarding the content and features of the intervention. We discuss our findings in the context of an interactive social validation process.