Implementing and Evaluating Manualized Interventions in U.S. Organizations Serving Youth with Foster Care Experience: Lessons Learned from the Field

Abstract

The goal of the current study is to glean lessons learned from the Fostering Higher Education (FHE) intervention evaluation study to provide concrete strategies for helping other youth-serving organizations overcome barriers to participating in manualized intervention implementation and evaluation. Specifically, this study assesses lessons learned in organizations that serve youth with foster care experience regarding (1) implementing FHE in relation to (a) site preparation, (b) implementation, and (c) pursuing racial equity in practice; and (2) participating in research/evaluation. This study involves qualitative analyses of surveys, emails, and meeting notes from FHE implementation staff, supervisors, administrative staff, and TA providers across three study sites in the United States. Surveys assessed lessons learned by site implementation staff during the FHE implementation and evaluation process, as well as quarterly assessments of the technical assistance for implementation and evaluation provided to FHE implementation sites by the research team. Emails and meeting notes provided insights into sites’ implementation- and research/evaluation-related experiences and challenges as they were happening during the study. Communication/collaboration were key for the success of both implementation and evaluation of FHE, while training and technology were also key for implementation, and project timing and understanding the value of research were important for evaluation participation. Key themes regarding the pursuit of racial equity in FHE practice included the importance of collective learning, independent practice, and client-centered program delivery. A variety of recommendations for other youth-serving organizations interested in implementing and evaluating manualized interventions are provided based on the study’s findings.