Pub Date : 2025-02-13DOI: 10.1016/j.evalprogplan.2025.102557
Mita Marra
This article highlights recurrent themes and research communities in Sustainability Assessment (SA), a rapidly growing trans-disciplinary area particularly relevant to the global evaluation community. This bibliometric analysis signals the emergence of a substantial research community based in Asia and the Middle East, whose production is distinct from North American and European-centric evaluation studies. While the latter primarily address methodological challenges related to sustainability issues in social policy, organizational capacity building, and public health, the broader SA literature centers on life-cycle assessments to integrate the analysis of environmental and socioeconomic effects in such domains as biodiversity, energy efficiency, urban planning, alternative agriculture, and supply chain management. This mapping exercise highlights the global distribution of research output and identifies existing gaps and potential future cross-fertilization. The transdisciplinary SA literature can draw from theory-based designs attuned to complexity and systems thinking. Policy analysts and evaluators can gain insights from diverse SA perspectives and policy approaches to tackle sustainability challenges more systematically.
{"title":"Bridging the gaps in sustainability assessment: A systematic literature review, 2014–2023","authors":"Mita Marra","doi":"10.1016/j.evalprogplan.2025.102557","DOIUrl":"10.1016/j.evalprogplan.2025.102557","url":null,"abstract":"<div><div>This article highlights recurrent themes and research communities in Sustainability Assessment (SA), a rapidly growing trans-disciplinary area particularly relevant to the global evaluation community. This bibliometric analysis signals the emergence of a substantial research community based in Asia and the Middle East, whose production is distinct from North American and European-centric evaluation studies. While the latter primarily address methodological challenges related to sustainability issues in social policy, organizational capacity building, and public health, the broader SA literature centers on life-cycle assessments to integrate the analysis of environmental and socioeconomic effects in such domains as biodiversity, energy efficiency, urban planning, alternative agriculture, and supply chain management. This mapping exercise highlights the global distribution of research output and identifies existing gaps and potential future cross-fertilization. The transdisciplinary SA literature can draw from theory-based designs attuned to complexity and systems thinking. Policy analysts and evaluators can gain insights from diverse SA perspectives and policy approaches to tackle sustainability challenges more systematically.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"110 ","pages":"Article 102557"},"PeriodicalIF":1.5,"publicationDate":"2025-02-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143422491","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-02-05DOI: 10.1016/j.evalprogplan.2025.102556
Stewart I. Donaldson, Jennifer P. Villalobos, Minji Cho
“Follow the Science” was the cry heard worldwide during the COVID-19 global pandemic. This approach was used to develop evidence-based prevention measures (e.g., social distancing, hand washing, and mask-wearing), COVID treatments, and vaccines and to prevent significant declines in well-being (Donaldson, Cabrera, and Gaffaney, 2021). Leveraging this approach, the study aimed to understand promising ways to disrupt patterns of prejudice and its harmful consequences and identify the most exemplary interventions. The current study systematically reviewed 2515 published peer-reviewed studies included in 13 meta-analyses and systematic reviews on prejudice reduction interventions, using inclusion and exclusion criteria focused on gender and/or race/ethnicity. Phase 1 identified 13 studies, highlighting four exemplary evidence-based approaches: Contact Interventions, Perspective Taking, Interactive and Narrative Modalities, and Multi-faceted Interventions. These approaches presented notable success with the largest effect sizes and should be considered carefully when planning new prejudice reduction efforts. In Phase 2, the study extracted specific interventions from the 13 studies, identifying six specific exemplary interventions for mitigating prejudice and its adverse effects. The study discusses the implications of these findings for program planners and evaluators, suggesting the use of empirical insights to design post-COVID interventions, such as cultural exchange programs, virtual reality experiences, and cross-cultural music initiatives, to create meaningful social changes. Despite these practical insights, the study has limitations, including partial adherence to PRISMA guidelines and the omission of risk of bias assessment for individual studies.
{"title":"Following the science to understand how to reduce prejudice and its harmful consequences: A guide for evaluators and program planners","authors":"Stewart I. Donaldson, Jennifer P. Villalobos, Minji Cho","doi":"10.1016/j.evalprogplan.2025.102556","DOIUrl":"10.1016/j.evalprogplan.2025.102556","url":null,"abstract":"<div><div>“Follow the Science” was the cry heard worldwide during the COVID-19 global pandemic. This approach was used to develop evidence-based prevention measures (e.g., social distancing, hand washing, and mask-wearing), COVID treatments, and vaccines and to prevent significant declines in well-being (Donaldson, Cabrera, and Gaffaney, 2021). Leveraging this approach, the study aimed to understand promising ways to disrupt patterns of prejudice and its harmful consequences and identify the most exemplary interventions. The current study systematically reviewed 2515 published peer-reviewed studies included in 13 meta-analyses and systematic reviews on prejudice reduction interventions, using inclusion and exclusion criteria focused on gender and/or race/ethnicity. Phase 1 identified 13 studies, highlighting four exemplary evidence-based approaches: <em>Contact Interventions, Perspective Taking, Interactive and Narrative Modalities, and Multi-faceted Interventions</em>. These approaches presented notable success with the largest effect sizes and should be considered carefully when planning new prejudice reduction efforts. In Phase 2, the study extracted specific interventions from the 13 studies, identifying six specific exemplary interventions for mitigating prejudice and its adverse effects. The study discusses the implications of these findings for program planners and evaluators, suggesting the use of empirical insights to design post-COVID interventions, such as cultural exchange programs, virtual reality experiences, and cross-cultural music initiatives, to create meaningful social changes. Despite these practical insights, the study has limitations, including partial adherence to PRISMA guidelines and the omission of risk of bias assessment for individual studies.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"110 ","pages":"Article 102556"},"PeriodicalIF":1.5,"publicationDate":"2025-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143394902","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This study evaluates the transformative impact of the Deen Dayal Upadhyaya Grameen Kaushalya Yojana (DDU-GKY) on rural youth in Gujarat, focusing on vocational skill enhancement and employability. Employing a robust mixed-methods approach grounded in the Kirkpatrick training evaluation model, this research dives deeper into the nuanced effects of gender, educational background, and Project Implementing Agencies (PIAs) on the effectiveness of skill development initiatives. Quantitative data from over 500 beneficiaries and qualitative insights through in-depth interviews reveal critical success factors and areas for improvement, underscoring the scheme's pivotal role in bridging the rural-urban skill gap. This comprehensive analysis not only affirms the positive outcomes of the DDU-GKY initiative but also identifies key leverage points for policymakers and practitioners to enhance vocational training programs in Gujarat and similar contexts.
{"title":"Vocational training and employability: A study in reference to skill development program from Gujarat, India","authors":"Anurag Kumar Srivastava , Bhavya Logar , Surbhi Sanghvi , Avani Vaghela , Manish Adwani","doi":"10.1016/j.evalprogplan.2025.102554","DOIUrl":"10.1016/j.evalprogplan.2025.102554","url":null,"abstract":"<div><div>This study evaluates the transformative impact of the Deen Dayal Upadhyaya Grameen Kaushalya Yojana (DDU-GKY) on rural youth in Gujarat, focusing on vocational skill enhancement and employability. Employing a robust mixed-methods approach grounded in the Kirkpatrick training evaluation model, this research dives deeper into the nuanced effects of gender, educational background, and Project Implementing Agencies (PIAs) on the effectiveness of skill development initiatives. Quantitative data from over 500 beneficiaries and qualitative insights through in-depth interviews reveal critical success factors and areas for improvement, underscoring the scheme's pivotal role in bridging the rural-urban skill gap. This comprehensive analysis not only affirms the positive outcomes of the DDU-GKY initiative but also identifies key leverage points for policymakers and practitioners to enhance vocational training programs in Gujarat and similar contexts.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"110 ","pages":"Article 102554"},"PeriodicalIF":1.5,"publicationDate":"2025-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143378060","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-01-31DOI: 10.1016/j.evalprogplan.2025.102550
Susanna R. Cohen , Virginie Marchand , Kimberly Calkins , Maya J. Stephens , Mariam L. Barabara , Linda M. Minja , Gaudensia A. Olomi , Janeth Mlay , Pendo S. Mlay , Olivia R. Hanson , Blandina T. Mmbaga , Melissa H. Watt
Introduction
Stigma towards women living with HIV (WLHIV) during childbirth can lead to suboptimal care and clinical outcomes. In this paper we describe the design of MAMA, a simulation team-training curriculum for labor and delivery (L&D) providers to reduce HIV stigma, provide more respectful maternity care (RMC), and improve clinical empathy.
Methods
In order to adapt the PRONTO model of simulation training, we integrated and applied the ADAPT-ITT framework for systematic adaptation of evidence-based interventions (EBI) and participatory design principles to create a responsive and innovative program. This process ensured we met local needs through continuous and iterative input from stakeholders, enabling those who would benefit from the intervention to drive its creation.
Results
The final intervention is a 2.5 days workshop, followed by a 2-hour in-situ refresher in the providers’ clinical setting. The training centers simulation scenarios, teamwork and communication activities, and interactive lessons on principles of RMC, HIV stigma, prevention of mother-to-child transmission, implicit bias, teamwork, clinical empathy, and coping with burnout.
Conclusion
The ADAPT-ITT model, augmented by participatory design strategies, provides a systematic yet flexible process to adapt and contextualize EBIs. The use of these complementary approaches resulted in a locally grounded intervention to build provider confidence and skills caring for WLHIV giving birth and to improve RMC in facilities in Tanzania.
Trial registration
NCT 03600142
{"title":"Participatory simulation training design: The MAMA interprofessional team-training program for obstetric care of pregnant individuals living with HIV in Tanzania","authors":"Susanna R. Cohen , Virginie Marchand , Kimberly Calkins , Maya J. Stephens , Mariam L. Barabara , Linda M. Minja , Gaudensia A. Olomi , Janeth Mlay , Pendo S. Mlay , Olivia R. Hanson , Blandina T. Mmbaga , Melissa H. Watt","doi":"10.1016/j.evalprogplan.2025.102550","DOIUrl":"10.1016/j.evalprogplan.2025.102550","url":null,"abstract":"<div><h3>Introduction</h3><div>Stigma towards women living with HIV (WLHIV) during childbirth can lead to suboptimal care and clinical outcomes. In this paper we describe the design of <em>MAMA</em>, a simulation team-training curriculum for labor and delivery (L&D) providers to reduce HIV stigma, provide more respectful maternity care (RMC), and improve clinical empathy.</div></div><div><h3>Methods</h3><div>In order to adapt the PRONTO model of simulation training, we integrated and applied the ADAPT-ITT framework for systematic adaptation of evidence-based interventions (EBI) and participatory design principles to create a responsive and innovative program. This process ensured we met local needs through continuous and iterative input from stakeholders, enabling those who would benefit from the intervention to drive its creation.</div></div><div><h3>Results</h3><div>The final intervention is a 2.5 days workshop, followed by a 2-hour <em>in-situ</em> refresher in the providers’ clinical setting. The training centers simulation scenarios, teamwork and communication activities, and interactive lessons on principles of RMC, HIV stigma, prevention of mother-to-child transmission, implicit bias, teamwork, clinical empathy, and coping with burnout.</div></div><div><h3>Conclusion</h3><div>The ADAPT-ITT model, augmented by participatory design strategies, provides a systematic yet flexible process to adapt and contextualize EBIs. The use of these complementary approaches resulted in a locally grounded intervention to build provider confidence and skills caring for WLHIV giving birth and to improve RMC in facilities in Tanzania.</div></div><div><h3>Trial registration</h3><div>NCT 03600142</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"110 ","pages":"Article 102550"},"PeriodicalIF":1.5,"publicationDate":"2025-01-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143182650","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-01-30DOI: 10.1016/j.evalprogplan.2025.102551
Wenjun Mai , Lijun Mai , Yanpeng Chen
Insufficient and low public service quality in China has resulted in unfulfilled resident needs, necessitating an examination to improve public service quality. Thus, this study constructs a public service quality index for 29 provinces covering 2004–2020 to explore the relationship between expenditure decentralization and public service quality. Using Fixed effects model, OLS and System Generalized Method of Moments (SYS-GMM) technique, this study reveals that expenditure decentralization has a significantly positive effect on public service quality, with a 1 % increase in expenditure decentralization leading to a 0.287 % improvement in public service quality. Additionally, the impact of expenditure decentralization on public service quality in the eastern and central regions is positively significant, while in the western region, expenditure decentralization does not positively affect public service quality. Furthermore, based on the public service quality theory, this study finds that FDI and fiscal self-sufficiency can enhance the relationship between expenditure decentralization and public service quality. The study provides evidence-based recommendations for policymakers to prioritize expenditure decentralization as a strategy to enhance public service quality, especially when considering attracting FDI and promoting fiscal self-sufficiency.
{"title":"Assessing the expenditure decentralization in enhancing public service quality: Evidence from 29 province in China","authors":"Wenjun Mai , Lijun Mai , Yanpeng Chen","doi":"10.1016/j.evalprogplan.2025.102551","DOIUrl":"10.1016/j.evalprogplan.2025.102551","url":null,"abstract":"<div><div>Insufficient and low public service quality in China has resulted in unfulfilled resident needs, necessitating an examination to improve public service quality. Thus, this study constructs a public service quality index for 29 provinces covering 2004–2020 to explore the relationship between expenditure decentralization and public service quality. Using Fixed effects model, OLS and System Generalized Method of Moments (SYS-GMM) technique, this study reveals that expenditure decentralization has a significantly positive effect on public service quality, with a 1 % increase in expenditure decentralization leading to a 0.287 % improvement in public service quality. Additionally, the impact of expenditure decentralization on public service quality in the eastern and central regions is positively significant, while in the western region, expenditure decentralization does not positively affect public service quality. Furthermore, based on the public service quality theory, this study finds that FDI and fiscal self-sufficiency can enhance the relationship between expenditure decentralization and public service quality. The study provides evidence-based recommendations for policymakers to prioritize expenditure decentralization as a strategy to enhance public service quality, especially when considering attracting FDI and promoting fiscal self-sufficiency.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"110 ","pages":"Article 102551"},"PeriodicalIF":1.5,"publicationDate":"2025-01-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143081771","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-01-28DOI: 10.1016/j.evalprogplan.2025.102553
Md. Faisal-E-Alam , Zeennat Ara Begum , Abu Reza Md Towfiqul Islam
This study investigates the effects of training on behavioral changes and overall performance at both the employee and organizational levels within the private banking sector of Bangladesh. Using the Theory of Planned Behavior (TPB) and Goal-Setting Theory (GST) as the theoretical framework, the research explores the underexamined third and fourth levels of Kirkpatrick’s training evaluation model, focusing specifically on behavioral outcomes and their subsequent influence on performance. Data collected from employees through structured questionnaires were analyzed using the Paired sample t-test. Findings reveal that training positively impacts employee behavior and enhances individual and organizational performance, particularly in effective teamwork, job satisfaction, work quality, task efficiency, and retaining existing clients while attracting new ones. This study represents one of the first empirical investigations in the banking sector of Bangladesh to link behavioral change evaluation to performance outcomes evaluation following training interventions. The research provides valuable insights for policymakers and organizational leaders, emphasizing the need for comprehensive training programs to promote skill development and behavioral and performance improvements. Future research should incorporate a larger sample size, adopt a longitudinal design, use advanced statistical methods like structural equation modeling (SEM), and investigate moderating variables to better understand the complex relationships between training interventions, employee behavior, and performance outcomes.
{"title":"Unveiling training effectiveness through behavior and performance evaluations: A case from developing country","authors":"Md. Faisal-E-Alam , Zeennat Ara Begum , Abu Reza Md Towfiqul Islam","doi":"10.1016/j.evalprogplan.2025.102553","DOIUrl":"10.1016/j.evalprogplan.2025.102553","url":null,"abstract":"<div><div>This study investigates the effects of training on behavioral changes and overall performance at both the employee and organizational levels within the private banking sector of Bangladesh. Using the Theory of Planned Behavior (TPB) and Goal-Setting Theory (GST) as the theoretical framework, the research explores the underexamined third and fourth levels of Kirkpatrick’s training evaluation model, focusing specifically on behavioral outcomes and their subsequent influence on performance. Data collected from employees through structured questionnaires were analyzed using the Paired sample t-test. Findings reveal that training positively impacts employee behavior and enhances individual and organizational performance, particularly in effective teamwork, job satisfaction, work quality, task efficiency, and retaining existing clients while attracting new ones. This study represents one of the first empirical investigations in the banking sector of Bangladesh to link behavioral change evaluation to performance outcomes evaluation following training interventions. The research provides valuable insights for policymakers and organizational leaders, emphasizing the need for comprehensive training programs to promote skill development and behavioral and performance improvements. Future research should incorporate a larger sample size, adopt a longitudinal design, use advanced statistical methods like structural equation modeling (SEM), and investigate moderating variables to better understand the complex relationships between training interventions, employee behavior, and performance outcomes.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"110 ","pages":"Article 102553"},"PeriodicalIF":1.5,"publicationDate":"2025-01-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143180646","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
In 2017, the continuity of midwifery care model was introduced as the way forward in Scottish maternity and neonatal services. There is no shared research strategy aligning research needs with an agenda, setting goals and revising plans. In this paper, we outline the systematic multi-actor and integrated knowledge translation process that frames and informs our initiative to develop a continuity of midwifery care research strategy, focusing on establishing a comprehensive mission, vision, and research topics. Guided by the pre-implementation process as part of the implementation science methodology, we engaged with a Scottish group of stakeholders, including service providers, academics, managers/policymakers, service users’ advocates and midwifery students during targeted activities to contribute to a widely held perspective. We collected data using an online poll, subgroup brainstorming sessions, plenary group discussions, evaluation and video recording to frame and inform the research mission, vision and study topics. Data collection tools included word clouds, brainstorming sheets, observation notes, ranking, evaluation forms and recording transcripts. The outcomes of a stepwise analytic approach of mapping, synthesising, and using the data to develop a continuity of midwifery care research direction and focus will inform future funding applications, studies and projects. The pre-implementation process and actions described in this paper can serve as an example of structuring comprehensive research strategies in other settings, cultures, domains or contexts.
{"title":"The pre-implementation process of the continuity of midwifery care research strategy: An implementation science methodologically guided initiative","authors":"Yvonne Kuipers , Alix Aitken-Arbuckle , Kathryn Hardie , Amy Corrigan , Holly Jenkins , Justine Craig","doi":"10.1016/j.evalprogplan.2025.102552","DOIUrl":"10.1016/j.evalprogplan.2025.102552","url":null,"abstract":"<div><div>In 2017, the continuity of midwifery care model was introduced as the way forward in Scottish maternity and neonatal services. There is no shared research strategy aligning research needs with an agenda, setting goals and revising plans. In this paper, we outline the systematic multi-actor and integrated knowledge translation process that frames and informs our initiative to develop a continuity of midwifery care research strategy, focusing on establishing a comprehensive mission, vision, and research topics. Guided by the pre-implementation process as part of the implementation science methodology, we engaged with a Scottish group of stakeholders, including service providers, academics, managers/policymakers, service users’ advocates and midwifery students during targeted activities to contribute to a widely held perspective. We collected data using an online poll, subgroup brainstorming sessions, plenary group discussions, evaluation and video recording to frame and inform the research mission, vision and study topics. Data collection tools included word clouds, brainstorming sheets, observation notes, ranking, evaluation forms and recording transcripts. The outcomes of a stepwise analytic approach of mapping, synthesising, and using the data to develop a continuity of midwifery care research direction and focus will inform future funding applications, studies and projects. The pre-implementation process and actions described in this paper can serve as an example of structuring comprehensive research strategies in other settings, cultures, domains or contexts.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"110 ","pages":"Article 102552"},"PeriodicalIF":1.5,"publicationDate":"2025-01-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143075893","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-01-17DOI: 10.1016/j.evalprogplan.2025.102539
Rebecca L. Fix , Edward L. Palmer Sr.
Growing recognition of the serious consequences of racism in the United States encourage organizations and agencies to move toward an anti-racist approach. Implicit racial bias trainings are one piece of the approach toward this end. While many such trainings are being conducted nationwide, it remains unclear what practices best encourage participation, engagement, and desired outcomes following implicit racial bias trainings. We collected data from 225 implicit racial bias training participants working in criminal legal, educational, health care, and corporate settings. At the end of the trainings, participants completed brief surveys measuring knowledge about implicit bias, ethnocultural empathy, and acceptability of racial bias. Written responses about what was liked and could be improved in the training were also collected and analyzed using inductive coding to arrive at codes, categories, and themes. Results suggest participant voice is integral in understanding how to engage participants in trainings. Participants described being engaged in the training through a targeted introduction to the topic and through stylistic considerations by the facilitator including modeling vulnerability and self-examination. Findings emphasize that what participants perceive to be best practices in such trainings integrate strategies through which we can educate adult learners, engage participants, and address a sensitive topic head-on.
{"title":"Active ingredients in implicit racial bias training: Incorporating participant voice to promote engagement","authors":"Rebecca L. Fix , Edward L. Palmer Sr.","doi":"10.1016/j.evalprogplan.2025.102539","DOIUrl":"10.1016/j.evalprogplan.2025.102539","url":null,"abstract":"<div><div>Growing recognition of the serious consequences of racism in the United States encourage organizations and agencies to move toward an anti-racist approach. Implicit racial bias trainings are one piece of the approach toward this end. While many such trainings are being conducted nationwide, it remains unclear what practices best encourage participation, engagement, and desired outcomes following implicit racial bias trainings. We collected data from 225 implicit racial bias training participants working in criminal legal, educational, health care, and corporate settings. At the end of the trainings, participants completed brief surveys measuring knowledge about implicit bias, ethnocultural empathy, and acceptability of racial bias. Written responses about what was liked and could be improved in the training were also collected and analyzed using inductive coding to arrive at codes, categories, and themes. Results suggest participant voice is integral in understanding how to engage participants in trainings. Participants described being engaged in the training through a targeted introduction to the topic and through stylistic considerations by the facilitator including modeling vulnerability and self-examination. Findings emphasize that what participants perceive to be best practices in such trainings integrate strategies through which we can educate adult learners, engage participants, and address a sensitive topic head-on.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"109 ","pages":"Article 102539"},"PeriodicalIF":1.5,"publicationDate":"2025-01-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143025370","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-01-16DOI: 10.1016/j.evalprogplan.2025.102540
Elizabeth Jarpe-Ratner , Lara Altman , Aimee Schnabel , Bianca Reid , Booker Marshall , Kendall Matias , Kat Ramirez-Mercado , Michael C. Fagen , Lisa Masinter
Objective
Linking adolescent students to sexual health services has been recommended to promote overall adolescent health and wellbeing. Support at the school level is needed to develop such linkages, particularly in large, urban districts.
Data collection methods
A series of focus groups and interviews were conducted in three high schools piloting sexual health services linkage efforts in Chicago Public Schools. Analytical strategy: All focus groups were recorded, transcribed, and analyzed using Atlas.ti.
Findings
Study participants articulated two central challenges and strategies to address them. To address the first challenge – integrating and coordinating services into the school culture –valueholders suggested increasing communication among school staff members and parents and integrating providers into the school ecosystem. Strategies suggested to address the second challenge – issues of stigma and privacy around seeking services – include offering more than sexual health services, maintaining confidentiality and minimizing staff knowledge of service utilization, increasing staff capacity to meet students’ needs and reduce discomfort, and finally partnering with students to disseminate information about service availability and promote utilization.
Conclusion
A Toolkit, documenting these suggested strategies and recommendations, was developed and is currently being used to inform ongoing professional development for school staff across the district on how to connect young people to sexual health services. Lessons learned from this process are reported here as well as implications for other schools, districts, and the field.
{"title":"Formative research and development of a referral toolkit for sexual health services linkages within chicago public high schools","authors":"Elizabeth Jarpe-Ratner , Lara Altman , Aimee Schnabel , Bianca Reid , Booker Marshall , Kendall Matias , Kat Ramirez-Mercado , Michael C. Fagen , Lisa Masinter","doi":"10.1016/j.evalprogplan.2025.102540","DOIUrl":"10.1016/j.evalprogplan.2025.102540","url":null,"abstract":"<div><h3>Objective</h3><div>Linking adolescent students to sexual health services has been recommended to promote overall adolescent health and wellbeing. Support at the school level is needed to develop such linkages, particularly in large, urban districts.</div></div><div><h3>Data collection methods</h3><div>A series of focus groups and interviews were conducted in three high schools piloting sexual health services linkage efforts in Chicago Public Schools. Analytical strategy: All focus groups were recorded, transcribed, and analyzed using Atlas.ti.</div></div><div><h3>Findings</h3><div>Study participants articulated two central challenges and strategies to address them. To address the first challenge – integrating and coordinating services into the school culture –valueholders suggested increasing communication among school staff members and parents and integrating providers into the school ecosystem. Strategies suggested to address the second challenge – issues of stigma and privacy around seeking services – include offering more than sexual health services, maintaining confidentiality and minimizing staff knowledge of service utilization, increasing staff capacity to meet students’ needs and reduce discomfort, and finally partnering with students to disseminate information about service availability and promote utilization.</div></div><div><h3>Conclusion</h3><div>A Toolkit, documenting these suggested strategies and recommendations, was developed and is currently being used to inform ongoing professional development for school staff across the district on how to connect young people to sexual health services. Lessons learned from this process are reported here as well as implications for other schools, districts, and the field.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"110 ","pages":"Article 102540"},"PeriodicalIF":1.5,"publicationDate":"2025-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143042284","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-01-15DOI: 10.1016/j.evalprogplan.2025.102534
Bidossessi M.G. Dossou Kpanou , Jori N. Hall , Kathleen D. Kelsey
Evaluation practices in the French-speaking countries of the West African Economic and Monetary Union (WAEMU) are poorly understood and infrequently documented. Our study is a descriptive analysis that elucidates how stakeholders are conceptualized and involved in evaluation processes in WAEMU. In these countries, evaluators are concerned about the weak stakeholder involvement in evaluation activity and call for greater stakeholder engagement, juxtaposed to the challenges of doing so. This embedded mixed methods design allowed us to examine stakeholders’ involvement in evaluation processes in the French-speaking WAEMU countries. The results revealed that stakeholders were conceptualized either through structured categorization using established categories in the evaluation literature or through contextual categorization, depending on their relevance to the evaluation process and the information they can provide. Regardless of these categorizations, the primary rationale for stakeholder engagement processes was to achieve acceptable or credible results and to engage the most influential stakeholders. These findings contribute to the evaluation literature by offering a deeper understanding of stakeholder involvement in the WAEMU context.
{"title":"Conquering acceptability: A study of stakeholder inclusion practices in evaluation processes in francophone West African Countries","authors":"Bidossessi M.G. Dossou Kpanou , Jori N. Hall , Kathleen D. Kelsey","doi":"10.1016/j.evalprogplan.2025.102534","DOIUrl":"10.1016/j.evalprogplan.2025.102534","url":null,"abstract":"<div><div>Evaluation practices in the French-speaking countries of the West African Economic and Monetary Union (WAEMU) are poorly understood and infrequently documented. Our study is a descriptive analysis that elucidates how stakeholders are conceptualized and involved in evaluation processes in WAEMU. In these countries, evaluators are concerned about the weak stakeholder involvement in evaluation activity and call for greater stakeholder engagement, juxtaposed to the challenges of doing so. This embedded mixed methods design allowed us to examine stakeholders’ involvement in evaluation processes in the French-speaking WAEMU countries. The results revealed that stakeholders were conceptualized either through structured categorization using established categories in the evaluation literature or through contextual categorization, depending on their relevance to the evaluation process and the information they can provide. Regardless of these categorizations, the primary rationale for stakeholder engagement processes was to achieve acceptable or credible results and to engage the most influential stakeholders. These findings contribute to the evaluation literature by offering a deeper understanding of stakeholder involvement in the WAEMU context.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"110 ","pages":"Article 102534"},"PeriodicalIF":1.5,"publicationDate":"2025-01-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143029909","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}