Evaluation and Program Planning最新文献

{"title":"Deflecting people experiencing a mental health crisis from the criminal-legal system at dispatch: Findings from calls-for-service reports and statewide survey data","authors":"Bethany Hedden-Clayton ,&nbsp;Alexis Carl ,&nbsp;Leonard Swanson ,&nbsp;Erin Comartin ,&nbsp;Sheryl Kubiak","doi":"10.1016/j.evalprogplan.2025.102727","DOIUrl":"10.1016/j.evalprogplan.2025.102727","url":null,"abstract":"<div><h3>Introduction</h3><div>People with mental health needs are overrepresented in the criminal-legal system in the United States. While mental health deflection and diversion from the criminal-legal system exists, limited investigations have focused on what happens to support these efforts at emergency communication centers.</div></div><div><h3>Methods</h3><div>In order to understand the possibilities for deflection at emergency communication centers, this exploratory study examined the barriers to dispatching alternative and non-law enforcement responses to mental health calls as well as the concurrence between how 911 professionals coded calls-for-service that law enforcement officers deemed to be mental health-related. Data comes from an online survey administered to two statewide 911 professional associations to assess day-to-day practices for responding to mental health calls as well as two-years of law enforcement mental health calls-for-service reports from a midwestern county.</div></div><div><h3>Results</h3><div>Regarding the use of alternative mental health responses, 911 professionals reported several concerns such as: the safety of citizens and first responders; personal, organizational, and system-level liabilities; and obligations to fulfilling caller expectations and duties as 911 professionals. Of mental health crises responded to by law enforcement officers, 911 professionals coded just over half as mental health-related. Mental health call codes were more likely to diverge between 911 professionals and law enforcement officers in communities with higher poverty rates.</div></div><div><h3>Discussion</h3><div>Results suggest it is possible for 911 professionals to identify mental health calls but there are significant implementation barriers to connecting people to non-law enforcement responses via emergency communication centers.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102727"},"PeriodicalIF":2.0,"publicationDate":"2025-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145466364","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Improving the foundational literacy skills of marginalized learners through satellite-based EdTech: The MGCubed project in Ghana","authors":"Abdul Badi Sayibu,&nbsp;Jesus Miguel Falcon Perez,&nbsp;Muniratu Issifu","doi":"10.1016/j.evalprogplan.2025.102726","DOIUrl":"10.1016/j.evalprogplan.2025.102726","url":null,"abstract":"<div><div>This paper presents the literacy results of a project titled \"Making Ghanaian Girls Great!\" (MGCubed). The project was implemented by Plan International and funded by the Foreign, Commonwealth &amp; Development Office (FCDO) through the Girl Education Challenge for Transition Fund (GEC-T). It is important to note that all opinions expressed in this article are those of the authors and do not reflect the views of the FCDO. The project utilized satellite-based education technology (EdTech) to provide distance learning to marginalized early-grade learners, primarily girls aged 9–15 years. In the assessment, girls in the treatment schools achieved a significantly higher aggregate score in literacy compared to those in the control schools. Specifically, a Difference-In-Difference regression analysis showed that the treatment group scored 1.3 %age points higher than the control group, a statistically significant difference at 5 % level of significance. These findings demonstrate that satellite-based EdTech can be an effective strategy for improving learning outcomes among underserved populations.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102726"},"PeriodicalIF":2.0,"publicationDate":"2025-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145453665","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Evaluating the sustainable development of digital inclusive finance through fuzzy DEMATEL and VIKOR: A dual-perspective approach","authors":"Guan-Jie Lien ,&nbsp;Kuo Cheng Chung ,&nbsp;Hwang Tsuen Guo","doi":"10.1016/j.evalprogplan.2025.102725","DOIUrl":"10.1016/j.evalprogplan.2025.102725","url":null,"abstract":"<div><div>Digital Inclusive Finance (DIF) leverages internet-based platforms to expand financial access for underserved populations, improving efficiency and reducing costs. The central challenge involves reconciling divergent managerial and user perspectives to foster sustainable Digital Inclusive Finance (DIF). Existing policies often overlook demand-side heterogeneity, failing to consider how variations in digital competence and trust impact user engagement. This study adopts a dual-perspective Multi-Attribute Decision-Making (MADM) framework, using Fuzzy DEMATEL to map institutional factor relationships, such as policy and technical readiness, and VIKOR to integrate user priorities. Empirical findings highlight trust and digital literacy as critical barriers to DIF adoption in Taiwan. The proposed Fuzzy DEMATEL–VIKOR framework reconciles institutional and user perspectives, providing a context-sensitive approach for policymakers to support equitable financial inclusion in digitally transitioning economies.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102725"},"PeriodicalIF":2.0,"publicationDate":"2025-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145453700","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Preparing resilient educators: A narrative review on CBT-based workshops for pre-service teachers","authors":"Carmit Gal","doi":"10.1016/j.evalprogplan.2025.102721","DOIUrl":"10.1016/j.evalprogplan.2025.102721","url":null,"abstract":"<div><div>Teacher stress and early career attrition represent global challenges in education, yet significant gaps exist in understanding how Cognitive Behavioral Therapy (CBT)-based interventions can build resilience in pre-service teachers. While mindfulness and social-emotional learning programs have received attention, few studies have systematically examined CBT workshops for teacher preparation or explored their implications for advancing evaluation methodology in educational contexts. This narrative review addresses these gaps by synthesizing evidence on CBT-based workshops for pre-service teachers while examining contributions to evaluation scholarship. Across diverse cultural and institutional contexts, CBT interventions consistently reduced stress, improved emotional regulation, and enhanced self-efficacy, with immediate benefits and variable long-term outcomes. The mechanistic clarity of CBT's cognitive restructuring approach enables precise measurement of causal pathways, making these interventions particularly suitable for theory-driven evaluation frameworks. The review reveals three critical contributions to evaluation methodology: validation of theory-driven approaches in complex educational settings, demonstration that cultural adaptation enhances program effectiveness without compromising evaluation rigor, and illumination of temporal complexity in preventive interventions. These findings provide lessons for the international evaluation community about implementing and assessing preventive interventions across diverse contexts. This study contributes a novel perspective demonstrating how CBT-based interventions can inform both teacher education program design and advancement of evaluation theory and practice.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102721"},"PeriodicalIF":2.0,"publicationDate":"2025-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145394055","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Enhancing longitudinal impact evaluation of non-experimental interventions: A comparative analysis of generalized estimating equations and multilevel models based on empirical evaluation of temporal change in food security following an economic empowerment intervention","authors":"Amon Exavery ,&nbsp;Peter Josephat Kirigiti ,&nbsp;Ramkumar T. Balan ,&nbsp;John Charles","doi":"10.1016/j.evalprogplan.2025.102722","DOIUrl":"10.1016/j.evalprogplan.2025.102722","url":null,"abstract":"<div><h3>Background</h3><div>Inadequate impact evaluation methods such as percentage changes in outcomes between assessment points, persist as a significant challenge, undermining assessment accuracy. This study provides empirical evidence to enhance evaluation practices for non-experimental interventions by comparing Generalized Estimating Equations (GEE) and Multilevel Models (MLM), with the WORTH Yetu intervention’s impact on food security as a case in point.</div></div><div><h3>Methods</h3><div>Guided by the Realist Evaluation (RE) framework which focuses on exploring what works, for whom, in what circumstances, and how, this study employed a longitudinal design using a difference-in-differences (DID) estimator to assess the impact of the WORTH Yetu economic empowerment intervention on food security among families caring for orphaned and vulnerable children (OVC) in Tanzania. Both GEE and MLM were applied to compare their performance and determine which approach, within the RE framework, offers a simpler and more practical option for improving impact evaluation practices in non-experimental settings.</div></div><div><h3>Results</h3><div>The analysis included 497,293 observations from 249,655 caregivers (aged ≥18 years) at baseline, 247,638 of whom were reassessed at follow-up. The study found a higher likelihood of enhanced food security among WORTH Yetu participants at follow-up compared to non-participants: aOR = 1.551 (95 % CI 1.509–1.594, <em>p</em> &lt; 0.001) in GEE and aOR = 1.572 (95 % CI 1.528–1.616, <em>p</em> &lt; 0.001), ICC = 28.2 % in MLM. In the computation process, GEE was simpler, estimating one set of parameters, while MLM estimated both fixed- and random-effects, requiring additional considerations and longer runtime.</div></div><div><h3>Conclusion</h3><div>Both GEE and MLM produced comparable results in terms of the magnitude, direction, and statistical significance of the WORTH Yetu economic empowerment intervention’s impact on food security. However, while GEE was simpler and more efficient as it estimated one set of parameters, MLM required additional steps and considerations to estimate both fixed-effects and random-effects. As a result, this study found greater advantages in using GEE over MLM, an option likely to improve longitudinal impact evaluation practices, especially in resource-constrained non-experimental settings, by streamlining the analysis without compromising the statistical rigor.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102722"},"PeriodicalIF":2.0,"publicationDate":"2025-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145416868","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Evaluation of tourist importance-performance for supporting adaptive marine conservation programs through marine natural capital","authors":"I Wayan Koko Suryawan ,&nbsp;Sapta Suhardono ,&nbsp;Van Viet Nguyen ,&nbsp;Chun-Hung Lee","doi":"10.1016/j.evalprogplan.2025.102724","DOIUrl":"10.1016/j.evalprogplan.2025.102724","url":null,"abstract":"<div><div>This study utilizes Importance-Performance Analysis (IPA) and regression modeling to critically evaluate tourist perceptions and their engagement in marine conservation programs in Bali, Indonesia, emphasizing the intricate relationships between human activities and environmental outcomes. Focusing on four adaptive capacity components including asset, knowledge, flexibility, and engagement, this research assesses the disparity between tourists’ expectations and the actual performance of natural capital initiatives, while providing a socio-economic analysis of these gaps. The target demographic of tourists typically exhibits higher income levels (greater than IDR 5,000,000), low travel frequencies (1 trip per year), moderate support for local natural capital initiatives (rated 2 on a scale), and a higher education level (bachelor’s degree and above). These attributes significantly shape their perceptions and interactions with the marine environment. The findings reveal substantial discrepancies, particularly in educational and engagement activities, which these well-educated and economically capable tourists value highly but report as underperforming. Moreover, the study elucidates how overall perceptions of importance and performance significantly influence tourists’ willingness to financially support conservation efforts. This analysis underlines the necessity for tourism operators to enhance the quality, interactivity, and visibility of conservation activities to effectively increase support. Strategic recommendations are proposed to refine these conservation practices, better aligning them with both tourist expectations and sustainable environmental goals. These recommendations aim to optimize the effectiveness and sustainability of marine conservation efforts, thereby ensuring they achieve significant environmental benefits while simultaneously enhancing tourist satisfaction and supporting sustainable tourism development.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102724"},"PeriodicalIF":2.0,"publicationDate":"2025-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145519548","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Framing the shift to supported employment: Exploring the impacts of a person-centred programme evaluation approach through peer led participatory research","authors":"Fahimeh Malekinezhad,&nbsp;Paul Courtney","doi":"10.1016/j.evalprogplan.2025.102723","DOIUrl":"10.1016/j.evalprogplan.2025.102723","url":null,"abstract":"<div><div>Employment support programs play a crucial role in assisting the unemployed in overcoming challenges to achieve their employment goals. The experiences of participants with multiple challenges provide insights into programme effectiveness in achieving personalised goals of employability, social development, and inclusion. This study contributes to the evaluation of supported employment by presenting a peer-derived framework grounded in participants lived experiences. Interviews with twelve participants revealed themes around employment barriers, participation opportunities, one-to-one support, achievements, and recommendations. Findings highlight the value of flexible, personalised pathways that not only enhance employability but also build confidence, motivation and support social inclusion. The developed framework including personalised support, meaningful activities, and self-perceived progress offers guidance for designing inclusive employment programmes and their evaluation. A key recommendation is the need for ongoing support to sustain employment among disadvantaged individuals managing social, mental, and physical health challenges. From an evaluation perspective, the framework demonstrates how participant-informed mechanisms—such as confidence and empowerment—drive employability and social skills, consistent with the Context–Mechanism–Outcome logic of realist evaluation. By situating peer-led evaluation within realist, empowerment, and utilisation-focused traditions, this study refines programme evaluation and strengthens its practical relevance. It shows how outcome-focused fidelity models, which capture structural quality, can be complemented by peer-led approaches capturing experiential quality. Together, these perspectives provide a holistic and transferable evaluation model that speaks to both programme design and lived experience. Beyond the local context, lessons learned highlight the value of inclusive, participatory evaluation methods in generating credible, stakeholder-driven insights and advancing more effective employment support practices globally.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102723"},"PeriodicalIF":2.0,"publicationDate":"2025-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145394125","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"An evaluation of the culturally-centered addictions research training (C-CART) graduate certificate program: A qualitative review","authors":"A. Gelatt ,&nbsp;J. Santos ,&nbsp;E.R. Eaves ,&nbsp;K. Elwell ,&nbsp;A. Roddy ,&nbsp;S. Haberstroh ,&nbsp;T. Lane ,&nbsp;K. Mommaerts ,&nbsp;J. Roddy ,&nbsp;T.G. Bautista ,&nbsp;O. Rogers ,&nbsp;J.A. Baldwin ,&nbsp;R. Mellott","doi":"10.1016/j.evalprogplan.2025.102718","DOIUrl":"10.1016/j.evalprogplan.2025.102718","url":null,"abstract":"<div><div>The Culturally-Centered Addictions Research Training (C-CART) program is a two-year graduate training program designed to train practicing clinicians and doctoral students in health-related fields in culturally-centered research for the prevention and treatment of substance use disorders (SUDs) among underserved rural communities.This paper presents data from the qualitative portion of program evaluation. These data identified the program’s strengths and areas for growth, which have been implemented to ensure a better learning experience for Scholars. We conducted ten focus groups with three C-CART cohorts, with a total of 32 Scholars. Thematic analysis revealed that participation in the program was motivated by the program emphasis on culture and research skills, as well as opportunities to connect with community agencies. Scholars were positively impacted by improved research skills and understanding of methods, increased knowledge of the importance of culturally centered practices for SUD prevention and treatment, and enhanced ability to work within interdisciplinary teams. Scholars reported gaining confidence and benefiting from a support network of faculty and peers outside their primary graduate programs.Challenges included managing demanding workloads, interprofessional cooperation, interagency collaboration, and interpersonal issues in community-engaged doctoral research. Future programs should consider how to facilitate collaboration in interdisciplinary research teams, cater to workload demand of doctoral Scholars, and ensure ample opportunities for connection and support.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102718"},"PeriodicalIF":2.0,"publicationDate":"2025-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145394104","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Predictive factors for inter-agency partnership success","authors":"Nicola Drago ,&nbsp;Tullio Vardanega","doi":"10.1016/j.evalprogplan.2025.102719","DOIUrl":"10.1016/j.evalprogplan.2025.102719","url":null,"abstract":"<div><div>Building partnerships among development cooperation agencies strengthens their collective capacity. However, 2 partnerships out of 10 fail to achieve their intended objectives. Ex-ante evaluation of future partnerships should help attain a higher rate of success. To do this, agencies need a better understanding of the factors behind successful or unsuccessful partnerships. This paper draws from the first stage of a research project aimed at systematically identifying and classifying such factors by importance in a semi-automated manner, to streamline partnership planning and evaluation tasks. The principal result we report here is a dataset containing 750 factors of influence, visualized along three axes: operations and country context, governance and management, and project quality, and grouped into ten clusters. Evaluators and planners can readily use the factors and complete method to focus multi-stakeholder discussions and information gathering, as well as to learn to use Natural Language Processing and Machine Learning approaches on project design and evaluation document corpora. Future research can overcome the limitations of the method by standardizing the factor set through ontological and taxonomic work, as well as incorporating automated context and behavioral analyses.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102719"},"PeriodicalIF":2.0,"publicationDate":"2025-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145356431","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Evaluation of the gradual release of responsibility framework’s effectiveness on oral summarization skills in Turkish middle school classrooms: A mixed methods study","authors":"Kürşat Kaya ,&nbsp;Mehmet Kurudayıoğlu ,&nbsp;Kasım Yıldırım ,&nbsp;Abbey Galeza ,&nbsp;Timothy Rasinski","doi":"10.1016/j.evalprogplan.2025.102720","DOIUrl":"10.1016/j.evalprogplan.2025.102720","url":null,"abstract":"<div><div>We aimed to explore the effects of the gradual release of responsibility framework on sixth-grade students’ oral summarization skills in the Turkish language. The current study employed convergent mixed methods research. In the quantitative phase, a pretest-posttest control group quasi-experimental design was used. The sample of the quantitative phase consisted of 41 sixth-grade students in Türkiye. The qualitative phase included observations about the intervention and the students’ diaries in the experimental group (<em>n</em> = 20). The covariance analyses on the posttest scores of the students revealed that summarization attitudes and summarization achievements of the experimental group students varied significantly compared to the control group students. In addition, it was observed that the intervention provided new insights into how students summarized a text. The students’ diaries showed that while they had difficulties with oral summarization during the intervention, they gradually developed an awareness and they liked to summarize.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102720"},"PeriodicalIF":2.0,"publicationDate":"2025-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145362715","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}