Evaluation and Program Planning最新文献_第2页

Lessons learned in the implementation of graduation programs: The experience of Colombia, Mexico, and Paraguay 毕业课程实施的经验教训：哥伦比亚、墨西哥和巴拉圭的经验。

IF 2 4区社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY

Evaluation and Program Planning

Pub Date : 2026-04-01 Epub Date: 2025-12-19 DOI: 10.1016/j.evalprogplan.2025.102746

Graciela Teruel-Belismelis , Jorge H. Maldonado , Marlene Peters-Castilla , Manuel Triano-Enríquez

The aim of this study is to identify systematic and generalizable strengths and weaknesses in the processes for implementing four graduation programs carried out in Colombia (2), Mexico, and Paraguay in 2015–17. The specific aims are to identify some of the key factors common to these processes and their contribution to the efficiency of program implementation, as well as to not others that may not appear in all these processes but may affect the implementation of programs and alter their results. The identification of these factors can provide empirical evidence for “lessons learned” that can facilitate their replication in other countries. The procedure is to analyze qualitative data which were collected during the process evaluation of each program from 2015 to 2018, by using the Consolidated Framework for Implementation Research (CFIR) to guide the analysis. Constructs that strongly influence implementation effectiveness were identified through a cross- case comparison of ratings. The categories of analysis are the domains: intervention characteristics, outer settings, inner settings, characteristics of individuals and process and these were used in a concrete study of three general processes: planning, preparation, and implementation. Among the lessons learned were the importance of marketing networks for the goods and services produced by beneficiaries; the importance of leadership engagement of the field team and a good learning climate for them; the need to consider differences in the educational level of beneficiaries, their ability to run a business, and their local micro contexts in the program design.

本研究的目的是确定2015-17年在哥伦比亚(2)、墨西哥和巴拉圭开展的四个毕业项目实施过程中的系统和可推广的优势和劣势。具体的目标是确定这些过程的一些共同的关键因素，以及它们对计划实施效率的贡献，以及可能不会出现在所有这些过程中，但可能影响计划实施并改变其结果的其他因素。确定这些因素可以为“经验教训”提供经验证据，从而促进在其他国家复制这些经验教训。该程序是通过使用实施研究综合框架（CFIR）指导分析，分析2015年至2018年每个项目过程评估期间收集的定性数据。通过评分的跨案例比较，确定了强烈影响实施有效性的构念。分析的范畴是：干预特征、外部环境、内部环境、个体特征和过程，这些被用于对三个一般过程的具体研究：计划、准备和实施。所吸取的教训包括受益者生产的商品和服务的销售网络的重要性；现场团队的领导参与和良好的学习氛围的重要性；在项目设计中，需要考虑受益人的教育水平、经营业务的能力以及当地微观环境的差异。

{"title":"Lessons learned in the implementation of graduation programs: The experience of Colombia, Mexico, and Paraguay","authors":"Graciela Teruel-Belismelis , Jorge H. Maldonado , Marlene Peters-Castilla , Manuel Triano-Enríquez","doi":"10.1016/j.evalprogplan.2025.102746","DOIUrl":"10.1016/j.evalprogplan.2025.102746","url":null,"abstract":"<div><div>The <strong>aim</strong> of this study is to identify systematic and generalizable strengths and weaknesses in the processes for implementing four graduation programs carried out in Colombia (2), Mexico, and Paraguay in 2015–17. The <strong>specific aims</strong> are to identify some of the key factors common to these processes and their contribution to the efficiency of program implementation, as well as to not others that may not appear in all these processes but may affect the implementation of programs and alter their results. The identification of these factors can provide empirical evidence for “lessons learned” that can facilitate their replication in other countries. The <strong>procedure</strong> is to analyze qualitative data which were collected during the process evaluation of each program from 2015 to 2018, by using the Consolidated Framework for Implementation Research (CFIR) to guide the analysis. Constructs that strongly influence implementation effectiveness were identified through a cross- case comparison of ratings. The categories of analysis are the domains: intervention characteristics, outer settings, inner settings, characteristics of individuals and process and these were used in a concrete study of three general processes: planning, preparation, and implementation. Among the <strong>lessons learned</strong> were the importance of marketing networks for the goods and services produced by beneficiaries; the importance of leadership engagement of the field team and a good learning climate for them; the need to consider differences in the educational level of beneficiaries, their ability to run a business, and their local micro contexts in the program design.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"115 ","pages":"Article 102746"},"PeriodicalIF":2.0,"publicationDate":"2026-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145879242","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Integrating SWOT-QCA for determining subregion strategy in the economic sector 整合SWOT-QCA以确定经济部门的分区域战略。

IF 2 4区社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY

Evaluation and Program Planning

Pub Date : 2026-04-01 Epub Date: 2025-12-26 DOI: 10.1016/j.evalprogplan.2025.102750

Setyardi Pratika Mulya , Andrea Emma Pravitasari , Andi Syah Putra , Vely Brian Rosandi , Siti Wulandari , Muhammad Wahid , Dadang Wihana , Mohammad Fahrizal

Over the past 6 decades, several studies have been carried out to recognize the critical role of strategic analysis in the planning process under various conditions. Previous research shows that combining other analyses with Strengths-Weaknesses-Opportunities-Threats (SWOT) can complement certain aspects of strategy determination or quantify strategies. This paper proposes a strategy linkage based on specific regions. Generalized strategy formulation obtained from SWOT analysis is often ineffective in implementation and goal achievement. This is primarily because specific strategy formulation is essential in producing more effective and implementable strategy in the field. Despite the potential, methods that integrate qualitative and quantitative data are still rarely practiced. Therefore, this paper aims to offer an alternative approach to specific strategy formulation at the sub-regional level by integrating SWOT analysis with Qualitative Comparative Analysis (QCA), known as SWOT-QCA. The application of SWOT-QCA was shown through a case study of economic development in Depok City, Indonesia. The results provided several innovative contributions to regional planning. These results have significant implications for addressing knowledge gaps, particularly in strategy formulation methodologies, which can assist planners and local governments in future regional development efforts.

在过去的60年里，已经进行了几项研究，以认识到战略分析在各种条件下的规划过程中的关键作用。先前的研究表明，将其他分析与优势-劣势-机会-威胁（SWOT）相结合可以补充战略确定或量化战略的某些方面。本文提出了基于特定区域的战略联动。通过SWOT分析得出的广义战略制定在实施和目标实现上往往是无效的。这主要是因为制订具体的战略对于在外地制订更有效和可执行的战略是必不可少的。尽管有潜力，整合定性和定量数据的方法仍然很少被实践。因此，本文旨在通过将SWOT分析与定性比较分析（QCA）相结合，即SWOT-QCA，为次区域层面的具体战略制定提供一种替代方法。通过对印度尼西亚德波市经济发展的一个案例研究，展示了SWOT-QCA的应用。研究结果为区域规划提供了若干创新贡献。这些结果对解决知识差距，特别是战略制定方法方面的知识差距具有重要意义，可以帮助规划者和地方政府开展未来的区域发展工作。

{"title":"Integrating SWOT-QCA for determining subregion strategy in the economic sector","authors":"Setyardi Pratika Mulya , Andrea Emma Pravitasari , Andi Syah Putra , Vely Brian Rosandi , Siti Wulandari , Muhammad Wahid , Dadang Wihana , Mohammad Fahrizal","doi":"10.1016/j.evalprogplan.2025.102750","DOIUrl":"10.1016/j.evalprogplan.2025.102750","url":null,"abstract":"<div><div>Over the past 6 decades, several studies have been carried out to recognize the critical role of strategic analysis in the planning process under various conditions. Previous research shows that combining other analyses with Strengths-Weaknesses-Opportunities-Threats (SWOT) can complement certain aspects of strategy determination or quantify strategies. This paper proposes a strategy linkage based on specific regions. Generalized strategy formulation obtained from SWOT analysis is often ineffective in implementation and goal achievement. This is primarily because specific strategy formulation is essential in producing more effective and implementable strategy in the field. Despite the potential, methods that integrate qualitative and quantitative data are still rarely practiced. Therefore, this paper aims to offer an alternative approach to specific strategy formulation at the sub-regional level by integrating SWOT analysis with Qualitative Comparative Analysis (QCA), known as SWOT-QCA. The application of SWOT-QCA was shown through a case study of economic development in Depok City, Indonesia. The results provided several innovative contributions to regional planning. These results have significant implications for addressing knowledge gaps, particularly in strategy formulation methodologies, which can assist planners and local governments in future regional development efforts.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"115 ","pages":"Article 102750"},"PeriodicalIF":2.0,"publicationDate":"2026-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145866024","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Using theories of power and place to evaluate community health promotion 运用权力与地方理论评估社区健康促进。

IF 2 4区社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY

Evaluation and Program Planning

Pub Date : 2026-04-01 Epub Date: 2025-12-17 DOI: 10.1016/j.evalprogplan.2025.102745

Katie Powell , Miranda Thurston , Daniel Bloyce

There is some consensus that better ways of evaluating complex public health programmes are needed as experimental methods are limited in explaining the 'how' and 'why' of change. Methods like 'theory-of-change,' 'realist evaluation,' and 'systems evaluation' try to give a more complete picture of change by looking at the context of the programme. However, when these methods are used to study programmes that aim to reduce health inequalities, they often miss a crucial issue: how power affects people's health and engagement with programmes. This paper addresses that gap by reporting an ethnographic study of a community health promotion programme that was informed by a social theory of power (figurational sociology). When looking at how power dynamics played out in the targeted community, we could see why residents often did not trust the people running the programme, and why local status was so important to them. When programme staff understood these power dynamics, they were better able to connect with residents and help them improve their wellbeing. We argue that combining this way of looking at power with our observational approach gives us a much clearer understanding of how complex public health programmes work and why they succeed or fail in their aims.

人们达成了一些共识，认为需要更好地评估复杂的公共卫生规划，因为实验方法在解释变化的“如何”和“为什么”方面受到限制。像“变化理论”、“现实主义评估”和“系统评估”这样的方法试图通过观察项目的背景来给出一个更完整的变化图景。然而，当这些方法用于研究旨在减少卫生不平等的规划时，它们往往忽略了一个关键问题：权力如何影响人们的健康和对规划的参与。本文通过报告一项以社会权力理论（数字社会学）为依据的社区健康促进方案的人种学研究，解决了这一差距。当我们观察权力动态在目标社区如何发挥作用时，我们可以看到为什么居民往往不信任项目的负责人，以及为什么当地地位对他们如此重要。当项目工作人员了解这些权力动态时，他们能够更好地与居民联系并帮助他们改善他们的福祉。我们认为，将这种看待权力的方式与我们的观察方法相结合，可以让我们更清楚地了解复杂的公共卫生规划是如何运作的，以及它们成功或失败的原因。

{"title":"Using theories of power and place to evaluate community health promotion","authors":"Katie Powell , Miranda Thurston , Daniel Bloyce","doi":"10.1016/j.evalprogplan.2025.102745","DOIUrl":"10.1016/j.evalprogplan.2025.102745","url":null,"abstract":"<div><div>There is some consensus that better ways of evaluating complex public health programmes are needed as experimental methods are limited in explaining the 'how' and 'why' of change. Methods like 'theory-of-change,' 'realist evaluation,' and 'systems evaluation' try to give a more complete picture of change by looking at the context of the programme. However, when these methods are used to study programmes that aim to reduce health inequalities, they often miss a crucial issue: how power affects people's health and engagement with programmes. This paper addresses that gap by reporting an ethnographic study of a community health promotion programme that was informed by a social theory of power (figurational sociology). When looking at how power dynamics played out in the targeted community, we could see why residents often did not trust the people running the programme, and why local status was so important to them. When programme staff understood these power dynamics, they were better able to connect with residents and help them improve their wellbeing. We argue that combining this way of looking at power with our observational approach gives us a much clearer understanding of how complex public health programmes work and why they succeed or fail in their aims.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"115 ","pages":"Article 102745"},"PeriodicalIF":2.0,"publicationDate":"2026-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145828770","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Planning for implementation scale-up of a medication for opioid use disorder program across rural Colorado: Ensuring fit to context 计划在科罗拉多州农村实施扩大阿片类药物使用障碍方案：确保符合背景。

IF 2 4区社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY

Evaluation and Program Planning

Pub Date : 2026-04-01 Epub Date: 2025-12-24 DOI: 10.1016/j.evalprogplan.2025.102749

Claudia R. Amura , Aimee Techau , Natalie D. Ritchie , Tanya R. Sorrell , Mary Weber , Bethany M. Kwan , Elaine H. Morrato , Paul F. Cook

Opioid use is a major public health crisis in the United States. Colorado’s Medication for Opioid Use Disorders (MOUD) program expansion was funded to address this problem in rural counties, which are disproportionately affected. Aligning with a Fit to Context Framework for Designing for Dissemination and Sustainability (F2C D4DS), we used customer discovery and value proposition methods to engage partners in an iterative process of conceptualization and design of a MOUD program to guide implementation scale-up and dissemination plans. Interviews (N = 26) with target adopters and influencers (e.g. pilot and prospective agencies, community partners) revealed expansion barriers of greatest priority to solve: 1) organizations’ capacity to provide MOUD; (2) access to treatment and patient-centered care; (3) service and system coordination; (4) stigma associated with OUD; (5) concerns about financial sustainability; and (6) mandated reporting systems. We used process mapping to analyze each organization’s context, structure, and workflows. This phase of conceptualization led to the design of new MOUD program elements to enhance its value: a clinical toolkit and guidelines, an enhanced data collection system for reporting, a process map, and implementation logic models for integrated patient-centered MOUD treatment and reporting. The F2C D4DS process allowed us to identify needs and benefits of greatest value for adopters, and informed MOUD expansion into areas with high OUD overdose risk across the state, to maximize patient outcomes. This study also contributes to evaluation literature by systematically integrating the pre-implementation phase to enhance contextual fit and sustainability for large-scale MOUD initiatives.

阿片类药物的使用是美国的一项重大公共卫生危机。科罗拉多州阿片类药物使用障碍（mod）项目的扩展是为了解决农村县的这一问题而资助的，这些县受到的影响不成比例。根据《面向传播和可持续性设计的情境契合框架》（F2C D4DS），我们使用客户发现和价值主张方法，让合作伙伴参与到模块化项目概念化和设计的迭代过程中，以指导实施规模扩大和传播计划。与目标采用者和影响者（例如试点和潜在机构、社区合作伙伴）的访谈（N = 26）揭示了最优先解决的扩展障碍：1)组织提供mod的能力；(2)获得治疗和以患者为中心的护理；(3)服务与系统协调；(4)与OUD相关的柱头；(5)对财务可持续性的担忧；(6)强制性报告制度。我们使用过程映射来分析每个组织的上下文、结构和工作流。概念化的这一阶段导致了新的mod程序元素的设计，以提高其价值：临床工具包和指南，用于报告的增强数据收集系统，流程图，以及用于集成以患者为中心的mod治疗和报告的实现逻辑模型。F2C D4DS流程使我们能够确定采用者的需求和最大价值，并告知mod扩展到全州OUD过量风险高的地区，以最大限度地提高患者的治疗效果。本研究还通过系统地整合实施前阶段来提高大规模mod计划的环境适应性和可持续性，从而为评估文献做出贡献。

{"title":"Planning for implementation scale-up of a medication for opioid use disorder program across rural Colorado: Ensuring fit to context","authors":"Claudia R. Amura , Aimee Techau , Natalie D. Ritchie , Tanya R. Sorrell , Mary Weber , Bethany M. Kwan , Elaine H. Morrato , Paul F. Cook","doi":"10.1016/j.evalprogplan.2025.102749","DOIUrl":"10.1016/j.evalprogplan.2025.102749","url":null,"abstract":"<div><div>Opioid use is a major public health crisis in the United States. Colorado’s Medication for Opioid Use Disorders (MOUD) program expansion was funded to address this problem in rural counties, which are disproportionately affected. Aligning with a Fit to Context Framework for Designing for Dissemination and Sustainability (F2C D4DS), we used customer discovery and value proposition methods to engage partners in an iterative process of conceptualization and design of a MOUD program to guide implementation scale-up and dissemination plans. Interviews (N = 26) with target adopters and influencers (e.g. pilot and prospective agencies, community partners) revealed expansion barriers of greatest priority to solve: 1) organizations’ capacity to provide MOUD; (2) access to treatment and patient-centered care; (3) service and system coordination; (4) stigma associated with OUD; (5) concerns about financial sustainability; and (6) mandated reporting systems. We used process mapping to analyze each organization’s context, structure, and workflows. This phase of conceptualization led to the design of new MOUD program elements to enhance its value: a clinical toolkit and guidelines, an enhanced data collection system for reporting, a process map, and implementation logic models for integrated patient-centered MOUD treatment and reporting. The F2C D4DS process allowed us to identify needs and benefits of greatest value for adopters, and informed MOUD expansion into areas with high OUD overdose risk across the state, to maximize patient outcomes. This study also contributes to evaluation literature by systematically integrating the pre-implementation phase to enhance contextual fit and sustainability for large-scale MOUD initiatives.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"115 ","pages":"Article 102749"},"PeriodicalIF":2.0,"publicationDate":"2026-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145866007","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Effectiveness of super skills for life transdiagnostic program in children with mental health problems: One-year outcomes in a clinical setting. 生活超技能跨诊断项目对有心理健康问题的儿童的有效性：临床环境中的一年结果。

IF 2 4区社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY

Evaluation and Program Planning

Pub Date : 2026-03-15 DOI: 10.1016/j.evalprogplan.2026.102781

Sara Diego, Alexandra Morales, Mireia Orgilés

Symptoms of anxiety and depression are common in children. There are limitations that prevent the implementation of evidenced-based interventions in national mental health services. Additionally, a community setting may involve factors that limit effectiveness compared to a research setting.

Objectives: This study is the first to evaluate the medium- and long-term effectiveness of the Super Skills for Life (SSL) transdiagnostic program integrated into routine clinical practice in Spain, thereby addressing the critical gap between controlled trials and real-world implementation.

Method: 43 children (mean = 10.21 years, 65.1% boys) with an emotional disorder participated.

Results: Children who met criteria for an emotional disorder decreased significantly at all follow-up visits after the intervention (3-, 6- and 12-months). In addition, significantly lower scores were found for symptoms of depression, anxiety, and global difficulties. Reductions in anxiety symptoms and global difficulties were statistically significant at 3-, 6-, and 12-months follow-up.

Conclusions: The SSL program, when implemented in routine mental health services, reduces children's symptoms and diagnoses and demonstrates the feasibility of applying a transdiagnostic, group-based intervention in real-world clinical settings. Beyond clinical improvements, the design-anchored in multi-informant evidence, fidelity monitoring, and longitudinal follow-up-provides a replicable model for evaluating child mental health interventions under real-world conditions, strengthening both scientific validity and clinical utility.

焦虑和抑郁的症状在儿童中很常见。在国家精神卫生服务中实施循证干预措施存在一些限制。此外，与研究环境相比，社区环境可能涉及限制有效性的因素。目的：本研究首次评估了将“生命超级技能”（SSL）跨诊断项目纳入西班牙常规临床实践的中长期有效性，从而解决了对照试验与现实世界实施之间的关键差距。方法：43例患有情绪障碍的儿童（平均10.21岁，男孩占65.1%）参与调查。结果：在干预后（3个月、6个月和12个月）的所有随访中，符合情绪障碍标准的儿童显著减少。此外，抑郁、焦虑和全球困难症状的得分明显较低。在3个月、6个月和12个月的随访中，焦虑症状和整体困难的减少具有统计学意义。结论：SSL项目在常规精神卫生服务中实施时，减少了儿童的症状和诊断，并证明了在现实世界的临床环境中应用跨诊断、基于群体的干预的可行性。除了临床改善之外，该设计基于多信息提供者证据、保真度监测和纵向随访，为评估现实世界条件下的儿童心理健康干预提供了一个可复制的模型，加强了科学有效性和临床实用性。

{"title":"Effectiveness of super skills for life transdiagnostic program in children with mental health problems: One-year outcomes in a clinical setting.","authors":"Sara Diego, Alexandra Morales, Mireia Orgilés","doi":"10.1016/j.evalprogplan.2026.102781","DOIUrl":"https://doi.org/10.1016/j.evalprogplan.2026.102781","url":null,"abstract":"<p><p>Symptoms of anxiety and depression are common in children. There are limitations that prevent the implementation of evidenced-based interventions in national mental health services. Additionally, a community setting may involve factors that limit effectiveness compared to a research setting.</p><p><strong>Objectives: </strong>This study is the first to evaluate the medium- and long-term effectiveness of the Super Skills for Life (SSL) transdiagnostic program integrated into routine clinical practice in Spain, thereby addressing the critical gap between controlled trials and real-world implementation.</p><p><strong>Method: </strong>43 children (mean = 10.21 years, 65.1% boys) with an emotional disorder participated.</p><p><strong>Results: </strong>Children who met criteria for an emotional disorder decreased significantly at all follow-up visits after the intervention (3-, 6- and 12-months). In addition, significantly lower scores were found for symptoms of depression, anxiety, and global difficulties. Reductions in anxiety symptoms and global difficulties were statistically significant at 3-, 6-, and 12-months follow-up.</p><p><strong>Conclusions: </strong>The SSL program, when implemented in routine mental health services, reduces children's symptoms and diagnoses and demonstrates the feasibility of applying a transdiagnostic, group-based intervention in real-world clinical settings. Beyond clinical improvements, the design-anchored in multi-informant evidence, fidelity monitoring, and longitudinal follow-up-provides a replicable model for evaluating child mental health interventions under real-world conditions, strengthening both scientific validity and clinical utility.</p>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"117 ","pages":"102781"},"PeriodicalIF":2.0,"publicationDate":"2026-03-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147487834","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Insights into the implementation evaluation for a rehabilitation program for children with impairments leading to surgically treatable disabilities in a resource-limited setting. 在资源有限的环境下，对导致手术可治疗残疾的残疾儿童的康复计划实施评估的见解。

IF 2 4区社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY

Evaluation and Program Planning

Pub Date : 2026-03-12 DOI: 10.1016/j.evalprogplan.2026.102779

Laura Schulz, Ambria Crusan, Kristen Maisano, Jennifer Biggs, Keira DiSpirito, Rose Francis, Emmanuel Mduma, Kari Hartwig

This surgical rehabilitation program in a community setting provides a case study for the implementation of an effective monitoring and evaluation (M&E) plan. The partnership between St. Catherine University evaluators and staff at Kafika House Tanzania offers insights into how to strengthen evaluation and planning for a rehabilitation program and provides a case study for working in intercultural partnerships. This paper assesses the responsiveness, quality and fidelity of M&E implementation, and elucidates lessons learned from evaluation implementation and key adaptations from piloting data collection in a resource-limited setting. Feedback interviews with Kafika House staff demonstrated responsiveness to the M&E tools. Pilot data collected from tools developed for program and impact evaluation were used to measure implementation quality and fidelity. Data collector buy-in and responsive and communicative partnership supports motivation for consistent data collection. Kafika House learned that program evaluation was imperative to data quality and fidelity while the academic team learned how to best support the evaluation plan. Utilizing an ecological model strengthened our consideration of the individual, community, and innovative factors of implementation that promoted the sustainability of the M&E program. Evaluation and planning adaptations in a resource-limited setting considered training, funding, sustainable integration, and administration of measurement tools.

这个手术康复计划在社区设置提供了一个案例研究的实施有效的监测和评估（M&E）计划。圣凯瑟琳大学评估人员与坦桑尼亚卡夫卡之家工作人员之间的伙伴关系为如何加强康复方案的评估和规划提供了见解，并为跨文化伙伴关系的工作提供了案例研究。本文评估了M&E实施的响应性、质量和保真度，并阐明了从评估实施中吸取的经验教训，以及在资源有限的情况下从试点数据收集中获得的关键调整。对Kafika House员工的反馈访谈显示了他们对M&E工具的响应。从为项目和影响评估开发的工具中收集的试点数据用于衡量实施质量和保真度。数据收集者的支持以及响应性和沟通性伙伴关系支持一致数据收集的动机。Kafika House了解到，项目评估对数据质量和保真度至关重要，而学术团队则了解如何最好地支持评估计划。利用生态模型加强了我们对个人、社区和创新实施因素的考虑，促进了M&E项目的可持续性。在资源有限的环境中评估和规划适应性，考虑培训、资金、可持续的整合和测量工具的管理。

{"title":"Insights into the implementation evaluation for a rehabilitation program for children with impairments leading to surgically treatable disabilities in a resource-limited setting.","authors":"Laura Schulz, Ambria Crusan, Kristen Maisano, Jennifer Biggs, Keira DiSpirito, Rose Francis, Emmanuel Mduma, Kari Hartwig","doi":"10.1016/j.evalprogplan.2026.102779","DOIUrl":"https://doi.org/10.1016/j.evalprogplan.2026.102779","url":null,"abstract":"<p><p>This surgical rehabilitation program in a community setting provides a case study for the implementation of an effective monitoring and evaluation (M&E) plan. The partnership between St. Catherine University evaluators and staff at Kafika House Tanzania offers insights into how to strengthen evaluation and planning for a rehabilitation program and provides a case study for working in intercultural partnerships. This paper assesses the responsiveness, quality and fidelity of M&E implementation, and elucidates lessons learned from evaluation implementation and key adaptations from piloting data collection in a resource-limited setting. Feedback interviews with Kafika House staff demonstrated responsiveness to the M&E tools. Pilot data collected from tools developed for program and impact evaluation were used to measure implementation quality and fidelity. Data collector buy-in and responsive and communicative partnership supports motivation for consistent data collection. Kafika House learned that program evaluation was imperative to data quality and fidelity while the academic team learned how to best support the evaluation plan. Utilizing an ecological model strengthened our consideration of the individual, community, and innovative factors of implementation that promoted the sustainability of the M&E program. Evaluation and planning adaptations in a resource-limited setting considered training, funding, sustainable integration, and administration of measurement tools.</p>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"117 ","pages":"102779"},"PeriodicalIF":2.0,"publicationDate":"2026-03-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147491981","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Drivers of change effectiveness in public universities in the State of Amhara: Toward developing promising propositions through a critical co-constructive perspective 阿姆哈拉州公立大学变革有效性的驱动因素：通过批判性的共同建设性视角发展有希望的命题。

IF 2 4区社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY

Evaluation and Program Planning

Pub Date : 2026-02-01 Epub Date: 2025-11-22 DOI: 10.1016/j.evalprogplan.2025.102733

Bekalu Tadesse Moges , Getnet Tizazu Fetene , Getu Shiferaw Wolle

Most studies examining the effectiveness of system-wide change initiatives in public universities rely heavily on simplistic models of technical rationality that emphasize planning, control, and monitoring. This perspective is known to ignore the contextual and relational interactions that shape the understanding of educational change. Alternatively, the present study makes a case for the adoption of a Critical co-constructive stance to allow context-based solutions that optimize the successful implementation of the initiatives. With this stance, the study identifies context-based drivers and propositions grounded in the views of change implementers. Using 15 key informant interviews and 6 focus group discussions, data were collected from teachers, and academic leaders selected through theoretical sampling. The data are analyzed using the constant comparison technique. The study found that profound change is a critically co-constructed phenomenon that evolves through ongoing meaning-making among implementers. Additionally, the study identified 16 interrelated drivers and their respective propositions that optimize the chance of successful educational change. The drivers represent multilevel interactions within and across implementing institutions. Practical policy and efficiency implications for the development and implementation of change initiatives are discussed.

大多数检查公立大学系统范围内变革主动性的有效性的研究严重依赖于强调计划、控制和监督的技术合理性的简化模型。众所周知，这种观点忽视了影响对教育变革理解的背景和关系相互作用。或者，本研究提出了一个案例，采用关键的共同建设性立场，允许基于情境的解决方案，优化倡议的成功实施。基于这一立场，该研究确定了基于情境的驱动因素和基于变革实施者观点的主张。通过15次关键信息访谈和6次焦点小组讨论，从教师和通过理论抽样选择的学术带头人中收集数据。数据分析采用恒定比较法。研究发现，深刻的变革是一种批判性的共同构建现象，它通过实施者之间不断的意义创造而演变。此外，该研究还确定了16个相互关联的驱动因素及其各自的主张，以优化成功教育变革的机会。驱动因素代表了实施机构内部和机构之间的多层次互动。实际的政策和效率的影响，发展和实施的变革倡议进行了讨论。

{"title":"Drivers of change effectiveness in public universities in the State of Amhara: Toward developing promising propositions through a critical co-constructive perspective","authors":"Bekalu Tadesse Moges , Getnet Tizazu Fetene , Getu Shiferaw Wolle","doi":"10.1016/j.evalprogplan.2025.102733","DOIUrl":"10.1016/j.evalprogplan.2025.102733","url":null,"abstract":"<div><div>Most studies examining the effectiveness of system-wide change initiatives in public universities rely heavily on simplistic models of technical rationality that emphasize planning, control, and monitoring. This perspective is known to ignore the contextual and relational interactions that shape the understanding of educational change. Alternatively, the present study makes a case for the adoption of a Critical co-constructive stance to allow context-based solutions that optimize the successful implementation of the initiatives. With this stance, the study identifies context-based drivers and propositions grounded in the views of change implementers. Using 15 key informant interviews and 6 focus group discussions, data were collected from teachers, and academic leaders selected through theoretical sampling. The data are analyzed using the constant comparison technique. The study found that profound change is a critically co-constructed phenomenon that evolves through ongoing meaning-making among implementers. Additionally, the study identified 16 interrelated drivers and their respective propositions that optimize the chance of successful educational change. The drivers represent multilevel interactions within and across implementing institutions. Practical policy and efficiency implications for the development and implementation of change initiatives are discussed.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102733"},"PeriodicalIF":2.0,"publicationDate":"2026-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145605982","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Implementing statewide literacy and special education training in the U.S.: A mixed-methods evaluation 在美国实施全州扫盲和特殊教育培训：一种混合方法评估

IF 2 4区社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY

Evaluation and Program Planning

Pub Date : 2026-02-01 Epub Date: 2025-09-09 DOI: 10.1016/j.evalprogplan.2025.102712

Deborah K. Reed, Anna S. Gibbs, Julie K. Owens

To address gaps in the field’s knowledge about implementing educator preparation program (EPP) reforms at scale, this mixed methods study gathered data from one U.S. state’s instructors to understand their perceptions of and experiences complying with new legislation and implementing state-provided training modules for future K-5 literacy and special education teachers and leaders. Across the state’s 40 EPPs, 188 survey responses and 24 focus group participants’ comments were gathered. Instructors generally agreed with the policy goals and appreciated the evidence base of the module content. However, they recommended improving student engagement and providing more implementation guidance and tools. Overall, the data suggested there was a lack of systematic implementation planning that potentially hampered reform efforts. Lessons learned about implementing policies at scale are discussed.

为了解决在大规模实施教育者准备计划（EPP）改革方面的知识差距，这项混合方法研究从美国一个州的教师那里收集了数据，以了解他们对遵守新立法和实施国家为未来的K-5扫盲和特殊教育教师和领导者提供的培训模块的看法和经验。在该州的40个epp中，收集了188份调查回复和24个焦点小组参与者的评论。教师普遍同意政策目标，并赞赏模块内容的证据基础。然而，他们建议提高学生的参与度，并提供更多的实施指导和工具。总体而言，数据表明缺乏系统的实施规划，这可能会阻碍改革努力。讨论了大规模实施政策的经验教训。

引用次数: 0

Evaluation of the gradual release of responsibility framework’s effectiveness on oral summarization skills in Turkish middle school classrooms: A mixed methods study 逐步释放责任框架对土耳其中学课堂口头总结技能的有效性评价：一项混合方法研究

IF 2 4区社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY

Evaluation and Program Planning

Pub Date : 2026-02-01 Epub Date: 2025-10-17 DOI: 10.1016/j.evalprogplan.2025.102720

Kürşat Kaya , Mehmet Kurudayıoğlu , Kasım Yıldırım , Abbey Galeza , Timothy Rasinski

We aimed to explore the effects of the gradual release of responsibility framework on sixth-grade students’ oral summarization skills in the Turkish language. The current study employed convergent mixed methods research. In the quantitative phase, a pretest-posttest control group quasi-experimental design was used. The sample of the quantitative phase consisted of 41 sixth-grade students in Türkiye. The qualitative phase included observations about the intervention and the students’ diaries in the experimental group (n = 20). The covariance analyses on the posttest scores of the students revealed that summarization attitudes and summarization achievements of the experimental group students varied significantly compared to the control group students. In addition, it was observed that the intervention provided new insights into how students summarized a text. The students’ diaries showed that while they had difficulties with oral summarization during the intervention, they gradually developed an awareness and they liked to summarize.

本研究旨在探讨责任框架渐进式释放对六年级学生土耳其语口语总结能力的影响。本研究采用收敛混合方法研究。定量阶段采用前测后测对照组准实验设计。定量阶段的样本包括41名基耶州六年级学生。定性阶段包括观察实验组的干预措施和学生日记（n = 20）。对学生的后测成绩进行协方差分析发现，实验组学生的总结态度和总结成绩与对照组学生有显著差异。此外，据观察，干预为学生如何总结文本提供了新的见解。从学生的日记中可以看出，在干预过程中，虽然他们在口头总结方面有困难，但他们逐渐形成了一种意识，并且喜欢总结。

{"title":"Evaluation of the gradual release of responsibility framework’s effectiveness on oral summarization skills in Turkish middle school classrooms: A mixed methods study","authors":"Kürşat Kaya , Mehmet Kurudayıoğlu , Kasım Yıldırım , Abbey Galeza , Timothy Rasinski","doi":"10.1016/j.evalprogplan.2025.102720","DOIUrl":"10.1016/j.evalprogplan.2025.102720","url":null,"abstract":"<div><div>We aimed to explore the effects of the gradual release of responsibility framework on sixth-grade students’ oral summarization skills in the Turkish language. The current study employed convergent mixed methods research. In the quantitative phase, a pretest-posttest control group quasi-experimental design was used. The sample of the quantitative phase consisted of 41 sixth-grade students in Türkiye. The qualitative phase included observations about the intervention and the students’ diaries in the experimental group (<em>n</em> = 20). The covariance analyses on the posttest scores of the students revealed that summarization attitudes and summarization achievements of the experimental group students varied significantly compared to the control group students. In addition, it was observed that the intervention provided new insights into how students summarized a text. The students’ diaries showed that while they had difficulties with oral summarization during the intervention, they gradually developed an awareness and they liked to summarize.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102720"},"PeriodicalIF":2.0,"publicationDate":"2026-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145362715","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

An evaluation of the culturally-centered addictions research training (C-CART) graduate certificate program: A qualitative review 以文化为中心的成瘾研究训练（C-CART）研究生证书课程的评估：定性回顾。

IF 2 4区社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY

Evaluation and Program Planning

Pub Date : 2026-02-01 Epub Date: 2025-10-23 DOI: 10.1016/j.evalprogplan.2025.102718

A. Gelatt , J. Santos , E.R. Eaves , K. Elwell , A. Roddy , S. Haberstroh , T. Lane , K. Mommaerts , J. Roddy , T.G. Bautista , O. Rogers , J.A. Baldwin , R. Mellott

The Culturally-Centered Addictions Research Training (C-CART) program is a two-year graduate training program designed to train practicing clinicians and doctoral students in health-related fields in culturally-centered research for the prevention and treatment of substance use disorders (SUDs) among underserved rural communities.This paper presents data from the qualitative portion of program evaluation. These data identified the program’s strengths and areas for growth, which have been implemented to ensure a better learning experience for Scholars. We conducted ten focus groups with three C-CART cohorts, with a total of 32 Scholars. Thematic analysis revealed that participation in the program was motivated by the program emphasis on culture and research skills, as well as opportunities to connect with community agencies. Scholars were positively impacted by improved research skills and understanding of methods, increased knowledge of the importance of culturally centered practices for SUD prevention and treatment, and enhanced ability to work within interdisciplinary teams. Scholars reported gaining confidence and benefiting from a support network of faculty and peers outside their primary graduate programs.Challenges included managing demanding workloads, interprofessional cooperation, interagency collaboration, and interpersonal issues in community-engaged doctoral research. Future programs should consider how to facilitate collaboration in interdisciplinary research teams, cater to workload demand of doctoral Scholars, and ensure ample opportunities for connection and support.

以文化为中心的成瘾研究培训（C-CART）项目是一个为期两年的研究生培训项目，旨在培训与健康相关领域的临床医生和博士生进行以文化为中心的研究，以预防和治疗服务不足的农村社区的物质使用障碍（SUDs）。本文提供了项目评估定性部分的数据。这些数据确定了该项目的优势和增长领域，并已实施，以确保为学者提供更好的学习体验。我们进行了10个焦点小组，有3个C-CART队列，共有32名学者。专题分析显示，参与该计划的动机是该计划强调文化和研究技能，以及与社区机构联系的机会。通过提高研究技能和对方法的理解，增加对以文化为中心的实践对SUD预防和治疗的重要性的认识，以及增强在跨学科团队中工作的能力，学者们受到了积极的影响。学者们报告说，在他们的主要研究生课程之外，他们从教师和同龄人的支持网络中获得了信心和受益。挑战包括管理高要求的工作量、跨专业合作、跨机构合作以及社区参与博士研究中的人际关系问题。未来的项目应考虑如何促进跨学科研究团队的合作，满足博士学者的工作量需求，并确保充足的联系和支持机会。

{"title":"An evaluation of the culturally-centered addictions research training (C-CART) graduate certificate program: A qualitative review","authors":"A. Gelatt , J. Santos , E.R. Eaves , K. Elwell , A. Roddy , S. Haberstroh , T. Lane , K. Mommaerts , J. Roddy , T.G. Bautista , O. Rogers , J.A. Baldwin , R. Mellott","doi":"10.1016/j.evalprogplan.2025.102718","DOIUrl":"10.1016/j.evalprogplan.2025.102718","url":null,"abstract":"<div><div>The Culturally-Centered Addictions Research Training (C-CART) program is a two-year graduate training program designed to train practicing clinicians and doctoral students in health-related fields in culturally-centered research for the prevention and treatment of substance use disorders (SUDs) among underserved rural communities.This paper presents data from the qualitative portion of program evaluation. These data identified the program’s strengths and areas for growth, which have been implemented to ensure a better learning experience for Scholars. We conducted ten focus groups with three C-CART cohorts, with a total of 32 Scholars. Thematic analysis revealed that participation in the program was motivated by the program emphasis on culture and research skills, as well as opportunities to connect with community agencies. Scholars were positively impacted by improved research skills and understanding of methods, increased knowledge of the importance of culturally centered practices for SUD prevention and treatment, and enhanced ability to work within interdisciplinary teams. Scholars reported gaining confidence and benefiting from a support network of faculty and peers outside their primary graduate programs.Challenges included managing demanding workloads, interprofessional cooperation, interagency collaboration, and interpersonal issues in community-engaged doctoral research. Future programs should consider how to facilitate collaboration in interdisciplinary research teams, cater to workload demand of doctoral Scholars, and ensure ample opportunities for connection and support.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102718"},"PeriodicalIF":2.0,"publicationDate":"2026-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145394104","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0