首页 > 最新文献

Evaluation and Program Planning最新文献

英文 中文
Lessons learned in the implementation of graduation programs: The experience of Colombia, Mexico, and Paraguay 毕业课程实施的经验教训:哥伦比亚、墨西哥和巴拉圭的经验。
IF 2 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2025-12-19 DOI: 10.1016/j.evalprogplan.2025.102746
Graciela Teruel-Belismelis , Jorge H. Maldonado , Marlene Peters-Castilla , Manuel Triano-Enríquez
The aim of this study is to identify systematic and generalizable strengths and weaknesses in the processes for implementing four graduation programs carried out in Colombia (2), Mexico, and Paraguay in 2015–17. The specific aims are to identify some of the key factors common to these processes and their contribution to the efficiency of program implementation, as well as to not others that may not appear in all these processes but may affect the implementation of programs and alter their results. The identification of these factors can provide empirical evidence for “lessons learned” that can facilitate their replication in other countries. The procedure is to analyze qualitative data which were collected during the process evaluation of each program from 2015 to 2018, by using the Consolidated Framework for Implementation Research (CFIR) to guide the analysis. Constructs that strongly influence implementation effectiveness were identified through a cross- case comparison of ratings. The categories of analysis are the domains: intervention characteristics, outer settings, inner settings, characteristics of individuals and process and these were used in a concrete study of three general processes: planning, preparation, and implementation. Among the lessons learned were the importance of marketing networks for the goods and services produced by beneficiaries; the importance of leadership engagement of the field team and a good learning climate for them; the need to consider differences in the educational level of beneficiaries, their ability to run a business, and their local micro contexts in the program design.
本研究的目的是确定2015-17年在哥伦比亚(2)、墨西哥和巴拉圭开展的四个毕业项目实施过程中的系统和可推广的优势和劣势。具体的目标是确定这些过程的一些共同的关键因素,以及它们对计划实施效率的贡献,以及可能不会出现在所有这些过程中,但可能影响计划实施并改变其结果的其他因素。确定这些因素可以为“经验教训”提供经验证据,从而促进在其他国家复制这些经验教训。该程序是通过使用实施研究综合框架(CFIR)指导分析,分析2015年至2018年每个项目过程评估期间收集的定性数据。通过评分的跨案例比较,确定了强烈影响实施有效性的构念。分析的范畴是:干预特征、外部环境、内部环境、个体特征和过程,这些被用于对三个一般过程的具体研究:计划、准备和实施。所吸取的教训包括受益者生产的商品和服务的销售网络的重要性;现场团队的领导参与和良好的学习氛围的重要性;在项目设计中,需要考虑受益人的教育水平、经营业务的能力以及当地微观环境的差异。
{"title":"Lessons learned in the implementation of graduation programs: The experience of Colombia, Mexico, and Paraguay","authors":"Graciela Teruel-Belismelis ,&nbsp;Jorge H. Maldonado ,&nbsp;Marlene Peters-Castilla ,&nbsp;Manuel Triano-Enríquez","doi":"10.1016/j.evalprogplan.2025.102746","DOIUrl":"10.1016/j.evalprogplan.2025.102746","url":null,"abstract":"<div><div>The <strong>aim</strong> of this study is to identify systematic and generalizable strengths and weaknesses in the processes for implementing four graduation programs carried out in Colombia (2), Mexico, and Paraguay in 2015–17. The <strong>specific aims</strong> are to identify some of the key factors common to these processes and their contribution to the efficiency of program implementation, as well as to not others that may not appear in all these processes but may affect the implementation of programs and alter their results. The identification of these factors can provide empirical evidence for “lessons learned” that can facilitate their replication in other countries. The <strong>procedure</strong> is to analyze qualitative data which were collected during the process evaluation of each program from 2015 to 2018, by using the Consolidated Framework for Implementation Research (CFIR) to guide the analysis. Constructs that strongly influence implementation effectiveness were identified through a cross- case comparison of ratings. The categories of analysis are the domains: intervention characteristics, outer settings, inner settings, characteristics of individuals and process and these were used in a concrete study of three general processes: planning, preparation, and implementation. Among the <strong>lessons learned</strong> were the importance of marketing networks for the goods and services produced by beneficiaries; the importance of leadership engagement of the field team and a good learning climate for them; the need to consider differences in the educational level of beneficiaries, their ability to run a business, and their local micro contexts in the program design.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"115 ","pages":"Article 102746"},"PeriodicalIF":2.0,"publicationDate":"2025-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145879242","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using theories of power and place to evaluate community health promotion 运用权力与地方理论评估社区健康促进。
IF 2 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2025-12-17 DOI: 10.1016/j.evalprogplan.2025.102745
Katie Powell , Miranda Thurston , Daniel Bloyce
There is some consensus that better ways of evaluating complex public health programmes are needed as experimental methods are limited in explaining the 'how' and 'why' of change. Methods like 'theory-of-change,' 'realist evaluation,' and 'systems evaluation' try to give a more complete picture of change by looking at the context of the programme. However, when these methods are used to study programmes that aim to reduce health inequalities, they often miss a crucial issue: how power affects people's health and engagement with programmes. This paper addresses that gap by reporting an ethnographic study of a community health promotion programme that was informed by a social theory of power (figurational sociology). When looking at how power dynamics played out in the targeted community, we could see why residents often did not trust the people running the programme, and why local status was so important to them. When programme staff understood these power dynamics, they were better able to connect with residents and help them improve their wellbeing. We argue that combining this way of looking at power with our observational approach gives us a much clearer understanding of how complex public health programmes work and why they succeed or fail in their aims.
人们达成了一些共识,认为需要更好地评估复杂的公共卫生规划,因为实验方法在解释变化的“如何”和“为什么”方面受到限制。像“变化理论”、“现实主义评估”和“系统评估”这样的方法试图通过观察项目的背景来给出一个更完整的变化图景。然而,当这些方法用于研究旨在减少卫生不平等的规划时,它们往往忽略了一个关键问题:权力如何影响人们的健康和对规划的参与。本文通过报告一项以社会权力理论(数字社会学)为依据的社区健康促进方案的人种学研究,解决了这一差距。当我们观察权力动态在目标社区如何发挥作用时,我们可以看到为什么居民往往不信任项目的负责人,以及为什么当地地位对他们如此重要。当项目工作人员了解这些权力动态时,他们能够更好地与居民联系并帮助他们改善他们的福祉。我们认为,将这种看待权力的方式与我们的观察方法相结合,可以让我们更清楚地了解复杂的公共卫生规划是如何运作的,以及它们成功或失败的原因。
{"title":"Using theories of power and place to evaluate community health promotion","authors":"Katie Powell ,&nbsp;Miranda Thurston ,&nbsp;Daniel Bloyce","doi":"10.1016/j.evalprogplan.2025.102745","DOIUrl":"10.1016/j.evalprogplan.2025.102745","url":null,"abstract":"<div><div>There is some consensus that better ways of evaluating complex public health programmes are needed as experimental methods are limited in explaining the 'how' and 'why' of change. Methods like 'theory-of-change,' 'realist evaluation,' and 'systems evaluation' try to give a more complete picture of change by looking at the context of the programme. However, when these methods are used to study programmes that aim to reduce health inequalities, they often miss a crucial issue: how power affects people's health and engagement with programmes. This paper addresses that gap by reporting an ethnographic study of a community health promotion programme that was informed by a social theory of power (figurational sociology). When looking at how power dynamics played out in the targeted community, we could see why residents often did not trust the people running the programme, and why local status was so important to them. When programme staff understood these power dynamics, they were better able to connect with residents and help them improve their wellbeing. We argue that combining this way of looking at power with our observational approach gives us a much clearer understanding of how complex public health programmes work and why they succeed or fail in their aims.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"115 ","pages":"Article 102745"},"PeriodicalIF":2.0,"publicationDate":"2025-12-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145828770","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
IF 2 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2025-12-03 DOI: 10.1016/j.evalprogplan.2025.102735
Melanie Hwalek
{"title":"","authors":"Melanie Hwalek","doi":"10.1016/j.evalprogplan.2025.102735","DOIUrl":"10.1016/j.evalprogplan.2025.102735","url":null,"abstract":"","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"115 ","pages":"Article 102735"},"PeriodicalIF":2.0,"publicationDate":"2025-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145685298","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Measuring the impact of a novel program in a Family Treatment Court: Quality of life, mental health, and self-esteem inventories in program evaluation 衡量家庭治疗法庭新项目的影响:项目评估中的生活质量、心理健康和自尊量表
IF 2 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2025-11-29 DOI: 10.1016/j.evalprogplan.2025.102734
Julie B. Raines
Family Treatment Courts (FTCs) accept parents in civil neglect cases where the parent is suffering from substance use and/or mental health issues. Modeled after adult drug treatment courts, FTCs coordinate substance use and mental health treatment, as well as other social support services for participants like housing and employment. Recently, one FTC in the United States began providing additional supervised and monitored visitation to participants within their FTC program, as well as one-on-one evidence-based parenting education. Called Enhanced Parenting Time (EPT), the goal of this innovative program is to motivate FTC participants with extra visitation while simultaneously improving parenting skills. As part of a program evaluation paid for by the Office of Juvenile Justice and Delinquency Prevention (OJJDP), three separate instruments were used to determine the impact EPT had on its participants. Comparison data collected from the Quality-of-Life Scales (QOLS), Mental Health Continuum – Short Form (MHC-SF), and Rosenberg Self Esteem scale (RSE) yielded differences between EPT participants and non-EPT participants. This research focuses on the use of these instruments in an impact evaluation of a novel treatment court program in the United States and contributes to evaluation methodology frameworks for treatment court programs.
家庭治疗法庭(FTCs)受理父母滥用药物和/或精神健康有问题的民事疏忽案件。以成人药物治疗法庭为模型,FTCs协调药物使用和心理健康治疗,以及为参与者提供住房和就业等其他社会支持服务。最近,美国的一家联邦贸易委员会开始为他们的联邦贸易委员会项目的参与者提供额外的监督和监控探访,以及一对一的循证育儿教育。这个创新项目被称为“增强育儿时间”(EPT),目的是通过额外的探视来激励联邦贸易委员会的参与者,同时提高育儿技能。作为由青少年司法和犯罪预防办公室(OJJDP)资助的项目评估的一部分,研究人员使用了三种不同的工具来确定EPT对参与者的影响。从生活质量量表(QOLS)、心理健康连续短表(MHC-SF)和Rosenberg自尊量表(RSE)收集的比较数据显示EPT参与者与非EPT参与者之间存在差异。本研究的重点是在美国一个新的治疗法庭项目的影响评估中使用这些工具,并为治疗法庭项目的评估方法框架做出贡献。
{"title":"Measuring the impact of a novel program in a Family Treatment Court: Quality of life, mental health, and self-esteem inventories in program evaluation","authors":"Julie B. Raines","doi":"10.1016/j.evalprogplan.2025.102734","DOIUrl":"10.1016/j.evalprogplan.2025.102734","url":null,"abstract":"<div><div>Family Treatment Courts (FTCs) accept parents in civil neglect cases where the parent is suffering from substance use and/or mental health issues. Modeled after adult drug treatment courts, FTCs coordinate substance use and mental health treatment, as well as other social support services for participants like housing and employment. Recently, one FTC in the United States began providing additional supervised and monitored visitation to participants within their FTC program, as well as one-on-one evidence-based parenting education. Called Enhanced Parenting Time (EPT), the goal of this innovative program is to motivate FTC participants with extra visitation while simultaneously improving parenting skills. As part of a program evaluation paid for by the Office of Juvenile Justice and Delinquency Prevention (OJJDP), three separate instruments were used to determine the impact EPT had on its participants. Comparison data collected from the Quality-of-Life Scales (QOLS), Mental Health Continuum – Short Form (MHC-SF), and Rosenberg Self Esteem scale (RSE) yielded differences between EPT participants and non-EPT participants. This research focuses on the use of these instruments in an impact evaluation of a novel treatment court program in the United States and contributes to evaluation methodology frameworks for treatment court programs.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"115 ","pages":"Article 102734"},"PeriodicalIF":2.0,"publicationDate":"2025-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145645881","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Drivers of change effectiveness in public universities in the State of Amhara: Toward developing promising propositions through a critical co-constructive perspective 阿姆哈拉州公立大学变革有效性的驱动因素:通过批判性的共同建设性视角发展有希望的命题。
IF 2 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2025-11-22 DOI: 10.1016/j.evalprogplan.2025.102733
Bekalu Tadesse Moges , Getnet Tizazu Fetene , Getu Shiferaw Wolle
Most studies examining the effectiveness of system-wide change initiatives in public universities rely heavily on simplistic models of technical rationality that emphasize planning, control, and monitoring. This perspective is known to ignore the contextual and relational interactions that shape the understanding of educational change. Alternatively, the present study makes a case for the adoption of a Critical co-constructive stance to allow context-based solutions that optimize the successful implementation of the initiatives. With this stance, the study identifies context-based drivers and propositions grounded in the views of change implementers. Using 15 key informant interviews and 6 focus group discussions, data were collected from teachers, and academic leaders selected through theoretical sampling. The data are analyzed using the constant comparison technique. The study found that profound change is a critically co-constructed phenomenon that evolves through ongoing meaning-making among implementers. Additionally, the study identified 16 interrelated drivers and their respective propositions that optimize the chance of successful educational change. The drivers represent multilevel interactions within and across implementing institutions. Practical policy and efficiency implications for the development and implementation of change initiatives are discussed.
大多数检查公立大学系统范围内变革主动性的有效性的研究严重依赖于强调计划、控制和监督的技术合理性的简化模型。众所周知,这种观点忽视了影响对教育变革理解的背景和关系相互作用。或者,本研究提出了一个案例,采用关键的共同建设性立场,允许基于情境的解决方案,优化倡议的成功实施。基于这一立场,该研究确定了基于情境的驱动因素和基于变革实施者观点的主张。通过15次关键信息访谈和6次焦点小组讨论,从教师和通过理论抽样选择的学术带头人中收集数据。数据分析采用恒定比较法。研究发现,深刻的变革是一种批判性的共同构建现象,它通过实施者之间不断的意义创造而演变。此外,该研究还确定了16个相互关联的驱动因素及其各自的主张,以优化成功教育变革的机会。驱动因素代表了实施机构内部和机构之间的多层次互动。实际的政策和效率的影响,发展和实施的变革倡议进行了讨论。
{"title":"Drivers of change effectiveness in public universities in the State of Amhara: Toward developing promising propositions through a critical co-constructive perspective","authors":"Bekalu Tadesse Moges ,&nbsp;Getnet Tizazu Fetene ,&nbsp;Getu Shiferaw Wolle","doi":"10.1016/j.evalprogplan.2025.102733","DOIUrl":"10.1016/j.evalprogplan.2025.102733","url":null,"abstract":"<div><div>Most studies examining the effectiveness of system-wide change initiatives in public universities rely heavily on simplistic models of technical rationality that emphasize planning, control, and monitoring. This perspective is known to ignore the contextual and relational interactions that shape the understanding of educational change. Alternatively, the present study makes a case for the adoption of a Critical co-constructive stance to allow context-based solutions that optimize the successful implementation of the initiatives. With this stance, the study identifies context-based drivers and propositions grounded in the views of change implementers. Using 15 key informant interviews and 6 focus group discussions, data were collected from teachers, and academic leaders selected through theoretical sampling. The data are analyzed using the constant comparison technique. The study found that profound change is a critically co-constructed phenomenon that evolves through ongoing meaning-making among implementers. Additionally, the study identified 16 interrelated drivers and their respective propositions that optimize the chance of successful educational change. The drivers represent multilevel interactions within and across implementing institutions. Practical policy and efficiency implications for the development and implementation of change initiatives are discussed.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102733"},"PeriodicalIF":2.0,"publicationDate":"2025-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145605982","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The coupling coordination development of rural medical health service and rural economy: Evidence from China 农村医疗卫生服务与农村经济的耦合协调发展:来自中国的证据。
IF 2 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2025-11-15 DOI: 10.1016/j.evalprogplan.2025.102732
Junjie Zhao , Ye Ding , Shangren Qin
The equity of rural medical health services and their coordination with the rural economy needs to be clarified. This article reports on the coupling coordination development of rural medical health services and the economy in China. We used panel data for 29 provincial-level administrative regions in China from 2009 to 2019 to analyze the development level and coupling coordination degree of rural medical health services and rural economy from a spatial and temporal perspective. Using a spatial autocorrelation test, the correlation of the coupling coordination degree of each administrative region and the spatial clustering characteristics of the coupling coordination degree of the east, central, west, and northeast regions was analyzed. Results showed that the level of development of the two subsystems turned from 2014. The rural economy was gradually catching up with medical and health services, yet rural health services had always been important in the development of the system, coupling coordination degree. Spatially, the development level and coupling coordination of the subsystem showed a “high eastern” distribution pattern, while the inequity among provincial-level administrative regions in the east was more significant. The subsystems of 29 provincial-level administrative regions exhibited both spatial-temporal differences and positive spatial correlation. The phenomenon of regional differentiation and imbalance still exists in rural China. It indicates that neighboring regions influence each other and produce a spillover effect, so promoting regional linkage can better promote balanced regional development. These findings will help the government to implement targeted policies to improve health quality and health equity in rural areas.
农村医疗卫生服务的公平性及其与农村经济的协调性需要明确。本文报道了中国农村医疗卫生服务与经济的耦合协调发展。利用2009 - 2019年中国29个省级行政区的面板数据,从时空视角分析农村医疗卫生服务与农村经济发展水平及耦合协调程度。采用空间自相关检验,分析了各行政区域耦合协调度的相关性与东、中、西、东北区域耦合协调度的空间聚类特征。结果表明,两个子系统的发展水平从2014年开始出现逆转。农村经济逐步赶上医疗卫生服务,但农村卫生服务在系统发展、耦合协调程度等方面一直处于重要地位。空间上,各子系统的发展水平和耦合协调性呈现“高东部”的分布格局,东部省级行政区间的不平等更为显著。29个省级行政区的各子系统既有时空差异,又有空间正相关。中国农村地区分化和不平衡现象依然存在。这说明相邻区域之间相互影响,产生溢出效应,促进区域联动能更好地促进区域均衡发展。这些发现将有助于政府实施有针对性的政策,以改善农村地区的卫生质量和卫生公平。
{"title":"The coupling coordination development of rural medical health service and rural economy: Evidence from China","authors":"Junjie Zhao ,&nbsp;Ye Ding ,&nbsp;Shangren Qin","doi":"10.1016/j.evalprogplan.2025.102732","DOIUrl":"10.1016/j.evalprogplan.2025.102732","url":null,"abstract":"<div><div>The equity of rural medical health services and their coordination with the rural economy needs to be clarified. This article reports on the coupling coordination development of rural medical health services and the economy in China. We used panel data for 29 provincial-level administrative regions in China from 2009 to 2019 to analyze the development level and coupling coordination degree of rural medical health services and rural economy from a spatial and temporal perspective. Using a spatial autocorrelation test, the correlation of the coupling coordination degree of each administrative region and the spatial clustering characteristics of the coupling coordination degree of the east, central, west, and northeast regions was analyzed. Results showed that the level of development of the two subsystems turned from 2014. The rural economy was gradually catching up with medical and health services, yet rural health services had always been important in the development of the system, coupling coordination degree. Spatially, the development level and coupling coordination of the subsystem showed a “high eastern” distribution pattern, while the inequity among provincial-level administrative regions in the east was more significant. The subsystems of 29 provincial-level administrative regions exhibited both spatial-temporal differences and positive spatial correlation. The phenomenon of regional differentiation and imbalance still exists in rural China. It indicates that neighboring regions influence each other and produce a spillover effect, so promoting regional linkage can better promote balanced regional development. These findings will help the government to implement targeted policies to improve health quality and health equity in rural areas.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102732"},"PeriodicalIF":2.0,"publicationDate":"2025-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145551537","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Implementation evaluation of an intervention aimed at reducing test anxiety in adolescents 旨在减少青少年考试焦虑的干预措施的实施评估。
IF 2 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2025-11-14 DOI: 10.1016/j.evalprogplan.2025.102731
Gabriela Campeau , Gabrielle Yale-Soulière , Lyse Turgeon , Kassandra Berniqué , Kim Archambault

Introduction

Approximately 15 % of adolescents experience test anxiety in school settings. This type of anxiety, characterized by worries and physiological reactions to school assessments, can lead to significant academic and psychological difficulties. In response to the lack of effective school-based interventions, the Pastel workshops were developed. This targeted group intervention, which combines a cognitive-behavioral approach with study skills training, has demonstrated significant effects in reducing test anxiety in at-risk adolescents.

Objectives

This study aims to: 1) determine whether the training provided by Boscoville to program facilitators was properly implemented, 2) evaluate the implementation of the Pastel workshops, and 3) explore the facilitators and barriers encountered in supporting facilitators and implementing the workshops.

Methodology

The sample includes 24 students aged 14–17 in grades 10 and 11 from five schools who participated in the workshops, and nine professionals who facilitated them. Fidelity, delivered dosage, quality of delivery, and attendance and homework completion were measured to evaluate the implementation, while semi-structured interviews with the youth and facilitators were conducted to assess the implementation context.

Results

Findings show an overall score of 84 % for the evaluation of the training implementation and an average adherence score of 79 % for the workshop implementation. The context evaluation identified enablers and challenges based on Domitrovich’s multilevel framework, across societal, environmental, intervention-specific, and support system levels. Key enablers included the involvement of a third-party organization, the group-based format, strong motivation among facilitators, the relevance of the strategies presented, and the quality of the training. However, challenges emerged at multiple levels, including limited engagement for some participants, issues related to the organization of the workshop content, suboptimal quality of some implementation materials, and time constraints related to preparation and facilitation.

Conclusion

This study highlights that successful implementation of school-based psychosocial programs relies on thorough planning that integrates both core components and contextual factors. When combined with strong facilitator support, such planning fosters high fidelity, quality delivery, and sustained participant engagement.
简介:大约15% %的青少年在学校经历过考试焦虑。这种焦虑的特征是对学校评估的担忧和生理反应,可能导致严重的学业和心理困难。针对缺乏有效的学校干预措施的情况,开发了“粉彩”讲习班。这种有针对性的群体干预,结合了认知行为方法和学习技能训练,已经证明在减少高危青少年的考试焦虑方面有显著效果。目的:本研究旨在:1)确定Boscoville为项目辅导员提供的培训是否得到了适当的实施;2)评估Pastel讲习班的实施情况;3)探索在支持辅导员和实施讲习班时遇到的障碍。方法:样本包括来自五所学校的24名年龄在14-17岁的10年级和11年级的学生,他们参加了研讨会,以及9名为他们提供帮助的专业人士。测量保真度、交付剂量、交付质量、出勤和作业完成情况以评估实施情况,同时对青少年和辅导员进行半结构化访谈以评估实施情况。结果:调查结果显示培训实施评估的总分为84 %,车间实施的平均依从性得分为79 %。背景评估基于Domitrovich的多层次框架,跨越社会、环境、特定干预和支持系统层面,确定了推动因素和挑战。关键的促成因素包括第三方组织的参与、以小组为基础的形式、促进者之间的强烈动机、所提出的战略的相关性以及培训的质量。然而,挑战出现在多个层面,包括一些参与者的参与有限,与研讨会内容的组织有关的问题,一些实施材料的质量不理想,以及与准备和促进有关的时间限制。结论:本研究强调,成功实施基于学校的社会心理课程依赖于整合核心组成部分和环境因素的全面规划。当与强大的促进者支持相结合时,这样的计划促进了高保真度、高质量的交付和持续的参与者参与。
{"title":"Implementation evaluation of an intervention aimed at reducing test anxiety in adolescents","authors":"Gabriela Campeau ,&nbsp;Gabrielle Yale-Soulière ,&nbsp;Lyse Turgeon ,&nbsp;Kassandra Berniqué ,&nbsp;Kim Archambault","doi":"10.1016/j.evalprogplan.2025.102731","DOIUrl":"10.1016/j.evalprogplan.2025.102731","url":null,"abstract":"<div><h3>Introduction</h3><div>Approximately 15 % of adolescents experience test anxiety in school settings. This type of anxiety, characterized by worries and physiological reactions to school assessments, can lead to significant academic and psychological difficulties. In response to the lack of effective school-based interventions, the <em>Pastel</em> workshops were developed. This targeted group intervention, which combines a cognitive-behavioral approach with study skills training, has demonstrated significant effects in reducing test anxiety in at-risk adolescents.</div></div><div><h3>Objectives</h3><div>This study aims to: 1) determine whether the training provided by Boscoville to program facilitators was properly implemented, 2) evaluate the implementation of the Pastel workshops, and 3) explore the facilitators and barriers encountered in supporting facilitators and implementing the workshops.</div></div><div><h3>Methodology</h3><div>The sample includes 24 students aged 14–17 in grades 10 and 11 from five schools who participated in the workshops, and nine professionals who facilitated them. Fidelity, delivered dosage, quality of delivery, and attendance and homework completion were measured to evaluate the implementation, while semi-structured interviews with the youth and facilitators were conducted to assess the implementation context.</div></div><div><h3>Results</h3><div>Findings show an overall score of 84 % for the evaluation of the training implementation and an average adherence score of 79 % for the workshop implementation. The context evaluation identified enablers and challenges based on Domitrovich’s multilevel framework, across societal, environmental, intervention-specific, and support system levels. Key enablers included the involvement of a third-party organization, the group-based format, strong motivation among facilitators, the relevance of the strategies presented, and the quality of the training. However, challenges emerged at multiple levels, including limited engagement for some participants, issues related to the organization of the workshop content, suboptimal quality of some implementation materials, and time constraints related to preparation and facilitation.</div></div><div><h3>Conclusion</h3><div>This study highlights that successful implementation of school-based psychosocial programs relies on thorough planning that integrates both core components and contextual factors. When combined with strong facilitator support, such planning fosters high fidelity, quality delivery, and sustained participant engagement.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102731"},"PeriodicalIF":2.0,"publicationDate":"2025-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145558249","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using intervention mapping to develop training for US dental providers to recommend the HPV vaccine 使用干预测绘开发培训,为美国牙科提供者推荐HPV疫苗。
IF 2 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2025-11-11 DOI: 10.1016/j.evalprogplan.2025.102730
Jennifer Sukalski , Grace Ryan , Susan C. McKernan , Emily A. Janio , Rebecca Bucklin , Natoshia Askelson

Introduction

Iowa has the highest incidence of oropharyngeal cancer (OPC) in the US, and human papillomavirus (HPV) is the most common cause of that disease. An HPV vaccine is approved for OPC prevention, but its uptake is low. We identified dental offices as novel settings in which the HPV vaccine can be recommended to patients, and we describe our use of the Intervention Mapping (IM) framework to develop an intervention that prepares dental providers to recommend the vaccine to parents of patients aged 9–17.

Methods

Our planning group used IM to engage in (1) needs assessment, which involved surveying dental hygienists (n = 470) and interviewing dental hygienists (n = 19) and dentists (n = 20); (2) method and (3) theory identification; and (4) intervention development, (5) implementation, and (6) evaluation, resulting in our “Educate, Recommend, Refer” intervention.

Results

The needs assessment showed dental providers were willing to learn more about the HPV vaccine but needed training to confidently recommend it. We chose training methods that increase self-efficacy, in accordance with behavior change theory. Multiple health behavior theories and frameworks also prompted our development of supporting materials, that encouraged participants to engage in vaccine promotion, as well as an evaluation plan.

Conclusion

IM guided our integration of theory, existing evidence, and stakeholder input to create an intervention that comprehensively addressed the needs of our target audience and overcame limitations of other similar interventions. Presenting intervention development in accordance with the IM framework also gives practitioners clear information for its replication or adoption.
爱荷华州是美国口咽癌(OPC)发病率最高的州,而人乳头瘤病毒(HPV)是该疾病最常见的病因。一种HPV疫苗被批准用于预防OPC,但它的吸收率很低。我们将牙科诊所确定为可以向患者推荐HPV疫苗的新环境,并且我们描述了我们使用干预绘图(IM)框架来开发干预措施,使牙科提供者准备向9-17岁患者的父母推荐疫苗。方法:我们的规划组使用IM进行(1)需求评估,包括调查牙科保健员(n = 470)和访谈牙科保健员(n = 19)和牙医(n = 20);(2)方法鉴定;(3)理论鉴定;(4)干预发展,(5)实施,(6)评估,最终形成我们的“教育、推荐、推荐”干预。结果:需求评估显示牙科服务提供者愿意更多地了解HPV疫苗,但需要培训才能自信地推荐它。根据行为改变理论,我们选择了提高自我效能感的训练方法。多种健康行为理论和框架也促使我们开发了支持材料,鼓励参与者参与疫苗推广,以及评估计划。结论:IM指导我们将理论、现有证据和利益相关者的意见整合在一起,创建了一个全面满足目标受众需求的干预措施,并克服了其他类似干预措施的局限性。根据IM框架提出干预措施的发展也为从业者提供了复制或采用干预措施的明确信息。
{"title":"Using intervention mapping to develop training for US dental providers to recommend the HPV vaccine","authors":"Jennifer Sukalski ,&nbsp;Grace Ryan ,&nbsp;Susan C. McKernan ,&nbsp;Emily A. Janio ,&nbsp;Rebecca Bucklin ,&nbsp;Natoshia Askelson","doi":"10.1016/j.evalprogplan.2025.102730","DOIUrl":"10.1016/j.evalprogplan.2025.102730","url":null,"abstract":"<div><h3>Introduction</h3><div>Iowa has the highest incidence of oropharyngeal cancer (OPC) in the US, and human papillomavirus (HPV) is the most common cause of that disease. An HPV vaccine is approved for OPC prevention, but its uptake is low. We identified dental offices as novel settings in which the HPV vaccine can be recommended to patients, and we describe our use of the Intervention Mapping (IM) framework to develop an intervention that prepares dental providers to recommend the vaccine to parents of patients aged 9–17.</div></div><div><h3>Methods</h3><div>Our planning group used IM to engage in (1) needs assessment, which involved surveying dental hygienists (n = 470) and interviewing dental hygienists (n = 19) and dentists (n = 20); (2) method and (3) theory identification; and (4) intervention development, (5) implementation, and (6) evaluation, resulting in our “Educate, Recommend, Refer” intervention.</div></div><div><h3>Results</h3><div>The needs assessment showed dental providers were willing to learn more about the HPV vaccine but needed training to confidently recommend it. We chose training methods that increase self-efficacy, in accordance with behavior change theory. Multiple health behavior theories and frameworks also prompted our development of supporting materials, that encouraged participants to engage in vaccine promotion, as well as an evaluation plan.</div></div><div><h3>Conclusion</h3><div>IM guided our integration of theory, existing evidence, and stakeholder input to create an intervention that comprehensively addressed the needs of our target audience and overcame limitations of other similar interventions. Presenting intervention development in accordance with the IM framework also gives practitioners clear information for its replication or adoption.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102730"},"PeriodicalIF":2.0,"publicationDate":"2025-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145565949","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Does mentoring frequency matter? Effects on dropout rates and average grades among university students 辅导频率重要吗?对大学生辍学率和平均成绩的影响。
IF 2 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2025-11-03 DOI: 10.1016/j.evalprogplan.2025.102729
Miguel A. Alonso García , Aitana González Ortiz de Zárate , Irene Aliagas , Ma Ángeles Gómez-Flechoso
Mentoring programs are essential in supporting first-year university students by reducing dropout rates and enhancing grades. However, the optimal number of meetings has not been extensively explored. This article examines how the number of meetings influences outcomes across disciplines and demographics. Using a quasi-experimental approach with 9063 students (4 + meetings, n = 3074; ≤3 meetings, n = 2958; 0 meetings, n = 3031), who belonged to different areas of study, we analyzed dropout rates and grades through chi-square tests, phi statistics, ANOVA, and Bonferroni adjustments. Results indicate that more meetings generally lead to lower dropout rates and higher grades. However, exceptions exist in Science and Engineering, ≤ 3 meetings were as effective as 4 + meetings at reducing dropouts; while in Arts, Humanities, Social, and Legal Sciences, they were equally effective at improving grades. These findings suggest institutions can optimize mentoring strategies by tailoring programs to specific student needs, improving educational outcomes and fostering success.
通过减少辍学率和提高成绩,辅导项目对支持大学一年级学生至关重要。然而,会议的最佳次数尚未得到广泛探讨。本文研究了会议的数量如何影响跨学科和人口统计的结果。采用准实验方法对9063名学生(4次 +会议,n = 3074;≤3次会议,n = 2958;0次会议,n = 3031),他们属于不同的研究领域,我们通过卡方检验、phi统计、方差分析和Bonferroni调整来分析辍学率和成绩。结果表明,越多的会议通常会导致更低的辍学率和更高的成绩。然而,科学与工程领域存在例外,≤ 3次会议与4次 + 会议在减少辍学率方面同样有效;而在艺术、人文、社会和法律科学方面,他们在提高成绩方面同样有效。这些发现表明,学校可以根据学生的具体需求量身定制课程,从而优化指导策略,提高教育成果,促进成功。
{"title":"Does mentoring frequency matter? Effects on dropout rates and average grades among university students","authors":"Miguel A. Alonso García ,&nbsp;Aitana González Ortiz de Zárate ,&nbsp;Irene Aliagas ,&nbsp;Ma Ángeles Gómez-Flechoso","doi":"10.1016/j.evalprogplan.2025.102729","DOIUrl":"10.1016/j.evalprogplan.2025.102729","url":null,"abstract":"<div><div>Mentoring programs are essential in supporting first-year university students by reducing dropout rates and enhancing grades. However, the optimal number of meetings has not been extensively explored. This article examines how the number of meetings influences outcomes across disciplines and demographics. Using a quasi-experimental approach with 9063 students (4 + meetings, <em>n</em> = 3074; ≤3 meetings, <em>n</em> = 2958; 0 meetings, <em>n</em> = 3031), who belonged to different areas of study, we analyzed dropout rates and grades through chi-square tests, phi statistics, ANOVA, and Bonferroni adjustments. Results indicate that more meetings generally lead to lower dropout rates and higher grades. However, exceptions exist in Science and Engineering, ≤ 3 meetings were as effective as 4 + meetings at reducing dropouts; while in Arts, Humanities, Social, and Legal Sciences, they were equally effective at improving grades. These findings suggest institutions can optimize mentoring strategies by tailoring programs to specific student needs, improving educational outcomes and fostering success.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102729"},"PeriodicalIF":2.0,"publicationDate":"2025-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145460315","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Co-developing practice guides: A researcher-practitioner model for evidence-based practice 共同开发实践指南:循证实践的研究-实践模式。
IF 2 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2025-11-02 DOI: 10.1016/j.evalprogplan.2025.102728
Sebastian Lemire , Brian Freeman , Allan Porowski
Bridging the gap between evidence and practice continues to be a challenge. To support educators in applying research findings, the What Works Clearinghouse™ (WWC) has developed practice guides over the past two decades that translate evidence into actionable recommendations. Practice guides are perhaps best described as participatory evidence reviews where researchers collaborate with practitioners through every stage of the evidence review—from initial framing to final dissemination. This Method Note describes the development of a practice guide on teacher-delivered behavioral interventions in grades K-5, awarding particular attention to the important role of practitioners in developing the practice guide. A description of the structure and main features of a practice guide is also provided. In closing, the Method Note reflects on the limitations and future directions of participatory evidence reviews to better bridge the gap between evidence and practice.
弥合证据与实践之间的差距仍然是一项挑战。为了支持教育工作者应用研究成果,What Works Clearinghouse™(WWC)在过去二十年中制定了实践指南,将证据转化为可操作的建议。实践指南也许最好被描述为参与式证据审查,研究人员与从业人员在证据审查的每个阶段合作-从最初的框架到最终的传播。本方法说明描述了K-5年级教师提供的行为干预实践指南的开发,特别关注实践者在开发实践指南中的重要作用。还提供了对练习指南的结构和主要特征的描述。最后,方法说明反映了参与式证据审查的局限性和未来方向,以更好地弥合证据与实践之间的差距。
{"title":"Co-developing practice guides: A researcher-practitioner model for evidence-based practice","authors":"Sebastian Lemire ,&nbsp;Brian Freeman ,&nbsp;Allan Porowski","doi":"10.1016/j.evalprogplan.2025.102728","DOIUrl":"10.1016/j.evalprogplan.2025.102728","url":null,"abstract":"<div><div>Bridging the gap between evidence and practice continues to be a challenge. To support educators in applying research findings, the What Works Clearinghouse™ (WWC) has developed practice guides over the past two decades that translate evidence into actionable recommendations. Practice guides are perhaps best described as participatory evidence reviews where researchers collaborate with practitioners through every stage of the evidence review—from initial framing to final dissemination. This Method Note describes the development of a practice guide on teacher-delivered behavioral interventions in grades K-5, awarding particular attention to the important role of practitioners in developing the practice guide. A description of the structure and main features of a practice guide is also provided. In closing, the Method Note reflects on the limitations and future directions of participatory evidence reviews to better bridge the gap between evidence and practice.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102728"},"PeriodicalIF":2.0,"publicationDate":"2025-11-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145460381","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Evaluation and Program Planning
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1