首页 > 最新文献

Evaluation and Program Planning最新文献

英文 中文
Evaluation of the gradual release of responsibility framework’s effectiveness on oral summarization skills in Turkish middle school classrooms: A mixed methods study 逐步释放责任框架对土耳其中学课堂口头总结技能的有效性评价:一项混合方法研究
IF 2 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2025-10-17 DOI: 10.1016/j.evalprogplan.2025.102720
Kürşat Kaya , Mehmet Kurudayıoğlu , Kasım Yıldırım , Abbey Galeza , Timothy Rasinski
We aimed to explore the effects of the gradual release of responsibility framework on sixth-grade students’ oral summarization skills in the Turkish language. The current study employed convergent mixed methods research. In the quantitative phase, a pretest-posttest control group quasi-experimental design was used. The sample of the quantitative phase consisted of 41 sixth-grade students in Türkiye. The qualitative phase included observations about the intervention and the students’ diaries in the experimental group (n = 20). The covariance analyses on the posttest scores of the students revealed that summarization attitudes and summarization achievements of the experimental group students varied significantly compared to the control group students. In addition, it was observed that the intervention provided new insights into how students summarized a text. The students’ diaries showed that while they had difficulties with oral summarization during the intervention, they gradually developed an awareness and they liked to summarize.
本研究旨在探讨责任框架渐进式释放对六年级学生土耳其语口语总结能力的影响。本研究采用收敛混合方法研究。定量阶段采用前测后测对照组准实验设计。定量阶段的样本包括41名基耶州六年级学生。定性阶段包括观察实验组的干预措施和学生日记(n = 20)。对学生的后测成绩进行协方差分析发现,实验组学生的总结态度和总结成绩与对照组学生有显著差异。此外,据观察,干预为学生如何总结文本提供了新的见解。从学生的日记中可以看出,在干预过程中,虽然他们在口头总结方面有困难,但他们逐渐形成了一种意识,并且喜欢总结。
{"title":"Evaluation of the gradual release of responsibility framework’s effectiveness on oral summarization skills in Turkish middle school classrooms: A mixed methods study","authors":"Kürşat Kaya ,&nbsp;Mehmet Kurudayıoğlu ,&nbsp;Kasım Yıldırım ,&nbsp;Abbey Galeza ,&nbsp;Timothy Rasinski","doi":"10.1016/j.evalprogplan.2025.102720","DOIUrl":"10.1016/j.evalprogplan.2025.102720","url":null,"abstract":"<div><div>We aimed to explore the effects of the gradual release of responsibility framework on sixth-grade students’ oral summarization skills in the Turkish language. The current study employed convergent mixed methods research. In the quantitative phase, a pretest-posttest control group quasi-experimental design was used. The sample of the quantitative phase consisted of 41 sixth-grade students in Türkiye. The qualitative phase included observations about the intervention and the students’ diaries in the experimental group (<em>n</em> = 20). The covariance analyses on the posttest scores of the students revealed that summarization attitudes and summarization achievements of the experimental group students varied significantly compared to the control group students. In addition, it was observed that the intervention provided new insights into how students summarized a text. The students’ diaries showed that while they had difficulties with oral summarization during the intervention, they gradually developed an awareness and they liked to summarize.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102720"},"PeriodicalIF":2.0,"publicationDate":"2025-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145362715","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Impacting the substance abuse epidemic in America: A mixed methods examination of mentors of youth who experience substance use disorders within their families 影响美国药物滥用流行病:对家庭中经历药物使用障碍的青年导师的混合方法检查
IF 2 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2025-10-04 DOI: 10.1016/j.evalprogplan.2025.102715
Stephen Phillippi , Ashley Fenton , Kelsey Witmeier , Sara Juneau , Claudia Leonardi , Edmond P. Bowers , Brian Maus
This study aimed to explore the experiences and needs of mentors in Camp Mariposa; a program designed to prevent substance use among youth who have a family member with a substance use disorder (SUD). Using a mixed-methods design, the study included a quantitative survey and focus groups. Of 280 eligible mentors, 116 (41 %) completed the survey, with 24 (21 %) participating in follow-up focus groups. Descriptive statistics illustrate survey data findings, and qualitative findings reflect themes that emerged from focus groups. Mentors reported positive experiences working with peers and youth but also highlighted challenges that could inform future mentoring efforts. Key factors influencing their experiences included the benefits and challenges of mentoring, program leadership, self-care needs, and strategies during camp weekends. Mentors expressed a desire for more training and emphasized the importance of pre-camp briefings and post-camp debriefings. Confidence in mentoring abilities and maintaining empathy and boundaries were also highlighted. This study provides valuable insights for improving mentor support and training in programs targeting youth facing adversities that come with having a family member with a SUD.
本研究旨在探讨马里波萨营导师的经验与需求;这是一个旨在防止家庭成员有物质使用障碍(SUD)的青少年使用物质的项目。该研究采用混合方法设计,包括定量调查和焦点小组。在280名合格的导师中,116名(41% %)完成了调查,24名(21% %)参加了后续焦点小组。描述性统计说明了调查数据的结果,定性调查结果反映了焦点小组提出的主题。导师们报告了与同龄人和年轻人一起工作的积极经验,但也强调了可能为未来的指导工作提供信息的挑战。影响他们经历的关键因素包括辅导的好处和挑战,项目领导,自我照顾的需要,以及夏令营周末的策略。导师们表示希望得到更多的培训,并强调营前情况介绍会和营后情况介绍会的重要性。他们还强调了对指导能力的信心,以及保持同理心和界限的信心。这项研究为改善导师支持和培训项目提供了有价值的见解,这些项目针对的是那些因家庭成员患有SUD而面临逆境的青年。
{"title":"Impacting the substance abuse epidemic in America: A mixed methods examination of mentors of youth who experience substance use disorders within their families","authors":"Stephen Phillippi ,&nbsp;Ashley Fenton ,&nbsp;Kelsey Witmeier ,&nbsp;Sara Juneau ,&nbsp;Claudia Leonardi ,&nbsp;Edmond P. Bowers ,&nbsp;Brian Maus","doi":"10.1016/j.evalprogplan.2025.102715","DOIUrl":"10.1016/j.evalprogplan.2025.102715","url":null,"abstract":"<div><div>This study aimed to explore the experiences and needs of mentors in Camp Mariposa; a program designed to prevent substance use among youth who have a family member with a substance use disorder (SUD). Using a mixed-methods design, the study included a quantitative survey and focus groups. Of 280 eligible mentors, 116 (41 %) completed the survey, with 24 (21 %) participating in follow-up focus groups. Descriptive statistics illustrate survey data findings, and qualitative findings reflect themes that emerged from focus groups. Mentors reported positive experiences working with peers and youth but also highlighted challenges that could inform future mentoring efforts. Key factors influencing their experiences included the benefits and challenges of mentoring, program leadership, self-care needs, and strategies during camp weekends. Mentors expressed a desire for more training and emphasized the importance of pre-camp briefings and post-camp debriefings. Confidence in mentoring abilities and maintaining empathy and boundaries were also highlighted. This study provides valuable insights for improving mentor support and training in programs targeting youth facing adversities that come with having a family member with a SUD.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102715"},"PeriodicalIF":2.0,"publicationDate":"2025-10-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145266994","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Barriers and facilitators to recovery support interventions in US Rural Recovery Houses: Implementing the SMART life skills program 美国农村康复之家康复支持干预的障碍和促进因素:实施SMART生活技能计划。
IF 2 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2025-10-03 DOI: 10.1016/j.evalprogplan.2025.102717
Madison Ashworth, David Johnson, Robin A. Thompson, Grace L. Clancy, Jennah Baier, Jean Spielman
As substance use disorder continues to impact millions of Americans, various recovery support treatment and service modalities are being developed, evaluated, and refined for effectiveness. Recovery housing provides substance-free living environments for individuals in recovery and can offer a variety of services and structured programs for residents. One such program that has the potential to enhance resident outcomes is the Self-Management and Recovery Training (SMART) Successful Life Skills program (SLS), a 12-session curriculum that uses a mix of behavioral tools and aspects of the social model of recovery employed by standard mutual aid groups. In this paper, we discuss the implementation barriers and facilitators of a 3-year initiative that aimed to implement SLS in 100 rural recovery houses across the U.S. During this initiative, the study team faced significant barriers in recruitment and program implementation. Recruitment barriers included the unknown landscape of recovery housing, stigma and mistrust in research, inconsistent staffing models, and differing treatment philosophies. Further, access to technology, technical literacy, time constraints for both residents and recovery house staff, and staff turnover created a difficult environment to successfully implement and evaluate the impact of the SLS program. Numerous solutions were employed to overcome implementation and recruitment barriers in recovery housing such as multiple contact methods, collaboration, stakeholder engagement, financial/material support, evaluation flexibility and adaptability, and transparency.
由于物质使用障碍继续影响着数百万美国人,各种康复支持治疗和服务模式正在开发、评估和改进其有效性。康复住房为康复中的个人提供无物质的生活环境,可以为居民提供各种服务和结构化的项目。自我管理和康复训练(SMART)成功生活技能项目(SLS)就是这样一个有可能提高住院医生治疗效果的项目,这是一个12节课的课程,混合使用行为工具和标准互助会采用的康复社会模式的各个方面。在本文中,我们讨论了一项为期三年的计划的实施障碍和促进因素,该计划旨在在美国100个农村恢复屋实施SLS。在该计划中,研究小组在招聘和计划实施方面面临重大障碍。招聘障碍包括康复住房的未知景观,研究中的耻辱和不信任,不一致的人员配备模式以及不同的治疗理念。此外,技术的获取、技术素养、居民和康复中心工作人员的时间限制以及工作人员的更替都为成功实施和评估SLS计划的影响创造了一个困难的环境。为了克服恢复性住房的实施和招聘障碍,采用了多种解决方案,如多种联系方式、合作、利益相关者参与、财务/物质支持、评估灵活性和适应性以及透明度。
{"title":"Barriers and facilitators to recovery support interventions in US Rural Recovery Houses: Implementing the SMART life skills program","authors":"Madison Ashworth,&nbsp;David Johnson,&nbsp;Robin A. Thompson,&nbsp;Grace L. Clancy,&nbsp;Jennah Baier,&nbsp;Jean Spielman","doi":"10.1016/j.evalprogplan.2025.102717","DOIUrl":"10.1016/j.evalprogplan.2025.102717","url":null,"abstract":"<div><div>As substance use disorder continues to impact millions of Americans, various recovery support treatment and service modalities are being developed, evaluated, and refined for effectiveness. Recovery housing provides substance-free living environments for individuals in recovery and can offer a variety of services and structured programs for residents. One such program that has the potential to enhance resident outcomes is the Self-Management and Recovery Training (SMART) Successful Life Skills program (SLS), a 12-session curriculum that uses a mix of behavioral tools and aspects of the social model of recovery employed by standard mutual aid groups. In this paper, we discuss the implementation barriers and facilitators of a 3-year initiative that aimed to implement SLS in 100 rural recovery houses across the U.S. During this initiative, the study team faced significant barriers in recruitment and program implementation. Recruitment barriers included the unknown landscape of recovery housing, stigma and mistrust in research, inconsistent staffing models, and differing treatment philosophies. Further, access to technology, technical literacy, time constraints for both residents and recovery house staff, and staff turnover created a difficult environment to successfully implement and evaluate the impact of the SLS program. Numerous solutions were employed to overcome implementation and recruitment barriers in recovery housing such as multiple contact methods, collaboration, stakeholder engagement, financial/material support, evaluation flexibility and adaptability, and transparency.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102717"},"PeriodicalIF":2.0,"publicationDate":"2025-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145259587","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A program evaluation of a healthy lifestyle intervention adapted for individuals with brain injury 适合脑损伤患者的健康生活方式干预方案评估
IF 2 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2025-09-30 DOI: 10.1016/j.evalprogplan.2025.102716
Megan E. Douglas , Virginia Leidner , Alyssa Patterson , Christa Ochoa , Evan McShan , Stephanie Calhoun , Alex Suhalka , Simon Driver
Current recommendations are to modify existing evidence-based health interventions rather than building new interventions. Therefore, our team adapted an evidence-based healthy lifestyle intervention to meet the unique needs of individuals with traumatic brain injury (TBI) and stroke. Previously published outcomes supported clinical trial efficacy of these programs, but it is also important to evaluate programs from a participant perspective. Responses from 58 participants who completed their respective intervention and the program exit survey were analyzed. Quantitative items using a Likert-type scale were summarized using descriptive statistics and responses to open-ended questions were analyzed using a thematic approach. Most program components were rated as “very helpful” and open-ended responses suggested that the program was perceived to be effective, that participants would recommend it, and most got what they wanted out of the experience. Although the program was perceived as helpful, a preference for in-person, rather than video conferencing delivery, was evident in responses. Six themes (Challenges, Change in Lifestyle following the Program, Program Feedback, Telehealth Experience, Social Support, and External Tools) and 38 unique subthemes emerged and will help inform future iterations of similar programs for individuals with TBI and stroke to support healthy lifestyle change.
目前的建议是修改现有的循证卫生干预措施,而不是建立新的干预措施。因此,我们的团队采用基于证据的健康生活方式干预来满足创伤性脑损伤(TBI)和中风患者的独特需求。先前发表的结果支持这些方案的临床试验效果,但从参与者的角度评估方案也很重要。我们分析了58名参与者的回答,他们分别完成了干预和项目退出调查。使用李克特量表的定量项目使用描述性统计进行总结,对开放式问题的回答使用主题方法进行分析。大多数项目的组成部分被评为“非常有帮助”,开放式的回答表明,该项目被认为是有效的,参与者会推荐它,而且大多数人都得到了他们想要的体验。尽管该项目被认为是有帮助的,但在回应中,人们明显更喜欢面对面的会议,而不是视频会议。六个主题(挑战、项目后生活方式的改变、项目反馈、远程医疗体验、社会支持和外部工具)和38个独特的子主题将有助于为TBI和中风患者提供类似项目的未来迭代,以支持健康的生活方式改变。
{"title":"A program evaluation of a healthy lifestyle intervention adapted for individuals with brain injury","authors":"Megan E. Douglas ,&nbsp;Virginia Leidner ,&nbsp;Alyssa Patterson ,&nbsp;Christa Ochoa ,&nbsp;Evan McShan ,&nbsp;Stephanie Calhoun ,&nbsp;Alex Suhalka ,&nbsp;Simon Driver","doi":"10.1016/j.evalprogplan.2025.102716","DOIUrl":"10.1016/j.evalprogplan.2025.102716","url":null,"abstract":"<div><div>Current recommendations are to modify existing evidence-based health interventions rather than building new interventions. Therefore, our team adapted an evidence-based healthy lifestyle intervention to meet the unique needs of individuals with traumatic brain injury (TBI) and stroke. Previously published outcomes supported clinical trial efficacy of these programs, but it is also important to evaluate programs from a participant perspective. Responses from 58 participants who completed their respective intervention and the program exit survey were analyzed. Quantitative items using a Likert-type scale were summarized using descriptive statistics and responses to open-ended questions were analyzed using a thematic approach. Most program components were rated as “very helpful” and open-ended responses suggested that the program was perceived to be effective, that participants would recommend it, and most got what they wanted out of the experience. Although the program was perceived as helpful, a preference for in-person, rather than video conferencing delivery, was evident in responses. Six themes (<em>Challenges</em>, <em>Change in Lifestyle following the Program</em>, <em>Program Feedback</em>, <em>Telehealth Experience</em>, <em>Social Support</em>, and <em>External Tools</em>) and 38 unique subthemes emerged and will help inform future iterations of similar programs for individuals with TBI and stroke to support healthy lifestyle change.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102716"},"PeriodicalIF":2.0,"publicationDate":"2025-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145221434","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Causal decision-making for speed camera allocation: Methodology and an application 高速摄影机配置的因果决策:方法与应用
IF 2 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2025-09-25 DOI: 10.1016/j.evalprogplan.2025.102713
Yingheng Zhang , Haojie Li
Speed enforcement cameras are implemented worldwide to regulate driving behaviours and enhance road traffic safety. Proper allocation of speed cameras is quite important. In practice, we should first identify road sites likely to experience larger crash reductions with speed cameras, but this step is commonly simplified as ranking sites based on the historical crash frequency. This paper proposes the use of causal decision-making to refine speed camera allocation rules. Within this framework, the heterogeneous treatment effects (HTEs) of speed cameras on crash frequency across different sites are first modelled by applying causal machine learning methods. Subsequently, by exploiting the trained HTE model, sites with larger predicted road safety benefits (i.e., crash reductions) will be prioritised for allocation. A UK case study is presented to demonstrate the superiority of the proposed method. Different speed camera allocation rules, including the HTE-based, historical crash-based, and random allocation, are compared with respect to the number of prevented road traffic crashes. Our empirical results indicate that a larger number of past crashes in general implies a larger safety benefit of the speed camera. Therefore, the historical crash frequency could be regarded as a useful criterion for camera site selection in the absence of additional information. Nonetheless, the HTE-based rule has been found to further enhance the allocation performance. That is, more road traffic crashes could be prevented by adopting the HTE-based rule. In future transportation research and practice, the causal decision-making framework could be applied more generally to costly resource allocation tasks.
世界各地都安装了超速执法摄影机,以规范驾驶行为和加强道路交通安全。正确配置测速摄像机是非常重要的。在实践中,我们应该首先用测速摄像机识别出可能经历更大碰撞减少的道路站点,但这一步通常被简化为根据历史碰撞频率对站点进行排名。本文提出利用因果决策方法来改进测速摄像机的配置规则。在此框架内,首先通过应用因果机器学习方法对超速摄像头对不同地点碰撞频率的异质性处理效应(HTEs)进行建模。随后,通过利用经过训练的HTE模型,预测道路安全效益(即减少碰撞)较大的站点将被优先分配。一个英国的案例研究证明了所提出的方法的优越性。比较了基于hte、基于历史碰撞和随机分配的不同测速摄像机分配规则对防止道路交通碰撞数量的影响。我们的实证结果表明,更多的过去的碰撞通常意味着更大的安全效益的测速摄像头。因此,在没有额外信息的情况下,历史碰撞频率可以被视为相机选址的有用标准。然而,基于hte的规则可以进一步提高分配性能。也就是说,采用基于hte的规则可以防止更多的道路交通事故。在未来的交通研究和实践中,因果决策框架可以更广泛地应用于昂贵的资源分配任务。
{"title":"Causal decision-making for speed camera allocation: Methodology and an application","authors":"Yingheng Zhang ,&nbsp;Haojie Li","doi":"10.1016/j.evalprogplan.2025.102713","DOIUrl":"10.1016/j.evalprogplan.2025.102713","url":null,"abstract":"<div><div>Speed enforcement cameras are implemented worldwide to regulate driving behaviours and enhance road traffic safety. Proper allocation of speed cameras is quite important. In practice, we should first identify road sites likely to experience larger crash reductions with speed cameras, but this step is commonly simplified as ranking sites based on the historical crash frequency. This paper proposes the use of causal decision-making to refine speed camera allocation rules. Within this framework, the heterogeneous treatment effects (HTEs) of speed cameras on crash frequency across different sites are first modelled by applying causal machine learning methods. Subsequently, by exploiting the trained HTE model, sites with larger predicted road safety benefits (i.e., crash reductions) will be prioritised for allocation. A UK case study is presented to demonstrate the superiority of the proposed method. Different speed camera allocation rules, including the HTE-based, historical crash-based, and random allocation, are compared with respect to the number of prevented road traffic crashes. Our empirical results indicate that a larger number of past crashes in general implies a larger safety benefit of the speed camera. Therefore, the historical crash frequency could be regarded as a useful criterion for camera site selection in the absence of additional information. Nonetheless, the HTE-based rule has been found to further enhance the allocation performance. That is, more road traffic crashes could be prevented by adopting the HTE-based rule. In future transportation research and practice, the causal decision-making framework could be applied more generally to costly resource allocation tasks.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102713"},"PeriodicalIF":2.0,"publicationDate":"2025-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145158703","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Program design and youth employability outcomes in South Africa: A longitudinal study 项目设计与南非青年就业能力结果:一项纵向研究
IF 2 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2025-09-24 DOI: 10.1016/j.evalprogplan.2025.102714
Gina A.N. Chowa , Rainier Masa , Graham Zulu , Miranda Manzanares
This study examines the association between program design and youth employability outcomes. Using longitudinal survey data from the Siyakha Youth Assets project in South Africa, we analyzed responses from a sample of 1809 youth enrolled in eight different employment programs across the country. Data were collected at four time points over 36 months using interviewer-administered questionnaires. Analyses were conducted on multiply imputed data sets using multilevel mixed-effects regression models, with repeated observations at Level 1 and program design features at Level 2. Results indicate variation in the association between program design features and outcomes. Youth in programs with moderate soft skills training, substantial work experience, and structured job matching reported significantly higher employability attributes, job readiness, and job interviewing skills, and were more likely to apply for jobs than those in programs with minimal soft skills, no work experience component, and unstructured or ad hoc matching. Program duration and technical skills training were not significantly associated with outcomes. The stipend provision showed a significant negative association with career self-management, while all other associations were non-significant. These findings underscore that the design and delivery of youth employment programs, particularly those integrating soft skills, work experience, and labor market matching, are linked to improved outcomes. In contrast, the standalone use of stipends, extended duration, or technical training shows limited effects over time. Results highlight the importance of integrated program design, particularly the inclusion of soft skills, experiential learning, and labor market linkages, in improving youth employment outcomes in South Africa.
本研究探讨计划设计与青年就业能力结果之间的关系。利用来自南非Siyakha青年资产项目的纵向调查数据,我们分析了来自全国8个不同就业项目的1809名青年样本的反馈。数据在36个月的四个时间点收集,使用访谈者管理的问卷。采用多水平混合效应回归模型对多个输入数据集进行分析,在第一级采用重复观察,在第二级采用方案设计特征。结果表明,程序设计特征和结果之间的关联存在差异。参加适度软技能培训、大量工作经验和结构化工作匹配项目的青年报告了更高的就业能力属性、工作准备和工作面试技巧,并且比那些参加软技能最少、没有工作经验组成部分、非结构化或特别匹配项目的青年更有可能申请工作。项目持续时间和技术技能培训与结果无显著相关。津贴规定与职业自我管理有显著的负相关关系,而所有其他关系则不显著。这些研究结果强调,青年就业项目的设计和实施,特别是那些将软技能、工作经验和劳动力市场匹配相结合的项目,与改善就业结果息息相关。相比之下,单独使用津贴、延长期限或技术培训随着时间的推移效果有限。研究结果强调了综合项目设计在改善南非青年就业成果方面的重要性,特别是将软技能、体验式学习和劳动力市场联系纳入其中。
{"title":"Program design and youth employability outcomes in South Africa: A longitudinal study","authors":"Gina A.N. Chowa ,&nbsp;Rainier Masa ,&nbsp;Graham Zulu ,&nbsp;Miranda Manzanares","doi":"10.1016/j.evalprogplan.2025.102714","DOIUrl":"10.1016/j.evalprogplan.2025.102714","url":null,"abstract":"<div><div>This study examines the association between program design and youth employability outcomes. Using longitudinal survey data from the Siyakha Youth Assets project in South Africa, we analyzed responses from a sample of 1809 youth enrolled in eight different employment programs across the country. Data were collected at four time points over 36 months using interviewer-administered questionnaires. Analyses were conducted on multiply imputed data sets using multilevel mixed-effects regression models, with repeated observations at Level 1 and program design features at Level 2. Results indicate variation in the association between program design features and outcomes. Youth in programs with moderate soft skills training, substantial work experience, and structured job matching reported significantly higher employability attributes, job readiness, and job interviewing skills, and were more likely to apply for jobs than those in programs with minimal soft skills, no work experience component, and unstructured or ad hoc matching. Program duration and technical skills training were not significantly associated with outcomes. The stipend provision showed a significant negative association with career self-management, while all other associations were non-significant. These findings underscore that the design and delivery of youth employment programs, particularly those integrating soft skills, work experience, and labor market matching, are linked to improved outcomes. In contrast, the standalone use of stipends, extended duration, or technical training shows limited effects over time. Results highlight the importance of integrated program design, particularly the inclusion of soft skills, experiential learning, and labor market linkages, in improving youth employment outcomes in South Africa.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102714"},"PeriodicalIF":2.0,"publicationDate":"2025-09-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145158706","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Optimising student loan recovery in Malawi: Bridging policy gaps, socio-economic realities, and administrative challenges 优化马拉维学生贷款回收:弥合政策差距、社会经济现实和行政挑战
IF 2 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2025-09-11 DOI: 10.1016/j.evalprogplan.2025.102674
Reuben Moyo , Jimmy Mbelwa , Evelyn Kachingwe , Juma Lungo
In Malawi, where student loans are crucial for expanding access to higher education, poor loan recovery poses a significant threat to the sustainability of financing and socioeconomic development. The study investigates student loan recovery challenges at Malawi’s Higher Education Student Loans and Grants Board (HESLGB), where rigid salary deductions result in a 32.6% non-repayment rate. A mixed-methods approach, grounded in behavioural economics, analyses survey data from 289 borrowers and interviews with 12 staff. Four themes, including enforcement mechanisms, borrower support systems, repayment schedules, and penalties, highlight barriers linked to a 70% informal workforce and administrative gaps. Unemployment, rigid schedules, and poor tracking impede recovery. We propose income-contingent repayment plans, digital platforms, borrower education, and policy reforms, drawing on regional models to offer scalable solutions for low- and middle-income countries.
在马拉维,学生贷款对扩大接受高等教育的机会至关重要,但贷款回收不良对融资和社会经济发展的可持续性构成重大威胁。该研究调查了马拉维高等教育学生贷款和助学金委员会(HESLGB)的学生贷款回收挑战,其中严格的工资扣除导致32.6%的不还款率。以行为经济学为基础的混合方法分析了289名借款人的调查数据,并采访了12名员工。执法机制、借款人支持系统、还款时间表和处罚等四个主题突出了与70%的非正规劳动力和行政缺口相关的障碍。失业、严格的时间表和糟糕的追踪阻碍了复苏。我们建议基于收入的还款计划、数字平台、借款人教育和政策改革,借鉴地区模式,为中低收入国家提供可扩展的解决方案。
{"title":"Optimising student loan recovery in Malawi: Bridging policy gaps, socio-economic realities, and administrative challenges","authors":"Reuben Moyo ,&nbsp;Jimmy Mbelwa ,&nbsp;Evelyn Kachingwe ,&nbsp;Juma Lungo","doi":"10.1016/j.evalprogplan.2025.102674","DOIUrl":"10.1016/j.evalprogplan.2025.102674","url":null,"abstract":"<div><div>In Malawi, where student loans are crucial for expanding access to higher education, poor loan recovery poses a significant threat to the sustainability of financing and socioeconomic development. The study investigates student loan recovery challenges at Malawi’s Higher Education Student Loans and Grants Board (HESLGB), where rigid salary deductions result in a 32.6% non-repayment rate. A mixed-methods approach, grounded in behavioural economics, analyses survey data from 289 borrowers and interviews with 12 staff. Four themes, including enforcement mechanisms, borrower support systems, repayment schedules, and penalties, highlight barriers linked to a 70% informal workforce and administrative gaps. Unemployment, rigid schedules, and poor tracking impede recovery. We propose income-contingent repayment plans, digital platforms, borrower education, and policy reforms, drawing on regional models to offer scalable solutions for low- and middle-income countries.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102674"},"PeriodicalIF":2.0,"publicationDate":"2025-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145049202","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Scenario-based planning for urban sustainability: Envisioning an ecological city in Shandiz, Iran by 2032 基于场景的城市可持续性规划:设想到2032年伊朗尚迪兹的生态城市。
IF 2 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2025-09-11 DOI: 10.1016/j.evalprogplan.2025.102711
Forouzan Taheri , Mahdi Kolahi
Urban sustainability in developing countries is often hindered by infrastructural limitations and the complexity of environmental uncertainties. This study applies scenario-based planning to explore future pathways for the development of an ecological city in Shandiz, Razavi Khorasan Province, Iran, by 2032. Following a six-step scenario planning framework, the research employed a mixed-methods approach, including expert questionnaires to identify and prioritize key drivers, and semi-structured interviews using saturation theory to construct scenario logics. The analysis yielded three distinct future scenarios: the Ideal City (sustainable and inclusive development), the Command City (state-driven but fragile planning), and the Ruined City (unsustainable and fragmented growth). Strategies were formulated to guide urban stakeholders toward realizing the most desirable future. The study contributes to the field of urban futures by demonstrating how participatory scenario planning can support informed decision-making under uncertainty and promote sustainable urban transitions.
发展中国家的城市可持续性往往受到基础设施限制和环境不确定性复杂性的阻碍。本研究采用基于场景的规划,探索到2032年伊朗拉扎维呼罗珊省尚迪兹生态城市的未来发展路径。根据六步情景规划框架,本研究采用了混合方法,包括专家问卷来识别和优先考虑关键驱动因素,以及利用饱和理论构建情景逻辑的半结构化访谈。分析得出了三种不同的未来情景:理想城市(可持续和包容性发展)、指挥城市(国家驱动但脆弱的规划)和废墟城市(不可持续和碎片化的增长)。制定了指导城市利益相关者实现最理想未来的战略。该研究通过展示参与式情景规划如何支持不确定性下的明智决策并促进可持续的城市转型,为城市未来领域做出了贡献。
{"title":"Scenario-based planning for urban sustainability: Envisioning an ecological city in Shandiz, Iran by 2032","authors":"Forouzan Taheri ,&nbsp;Mahdi Kolahi","doi":"10.1016/j.evalprogplan.2025.102711","DOIUrl":"10.1016/j.evalprogplan.2025.102711","url":null,"abstract":"<div><div>Urban sustainability in developing countries is often hindered by infrastructural limitations and the complexity of environmental uncertainties. This study applies scenario-based planning to explore future pathways for the development of an ecological city in Shandiz, Razavi Khorasan Province, Iran, by 2032. Following a six-step scenario planning framework, the research employed a mixed-methods approach, including expert questionnaires to identify and prioritize key drivers, and semi-structured interviews using saturation theory to construct scenario logics. The analysis yielded three distinct future scenarios: the Ideal City (sustainable and inclusive development), the Command City (state-driven but fragile planning), and the Ruined City (unsustainable and fragmented growth). Strategies were formulated to guide urban stakeholders toward realizing the most desirable future. The study contributes to the field of urban futures by demonstrating how participatory scenario planning can support informed decision-making under uncertainty and promote sustainable urban transitions.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102711"},"PeriodicalIF":2.0,"publicationDate":"2025-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145082108","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Mechanisms for institutionalising evaluation: A scoping review 使评价制度化的机制:范围审查。
IF 2 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2025-09-10 DOI: 10.1016/j.evalprogplan.2025.102710
Carla Cordoncillo Acosta
In recent years, there has been growing attention garnered by the institutionalisation of evaluation, with academia as well as international organisations, governments and practitioners engaging more with the topic. Recent publications, in particular the books edited by Stockmann and Meyer (2020, 2022, 2023) that bring together various experiences occurring in different European, American and Asian countries, have contributed significantly to the conceptual and theoretical development of the field. However, the predominant analytical frameworks used to assess institutionalisation are primarily designed to support international comparisons and to quantify the degree of institutionalisation across countries. As such, they tend to emphasise measurable indicators or enabling conditions, often overlooking the specific mechanisms and institutional arrangements that underpin the development and sustainability of evaluative practices. This article addresses that gap by conducting a scoping review of 29 case studies from 12 countries with different evaluation traditions. Rather than focusing on levels of institutionalisation, the analysis identifies and categorises the institutional arrangements and mechanisms most frequently used to embed evaluation within public administration. In doing so, it offers a structured overview intended to support public sector managers—particularly in contexts with limited evaluation traditions—in reflecting on and designing appropriate strategies to strengthen evaluation systems.
近年来,评估的制度化引起了越来越多的关注,学术界、国际组织、政府和从业者越来越多地参与到这个话题中来。最近的出版物,特别是斯托克曼和迈耶(2020年,2022年,2023年)编辑的书籍,汇集了发生在不同欧洲,美洲和亚洲国家的各种经验,对该领域的概念和理论发展做出了重大贡献。然而,用于评估制度化的主要分析框架主要是为了支持国际比较和量化各国的制度化程度。因此,它们往往强调可衡量的指标或有利的条件,往往忽略了支撑评价做法的发展和可持续性的具体机制和体制安排。本文通过对具有不同评价传统的12个国家的29个案例研究进行范围审查,解决了这一差距。该分析不是侧重于制度化的水平,而是确定和分类最常用于将评价纳入公共行政的体制安排和机制。在此过程中,它提供了一个结构化的概述,旨在支持公共部门管理人员,特别是在评价传统有限的情况下,反思和设计适当的战略,以加强评价制度。
{"title":"Mechanisms for institutionalising evaluation: A scoping review","authors":"Carla Cordoncillo Acosta","doi":"10.1016/j.evalprogplan.2025.102710","DOIUrl":"10.1016/j.evalprogplan.2025.102710","url":null,"abstract":"<div><div>In recent years, there has been growing attention garnered by the institutionalisation of evaluation, with academia as well as international organisations, governments and practitioners engaging more with the topic<em>.</em> Recent publications, in particular the books edited by Stockmann and Meyer (2020, 2022, 2023) that bring together various experiences occurring in different European, American and Asian countries, have contributed significantly to the conceptual and theoretical development of the field. However, the predominant analytical frameworks used to assess institutionalisation are primarily designed to support international comparisons and to quantify the degree of institutionalisation across countries. As such, they tend to emphasise measurable indicators or enabling conditions, often overlooking the specific mechanisms and institutional arrangements that underpin the development and sustainability of evaluative practices. This article addresses that gap by conducting a scoping review of 29 case studies from 12 countries with different evaluation traditions. Rather than focusing on levels of institutionalisation, the analysis identifies and categorises the institutional arrangements and mechanisms most frequently used to embed evaluation within public administration. In doing so, it offers a structured overview intended to support public sector managers—particularly in contexts with limited evaluation traditions—in reflecting on and designing appropriate strategies to strengthen evaluation systems.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102710"},"PeriodicalIF":2.0,"publicationDate":"2025-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145082118","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Implementing statewide literacy and special education training in the U.S.: A mixed-methods evaluation 在美国实施全州扫盲和特殊教育培训:一种混合方法评估
IF 2 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2025-09-09 DOI: 10.1016/j.evalprogplan.2025.102712
Deborah K. Reed, Anna S. Gibbs, Julie K. Owens
To address gaps in the field’s knowledge about implementing educator preparation program (EPP) reforms at scale, this mixed methods study gathered data from one U.S. state’s instructors to understand their perceptions of and experiences complying with new legislation and implementing state-provided training modules for future K-5 literacy and special education teachers and leaders. Across the state’s 40 EPPs, 188 survey responses and 24 focus group participants’ comments were gathered. Instructors generally agreed with the policy goals and appreciated the evidence base of the module content. However, they recommended improving student engagement and providing more implementation guidance and tools. Overall, the data suggested there was a lack of systematic implementation planning that potentially hampered reform efforts. Lessons learned about implementing policies at scale are discussed.
为了解决在大规模实施教育者准备计划(EPP)改革方面的知识差距,这项混合方法研究从美国一个州的教师那里收集了数据,以了解他们对遵守新立法和实施国家为未来的K-5扫盲和特殊教育教师和领导者提供的培训模块的看法和经验。在该州的40个epp中,收集了188份调查回复和24个焦点小组参与者的评论。教师普遍同意政策目标,并赞赏模块内容的证据基础。然而,他们建议提高学生的参与度,并提供更多的实施指导和工具。总体而言,数据表明缺乏系统的实施规划,这可能会阻碍改革努力。讨论了大规模实施政策的经验教训。
{"title":"Implementing statewide literacy and special education training in the U.S.: A mixed-methods evaluation","authors":"Deborah K. Reed,&nbsp;Anna S. Gibbs,&nbsp;Julie K. Owens","doi":"10.1016/j.evalprogplan.2025.102712","DOIUrl":"10.1016/j.evalprogplan.2025.102712","url":null,"abstract":"<div><div>To address gaps in the field’s knowledge about implementing educator preparation program (EPP) reforms at scale, this mixed methods study gathered data from one U.S. state’s instructors to understand their perceptions of and experiences complying with new legislation and implementing state-provided training modules for future K-5 literacy and special education teachers and leaders. Across the state’s 40 EPPs, 188 survey responses and 24 focus group participants’ comments were gathered. Instructors generally agreed with the policy goals and appreciated the evidence base of the module content. However, they recommended improving student engagement and providing more implementation guidance and tools. Overall, the data suggested there was a lack of systematic implementation planning that potentially hampered reform efforts. Lessons learned about implementing policies at scale are discussed.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102712"},"PeriodicalIF":2.0,"publicationDate":"2025-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145049203","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Evaluation and Program Planning
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1