Evaluation and Program Planning最新文献_第7页

Evaluating the impact of the Programa Saúde na Escola on adolescent sexual and reproductive health in Brazil: A quasi-experimental analysis using propensity score matching 评估Saúde na Escola方案对巴西青少年性健康和生殖健康的影响：使用倾向得分匹配的准实验分析

IF 1.5 4区社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY

Evaluation and Program Planning

Pub Date : 2025-07-23 DOI: 10.1016/j.evalprogplan.2025.102661

Jessica Antunes de Oliveira , Marco Tulio Aniceto França

Promoting access to knowledge about sexual and reproductive health in schools is important for adolescents' development, serving as a protective factor against risky sexual behaviors. Therefore, the objective of the study is to evaluate the impact of the Programa Saúde na Escola (PSE) on sexual- and reproductive-health indicators, such as condom use and knowledge on the topic, using data from Pesquisa Nacional de Saúde Escolar (PeNSE) from 2019. The study is designed to provide representative results of students regularly enrolled in public and private schools across the entire national territory, using a probabilistic sample of Brazilian students. After adjustments, the final sample totaled 6.663 observations of students from public schools. In a quasi-experimental approach, a propensity score matching model is used, to compare students attending schools that participate in the program (treatment group) with those attending non-participating schools (control group). The results show that students from schools participating in the PSE report receiving more guidance on preventing pregnancy, sexually transmitted infection, and how to obtain free condoms. Furthermore, students at schools participating in the program start their sexual life slightly earlier. Significant results are found for the total sample and for girls. The variables related to effective condom use are not significant in any specification. These findings suggest that although access to information has increased, no changes in behavior are perceived, which opens space to consider improvements in the implementation of the program, such as strengthening partnerships with basic health units. A sensitivity analysis using the Rosenbaum limits test indicates no bias in the sample.

在学校促进获得性健康和生殖健康知识对青少年的发展非常重要，可以作为防止危险性行为的保护因素。因此，本研究的目的是利用2019年Saúde国家社会保障计划（PeNSE）的数据，评估Saúde社会保障计划（PSE）对性健康和生殖健康指标的影响，如避孕套的使用和有关这一主题的知识。这项研究的目的是利用巴西学生的概率样本，为全国范围内定期就读公立和私立学校的学生提供具有代表性的结果。经过调整后，最终样本共有6.663个公立学校学生的观察值。在准实验方法中，使用倾向得分匹配模型来比较参加该计划的学校（治疗组）和参加未参加该计划的学校（对照组）的学生。结果显示，参与PSE报告的学校的学生在预防怀孕、性传播感染以及如何获得免费避孕套方面得到了更多的指导。此外，参加该计划的学校的学生开始性生活的时间略早。对于总样本和女孩来说，结果都很显著。与有效使用避孕套有关的变量在任何规范中都不重要。这些调查结果表明，虽然获得信息的机会增加了，但人们的行为没有发生变化，这就为考虑改进方案的执行开辟了空间，例如加强与基本保健单位的伙伴关系。使用Rosenbaum极限检验的敏感性分析表明样本中没有偏倚。

{"title":"Evaluating the impact of the Programa Saúde na Escola on adolescent sexual and reproductive health in Brazil: A quasi-experimental analysis using propensity score matching","authors":"Jessica Antunes de Oliveira , Marco Tulio Aniceto França","doi":"10.1016/j.evalprogplan.2025.102661","DOIUrl":"10.1016/j.evalprogplan.2025.102661","url":null,"abstract":"<div><div>Promoting access to knowledge about sexual and reproductive health in schools is important for adolescents' development, serving as a protective factor against risky sexual behaviors. Therefore, the objective of the study is to evaluate the impact of the <em>Programa Saúde na Escola</em> (PSE) on sexual- and reproductive-health indicators, such as condom use and knowledge on the topic, using data from <em>Pesquisa Nacional de Saúde Escolar</em> (PeNSE) from 2019. The study is designed to provide representative results of students regularly enrolled in public and private schools across the entire national territory, using a probabilistic sample of Brazilian students. After adjustments, the final sample totaled 6.663 observations of students from public schools. In a quasi-experimental approach, a propensity score matching model is used, to compare students attending schools that participate in the program (treatment group) with those attending non-participating schools (control group). The results show that students from schools participating in the PSE report receiving more guidance on preventing pregnancy, sexually transmitted infection, and how to obtain free condoms. Furthermore, students at schools participating in the program start their sexual life slightly earlier. Significant results are found for the total sample and for girls. The variables related to effective condom use are not significant in any specification. These findings suggest that although access to information has increased, no changes in behavior are perceived, which opens space to consider improvements in the implementation of the program, such as strengthening partnerships with basic health units. A sensitivity analysis using the Rosenbaum limits test indicates no bias in the sample.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102661"},"PeriodicalIF":1.5,"publicationDate":"2025-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144714182","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

A university and community partnership that built capacity through program evaluation 通过项目评估建立能力的大学和社区伙伴关系

IF 2 4区社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY

Evaluation and Program Planning

Pub Date : 2025-07-23 DOI: 10.1016/j.evalprogplan.2025.102669

Candace Lind , Beth Archer-Kuhn , Natalie Beltrano , Lisa Garrisen , Janet Hettler , Sandra M. Reilly , Leianne Vye-Rogers , Justine Reyes

A community organization-university partnership was formed to complete program evaluation research to enhance the effectiveness of the organization in its efforts to improve the resiliency of families in crisis or in need of respite. Incorporating the voices of staff and former families who had the critical expertise and lived experiences with programs and evaluative tools undergirded this work. Six themes arose from focus groups and interview data that provided recommendations for leadership on the evaluative process and tools used and informed the literature review. The theoretical approach to this research highlighted program inequities and illuminated the need for more culturally safe program evaluation practices that respect diversity and inclusivity and focus on equity-building designs. Although time-consuming, front-line staff became familiar with their own program logic models, understood how they connected to their day-to-day work with children and families, and developed a sense of ownership through hands-on involvement. Importantly, logic model development was demystified. Recognizing the organization needed a less intimidating visual representation of their logic models, a one-page version was developed for each program along with fuller versions. A repository of measures developed for staff will ensure ongoing access to evidence-informed tools for updating the evaluative framework for their programs.

一个社区组织和大学的伙伴关系形成了，以完成项目评估研究，以提高该组织在努力提高危机或需要喘息的家庭的恢复能力方面的效率。将具有关键专业知识和生活经验的工作人员和前家庭的声音与项目和评估工具相结合，巩固了这项工作。从焦点小组和访谈数据中产生了六个主题，这些主题为评估过程和使用的工具的领导提供了建议，并为文献综述提供了信息。本研究的理论方法强调了项目的不平等，并阐明了更多文化上安全的项目评估实践的必要性，这些实践尊重多样性和包容性，并关注公平建设设计。虽然耗时，但一线员工熟悉了他们自己的项目逻辑模型，了解了如何将他们与儿童和家庭的日常工作联系起来，并通过亲身参与培养了一种主人主人感。重要的是，逻辑模型的开发被揭开了神秘面纱。认识到组织需要一个不那么吓人的逻辑模型的可视化表示，为每个程序开发了一个一页的版本以及更完整的版本。为工作人员制定的措施储存库将确保不断获得循证工具，以更新其方案的评价框架。

{"title":"A university and community partnership that built capacity through program evaluation","authors":"Candace Lind , Beth Archer-Kuhn , Natalie Beltrano , Lisa Garrisen , Janet Hettler , Sandra M. Reilly , Leianne Vye-Rogers , Justine Reyes","doi":"10.1016/j.evalprogplan.2025.102669","DOIUrl":"10.1016/j.evalprogplan.2025.102669","url":null,"abstract":"<div><div>A community organization-university partnership was formed to complete program evaluation research to enhance the effectiveness of the organization in its efforts to improve the resiliency of families in crisis or in need of respite. Incorporating the voices of staff and former families who had the critical expertise and lived experiences with programs and evaluative tools undergirded this work. Six themes arose from focus groups and interview data that provided recommendations for leadership on the evaluative process and tools used and informed the literature review. The theoretical approach to this research highlighted program inequities and illuminated the need for more culturally safe program evaluation practices that respect diversity and inclusivity and focus on equity-building designs. Although time-consuming, front-line staff became familiar with their own program logic models, understood how they connected to their day-to-day work with children and families, and developed a sense of ownership through hands-on involvement. Importantly, logic model development was demystified. Recognizing the organization needed a less intimidating visual representation of their logic models, a one-page version was developed for each program along with fuller versions. A repository of measures developed for staff will ensure ongoing access to evidence-informed tools for updating the evaluative framework for their programs.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102669"},"PeriodicalIF":2.0,"publicationDate":"2025-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144738120","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Can programme budget preparation mechanisms improve the allocation of public resources? Examples from ministries in Cameroon 方案预算编制机制能否改善公共资源的分配？喀麦隆各部委的例子

IF 1.5 4区社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY

Evaluation and Program Planning

Pub Date : 2025-07-23 DOI: 10.1016/j.evalprogplan.2025.102668

Onana Simon Pierre, Ousmane Diaby

This article examines the impact of programme budget preparation mechanisms on the allocation of public resources in Cameroon. To achieve this, we first conducted an exploratory study of eight officials involved in preparing the state budget. This exploratory study enabled us to develop the variables that would lead to an analytical model. A survey was carried out with 475 actors in the budget design process in central services of 29 ministries in Cameroon. Findings from simple probit regressions indicate that programme budget preparation mechanisms improve the allocation of budgetary resources in Cameroon. According to estimates, multi-annuality, expenditure reviews, performance measurement indicators and the structuring of appropriations into programmes, actions, activities and tasks have a positive impact on the allocation of budget revenue. However, this positive impact is mitigated by the Parliament's limited role in budgetary authorisation. The study recommends that external budgetary controls should be stepped up.

本文探讨了方案预算编制机制对喀麦隆公共资源分配的影响。为此，我们首先对参与编制国家预算的8名官员进行了探索性研究。这一探索性研究使我们能够开发出能够导致分析模型的变量。对喀麦隆29个部委的中央服务部门预算设计过程中的475名行动者进行了调查。简单概率回归的结果表明，方案预算编制机制改善了喀麦隆预算资源的分配。据估计，多年期、支出审查、执行情况衡量指标和将拨款分成方案、行动、活动和任务对预算收入的分配产生积极影响。然而，由于议会在预算授权方面的作用有限，这种积极影响被削弱了。研究报告建议应加强外部预算控制。

引用次数: 0

Capturing the most significant change after a work-training program for community health workers 在为社区卫生工作者开展工作培训项目后，获得了最显著的变化

IF 2 4区社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY

Evaluation and Program Planning

Pub Date : 2025-07-23 DOI: 10.1016/j.evalprogplan.2025.102667

Sylvia Hoens , Suzannah D’Hooghe , Octavia Kint , Bert Quintiens , Dorien Brosens , Liesbeth De Donder , An-Sofie Smetcoren

This paper examines the changes community health workers experienced after following a nine-month work-training program and the enabling/disabling factors leading to these changes. Using the Most Significant Change technique, stories from community health workers were collected through individual interviews (N = 9), after which other community health works discussed these stories in a focus group (N = 7). Results showed that Most Significant Changes were: increased knowledge, social skills and attitudes, career discovery and facilitated employability, expanded social networks and support systems, and gained social recognition. Mentoring, peer learning and peer support, and experience-based learning were indispensable in realizing those changes. Participants selected stories as significant when they were recognizable, inspirable, or admirable. Finally, our experience suggests that the Most Significant Change technique mostly identifies positive changes, which has the potential to move programs forward. In future evaluation research using the Most Significant Change, we suggest not only a horizontal (with peers) but also vertical story selection process (with coordinators) to have a deeper understanding of different perspectives and their reasoning behind selecting stories.

本文考察了社区卫生工作者在经过9个月的工作培训计划后所经历的变化以及导致这些变化的有利/不利因素。使用最显著变化技术，通过个人访谈收集社区卫生工作者的故事（N = 9），之后其他社区卫生工作人员在焦点小组中讨论这些故事（N = 7）。结果显示，最显著的变化是：知识、社会技能和态度的增加，职业发现和就业能力的促进，社会网络和支持系统的扩大，以及获得社会认可。在实现这些变化的过程中，指导、同伴学习和同伴支持以及基于经验的学习是不可或缺的。参与者选择的故事是可识别的、鼓舞人心的或令人钦佩的。最后，我们的经验表明，Most Significant Change技术主要识别积极的变化，这些变化具有推动项目向前发展的潜力。在未来使用“最显著变化”的评估研究中，我们建议不仅要进行横向（与同伴），还要进行纵向（与协调员）的故事选择过程，以更深入地了解不同的视角及其选择故事背后的原因。

{"title":"Capturing the most significant change after a work-training program for community health workers","authors":"Sylvia Hoens , Suzannah D’Hooghe , Octavia Kint , Bert Quintiens , Dorien Brosens , Liesbeth De Donder , An-Sofie Smetcoren","doi":"10.1016/j.evalprogplan.2025.102667","DOIUrl":"10.1016/j.evalprogplan.2025.102667","url":null,"abstract":"<div><div>This paper examines the changes community health workers experienced after following a nine-month work-training program and the enabling/disabling factors leading to these changes. Using the Most Significant Change technique, stories from community health workers were collected through individual interviews (N = 9), after which other community health works discussed these stories in a focus group (N = 7). Results showed that Most Significant Changes were: increased knowledge, social skills and attitudes, career discovery and facilitated employability, expanded social networks and support systems, and gained social recognition. Mentoring, peer learning and peer support, and experience-based learning were indispensable in realizing those changes. Participants selected stories as significant when they were recognizable, inspirable, or admirable. Finally, our experience suggests that the Most Significant Change technique mostly identifies positive changes, which has the potential to move programs forward. In future evaluation research using the Most Significant Change, we suggest not only a horizontal (with peers) but also vertical story selection process (with coordinators) to have a deeper understanding of different perspectives and their reasoning behind selecting stories.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102667"},"PeriodicalIF":2.0,"publicationDate":"2025-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144721940","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Participatory evaluation of a transdisciplinary behavioral health research center 一个跨学科行为健康研究中心的参与式评价

IF 2 4区社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY

Evaluation and Program Planning

Pub Date : 2025-07-23 DOI: 10.1016/j.evalprogplan.2025.102664

Melissa Gonzales , Steven P. Verney , Jeremiah D. Simmons , Lisa Cacari Stone , Maia Scarpetta , Ryan Martin , Nina Wallerstein

Health disparities interventions require the integration of culturally-aligned theories, concepts and methods from across multiple disciplines and socio-ecologic domains to create new models for addressing health inequities faced by vulnerable populations. The Transdisciplinary Research, Equity and Engagement Center (TREE) at the University of New Mexico expands community-based participatory research and translational team science principles to improve behavioral health equity among American Indian, Hispanic, rural, and other intersectional community partners. Consonant with this participatory emphasis, this case study summarizes the development and refinement of the Center‘s evaluation of its shared conceptual framework, based on understanding historic colonization as well as cultural resiliencies, for addressing behavioral health. We elaborate on the co-development of a participatory evaluation process, with transformational goals, including iterative dialogues with leadership, visioning retreats, adaptations to our logic model and refinement of survey instruments. Preliminary results are presented of our internal Center-wide evaluation survey on progress towards aims and new sub-aims as well as highlights of lessons learned on processes, innovative metrics, and equity implications for the Center and transdisciplinary research centers nationwide.

健康差异干预措施需要整合来自多个学科和社会生态领域的与文化一致的理论、概念和方法，以创建解决弱势群体面临的健康不平等问题的新模式。新墨西哥大学的跨学科研究、公平和参与中心（TREE）扩展了基于社区的参与性研究和转化团队科学原则，以改善美国印第安人、西班牙裔、农村和其他交叉社区合作伙伴的行为健康公平。与这一参与性重点相一致，本案例研究总结了该中心在理解历史殖民和文化弹性的基础上对其共同概念框架的评估的发展和完善，以解决行为健康问题。我们详细阐述了参与性评估过程的共同发展，具有转型目标，包括与领导层的反复对话，远见的务虚会，对我们的逻辑模型的适应以及调查工具的改进。初步结果展示了我们的内部中心范围内的评估调查的进展目标和新的子目标，以及重点教训的过程，创新指标，和公平的影响中心和全国跨学科研究中心。

{"title":"Participatory evaluation of a transdisciplinary behavioral health research center","authors":"Melissa Gonzales , Steven P. Verney , Jeremiah D. Simmons , Lisa Cacari Stone , Maia Scarpetta , Ryan Martin , Nina Wallerstein","doi":"10.1016/j.evalprogplan.2025.102664","DOIUrl":"10.1016/j.evalprogplan.2025.102664","url":null,"abstract":"<div><div>Health disparities interventions require the integration of culturally-aligned theories, concepts and methods from across multiple disciplines and socio-ecologic domains to create new models for addressing health inequities faced by vulnerable populations. The Transdisciplinary Research, Equity and Engagement Center (TREE) at the University of New Mexico expands community-based participatory research and translational team science principles to improve behavioral health equity among American Indian, Hispanic, rural, and other intersectional community partners. Consonant with this participatory emphasis, this case study summarizes the development and refinement of the Center‘s evaluation of its shared conceptual framework, based on understanding historic colonization as well as cultural resiliencies, for addressing behavioral health. We elaborate on the co-development of a participatory evaluation process, with transformational goals, including iterative dialogues with leadership, visioning retreats, adaptations to our logic model and refinement of survey instruments. Preliminary results are presented of our internal Center-wide evaluation survey on progress towards aims and new sub-aims as well as highlights of lessons learned on processes, innovative metrics, and equity implications for the Center and transdisciplinary research centers nationwide.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"113 ","pages":"Article 102664"},"PeriodicalIF":2.0,"publicationDate":"2025-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144827905","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Relationship between geographical factors and digital skills development among school administrators: A case study of Pathum Thani Province, Thailand 地理因素与学校管理者数字技能发展的关系：以泰国巴吞他尼省为例

IF 1.5 4区社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY

Evaluation and Program Planning

Pub Date : 2025-07-23 DOI: 10.1016/j.evalprogplan.2025.102663

Pimolpun Phetsombat , Nawhath Thanwiset Thanvisitthpon

This study investigates how geographical factors influence the digital skills of educational administrators in Thailand’s Pathum Thani province. A digital skills assessment framework, comprising three components: competency, knowledge, and experience, was developed and validated using confirmatory factor analysis. Data from 346 educational staff and 219 school teachers across seven districts were analyzed. The findings revealed significant district-level variation in digital skills, influenced by factors such as student population, student density, and budget support. The assessment framework demonstrated strong reliability and validity, with all model fit indices meeting accepted thresholds. This research contributes by providing a validated tool to assess digital proficiency in educational leadership and by identifying key geographical factors that shape digital skills development. It underscores the need for targeted digital training programs and equitable resource allocation to enhance digital proficiency among school administrators. These insights can inform national policies and guide the design of district-level digital literacy initiatives.

本研究探讨地理因素如何影响泰国巴吞他尼省教育行政人员的数位技能。数字技能评估框架由三个组成部分组成：能力、知识和经验，并使用验证性因素分析进行验证。来自7个地区的346名教育人员和219名学校教师的数据进行了分析。调查结果显示，受学生人数、学生密度和预算支持等因素的影响，各地区在数字技能方面存在显著差异。评估框架具有较强的信度和效度，所有模型拟合指标均满足可接受的阈值。这项研究提供了一个有效的工具来评估教育领导力中的数字能力，并确定了影响数字技能发展的关键地理因素。它强调需要有针对性的数字培训计划和公平的资源分配，以提高学校管理人员的数字熟练程度。这些见解可以为国家政策提供信息，并指导地区一级数字扫盲倡议的设计。

{"title":"Relationship between geographical factors and digital skills development among school administrators: A case study of Pathum Thani Province, Thailand","authors":"Pimolpun Phetsombat , Nawhath Thanwiset Thanvisitthpon","doi":"10.1016/j.evalprogplan.2025.102663","DOIUrl":"10.1016/j.evalprogplan.2025.102663","url":null,"abstract":"<div><div>This study investigates how geographical factors influence the digital skills of educational administrators in Thailand’s Pathum Thani province. A digital skills assessment framework, comprising three components: competency, knowledge, and experience, was developed and validated using confirmatory factor analysis. Data from 346 educational staff and 219 school teachers across seven districts were analyzed. The findings revealed significant district-level variation in digital skills, influenced by factors such as student population, student density, and budget support. The assessment framework demonstrated strong reliability and validity, with all model fit indices meeting accepted thresholds. This research contributes by providing a validated tool to assess digital proficiency in educational leadership and by identifying key geographical factors that shape digital skills development. It underscores the need for targeted digital training programs and equitable resource allocation to enhance digital proficiency among school administrators. These insights can inform national policies and guide the design of district-level digital literacy initiatives.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102663"},"PeriodicalIF":1.5,"publicationDate":"2025-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144702615","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

A quasi-experimental approach to evaluating magnet schools 一种准实验方法来评估名校

IF 1.5 4区社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY

Evaluation and Program Planning

Pub Date : 2025-07-23 DOI: 10.1016/j.evalprogplan.2025.102666

Jia Wang , Rolf Straubhaar , Seth Leon , David Kikoler , Elaine Rosales

The purpose of this article is to document an innovative and effective quasi-experimental, mixed methods approach developed for evaluating the effectiveness of magnet schools throughout the United States. Magnet schools continue to be one of the most common school choice mechanisms in the United States, and as a research team the authors have been evaluating the effectiveness of magnet schools in improving student achievement since 2010. In this paper, the authors share the evaluation research design that they have used through this work, with the intent of sharing best practices in effective magnet school evaluation with other scholars and practitioners engaged in work in similar school settings. Specifically, the authors here explain the benefits of various elements of their evaluation design: their selection of comparison schools, of comparison students within those schools, and their means of measuring magnet program implementation to evaluate the degree to which implementation affected student outcomes.

本文的目的是记录一种创新的、有效的准实验的、混合的方法，这种方法是为评估全美磁石学校的有效性而开发的。磁铁学校仍然是美国最常见的择校机制之一，作为一个研究团队，作者自2010年以来一直在评估磁铁学校在提高学生成绩方面的有效性。在本文中，作者分享了他们在这项工作中使用的评估研究设计，目的是与从事类似学校环境工作的其他学者和实践者分享有效磁铁学校评估的最佳实践。具体来说，作者在这里解释了他们的评估设计的各种元素的好处：他们选择比较学校，比较这些学校中的学生，以及他们衡量磁铁计划实施的方法，以评估实施对学生成绩的影响程度。

引用次数: 0

Evaluating the English for General Purposes (EGP) program at a Taiwanese University: A CIPP (context, input, process, and product) model study 评估台湾大学通用英语（EGP）课程：CIPP（情境、输入、过程和产品）模型研究

IF 2 4区社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY

Evaluation and Program Planning

Pub Date : 2025-07-22 DOI: 10.1016/j.evalprogplan.2025.102662

Shu-Hsiu Huang

English has been the only compulsory foreign language taught in colleges in Taiwan since 2005. It was referred to as 'English for General Purposes (EGP)' and was taught not only for students' further major-related studies, but also for future job competitiveness. With the implementation of 'The Program on Bilingual Education for Students in College (BEST)' in the second half of 2021, the importance of English has been further strengthened, which has intensified the missions carried by EGP. Consequently, the subject needed to be examined for potential ingrained problems and ways to improve it. The present study collected and analyzed the perspectives of 470 non-English major students at a university in Taiwan on the EGP curriculum, using four factors (context, input, process, and product, or CIPP) as well as gender, grade level, and language proficiency as variables. The results showed that students generally reacted positively to the current EGP curriculum, especially with respect to the process factor. Gender had a significant effect on perceptions, but there were no differences in perceptions based on students' English proficiency levels and grade levels. It is suggested that EGP curriculum designers should consider these differences in their future development of EGP courses.

自2005年以来，英语已成为台湾大学唯一的必修外语。它被称为“通用英语（EGP）”，不仅是为了学生进一步的专业相关学习，也是为了将来的工作竞争力。2021年下半年，随着“大学生双语教育计划”的实施，英语教育的重要性得到进一步加强，使学校肩负的使命更加明确。因此，需要审查这一主题，以找出潜在的根深蒂固的问题和改进它的方法。本研究以情境、输入、过程、产品（CIPP）、性别、年级、语言能力为变量，收集并分析台湾某大学470名非英语专业学生对英语基础课程的看法。结果显示，学生普遍对当前的EGP课程反应积极，特别是在过程因素方面。性别对认知有显著影响，但基于学生英语水平和年级水平的认知没有差异。建议课程设计者在未来的课程开发中考虑到这些差异。

{"title":"Evaluating the English for General Purposes (EGP) program at a Taiwanese University: A CIPP (context, input, process, and product) model study","authors":"Shu-Hsiu Huang","doi":"10.1016/j.evalprogplan.2025.102662","DOIUrl":"10.1016/j.evalprogplan.2025.102662","url":null,"abstract":"<div><div>English has been the only compulsory foreign language taught in colleges in Taiwan since 2005. It was referred to as 'English for General Purposes (EGP)' and was taught not only for students' further major-related studies, but also for future job competitiveness. With the implementation of 'The Program on Bilingual Education for Students in College (BEST)' in the second half of 2021, the importance of English has been further strengthened, which has intensified the missions carried by EGP. Consequently, the subject needed to be examined for potential ingrained problems and ways to improve it. The present study collected and analyzed the perspectives of 470 non-English major students at a university in Taiwan on the EGP curriculum, using four factors (context, input, process, and product, or CIPP) as well as gender, grade level, and language proficiency as variables. The results showed that students generally reacted positively to the current EGP curriculum, especially with respect to the process factor. Gender had a significant effect on perceptions, but there were no differences in perceptions based on students' English proficiency levels and grade levels. It is suggested that EGP curriculum designers should consider these differences in their future development of EGP courses.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102662"},"PeriodicalIF":2.0,"publicationDate":"2025-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144748594","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Evaluation of an online study group on trauma and dissociation for psychotherapists in India 对印度心理治疗师创伤和分离在线研究小组的评估

IF 1.5 4区社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY

Evaluation and Program Planning

Pub Date : 2025-07-20 DOI: 10.1016/j.evalprogplan.2025.102659

Adithy Adithy , Emma Emily de Wit , Gayitri Bhatt , J.G.F. Bunders-Aelen

Background

Mental health professionals (MHP¹s) in India are generally not adequately educated in the treatment of trauma. Educational programs can help to disseminate knowledge and skills about effective treatment for trauma, to ensure mental health care for clients. This study aimed to evaluate the usefulness of an educational program on trauma and dissociation (T&D²) for psychotherapists in India.

Methods

An online study group for psychotherapists was led by a psychotherapist, experienced in trauma. The program included didactic presentations, discussions and case presentations, with topics including definitions and types of T&D, assessments, best practices, models and therapeutic methods. Three questionnaires, 14 semi-structured interviews, and a follow-up FGD, were used to evaluate the program.

Findings

The online study group was found to be beneficial for psychotherapists to learn about T&D. Evaluation using participants’ reports revealed that they learned to understand clients’ symptoms and conceptualize treatment with a lens of T&D, and they became more confident in working with clients. These reports also indicated that the clients were benefiting.

Conclusions

An online study group for psychotherapists, which also formed a supportive learning community, was effective for learning about T&D for participants from varied backgrounds. Such programs could bridge the knowledge gap about treatment for T&D among MHPs, especially in low- and middle-income countries (LMICs).

背景：印度的精神卫生专业人员（mhp1）在创伤治疗方面通常没有得到充分的教育。教育项目可以帮助传播有关创伤有效治疗的知识和技能，以确保客户获得心理健康护理。本研究旨在评估印度心理治疗师创伤与分离（T&D2）教育计划的有效性。方法心理治疗师在线学习小组由有创伤经验的心理治疗师领导。该计划包括教学报告、讨论和案例报告，主题包括T&；D的定义和类型、评估、最佳实践、模型和治疗方法。三份问卷，14个半结构化访谈，以及后续的FGD，被用来评估该计划。研究发现，在线学习小组对心理治疗师了解T&；D有益。根据参与者的报告进行的评估显示，他们学会了理解客户的症状，并从T&；D的角度概念化治疗，他们在与客户合作时变得更有信心。这些报告还表明客户从中受益。结论心理治疗师的在线学习小组也形成了一个支持性的学习社区，对不同背景的参与者学习T&；D是有效的。这样的项目可以弥补MHPs之间关于结核病治疗的知识差距，特别是在低收入和中等收入国家。

{"title":"Evaluation of an online study group on trauma and dissociation for psychotherapists in India","authors":"Adithy Adithy , Emma Emily de Wit , Gayitri Bhatt , J.G.F. Bunders-Aelen","doi":"10.1016/j.evalprogplan.2025.102659","DOIUrl":"10.1016/j.evalprogplan.2025.102659","url":null,"abstract":"<div><h3>Background</h3><div>Mental health professionals (MHP<span><span><sup>1</sup></span></span>s) in India are generally not adequately educated in the treatment of trauma. Educational programs can help to disseminate knowledge and skills about effective treatment for trauma, to ensure mental health care for clients. This study aimed to evaluate the usefulness of an educational program on trauma and dissociation (T&D<span><span><sup>2</sup></span></span>) for psychotherapists in India.</div></div><div><h3>Methods</h3><div>An online study group for psychotherapists was led by a psychotherapist, experienced in trauma. The program included didactic presentations, discussions and case presentations, with topics including definitions and types of T&D, assessments, best practices, models and therapeutic methods. Three questionnaires, 14 semi-structured interviews, and a follow-up FGD, were used to evaluate the program.</div></div><div><h3>Findings</h3><div>The online study group was found to be beneficial for psychotherapists to learn about T&D. Evaluation using participants’ reports revealed that they learned to understand clients’ symptoms and conceptualize treatment with a lens of T&D, and they became more confident in working with clients. These reports also indicated that the clients were benefiting.</div></div><div><h3>Conclusions</h3><div>An online study group for psychotherapists, which also formed a supportive learning community, was effective for learning about T&D for participants from varied backgrounds. Such programs could bridge the knowledge gap about treatment for T&D among MHPs, especially in low- and middle-income countries (LMICs).</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102659"},"PeriodicalIF":1.5,"publicationDate":"2025-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144714183","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Framing and implementing evidence-based research in research groups and institutions to put knowledge to action 在研究小组和机构中制定和实施基于证据的研究，以将知识转化为行动

IF 1.5 4区社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY

Evaluation and Program Planning

Pub Date : 2025-07-19 DOI: 10.1016/j.evalprogplan.2025.102660

Birgitte Nørgaard , Carolina S. Romero , Malgorzata Bala , Hans Lund , Jane Andreasen

Objective

This study aimed to identify a comprehensive and applicable implementation framework that describes how evidence-based research (EBR) can come systematically into action.

Study design and setting

This is a non-empirical study in which the process leading to the criteria-based choice of framework is depicted. The implementation of EBR using the framework is systematically described, and potential implementation challenges are addressed.

Results

Based on five explicit criteria, the Theory, Model, and Framework Comparison and Selection Tool (T-CaST), the Knowledge to Action Framework was superior to alternative models. EBR was applied to the framework and discussed regarding the two overarching components, knowledge creation and the action cycle, as well as their single phases.

Conclusion

Recommendations for implementing EBR should integrate both scientific rigour and social engagement. The process should be carried out by a multidisciplinary team that involves as many relevant stakeholders as possible. It is considered a core issue that one size does not fit all; attention should be given to the culture of the research group or organisation, which might be obstructive to the aim of a specific implementation process.

本研究旨在确定一个全面和适用的实施框架，描述如何以证据为基础的研究（EBR）可以系统地付诸行动。研究设计和设置这是一项非实证研究，其中描述了导致基于标准的框架选择的过程。系统地描述了使用该框架的EBR的实现，并解决了潜在的实现挑战。结果基于理论、模型和框架比较和选择工具（T-CaST）这五个明确的标准，知识到行动框架优于其他模型。将EBR应用于该框架，并讨论了知识创造和行动周期这两个主要组成部分及其单个阶段。结论实施EBR的建议应结合科学严谨性和社会参与度。该过程应由一个多学科团队执行，该团队应涉及尽可能多的相关利益相关者。它被认为是一个核心问题，一个尺寸不适合所有；应注意研究小组或组织的文化，这可能会阻碍具体实施过程的目标。

{"title":"Framing and implementing evidence-based research in research groups and institutions to put knowledge to action","authors":"Birgitte Nørgaard , Carolina S. Romero , Malgorzata Bala , Hans Lund , Jane Andreasen","doi":"10.1016/j.evalprogplan.2025.102660","DOIUrl":"10.1016/j.evalprogplan.2025.102660","url":null,"abstract":"<div><h3>Objective</h3><div>This study aimed to identify a comprehensive and applicable implementation framework that describes how evidence-based research (EBR) can come systematically into action.</div></div><div><h3>Study design and setting</h3><div>This is a non-empirical study in which the process leading to the criteria-based choice of framework is depicted. The implementation of EBR using the framework is systematically described, and potential implementation challenges are addressed.</div></div><div><h3>Results</h3><div>Based on five explicit criteria, the Theory, Model, and Framework Comparison and Selection Tool (T-CaST), the Knowledge to Action Framework was superior to alternative models. EBR was applied to the framework and discussed regarding the two overarching components, knowledge creation and the action cycle, as well as their single phases.</div></div><div><h3>Conclusion</h3><div>Recommendations for implementing EBR should integrate both scientific rigour and social engagement. The process should be carried out by a multidisciplinary team that involves as many relevant stakeholders as possible. It is considered a core issue that one size does not fit all; attention should be given to the culture of the research group or organisation, which might be obstructive to the aim of a specific implementation process.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102660"},"PeriodicalIF":1.5,"publicationDate":"2025-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144702616","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0