首页 > 最新文献

Evaluation and Program Planning最新文献

英文 中文
Conquering acceptability: A study of stakeholder inclusion practices in evaluation processes in francophone West African Countries
IF 1.5 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2025-01-15 DOI: 10.1016/j.evalprogplan.2025.102534
Bidossessi M.G. Dossou Kpanou , Jori N. Hall , Kathleen D. Kelsey
Evaluation practices in the French-speaking countries of the West African Economic and Monetary Union (WAEMU) are poorly understood and infrequently documented. Our study is a descriptive analysis that elucidates how stakeholders are conceptualized and involved in evaluation processes in WAEMU. In these countries, evaluators are concerned about the weak stakeholder involvement in evaluation activity and call for greater stakeholder engagement, juxtaposed to the challenges of doing so. This embedded mixed methods design allowed us to examine stakeholders’ involvement in evaluation processes in the French-speaking WAEMU countries. The results revealed that stakeholders were conceptualized either through structured categorization using established categories in the evaluation literature or through contextual categorization, depending on their relevance to the evaluation process and the information they can provide. Regardless of these categorizations, the primary rationale for stakeholder engagement processes was to achieve acceptable or credible results and to engage the most influential stakeholders. These findings contribute to the evaluation literature by offering a deeper understanding of stakeholder involvement in the WAEMU context.
{"title":"Conquering acceptability: A study of stakeholder inclusion practices in evaluation processes in francophone West African Countries","authors":"Bidossessi M.G. Dossou Kpanou ,&nbsp;Jori N. Hall ,&nbsp;Kathleen D. Kelsey","doi":"10.1016/j.evalprogplan.2025.102534","DOIUrl":"10.1016/j.evalprogplan.2025.102534","url":null,"abstract":"<div><div>Evaluation practices in the French-speaking countries of the West African Economic and Monetary Union (WAEMU) are poorly understood and infrequently documented. Our study is a descriptive analysis that elucidates how stakeholders are conceptualized and involved in evaluation processes in WAEMU. In these countries, evaluators are concerned about the weak stakeholder involvement in evaluation activity and call for greater stakeholder engagement, juxtaposed to the challenges of doing so. This embedded mixed methods design allowed us to examine stakeholders’ involvement in evaluation processes in the French-speaking WAEMU countries. The results revealed that stakeholders were conceptualized either through structured categorization using established categories in the evaluation literature or through contextual categorization, depending on their relevance to the evaluation process and the information they can provide. Regardless of these categorizations, the primary rationale for stakeholder engagement processes was to achieve acceptable or credible results and to engage the most influential stakeholders. These findings contribute to the evaluation literature by offering a deeper understanding of stakeholder involvement in the WAEMU context.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"110 ","pages":"Article 102534"},"PeriodicalIF":1.5,"publicationDate":"2025-01-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143029909","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Inter-institutional cooperation and migrants' financial education: An Italian case study
IF 1.5 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2025-01-14 DOI: 10.1016/j.evalprogplan.2025.102537
Samuel Nocito , Alessandra Venturini
This study examines the Welcome-ED project—a partnership between the Municipality of Turin and the Turin Museum of Savings (MoS)—designed to provide tailored financial education to diverse migrant groups through cooperation with local entities, including cooperatives, non-profit associations, and provincial centers for adult education. By analyzing the project’s implementation, we identify its strengths and critical areas for improvement, offering actionable recommendations to guide the design of future financial education programs for migrants at the local level. The program’s use of multimodal, interactive teaching methods is a valuable aspect of this initiative, as it contributed to increasing participant engagement and delivering accessible content. Our analysis demonstrates that evaluation criteria should account for varying levels of topic difficulty, supported by insights from Item Response Theory (IRT). Migrants involved through cooperatives and non-profits exhibited the greatest knowledge gains, emphasizing the importance of context-specific approaches tailored to participants’ diverse needs—a goal achievable through effective inter-institutional cooperation and co-creation.
{"title":"Inter-institutional cooperation and migrants' financial education: An Italian case study","authors":"Samuel Nocito ,&nbsp;Alessandra Venturini","doi":"10.1016/j.evalprogplan.2025.102537","DOIUrl":"10.1016/j.evalprogplan.2025.102537","url":null,"abstract":"<div><div>This study examines the Welcome-ED project—a partnership between the Municipality of Turin and the Turin Museum of Savings (MoS)—designed to provide tailored financial education to diverse migrant groups through cooperation with local entities, including cooperatives, non-profit associations, and provincial centers for adult education. By analyzing the project’s implementation, we identify its strengths and critical areas for improvement, offering actionable recommendations to guide the design of future financial education programs for migrants at the local level. The program’s use of multimodal, interactive teaching methods is a valuable aspect of this initiative, as it contributed to increasing participant engagement and delivering accessible content. Our analysis demonstrates that evaluation criteria should account for varying levels of topic difficulty, supported by insights from Item Response Theory (IRT). Migrants involved through cooperatives and non-profits exhibited the greatest knowledge gains, emphasizing the importance of context-specific approaches tailored to participants’ diverse needs—a goal achievable through effective inter-institutional cooperation and co-creation.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"110 ","pages":"Article 102537"},"PeriodicalIF":1.5,"publicationDate":"2025-01-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143042293","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A study of preservice teachers’ digital competence development: Exploring the role of direct instruction, integrated practice, and modeling 职前教师数字化能力发展研究:探讨直接教学、综合实践和建模的作用。
IF 1.5 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2025-01-12 DOI: 10.1016/j.evalprogplan.2025.102538
Levon Momdjian , Marni Manegre , Mar Gutiérrez-Colón
As technology rapidly transforms educational landscapes, the imperative for teachers to possess digital competence becomes increasingly vital. This paper explores the effectiveness of different approaches employed by teacher education programs in equipping preservice teachers with digital competence. The study categorizes these approaches into three main groups: direct, integrated, and modeling. Through an analysis based on the DigCompEdu framework, the study aims to explore the relationship between teacher training approaches and the development of preservice teachers' digital competences. A mixed-methods approach, including surveys and document analyses, was utilized, involving 399 preservice teachers and 84 teacher educators from various Lebanese teacher training programs. The results indicate that teacher educators’ modeling plays a pivotal role in influencing preservice teachers' overall digital competence, surpassing the impact of both direct and integrated approaches. Recommendations include prioritizing digital professional development for teacher educators, revising curricula, addressing course design effectiveness, and enhancing both direct and integrated approaches. These insights aim to inform the design and improvement of teacher training programs to meet the evolving demands of digital education.
随着技术迅速改变教育格局,教师拥有数字能力的必要性变得越来越重要。本文探讨了教师教育项目在为职前教师配备数字能力方面采用的不同方法的有效性。该研究将这些方法分为三大类:直接、集成和建模。通过基于DigCompEdu框架的分析,本研究旨在探讨教师培训方式与职前教师数字能力发展之间的关系。采用了包括调查和文件分析在内的混合方法,涉及来自黎巴嫩各种教师培训方案的399名职前教师和84名教师教育工作者。结果表明,教师教育建模在影响职前教师整体数字能力方面发挥了关键作用,超过了直接方法和综合方法的影响。建议包括优先考虑教师教育工作者的数字专业发展,修订课程,解决课程设计的有效性,以及加强直接和综合方法。这些见解旨在为教师培训计划的设计和改进提供信息,以满足数字教育不断变化的需求。
{"title":"A study of preservice teachers’ digital competence development: Exploring the role of direct instruction, integrated practice, and modeling","authors":"Levon Momdjian ,&nbsp;Marni Manegre ,&nbsp;Mar Gutiérrez-Colón","doi":"10.1016/j.evalprogplan.2025.102538","DOIUrl":"10.1016/j.evalprogplan.2025.102538","url":null,"abstract":"<div><div>As technology rapidly transforms educational landscapes, the imperative for teachers to possess digital competence becomes increasingly vital. This paper explores the effectiveness of different approaches employed by teacher education programs in equipping preservice teachers with digital competence. The study categorizes these approaches into three main groups: direct, integrated, and modeling. Through an analysis based on the DigCompEdu framework, the study aims to explore the relationship between teacher training approaches and the development of preservice teachers' digital competences. A mixed-methods approach, including surveys and document analyses, was utilized, involving 399 preservice teachers and 84 teacher educators from various Lebanese teacher training programs. The results indicate that teacher educators’ modeling plays a pivotal role in influencing preservice teachers' overall digital competence, surpassing the impact of both direct and integrated approaches. Recommendations include prioritizing digital professional development for teacher educators, revising curricula, addressing course design effectiveness, and enhancing both direct and integrated approaches. These insights aim to inform the design and improvement of teacher training programs to meet the evolving demands of digital education.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"109 ","pages":"Article 102538"},"PeriodicalIF":1.5,"publicationDate":"2025-01-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143014088","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Characteristics of mandates for evidence-based behavioral health interventions in 8 selected US states 美国8个选定州的基于证据的行为卫生干预任务的特点。
IF 1.5 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2025-01-10 DOI: 10.1016/j.evalprogplan.2025.102536
Archer Lee-Easton, Michael Maranda, Stephen Magura

Purpose

Demand for the use of evidence-based interventions (EBI) to address behavioral health issues remains high in the United States. States are primarily tasked with determining what constitutes EBIs on a state-by-state basis. This results in variations in what constitutes an EBI across states. The study’s purpose is to determine the different ways in which state mandates for EBIs operationalize the concept of EBI, including the different levels of evidence that are required. The EBI mandates of 8 states were purposively selected for this study based on their Pew Charitable Trusts rating of EBI implementation.

Results

64 % of EBI operationalizations included a quality of evidence requirement and 74 % included an impact reporting requirement. 52 % included both types of requirements, 35 % featured one type of requirement or the other, and 14 % included neither type of requirement. There was variation in the content of those requirements depending on the implied tier of evidence and the state’s PMC rating category.

Conclusions

States need consistent operationalizations of what constitutes an EBI if they are to support the implementation of effective programming for behavioral health care. Additionally, states should produce more rigorous research-based operationalizations of what constitutes an EBI.
目的:在美国,使用基于证据的干预措施(EBI)来解决行为健康问题的需求仍然很高。各州的主要任务是在各州的基础上确定什么构成环境污染指数。这导致各州之间构成EBI的内容存在差异。本研究的目的是确定各州对EBI的授权如何运用EBI概念的不同方式,包括所需证据的不同水平。根据皮尤慈善信托对EBI实施的评级,有目的地选择了8个州的EBI授权进行本研究。结果:64% %的EBI实施包括证据质量要求,74% %包括影响报告要求。52% %包括两种需求,35% %包括一种或另一种需求,14% %不包括任何一种需求。这些要求的内容根据隐含的证据层次和州的PMC评级类别而有所不同。结论:各国如果要支持实施有效的行为保健方案拟订工作,就需要始终如一地实施构成EBI的内容。此外,各州应该对构成EBI的内容进行更严格的基于研究的操作。
{"title":"Characteristics of mandates for evidence-based behavioral health interventions in 8 selected US states","authors":"Archer Lee-Easton,&nbsp;Michael Maranda,&nbsp;Stephen Magura","doi":"10.1016/j.evalprogplan.2025.102536","DOIUrl":"10.1016/j.evalprogplan.2025.102536","url":null,"abstract":"<div><h3>Purpose</h3><div>Demand for the use of evidence-based interventions (EBI) to address behavioral health issues remains high in the United States. States are primarily tasked with determining what constitutes EBIs on a state-by-state basis. This results in variations in what constitutes an EBI across states. The study’s purpose is to determine the different ways in which state mandates for EBIs operationalize the concept of EBI, including the different levels of evidence that are required. The EBI mandates of 8 states were purposively selected for this study based on their Pew Charitable Trusts rating of EBI implementation.</div></div><div><h3>Results</h3><div>64 % of EBI operationalizations included a quality of evidence requirement and 74 % included an impact reporting requirement. 52 % included both types of requirements, 35 % featured one type of requirement or the other, and 14 % included neither type of requirement. There was variation in the content of those requirements depending on the implied tier of evidence and the state’s PMC rating category.</div></div><div><h3>Conclusions</h3><div>States need consistent operationalizations of what constitutes an EBI if they are to support the implementation of effective programming for behavioral health care. Additionally, states should produce more rigorous research-based operationalizations of what constitutes an EBI.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"109 ","pages":"Article 102536"},"PeriodicalIF":1.5,"publicationDate":"2025-01-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143014089","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using concept mapping methods to evaluate overdose data to action program efforts in Allegheny County, Pennsylvania 在宾夕法尼亚州阿勒格尼县,使用概念图方法评估药物过量数据,以实施行动计划。
IF 1.5 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2024-12-14 DOI: 10.1016/j.evalprogplan.2024.102532
Stephanie L. Creasy, Erin Seger, Molly Eggleston, Mary Hawk, James E. Egan

Background

The Pitt Public Health evaluation team used a mixed-methods, community-based participatory research method of concept mapping to evaluate factors affecting the Overdose Data to Action (OD2A) opioid overdose surveillance and prevention project outcomes for Allegheny County, Pennsylvania.

Methods

In June 2021 we developed the focal prompt: “What factors work to help or limit OD2A program outcomes at the individual, community, and or/system level?”Community partners participated in three phases: Brainstorming, Sorting and Rating, and Interpretation. Using concept mapping software, we applied multidimensional scaling to visualize a point map displaying factors and their relative relationships, and hierarchical cluster analysis to generate concept maps displaying clusters of factors.

Results

During the brainstorming phase community partners (N = 18) generated 69 unique statements describing factors impacting OD2A work and community partners (N = 16) sorted and rated statements using concept mapping software. In the interpretation community partners (N = 26) selected the 10-cluster map as the most salient cluster solution. Using this cluster map and cluster ratings, we identified Stigma, Criminalization and Marginalization, and Racial Equity as factors of highest importance to overdose prevention success but lowest in success thus far.

Discussion

Using concept mapping to evaluate factors affecting OD2A outcomes was a successful method of engaging community partners in considering opportunities to strengthen OD2A and future overdose prevention efforts.
背景:皮特公共卫生评估小组使用混合方法,以社区为基础的概念图参与性研究方法来评估影响宾夕法尼亚州阿勒格尼县阿片类药物过量监测和预防项目结果的因素。方法:在2021年6月,我们开发了焦点提示:“在个人、社区和/或系统层面,哪些因素有助于或限制OD2A项目的结果?”社区合作伙伴参与了三个阶段:头脑风暴、分类和评级以及解释。利用概念图软件,我们采用多维尺度来可视化显示因子及其相对关系的点图,并采用分层聚类分析来生成显示因子簇的概念图。结果:在头脑风暴阶段,社区合作伙伴(N = 18)产生了69个独特的陈述,描述了影响OD2A工作的因素,社区合作伙伴(N = 16)使用概念图软件对陈述进行了分类和评级。在解译社区合作伙伴(N = 26)中,选择10聚类图作为最显著的聚类解决方案。利用这一聚类图和聚类评级,我们确定了污名化、犯罪化和边缘化以及种族平等是对过量预防成功最重要的因素,但迄今为止成功程度最低。讨论:使用概念图来评估影响OD2A结果的因素是一种成功的方法,可以让社区合作伙伴考虑加强OD2A和未来过量预防工作的机会。
{"title":"Using concept mapping methods to evaluate overdose data to action program efforts in Allegheny County, Pennsylvania","authors":"Stephanie L. Creasy,&nbsp;Erin Seger,&nbsp;Molly Eggleston,&nbsp;Mary Hawk,&nbsp;James E. Egan","doi":"10.1016/j.evalprogplan.2024.102532","DOIUrl":"10.1016/j.evalprogplan.2024.102532","url":null,"abstract":"<div><h3>Background</h3><div>The Pitt Public Health evaluation team used a mixed-methods, community-based participatory research method of concept mapping to evaluate factors affecting the Overdose Data to Action (OD2A) opioid overdose surveillance and prevention project outcomes for Allegheny County, Pennsylvania.</div></div><div><h3>Methods</h3><div>In June 2021 we developed the focal prompt: “What factors work to help or limit OD2A program outcomes at the individual, community, and or/system level?”Community partners participated in three phases: Brainstorming, Sorting and Rating, and Interpretation. Using concept mapping software, we applied multidimensional scaling to visualize a point map displaying factors and their relative relationships, and hierarchical cluster analysis to generate concept maps displaying clusters of factors.</div></div><div><h3>Results</h3><div>During the brainstorming phase community partners (N = 18) generated 69 unique statements describing factors impacting OD2A work and community partners (N = 16) sorted and rated statements using concept mapping software. In the interpretation community partners (N = 26) selected the 10-cluster map as the most salient cluster solution. Using this cluster map and cluster ratings, we identified Stigma, Criminalization and Marginalization, and Racial Equity as factors of highest importance to overdose prevention success but lowest in success thus far.</div></div><div><h3>Discussion</h3><div>Using concept mapping to evaluate factors affecting OD2A outcomes was a successful method of engaging community partners in considering opportunities to strengthen OD2A and future overdose prevention efforts.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"109 ","pages":"Article 102532"},"PeriodicalIF":1.5,"publicationDate":"2024-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142830324","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
From margins to mainstream: Paving the way to digital equity through digital literacy training programs 从边缘到主流:通过数字扫盲培训项目为数字公平铺平道路。
IF 1.5 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2024-12-08 DOI: 10.1016/j.evalprogplan.2024.102533
Heena Choudhary
This research examines the challenges and opportunities in implementing Digital Literacy Training Programs (DLTPs) in rural areas of India, focusing on bridging the digital divide. Drawing on Standpoint Theory, the study explores how stakeholders' social locations and identities shape their perspectives on DLTPs, highlighting power dynamics and intersectionality within program implementation. Through qualitative analysis, including interviews with district-level managers, trainers, trainees, and potential beneficiaries, the study uncovers critical challenges such as infrastructural issues, limited access to digital resources, and perceived usefulness barriers. The findings contribute to theoretical understandings of social justice and knowledge production, emphasising the importance of valuing diverse perspectives and addressing intersecting forms of privilege and oppression. The study's implications extend to policy and practice, advocating for increased investment in digital infrastructure, tailored program design, stakeholder collaboration, and targeted awareness campaigns to effectively address the digital divide and promote digital empowerment in rural India. Overall, this research offers critical insights into the complexities of DLTP implementation and its implications for digital inclusion and social change.
本研究考察了在印度农村地区实施数字扫盲培训计划(DLTPs)的挑战和机遇,重点是弥合数字鸿沟。根据立场理论,该研究探讨了利益相关者的社会位置和身份如何影响他们对dltp的看法,突出了项目实施中的权力动态和交叉性。通过定性分析,包括对地区级管理人员、培训师、受训人员和潜在受益者的访谈,该研究揭示了关键挑战,如基础设施问题、数字资源的有限获取和感知有用性障碍。研究结果有助于从理论上理解社会正义和知识生产,强调重视不同观点和解决特权和压迫交叉形式的重要性。该研究的影响延伸到政策和实践,倡导增加对数字基础设施的投资,量身定制的项目设计,利益相关者合作,以及有针对性的宣传活动,以有效解决数字鸿沟,促进印度农村的数字赋权。总体而言,本研究为DLTP实施的复杂性及其对数字包容和社会变革的影响提供了重要见解。
{"title":"From margins to mainstream: Paving the way to digital equity through digital literacy training programs","authors":"Heena Choudhary","doi":"10.1016/j.evalprogplan.2024.102533","DOIUrl":"10.1016/j.evalprogplan.2024.102533","url":null,"abstract":"<div><div>This research examines the challenges and opportunities in implementing Digital Literacy Training Programs (DLTPs) in rural areas of India, focusing on bridging the digital divide. Drawing on Standpoint Theory, the study explores how stakeholders' social locations and identities shape their perspectives on DLTPs, highlighting power dynamics and intersectionality within program implementation. Through qualitative analysis, including interviews with district-level managers, trainers, trainees, and potential beneficiaries, the study uncovers critical challenges such as infrastructural issues, limited access to digital resources, and perceived usefulness barriers. The findings contribute to theoretical understandings of social justice and knowledge production, emphasising the importance of valuing diverse perspectives and addressing intersecting forms of privilege and oppression. The study's implications extend to policy and practice, advocating for increased investment in digital infrastructure, tailored program design, stakeholder collaboration, and targeted awareness campaigns to effectively address the digital divide and promote digital empowerment in rural India. Overall, this research offers critical insights into the complexities of DLTP implementation and its implications for digital inclusion and social change.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"109 ","pages":"Article 102533"},"PeriodicalIF":1.5,"publicationDate":"2024-12-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142872871","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Measuring fidelity of brief cognitive behavior therapy for insomnia: Development, reliability and validity 短暂认知行为治疗失眠症的保真度测量:发展、信度与效度。
IF 1.5 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2024-12-08 DOI: 10.1016/j.evalprogplan.2024.102531
Wendi F. Cross , Janet McCarten , Jennifer S. Funderburk , Hugh F. Crean , Jennifer Lockman , Caitlin E. Titus , Wilfred R. Pigeon

Purpose

Measuring fidelity is critical in program evaluations to assess how implementation influences outcomes. Implementer fidelity is comprised of adherence to the treatment content and competence of treatment delivery. Cognitive behavioral therapy for insomnia (CBT-I) is well-established and empirically supported with variants such as brief CBTi (bCBTi) showing promise in reducing both insomnia and depression. The impact of therapist fidelity on treatment outcomes is unknown in part because reliable measures have not been available. We developed measures of therapist fidelity for bCBT-i and assessed the impact of fidelity in the context of a pilot study with veterans in primary care.

Methods/Results

Audio recordings from 23 participants (78 % male) were coded.
Therapist adherence measures were created for each session along with a single measure of therapist competence. Inter-rater reliability was established and predictive validity was determined. For total adherence, inter-rater reliability was excellent across sessions (ICC =.73 −.80). The competence measure showed good reliability across all sessions (ICC =.57) and was internally consistent (Cronbach’s alpha =.75). There was only 10 % of shared variance between adherence and competence. All of the fidelity measures demonstrated associations with outcomes in the predicted direction; therapist adherence was significantly associated with decreased depression.
目的:测量保真度是评估项目实施如何影响结果的关键。实施者忠实度包括对治疗内容的坚持和治疗提供的能力。失眠的认知行为疗法(CBT-I)已经建立并得到了经验的支持,诸如简短的CBTi (bCBTi)等变体显示出减少失眠和抑郁的希望。治疗师忠诚对治疗结果的影响是未知的,部分原因是没有可靠的测量方法。我们为bCBT-i开发了治疗师忠实度的测量方法,并在初级保健退伍军人的试点研究中评估了忠实度的影响。方法/结果:对23名参与者(78% %男性)的录音进行编码。治疗师的依从性措施是为每个疗程创建的,以及治疗师能力的单一衡量标准。建立量表间信度,确定预测效度。对于总依从性,各疗程间的信度非常好(ICC =。73 .80)。能力测量在所有会话中显示出良好的信度(ICC =.57),并且内部一致(Cronbach's alpha =.75)。在依从性和能力之间只有10 %的共同方差。所有的保真度测量都与预测方向的结果相关;治疗师的依从性与抑郁症的减少显著相关。
{"title":"Measuring fidelity of brief cognitive behavior therapy for insomnia: Development, reliability and validity","authors":"Wendi F. Cross ,&nbsp;Janet McCarten ,&nbsp;Jennifer S. Funderburk ,&nbsp;Hugh F. Crean ,&nbsp;Jennifer Lockman ,&nbsp;Caitlin E. Titus ,&nbsp;Wilfred R. Pigeon","doi":"10.1016/j.evalprogplan.2024.102531","DOIUrl":"10.1016/j.evalprogplan.2024.102531","url":null,"abstract":"<div><h3>Purpose</h3><div>Measuring fidelity is critical in program evaluations to assess how implementation influences outcomes. Implementer fidelity is comprised of adherence to the treatment content and competence of treatment delivery. Cognitive behavioral therapy for insomnia (CBT-I) is well-established and empirically supported with variants such as brief CBTi (bCBTi) showing promise in reducing both insomnia and depression. The impact of therapist fidelity on treatment outcomes is unknown in part because reliable measures have not been available. We developed measures of therapist fidelity for bCBT-i and assessed the impact of fidelity in the context of a pilot study with veterans in primary care.</div></div><div><h3>Methods/Results</h3><div>Audio recordings from 23 participants (78 % male) were coded.</div><div>Therapist adherence measures were created for each session along with a single measure of therapist competence. Inter-rater reliability was established and predictive validity was determined. For total adherence, inter-rater reliability was excellent across sessions (ICC =.73 −.80). The competence measure showed good reliability across all sessions (ICC =.57) and was internally consistent (Cronbach’s alpha =.75). There was only 10 % of shared variance between adherence and competence. All of the fidelity measures demonstrated associations with outcomes in the predicted direction; therapist adherence was significantly associated with decreased depression.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"109 ","pages":"Article 102531"},"PeriodicalIF":1.5,"publicationDate":"2024-12-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142856087","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Participation among tribal youths of India in vocational training measures: A systematic review of literature 印度部落青年参与职业培训措施的情况:文献系统回顾。
IF 1.5 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2024-12-06 DOI: 10.1016/j.evalprogplan.2024.102530
Pritam Biswal , Chandan Kumar Sahoo , Niharranjan Mishra

Purpose

Vocational Training is integral to Skill India Mission 2015, which targets to mitigate youth unemployment. However, evidence reveals a significant number of unenrolled youths. Existing studies pinpoint the reasons for this decline in varied nations including India, but rarely they are specific to indigenous communities. Therefore, the aim is to delve into the diverse aspects of participation in vocational training, focusing on tribal communities in India.

Method

This systematic literature review uses the SPICE tool for question formulation, PRISMA guidelines for article selection, Mendeley for duplication elimination, and SQUIRE 2.0 for evaluating research quality.

Findings

There are few studies on tribal population participation in vocational training in India. An interpretation of synthesis based on 37 included studies highlights the low participation of tribes despite government emphasis. The analysis reveals that social stigma still hinders access to vocational training, undermining the potential benefits. Hence, inadequate progress in this area has compromised the fulfilment of its true purpose.

Originality

This study offers a unique approach by extracting literature and employing scientific review tools to find new insights. Notably, the review findings can shape the understanding of vocational training by stimulating global discussions.
目的:职业培训是“2015年印度技能使命”的组成部分,旨在缓解青年失业问题。然而,有证据显示,有相当数量的年轻人没有入学。现有的研究指出了包括印度在内的不同国家这种下降的原因,但很少针对土著社区。因此,我们的目标是深入研究参与职业培训的各个方面,重点关注印度的部落社区。方法:本系统文献综述使用SPICE工具制定问题,使用PRISMA指南选择文章,使用Mendeley工具消除重复,使用SQUIRE 2.0评估研究质量。研究发现:印度部落人口参与职业培训的研究较少。基于37项纳入研究的综合解释强调,尽管政府强调,部落的参与率很低。分析显示,社会耻辱感仍然阻碍了获得职业培训,削弱了潜在的好处。因此,在这一领域的不充分进展损害了其真正目的的实现。独创性:本研究提供了一种独特的方法,通过提取文献和使用科学回顾工具来发现新的见解。值得注意的是,审查结果可以通过激发全球讨论来塑造对职业培训的理解。
{"title":"Participation among tribal youths of India in vocational training measures: A systematic review of literature","authors":"Pritam Biswal ,&nbsp;Chandan Kumar Sahoo ,&nbsp;Niharranjan Mishra","doi":"10.1016/j.evalprogplan.2024.102530","DOIUrl":"10.1016/j.evalprogplan.2024.102530","url":null,"abstract":"<div><h3>Purpose</h3><div>Vocational Training is integral to Skill India Mission 2015, which targets to mitigate youth unemployment. However, evidence reveals a significant number of unenrolled youths. Existing studies pinpoint the reasons for this decline in varied nations including India, but rarely they are specific to indigenous communities. Therefore, the aim is to delve into the diverse aspects of participation in vocational training, focusing on tribal communities in India.</div></div><div><h3>Method</h3><div>This systematic literature review uses the SPICE tool for question formulation, PRISMA guidelines for article selection, Mendeley for duplication elimination, and SQUIRE 2.0 for evaluating research quality.</div></div><div><h3>Findings</h3><div>There are few studies on tribal population participation in vocational training in India. An interpretation of synthesis based on 37 included studies highlights the low participation of tribes despite government emphasis. The analysis reveals that social stigma still hinders access to vocational training, undermining the potential benefits. Hence, inadequate progress in this area has compromised the fulfilment of its true purpose.</div></div><div><h3>Originality</h3><div>This study offers a unique approach by extracting literature and employing scientific review tools to find new insights. Notably, the review findings can shape the understanding of vocational training by stimulating global discussions.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"109 ","pages":"Article 102530"},"PeriodicalIF":1.5,"publicationDate":"2024-12-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142819827","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluating the effects of collaborative governance: Case of a digital education project 评估协作治理的效果:以数字教育项目为例。
IF 1.5 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2024-11-30 DOI: 10.1016/j.evalprogplan.2024.102522
Stéphane Bonny, Tereza Cahlikova
The introduction of digital curricula has become topical due to the increasingly pervasive role of ICTs in the society implying the necessity to develop digital skills from a young age. Because of the lack of in-house know-how, governments often need to rely on external actors providing digital education expertise. Organisational structures of such programs thus resemble collaborative governance regimes with distinct roles attributed to specific stakeholders. In this study, we explore cross-sector collaboration structures of the DigEd project aiming to introduce digital education in different cycles of compulsory and post-compulsory schooling on the local level in Switzerland. Findings indicate that the lack of leadership and of clarification of each partner’s role during the pilot phase of the project did not allow for the creation of a shared understanding among the involved partners and led to the domination of a limited number of influential actors. This tendency is confirmed through a graphic SNA analysis clearly illustrating the centrality of non-state actors. This contribution shows that it is not only the effects of projects that should be of interest to evaluators, but also their internal collaboration structures.
由于信息通信技术在社会中的作用日益普遍,这意味着必须从小培养数字技能,因此引入数字课程已成为热门话题。由于缺乏内部专业知识,政府往往需要依靠外部参与者提供数字教育专业知识。因此,这些项目的组织结构类似于协作治理制度,具有归因于特定利益相关者的不同角色。在本研究中,我们探索了DigEd项目的跨部门合作结构,该项目旨在在瑞士地方一级的义务教育和义务教育后教育的不同周期中引入数字教育。调查结果表明,在项目的试点阶段,由于缺乏领导和没有明确每个伙伴的作用,无法在有关伙伴之间形成共同的理解,导致少数有影响力的行动者占据主导地位。这一趋势通过图形SNA分析得到证实,该分析清楚地说明了非国家行为者的中心地位。这一贡献表明,评估者不仅应该对项目的效果感兴趣,而且应该对它们的内部协作结构感兴趣。
{"title":"Evaluating the effects of collaborative governance: Case of a digital education project","authors":"Stéphane Bonny,&nbsp;Tereza Cahlikova","doi":"10.1016/j.evalprogplan.2024.102522","DOIUrl":"10.1016/j.evalprogplan.2024.102522","url":null,"abstract":"<div><div>The introduction of digital curricula has become topical due to the increasingly pervasive role of ICTs in the society implying the necessity to develop digital skills from a young age. Because of the lack of in-house know-how, governments often need to rely on external actors providing digital education expertise. Organisational structures of such programs thus resemble collaborative governance regimes with distinct roles attributed to specific stakeholders. In this study, we explore cross-sector collaboration structures of the DigEd project aiming to introduce digital education in different cycles of compulsory and post-compulsory schooling on the local level in Switzerland. Findings indicate that the lack of leadership and of clarification of each partner’s role during the pilot phase of the project did not allow for the creation of a shared understanding among the involved partners and led to the domination of a limited number of influential actors. This tendency is confirmed through a graphic SNA analysis clearly illustrating the centrality of non-state actors. This contribution shows that it is not only the effects of projects that should be of interest to evaluators, but also their internal collaboration structures.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"109 ","pages":"Article 102522"},"PeriodicalIF":1.5,"publicationDate":"2024-11-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142796138","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using music storytelling communication intervention to promote acceptance of C-sections among families in rural areas 运用音乐讲故事传播干预促进农村家庭对剖腹产的接受
IF 1.5 4区 社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY Pub Date : 2024-11-28 DOI: 10.1016/j.evalprogplan.2024.102521
Chinasa Emelda Nnanyelugo , Ndubuisi M. Nnanna , Ukam Ivi Ngwu , Ozioma Patience Nwokedi , Charles Okwuowulu , Izuchukwu John Ewulu , Chibuzor Cosmas Nwoga , Verlumun Celestine Gever
This study examined the effectiveness of music storytelling communication intervention in promoting the acceptance of caesarean section (CS) among families in rural areas. The families were randomly assigned to control groups, music storytelling and non-music storytelling. The result showed that although the families reported a negative perception of CS at baseline and rejected it as a delivery option, this changed significantly after the intervention. Comparatively, families in music storytelling scored higher regarding positive perceptions and acceptance of CS than those in non-music storytelling. The difference between the control and treatment groups was sustained during follow-up assessment after six months. However, a relapse of 5.0 was observed for the non-music storytelling regarding their perception and 5.5 regarding their acceptance of CS. For the music storytelling, the relapse was 2.1 for perception and 2.9 for acceptance. This means that music storytelling also led to a low relapse when compared with non-music storytelling communication intervention.
本研究探讨了音乐讲故事传播干预在促进农村家庭接受剖宫产(CS)中的效果。这些家庭被随机分配到对照组,用音乐讲故事和用非音乐讲故事。结果显示,尽管家庭在基线时报告了对CS的负面看法,并拒绝将其作为分娩选择,但在干预后这种情况发生了显著变化。相比之下,音乐讲故事的家庭在积极感知和接受CS方面的得分高于非音乐讲故事的家庭。在6个月后的随访评估中,对照组和实验组之间的差异持续存在。然而,非音乐讲故事的人在感知方面的复发率为5.0,在接受CS方面的复发率为5.5。在音乐讲故事方面,感知的复发率为2.1,接受的复发率为2.9。这意味着,与非音乐讲故事的交流干预相比,音乐讲故事也导致了较低的复发。
{"title":"Using music storytelling communication intervention to promote acceptance of C-sections among families in rural areas","authors":"Chinasa Emelda Nnanyelugo ,&nbsp;Ndubuisi M. Nnanna ,&nbsp;Ukam Ivi Ngwu ,&nbsp;Ozioma Patience Nwokedi ,&nbsp;Charles Okwuowulu ,&nbsp;Izuchukwu John Ewulu ,&nbsp;Chibuzor Cosmas Nwoga ,&nbsp;Verlumun Celestine Gever","doi":"10.1016/j.evalprogplan.2024.102521","DOIUrl":"10.1016/j.evalprogplan.2024.102521","url":null,"abstract":"<div><div>This study examined the effectiveness of music storytelling communication intervention in promoting the acceptance of caesarean section (CS) among families in rural areas. The families were randomly assigned to control groups, music storytelling and non-music storytelling. The result showed that although the families reported a negative perception of CS at baseline and rejected it as a delivery option, this changed significantly after the intervention. Comparatively, families in music storytelling scored higher regarding positive perceptions and acceptance of CS than those in non-music storytelling. The difference between the control and treatment groups was sustained during follow-up assessment after six months. However, a relapse of 5.0 was observed for the non-music storytelling regarding their perception and 5.5 regarding their acceptance of CS. For the music storytelling, the relapse was 2.1 for perception and 2.9 for acceptance. This means that music storytelling also led to a low relapse when compared with non-music storytelling communication intervention.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"108 ","pages":"Article 102521"},"PeriodicalIF":1.5,"publicationDate":"2024-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142757146","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Evaluation and Program Planning
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1