Evaluation and Program Planning最新文献

{"title":"Designing, developing and applying an instructional framework for a neonatal resuscitation program: Action research","authors":"Ayşe Şenoğlu ,&nbsp;Zekiye Karaçam ,&nbsp;Ali Tanju Altunsu","doi":"10.1016/j.evalprogplan.2025.102747","DOIUrl":"10.1016/j.evalprogplan.2025.102747","url":null,"abstract":"<div><div>This research was conducted to design, develop, and implement an in-house training framework aimed at improving the skills of healthcare professionals in newborn resuscitation practices. Action research has an inherently researcher–participant collaborative nature. An action research design was employed in this study, which was carried out with healthcare workers at a state hospital providing maternity services from February 1, 2020, to January 31, 2022. Both qualitative (observations, individual interviews and a focus group interview) and quantitative (knowledge assessment tests) data collection techniques were utilized in the study. Data were collected from researcher notes, the Neonatal Resuscitation Program (NRP) Knowledge Assessment Test, the Post-Training NRP Knowledge Assessment Test, observations, individual interviews, and focus group discussions. Quantitative data were analyzed using descriptive statistics, the Mann-Whitney U, Kruskal-Wallis and Wilcoxon tests; content analysis was employed for qualitative data. When the NRP Knowledge Assessment Test and the Post-training NRP Knowledge Assessment Test median scores were compared, it was found that the median NRP knowledge assessment test score was 43.0 (29.0–52.0), and the median post-training NRP knowledge assessment test score was 88.0 (85.0–93.0). A statistically significant difference was observed in the comparison of the participants' median scores in the NRP knowledge assessment test and the post-training NRP knowledge assessment test (p &lt; 0.001). According to the data from the individual interviews, it was found that the participants felt challenged by neonatal resuscitation, they did not use many aspects of their knowledge, there were communication problems between teams, and they expressed a need for training. It was observed that the participants could not perform the required routine practices fully and accurately and additionally could not perform neonatal resuscitation practices, including neonatal assessments, in line with the algorithms. During this action research, the deficiencies in medical equipment for neonatal resuscitation practices identified in the institution where the study was conducted were eliminated and the equipment was made operational and usable. Improvements were also made in the use of risk assessment and recording forms, the provision of flow charts and informative documents in the practice areas, and the organization of the working system of midwives. During this process, theoretical and practical training was provided to improve the knowledge and skills of health personnel in neonatal resuscitation practices. In addition, four mentors were trained and assigned to ensure the sustainability of all the improvements made. This research has revealed institutional infrastructure problems, along with knowledge and application deficiencies regarding neonatal resuscitation practices among healthcare professionals.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"115 ","pages":"Article 102747"},"PeriodicalIF":2.0,"publicationDate":"2025-12-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145884313","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Planning for implementation scale-up of a medication for opioid use disorder program across rural Colorado: Ensuring fit to context","authors":"Claudia R. Amura ,&nbsp;Aimee Techau ,&nbsp;Natalie D. Ritchie ,&nbsp;Tanya R. Sorrell ,&nbsp;Mary Weber ,&nbsp;Bethany M. Kwan ,&nbsp;Elaine H. Morrato ,&nbsp;Paul F. Cook","doi":"10.1016/j.evalprogplan.2025.102749","DOIUrl":"10.1016/j.evalprogplan.2025.102749","url":null,"abstract":"<div><div>Opioid use is a major public health crisis in the United States. Colorado’s Medication for Opioid Use Disorders (MOUD) program expansion was funded to address this problem in rural counties, which are disproportionately affected. Aligning with a Fit to Context Framework for Designing for Dissemination and Sustainability (F2C D4DS), we used customer discovery and value proposition methods to engage partners in an iterative process of conceptualization and design of a MOUD program to guide implementation scale-up and dissemination plans. Interviews (N = 26) with target adopters and influencers (e.g. pilot and prospective agencies, community partners) revealed expansion barriers of greatest priority to solve: 1) organizations’ capacity to provide MOUD; (2) access to treatment and patient-centered care; (3) service and system coordination; (4) stigma associated with OUD; (5) concerns about financial sustainability; and (6) mandated reporting systems. We used process mapping to analyze each organization’s context, structure, and workflows. This phase of conceptualization led to the design of new MOUD program elements to enhance its value: a clinical toolkit and guidelines, an enhanced data collection system for reporting, a process map, and implementation logic models for integrated patient-centered MOUD treatment and reporting. The F2C D4DS process allowed us to identify needs and benefits of greatest value for adopters, and informed MOUD expansion into areas with high OUD overdose risk across the state, to maximize patient outcomes. This study also contributes to evaluation literature by systematically integrating the pre-implementation phase to enhance contextual fit and sustainability for large-scale MOUD initiatives.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"115 ","pages":"Article 102749"},"PeriodicalIF":2.0,"publicationDate":"2025-12-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145866007","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Lessons learned in the implementation of graduation programs: The experience of Colombia, Mexico, and Paraguay","authors":"Graciela Teruel-Belismelis ,&nbsp;Jorge H. Maldonado ,&nbsp;Marlene Peters-Castilla ,&nbsp;Manuel Triano-Enríquez","doi":"10.1016/j.evalprogplan.2025.102746","DOIUrl":"10.1016/j.evalprogplan.2025.102746","url":null,"abstract":"<div><div>The <strong>aim</strong> of this study is to identify systematic and generalizable strengths and weaknesses in the processes for implementing four graduation programs carried out in Colombia (2), Mexico, and Paraguay in 2015–17. The <strong>specific aims</strong> are to identify some of the key factors common to these processes and their contribution to the efficiency of program implementation, as well as to not others that may not appear in all these processes but may affect the implementation of programs and alter their results. The identification of these factors can provide empirical evidence for “lessons learned” that can facilitate their replication in other countries. The <strong>procedure</strong> is to analyze qualitative data which were collected during the process evaluation of each program from 2015 to 2018, by using the Consolidated Framework for Implementation Research (CFIR) to guide the analysis. Constructs that strongly influence implementation effectiveness were identified through a cross- case comparison of ratings. The categories of analysis are the domains: intervention characteristics, outer settings, inner settings, characteristics of individuals and process and these were used in a concrete study of three general processes: planning, preparation, and implementation. Among the <strong>lessons learned</strong> were the importance of marketing networks for the goods and services produced by beneficiaries; the importance of leadership engagement of the field team and a good learning climate for them; the need to consider differences in the educational level of beneficiaries, their ability to run a business, and their local micro contexts in the program design.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"115 ","pages":"Article 102746"},"PeriodicalIF":2.0,"publicationDate":"2025-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145879242","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Using theories of power and place to evaluate community health promotion","authors":"Katie Powell ,&nbsp;Miranda Thurston ,&nbsp;Daniel Bloyce","doi":"10.1016/j.evalprogplan.2025.102745","DOIUrl":"10.1016/j.evalprogplan.2025.102745","url":null,"abstract":"<div><div>There is some consensus that better ways of evaluating complex public health programmes are needed as experimental methods are limited in explaining the 'how' and 'why' of change. Methods like 'theory-of-change,' 'realist evaluation,' and 'systems evaluation' try to give a more complete picture of change by looking at the context of the programme. However, when these methods are used to study programmes that aim to reduce health inequalities, they often miss a crucial issue: how power affects people's health and engagement with programmes. This paper addresses that gap by reporting an ethnographic study of a community health promotion programme that was informed by a social theory of power (figurational sociology). When looking at how power dynamics played out in the targeted community, we could see why residents often did not trust the people running the programme, and why local status was so important to them. When programme staff understood these power dynamics, they were better able to connect with residents and help them improve their wellbeing. We argue that combining this way of looking at power with our observational approach gives us a much clearer understanding of how complex public health programmes work and why they succeed or fail in their aims.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"115 ","pages":"Article 102745"},"PeriodicalIF":2.0,"publicationDate":"2025-12-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145828770","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"","authors":"Melanie Hwalek","doi":"10.1016/j.evalprogplan.2025.102735","DOIUrl":"10.1016/j.evalprogplan.2025.102735","url":null,"abstract":"","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"115 ","pages":"Article 102735"},"PeriodicalIF":2.0,"publicationDate":"2025-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145685298","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Measuring the impact of a novel program in a Family Treatment Court: Quality of life, mental health, and self-esteem inventories in program evaluation","authors":"Julie B. Raines","doi":"10.1016/j.evalprogplan.2025.102734","DOIUrl":"10.1016/j.evalprogplan.2025.102734","url":null,"abstract":"<div><div>Family Treatment Courts (FTCs) accept parents in civil neglect cases where the parent is suffering from substance use and/or mental health issues. Modeled after adult drug treatment courts, FTCs coordinate substance use and mental health treatment, as well as other social support services for participants like housing and employment. Recently, one FTC in the United States began providing additional supervised and monitored visitation to participants within their FTC program, as well as one-on-one evidence-based parenting education. Called Enhanced Parenting Time (EPT), the goal of this innovative program is to motivate FTC participants with extra visitation while simultaneously improving parenting skills. As part of a program evaluation paid for by the Office of Juvenile Justice and Delinquency Prevention (OJJDP), three separate instruments were used to determine the impact EPT had on its participants. Comparison data collected from the Quality-of-Life Scales (QOLS), Mental Health Continuum – Short Form (MHC-SF), and Rosenberg Self Esteem scale (RSE) yielded differences between EPT participants and non-EPT participants. This research focuses on the use of these instruments in an impact evaluation of a novel treatment court program in the United States and contributes to evaluation methodology frameworks for treatment court programs.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"115 ","pages":"Article 102734"},"PeriodicalIF":2.0,"publicationDate":"2025-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145645881","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Drivers of change effectiveness in public universities in the State of Amhara: Toward developing promising propositions through a critical co-constructive perspective","authors":"Bekalu Tadesse Moges ,&nbsp;Getnet Tizazu Fetene ,&nbsp;Getu Shiferaw Wolle","doi":"10.1016/j.evalprogplan.2025.102733","DOIUrl":"10.1016/j.evalprogplan.2025.102733","url":null,"abstract":"<div><div>Most studies examining the effectiveness of system-wide change initiatives in public universities rely heavily on simplistic models of technical rationality that emphasize planning, control, and monitoring. This perspective is known to ignore the contextual and relational interactions that shape the understanding of educational change. Alternatively, the present study makes a case for the adoption of a Critical co-constructive stance to allow context-based solutions that optimize the successful implementation of the initiatives. With this stance, the study identifies context-based drivers and propositions grounded in the views of change implementers. Using 15 key informant interviews and 6 focus group discussions, data were collected from teachers, and academic leaders selected through theoretical sampling. The data are analyzed using the constant comparison technique. The study found that profound change is a critically co-constructed phenomenon that evolves through ongoing meaning-making among implementers. Additionally, the study identified 16 interrelated drivers and their respective propositions that optimize the chance of successful educational change. The drivers represent multilevel interactions within and across implementing institutions. Practical policy and efficiency implications for the development and implementation of change initiatives are discussed.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102733"},"PeriodicalIF":2.0,"publicationDate":"2025-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145605982","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The coupling coordination development of rural medical health service and rural economy: Evidence from China","authors":"Junjie Zhao ,&nbsp;Ye Ding ,&nbsp;Shangren Qin","doi":"10.1016/j.evalprogplan.2025.102732","DOIUrl":"10.1016/j.evalprogplan.2025.102732","url":null,"abstract":"<div><div>The equity of rural medical health services and their coordination with the rural economy needs to be clarified. This article reports on the coupling coordination development of rural medical health services and the economy in China. We used panel data for 29 provincial-level administrative regions in China from 2009 to 2019 to analyze the development level and coupling coordination degree of rural medical health services and rural economy from a spatial and temporal perspective. Using a spatial autocorrelation test, the correlation of the coupling coordination degree of each administrative region and the spatial clustering characteristics of the coupling coordination degree of the east, central, west, and northeast regions was analyzed. Results showed that the level of development of the two subsystems turned from 2014. The rural economy was gradually catching up with medical and health services, yet rural health services had always been important in the development of the system, coupling coordination degree. Spatially, the development level and coupling coordination of the subsystem showed a “high eastern” distribution pattern, while the inequity among provincial-level administrative regions in the east was more significant. The subsystems of 29 provincial-level administrative regions exhibited both spatial-temporal differences and positive spatial correlation. The phenomenon of regional differentiation and imbalance still exists in rural China. It indicates that neighboring regions influence each other and produce a spillover effect, so promoting regional linkage can better promote balanced regional development. These findings will help the government to implement targeted policies to improve health quality and health equity in rural areas.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102732"},"PeriodicalIF":2.0,"publicationDate":"2025-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145551537","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Implementation evaluation of an intervention aimed at reducing test anxiety in adolescents","authors":"Gabriela Campeau ,&nbsp;Gabrielle Yale-Soulière ,&nbsp;Lyse Turgeon ,&nbsp;Kassandra Berniqué ,&nbsp;Kim Archambault","doi":"10.1016/j.evalprogplan.2025.102731","DOIUrl":"10.1016/j.evalprogplan.2025.102731","url":null,"abstract":"<div><h3>Introduction</h3><div>Approximately 15 % of adolescents experience test anxiety in school settings. This type of anxiety, characterized by worries and physiological reactions to school assessments, can lead to significant academic and psychological difficulties. In response to the lack of effective school-based interventions, the <em>Pastel</em> workshops were developed. This targeted group intervention, which combines a cognitive-behavioral approach with study skills training, has demonstrated significant effects in reducing test anxiety in at-risk adolescents.</div></div><div><h3>Objectives</h3><div>This study aims to: 1) determine whether the training provided by Boscoville to program facilitators was properly implemented, 2) evaluate the implementation of the Pastel workshops, and 3) explore the facilitators and barriers encountered in supporting facilitators and implementing the workshops.</div></div><div><h3>Methodology</h3><div>The sample includes 24 students aged 14–17 in grades 10 and 11 from five schools who participated in the workshops, and nine professionals who facilitated them. Fidelity, delivered dosage, quality of delivery, and attendance and homework completion were measured to evaluate the implementation, while semi-structured interviews with the youth and facilitators were conducted to assess the implementation context.</div></div><div><h3>Results</h3><div>Findings show an overall score of 84 % for the evaluation of the training implementation and an average adherence score of 79 % for the workshop implementation. The context evaluation identified enablers and challenges based on Domitrovich’s multilevel framework, across societal, environmental, intervention-specific, and support system levels. Key enablers included the involvement of a third-party organization, the group-based format, strong motivation among facilitators, the relevance of the strategies presented, and the quality of the training. However, challenges emerged at multiple levels, including limited engagement for some participants, issues related to the organization of the workshop content, suboptimal quality of some implementation materials, and time constraints related to preparation and facilitation.</div></div><div><h3>Conclusion</h3><div>This study highlights that successful implementation of school-based psychosocial programs relies on thorough planning that integrates both core components and contextual factors. When combined with strong facilitator support, such planning fosters high fidelity, quality delivery, and sustained participant engagement.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102731"},"PeriodicalIF":2.0,"publicationDate":"2025-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145558249","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Using intervention mapping to develop training for US dental providers to recommend the HPV vaccine","authors":"Jennifer Sukalski ,&nbsp;Grace Ryan ,&nbsp;Susan C. McKernan ,&nbsp;Emily A. Janio ,&nbsp;Rebecca Bucklin ,&nbsp;Natoshia Askelson","doi":"10.1016/j.evalprogplan.2025.102730","DOIUrl":"10.1016/j.evalprogplan.2025.102730","url":null,"abstract":"<div><h3>Introduction</h3><div>Iowa has the highest incidence of oropharyngeal cancer (OPC) in the US, and human papillomavirus (HPV) is the most common cause of that disease. An HPV vaccine is approved for OPC prevention, but its uptake is low. We identified dental offices as novel settings in which the HPV vaccine can be recommended to patients, and we describe our use of the Intervention Mapping (IM) framework to develop an intervention that prepares dental providers to recommend the vaccine to parents of patients aged 9–17.</div></div><div><h3>Methods</h3><div>Our planning group used IM to engage in (1) needs assessment, which involved surveying dental hygienists (n = 470) and interviewing dental hygienists (n = 19) and dentists (n = 20); (2) method and (3) theory identification; and (4) intervention development, (5) implementation, and (6) evaluation, resulting in our “Educate, Recommend, Refer” intervention.</div></div><div><h3>Results</h3><div>The needs assessment showed dental providers were willing to learn more about the HPV vaccine but needed training to confidently recommend it. We chose training methods that increase self-efficacy, in accordance with behavior change theory. Multiple health behavior theories and frameworks also prompted our development of supporting materials, that encouraged participants to engage in vaccine promotion, as well as an evaluation plan.</div></div><div><h3>Conclusion</h3><div>IM guided our integration of theory, existing evidence, and stakeholder input to create an intervention that comprehensively addressed the needs of our target audience and overcame limitations of other similar interventions. Presenting intervention development in accordance with the IM framework also gives practitioners clear information for its replication or adoption.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102730"},"PeriodicalIF":2.0,"publicationDate":"2025-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145565949","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}