Pub Date : 2025-10-01Epub Date: 2025-07-14DOI: 10.1016/j.evalprogplan.2025.102649
Fadile Aydın , Mecit Aslan
Teacher identity is shaped through an ongoing, dynamic process that integrates personal and professional dimensions over time and within specific contexts. In this context, teacher education and school climate can be regarded as two key factors influencing the development of teacher identity. This study aimed to investigate the effects of pre-service education and school climate on the formation of teacher identity. Data were collected from 875 teachers working in Türkiye, a developing country. The research employed three measurement tools: the Teacher Identity Scale, the Teacher Perceptions Scale for Competency of Pre-Service Education and the School Climate Scale. Structural equation modeling (SEM) and Pearson product-moment correlation coefficient (PPMCC) analyses were conducted to examine the data. The findings revealed that both pre-service education and school climate play a significant role in shaping teacher identity and are meaningful predictors of it. Additionally, a moderate and positive correlation was found between teachers’ perceptions of pre-service education, school climate and their sense of teacher identity.
{"title":"The role of pre-service education and school climate on teacher identity: Evidence from a developing country","authors":"Fadile Aydın , Mecit Aslan","doi":"10.1016/j.evalprogplan.2025.102649","DOIUrl":"10.1016/j.evalprogplan.2025.102649","url":null,"abstract":"<div><div>Teacher identity is shaped through an ongoing, dynamic process that integrates personal and professional dimensions over time and within specific contexts. In this context, teacher education and school climate can be regarded as two key factors influencing the development of teacher identity. This study aimed to investigate the effects of pre-service education and school climate on the formation of teacher identity. Data were collected from 875 teachers working in Türkiye, a developing country. The research employed three measurement tools: the Teacher Identity Scale, the Teacher Perceptions Scale for Competency of Pre-Service Education and the School Climate Scale. Structural equation modeling (SEM) and Pearson product-moment correlation coefficient (PPMCC) analyses were conducted to examine the data. The findings revealed that both pre-service education and school climate play a significant role in shaping teacher identity and are meaningful predictors of it. Additionally, a moderate and positive correlation was found between teachers’ perceptions of pre-service education, school climate and their sense of teacher identity.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102649"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144654516","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This study examines administration-faculty relationships at Chiana Senior High School (SHS) in Ghana, highlighting challenges in communication, cultural sensitivity, decision-making, and professional development. Using a mixed-methods approach, findings reveal that 75.6 % of faculty feel their concerns are unaddressed while communication channels exist. In absence of cultural sensitivity training, many (73.2 %) suggested that cultural diversity influences decision-making and conflict resolution. Among faculty members, majority (54.9 %) is involved in decision-making, with most (92.7 %) of them without access to adequate resources. The study’s novelty lies in its application of transformational leadership and participatory decision-making theories in a rural Ghanaian context, addressing an underexplored educational landscape. Although limited to one institution, it provides crucial insights for improving administration-faculty collaboration. Recommendations include enhancing communication, fostering participatory decision-making, and expanding cultural sensitivity training to create a more inclusive educational environment.
{"title":"Bridging the divide: Cultivating collaborative leadership in a rural Ghanaian school","authors":"Kwame Anokye , Abigail Okyere Darko , Edmund Kude Diderutua , Jemima Boateng , Helina Boansi Apea , Afia Agyeiwaa , Abdul-Jalil Halid , Ivy Betur Naaso , Basil Wepadam Awiah","doi":"10.1016/j.evalprogplan.2025.102636","DOIUrl":"10.1016/j.evalprogplan.2025.102636","url":null,"abstract":"<div><div>This study examines administration-faculty relationships at Chiana Senior High School (SHS) in Ghana, highlighting challenges in communication, cultural sensitivity, decision-making, and professional development. Using a mixed-methods approach, findings reveal that 75.6 % of faculty feel their concerns are unaddressed while communication channels exist. In absence of cultural sensitivity training, many (73.2 %) suggested that cultural diversity influences decision-making and conflict resolution. Among faculty members, majority (54.9 %) is involved in decision-making, with most (92.7 %) of them without access to adequate resources. The study’s novelty lies in its application of transformational leadership and participatory decision-making theories in a rural Ghanaian context, addressing an underexplored educational landscape. Although limited to one institution, it provides crucial insights for improving administration-faculty collaboration. Recommendations include enhancing communication, fostering participatory decision-making, and expanding cultural sensitivity training to create a more inclusive educational environment.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102636"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144314035","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-07-10DOI: 10.1016/j.evalprogplan.2025.102654
Xiafei Tao , Si Shi , Junqiang Liu
Objectives
Health records are crucial for implementing basic public health services (BPHSs) in China, yet their utilization rate lags behind the coverage rate. This study aimed to provide insights into the underutilization issue by exploring whether health records facilitate the utilization of other BPHSs.
Methods
We conducted empirical analyses to examine the impact of health records on the utilization of two specific BPHSs: health education and health management services for patients with hypertension and type 2 diabetes mellitus (T2DM). Multiple linear regression and binary logistic models were employed in the analyses. Additionally, we used the propensity score matching approach to address potential biases.
Results
Health records significantly enhanced the diversity of health education attended by residents, fostered active engagement in health education, and facilitated the utilization of corresponding health management services for patients with hypertension and T2DM.
Conclusions
Despite widespread skepticism concerning the utilization rate of health records, our findings provided empirical evidence that health records may benefit citizens’ self-health management and the utilization of other BPHSs. However, the specific mechanism of this impact needs to be further investigated. This study offers insights into the evaluation of public health programs in the Chinese context and highlights their implications for promoting health equity.
{"title":"Established but unused? An empirical study on the impact of health records on the utilization of basic public health services in China","authors":"Xiafei Tao , Si Shi , Junqiang Liu","doi":"10.1016/j.evalprogplan.2025.102654","DOIUrl":"10.1016/j.evalprogplan.2025.102654","url":null,"abstract":"<div><h3>Objectives</h3><div>Health records are crucial for implementing basic public health services (BPHSs) in China, yet their utilization rate lags behind the coverage rate. This study aimed to provide insights into the underutilization issue by exploring whether health records facilitate the utilization of other BPHSs.</div></div><div><h3>Methods</h3><div>We conducted empirical analyses to examine the impact of health records on the utilization of two specific BPHSs: health education and health management services for patients with hypertension and type 2 diabetes mellitus (T2DM). Multiple linear regression and binary logistic models were employed in the analyses. Additionally, we used the propensity score matching approach to address potential biases.</div></div><div><h3>Results</h3><div>Health records significantly enhanced the diversity of health education attended by residents, fostered active engagement in health education, and facilitated the utilization of corresponding health management services for patients with hypertension and T2DM.</div></div><div><h3>Conclusions</h3><div>Despite widespread skepticism concerning the utilization rate of health records, our findings provided empirical evidence that health records may benefit citizens’ self-health management and the utilization of other BPHSs. However, the specific mechanism of this impact needs to be further investigated. This study offers insights into the evaluation of public health programs in the Chinese context and highlights their implications for promoting health equity.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102654"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144663488","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-06-13DOI: 10.1016/j.evalprogplan.2025.102622
Marie-Therese Schultes , Daniel Graf , Julia Holzer , Barbara Schober , Christiane Spiel
Service learning courses enable students and lecturers at higher education institutions to take on social responsibility by collaborating with community partners. In this literature review that is complemented by empirical examples, we present advantages and challenges of this teaching approach as well as guidelines for developing concepts for a university-wide implementation and evaluation of service learning. Our article is informed by higher education, implementation and evaluation research and findings from the Third Mission project of the University of Vienna, Austria. Within the scope of the project, we conducted a multi-stakeholder workshop and an interview study with representatives from seven universities. We illustrate the service learning approach with two course examples from the University of Vienna’s psychology master’s programme. Then, we discuss how service learning can be systematically implemented at the university level using frameworks from implementation science and findings from an interview study. Results indicate that successful implementation of service learning at the university level is supported by long-term collaboration between the university and community partners and an institutional culture that visibly values students’ and lecturers’ additional efforts. Finally, we seek to advance the evaluation of higher education by presenting a comprehensive participatory approach to service learning assessment that actively involves diverse stakeholders, including students, faculty, and community partners and that can be applied across various disciplines. By integrating multiple perspectives, we offer a framework for capturing the multidimensional impacts of service learning on educational outcomes and community engagement.
{"title":"Implementation and evaluation of service learning at higher education institutions","authors":"Marie-Therese Schultes , Daniel Graf , Julia Holzer , Barbara Schober , Christiane Spiel","doi":"10.1016/j.evalprogplan.2025.102622","DOIUrl":"10.1016/j.evalprogplan.2025.102622","url":null,"abstract":"<div><div>Service learning courses enable students and lecturers at higher education institutions to take on social responsibility by collaborating with community partners. In this literature review that is complemented by empirical examples, we present advantages and challenges of this teaching approach as well as guidelines for developing concepts for a university-wide implementation and evaluation of service learning. Our article is informed by higher education, implementation and evaluation research and findings from the Third Mission project of the University of Vienna, Austria. Within the scope of the project, we conducted a multi-stakeholder workshop and an interview study with representatives from seven universities. We illustrate the service learning approach with two course examples from the University of Vienna’s psychology master’s programme. Then, we discuss how service learning can be systematically implemented at the university level using frameworks from implementation science and findings from an interview study. Results indicate that successful implementation of service learning at the university level is supported by long-term collaboration between the university and community partners and an institutional culture that visibly values students’ and lecturers’ additional efforts. Finally, we seek to advance the evaluation of higher education by presenting a comprehensive participatory approach to service learning assessment that actively involves diverse stakeholders, including students, faculty, and community partners and that can be applied across various disciplines. By integrating multiple perspectives, we offer a framework for capturing the multidimensional impacts of service learning on educational outcomes and community engagement.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102622"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144321771","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-06-18DOI: 10.1016/j.evalprogplan.2025.102639
Maggie Cole-Beebe , Florence K.L. Tangka , Jenny Beizer , Amarilys Bernacet , Stephen Brown , Paran Pordell , Reda Wilson , Sandy Jones , Sujha Subramanian
This study assessed resource allocation among registry activities, which may provide insight for efficient collection of high-quality cancer incidence data. We used a multimodal approach and purposively sampled 21 participating population-based cancer registries in the United States to ensure variation across several registries. The registries reported prospective staffing data and retrospective costing data, completing data collection from October 2021 to September 2022, reporting retrospective costing data for July 1, 2020, through June 30, 2021. From lessons learned from prior studies, we engaged participating registries early and throughout the study, ensuring the collection of meaningful, accurate quantitative data, as well as insights not captured quantitatively. Case volume is a major driver of registry costs. (On average, high-volume registries outspend low-volume registries by nearly 3x, annually). Upon examination of registry activities by case volume, we found that the two most resource-intensive registry activities are data acquisition and data processing, which may be addressed by innovations, such as electronic reporting and automation. Innovative data transfer and processing approaches could increase timeliness of data collection and reduce the labor resources required to process manually collected data. Registries adopting these innovations might achieve cost savings, which could make resources available to support other registry activities.
{"title":"A multimodal analysis of resource allocation across U.S. cancer registries","authors":"Maggie Cole-Beebe , Florence K.L. Tangka , Jenny Beizer , Amarilys Bernacet , Stephen Brown , Paran Pordell , Reda Wilson , Sandy Jones , Sujha Subramanian","doi":"10.1016/j.evalprogplan.2025.102639","DOIUrl":"10.1016/j.evalprogplan.2025.102639","url":null,"abstract":"<div><div>This study assessed resource allocation among registry activities, which may provide insight for efficient collection of high-quality cancer incidence data. We used a multimodal approach and purposively sampled 21 participating population-based cancer registries in the United States to ensure variation across several registries. The registries reported prospective staffing data and retrospective costing data, completing data collection from October 2021 to September 2022, reporting retrospective costing data for July 1, 2020, through June 30, 2021. From lessons learned from prior studies, we engaged participating registries early and throughout the study, ensuring the collection of meaningful, accurate quantitative data, as well as insights not captured quantitatively. Case volume is a major driver of registry costs. (On average, high-volume registries outspend low-volume registries by nearly 3x, annually). Upon examination of registry activities by case volume, we found that the two most resource-intensive registry activities are data acquisition and data processing, which may be addressed by innovations, such as electronic reporting and automation. Innovative data transfer and processing approaches could increase timeliness of data collection and reduce the labor resources required to process manually collected data. Registries adopting these innovations might achieve cost savings, which could make resources available to support other registry activities.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102639"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144502703","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-07-01DOI: 10.1016/j.evalprogplan.2025.102647
Bhanu Sharma , Jackie Robinson , Benjamin B. Arhen , Brian W. Timmons , Bryan Heal , Marika Warner
Background
Sport-for-development (SFD) is an innovative approach utilizing sport to foster positive physical, mental, and social outcomes among children and youth, particularly those from underserved backgrounds. Living labs, which emphasize participant-centered research conducted in natural, real-world environments, present unique challenges for outcome measurement, including reduced control over conditions, variability in participant engagement, and logistical issues that complicate standardized data collection. Further, there are few outcome measures that are developed for SFD measurement in living lab settings. For these reasons, outcome measurement in a living lab setting remains challenging.
Objective
Our objective was to evaluate a set of outcome measures that have been administered in a living lab setting to better understand their performance, reliability, and areas for improvement.
Methods
SFD programming was delivered in a living lab setting at a large facility located in an urban center in Toronto, Canada. We evaluated 11, self-reported, Likert-style outcome measures against 8 key metrics used in Classical Test Theory to understand (for example) floor-and-ceiling effects, inter-item correlations, internal consistency, and test-retest reliability. Data were collected from 2019 to 2024 across multiple cohorts aged 6–29 years, involving diverse SFD programs.
Results
Our analysis of 2656 questionnaire completions demonstrated strengths in data collection, including complete response rates with minimal missing data (91 % of outcome measures met missingness thresholds), yet also highlighted issues primarily related to single-item-endorsement and inter-item correlations (with 38 % and 19 % of outcome measures meeting these thresholds, respectively). These insights prompted iterative improvements to the evaluation tools, such as modifying Likert scale response formats to include more response categories (and thereby reducing the impact of binning of responses).
Conclusions
Evaluating our outcome measures provided insight into how they can be improved for administration in a living-lab setting. The results emphasize the need for context-appropriate tools to effectively capture nuanced SFD program impacts and underscore the importance of ongoing validation to improve both research quality and practical implementation in living lab environments.
{"title":"Evaluating sport-for-development outcome measures used in a living lab setting: Process, improvements, and insights","authors":"Bhanu Sharma , Jackie Robinson , Benjamin B. Arhen , Brian W. Timmons , Bryan Heal , Marika Warner","doi":"10.1016/j.evalprogplan.2025.102647","DOIUrl":"10.1016/j.evalprogplan.2025.102647","url":null,"abstract":"<div><h3>Background</h3><div>Sport-for-development (SFD) is an innovative approach utilizing sport to foster positive physical, mental, and social outcomes among children and youth, particularly those from underserved backgrounds. Living labs, which emphasize participant-centered research conducted in natural, real-world environments, present unique challenges for outcome measurement, including reduced control over conditions, variability in participant engagement, and logistical issues that complicate standardized data collection. Further, there are few outcome measures that are developed for SFD measurement in living lab settings. For these reasons, outcome measurement in a living lab setting remains challenging.</div></div><div><h3>Objective</h3><div>Our objective was to evaluate a set of outcome measures that have been administered in a living lab setting to better understand their performance, reliability, and areas for improvement.</div></div><div><h3>Methods</h3><div>SFD programming was delivered in a living lab setting at a large facility located in an urban center in Toronto, Canada. We evaluated 11, self-reported, Likert-style outcome measures against 8 key metrics used in Classical Test Theory to understand (for example) floor-and-ceiling effects, inter-item correlations, internal consistency, and test-retest reliability. Data were collected from 2019 to 2024 across multiple cohorts aged 6–29 years, involving diverse SFD programs.</div></div><div><h3>Results</h3><div>Our analysis of 2656 questionnaire completions demonstrated strengths in data collection, including complete response rates with minimal missing data (91 % of outcome measures met missingness thresholds), yet also highlighted issues primarily related to single-item-endorsement and inter-item correlations (with 38 % and 19 % of outcome measures meeting these thresholds, respectively). These insights prompted iterative improvements to the evaluation tools, such as modifying Likert scale response formats to include more response categories (and thereby reducing the impact of binning of responses).</div></div><div><h3>Conclusions</h3><div>Evaluating our outcome measures provided insight into how they can be improved for administration in a living-lab setting. The results emphasize the need for context-appropriate tools to effectively capture nuanced SFD program impacts and underscore the importance of ongoing validation to improve both research quality and practical implementation in living lab environments.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102647"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144571576","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-07-11DOI: 10.1016/j.evalprogplan.2025.102651
Hafiz Waqar Abbas , Neelum Khalid , Razia Anjum , Rashed Nawaz , Zhongliang Zhou , Shaoqing Gong
Background
One of the key lessons emerging from the COVID-19 pandemic is the necessity of assessing and strengthening the operational capacity of COVID-19 vaccination clinics (CVCs) to ensure effective response and service delivery during current and future pandemics. Countries with more robust and resilient CVC infrastructure were better equipped to manage mass vaccination efforts compared to those with constrained capacities. This study focuses on Pakistan, a lower-middle-income country, where mass vaccination campaigns across five regions encountered substantial operational challenges due to limited CVC capacity. Therefore, the main objective of this study is to develop a decision support framework and identify CVCs critical capacity factor criteria for regional risk ranking. Secondly, to analyse the negative impact of one most critical factor's weight change on other factors in each capacity domain and the ranking of five different regions under the uncertainty of the COVID-19 pandemic.
Methods
CVC's capacity domains and associated risk factors are identified from the literature, and a decision support framework is constructed based on the consensus of expert opinion through the Delphi technique. Further, secondary data is extracted from Pakistan’s national COVID-19 vaccination database. Overall, CVC's capacity risk evaluation process is comprised of the entropy weight method, grey rational analysis (GRA), and the new weight change method. The Shannon entropy weight method was used to determine the criteria weight. The GRA was based on the grey system theory. It was adopted for regional risk ranking and the sequential process. The new weight change method was selected for the sensitivity analysis.
Results
The study identified nine critical factor criteria for evaluating CVCs capacity: Operational status, Monitoring of CVCs, Standee/charts providing basic COVID-19 information, Availability of smart devices for data entry and reporting, Minimum number (0–50) of vaccinations per shift, Staff trained in cold chain management, Vaccine administration checklist, Staff trained to identify Adverse Events Following Immunization (AEFI), and Display of Healthcare Waste Management (HCWM) guidelines. The regional risk ranking revealed that Sindh and Khyber Pakhtunkhwa (KPK) were categorized as high-risk regions, while Baluchistan was assessed as moderate risk. In contrast, Punjab and other composite regional areas exhibited low risk, indicating relatively stronger preparedness and operational performance.
Conclusions
This research provides a comprehensive CVC capacity risk assessment. Findings from this research may provide key information that can be helpful in countries where health systems are facing severe CVC capacity constraints.
{"title":"Exploring the critical risk factors in COVID-19 vaccination clinics aimed uncertainty: Insight from Pakistan","authors":"Hafiz Waqar Abbas , Neelum Khalid , Razia Anjum , Rashed Nawaz , Zhongliang Zhou , Shaoqing Gong","doi":"10.1016/j.evalprogplan.2025.102651","DOIUrl":"10.1016/j.evalprogplan.2025.102651","url":null,"abstract":"<div><h3>Background</h3><div>One of the key lessons emerging from the COVID-19 pandemic is the necessity of assessing and strengthening the operational capacity of COVID-19 vaccination clinics (CVCs) to ensure effective response and service delivery during current and future pandemics. Countries with more robust and resilient CVC infrastructure were better equipped to manage mass vaccination efforts compared to those with constrained capacities. This study focuses on Pakistan, a lower-middle-income country, where mass vaccination campaigns across five regions encountered substantial operational challenges due to limited CVC capacity. Therefore, the main objective of this study is to develop a decision support framework and identify CVCs critical capacity factor criteria for regional risk ranking. Secondly, to analyse the negative impact of one most critical factor's weight change on other factors in each capacity domain and the ranking of five different regions under the uncertainty of the COVID-19 pandemic.</div></div><div><h3>Methods</h3><div>CVC's capacity domains and associated risk factors are identified from the literature, and a decision support framework is constructed based on the consensus of expert opinion through the Delphi technique. Further, secondary data is extracted from Pakistan’s national COVID-19 vaccination database. Overall, CVC's capacity risk evaluation process is comprised of the entropy weight method, grey rational analysis (GRA), and the new weight change method. The Shannon entropy weight method was used to determine the criteria weight. The GRA was based on the grey system theory. It was adopted for regional risk ranking and the sequential process. The new weight change method was selected for the sensitivity analysis.</div></div><div><h3>Results</h3><div>The study identified nine critical factor criteria for evaluating CVCs capacity: Operational status, Monitoring of CVCs, Standee/charts providing basic COVID-19 information, Availability of smart devices for data entry and reporting, Minimum number (0–50) of vaccinations per shift, Staff trained in cold chain management, Vaccine administration checklist, Staff trained to identify Adverse Events Following Immunization (AEFI), and Display of Healthcare Waste Management (HCWM) guidelines. The regional risk ranking revealed that Sindh and Khyber Pakhtunkhwa (KPK) were categorized as high-risk regions, while Baluchistan was assessed as moderate risk. In contrast, Punjab and other composite regional areas exhibited low risk, indicating relatively stronger preparedness and operational performance.</div></div><div><h3>Conclusions</h3><div>This research provides a comprehensive CVC capacity risk assessment. Findings from this research may provide key information that can be helpful in countries where health systems are facing severe CVC capacity constraints.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102651"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144633330","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-06-03DOI: 10.1016/j.evalprogplan.2025.102614
Emily Deans , George Economidis , Peter Gates , Andrea Zocco , Robert Stirling , Sally Nathan , Suzie Hudson , Sara Farnbach
Introduction
The non-profit sector contributes significantly to preventing and reducing harm from alcohol and other drugs (AOD). However, it can experience challenges when demonstrating impact via feasible and rigorous evaluation.
Methods
We conducted a scoping review to identify characteristics of, and barriers/enablers to, evaluations completed in non-profit AOD services, and to ascertain the degree of collaboration between researchers and service providers during three evaluation phases (preparatory, conduct; and dissemination and implementation). We searched EMBASE and Medline from inception to February 2023 for evaluations completed in small to medium non-profit AOD services. Screening and extraction were completed by three reviewers independently, and 80 % were checked by an additional reviewer.
Results
Ultimately, 56 records were included in this study. Included evaluations were largely initiated by researchers, with limited input from service providers in setting the agenda for the evaluations (preparatory phase) or translating findings into practice (dissemination and implementation phase). Where collaborations between researchers and service providers were in place, they generated funding and strong engagement with participants, leading to better recruitment, more complete data collection, and enhanced evaluation outcomes.
Conclusion
The review raises important implications for researchers and service providers to prioritise meaningful collaboration and innovation to inform appropriate selection of evaluation topics and designs. Specifically, such evaluations should generate knowledge which can be translated into practice, demonstrating the impact of services and programs and an evidence base built in the non-profit sector.
{"title":"A scoping review of program evaluations in non-profit alcohol and other drugs service settings: Considerations for service and research partnerships","authors":"Emily Deans , George Economidis , Peter Gates , Andrea Zocco , Robert Stirling , Sally Nathan , Suzie Hudson , Sara Farnbach","doi":"10.1016/j.evalprogplan.2025.102614","DOIUrl":"10.1016/j.evalprogplan.2025.102614","url":null,"abstract":"<div><h3>Introduction</h3><div>The non-profit sector contributes significantly to preventing and reducing harm from alcohol and other drugs (AOD). However, it can experience challenges when demonstrating impact via feasible and rigorous evaluation.</div></div><div><h3>Methods</h3><div>We conducted a scoping review to identify characteristics of, and barriers/enablers to, evaluations completed in non-profit AOD services, and to ascertain the degree of collaboration between researchers and service providers during three evaluation phases (preparatory, conduct; and dissemination and implementation). We searched EMBASE and Medline from inception to February 2023 for evaluations completed in small to medium non-profit AOD services. Screening and extraction were completed by three reviewers independently, and 80 % were checked by an additional reviewer.</div></div><div><h3>Results</h3><div>Ultimately, 56 records were included in this study. Included evaluations were largely initiated by researchers, with limited input from service providers in setting the agenda for the evaluations (preparatory phase) or translating findings into practice (dissemination and implementation phase). Where collaborations between researchers and service providers were in place, they generated funding and strong engagement with participants, leading to better recruitment, more complete data collection, and enhanced evaluation outcomes.</div></div><div><h3>Conclusion</h3><div>The review raises important implications for researchers and service providers to prioritise meaningful collaboration and innovation to inform appropriate selection of evaluation topics and designs. Specifically, such evaluations should generate knowledge which can be translated into practice, demonstrating the impact of services and programs and an evidence base built in the non-profit sector.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102614"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144270663","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-06-20DOI: 10.1016/j.evalprogplan.2025.102640
Van Hoye , Stacey Johnson , Florence Rostan , Fabienne Lemonnier , Benjamin Tezier , Susanna Geidne , Alex Donaldson , Anne Vuillemin
Developing and implementing health promotion interventions in sports clubs is challenging. Implementing interventions in real world settings should be specific to a sports club’s context, particularly their voluntary nature. The present study maps and analyzes the development of the PROSCeSS intervention, designed to support sports clubs to implement health promotion. A case study design mobilising Intervention Mapping — needs assessment, matrix of change, theory of action, program design, plan for adoption and implementation and evaluation — describes the multi-phase intervention. Results encompass the main findings from i) a literature review and a concept mapping study as a needs assessment; ii) a Delphi study and health promoting sports club intervention framework to design the matrix of change; iii) a case study among sports clubs and sports federations to select the theory of action; iv) the intervention co-construction to create the program; v) results from a pilot study to validate the plan for adoption; and vi) implementation and presentation of the e-PROSCeSS questionnaire creation and hybrid type-3 protocol as an evaluation method. The discussion explores the tensions created between evidence driven strategies and the habits of sports clubs, the use of top-down versus bottom-up approaches and reflections on the recursive rather than linear process adopted by the authors.
{"title":"Development of a health promoting sports clubs intervention: An intervention mapping process analysis","authors":"Van Hoye , Stacey Johnson , Florence Rostan , Fabienne Lemonnier , Benjamin Tezier , Susanna Geidne , Alex Donaldson , Anne Vuillemin","doi":"10.1016/j.evalprogplan.2025.102640","DOIUrl":"10.1016/j.evalprogplan.2025.102640","url":null,"abstract":"<div><div>Developing and implementing health promotion interventions in sports clubs is challenging. Implementing interventions in real world settings should be specific to a sports club’s context, particularly their voluntary nature. The present study maps and analyzes the development of the PROSCeSS intervention, designed to support sports clubs to implement health promotion. A case study design mobilising Intervention Mapping — needs assessment, matrix of change, theory of action, program design, plan for adoption and implementation and evaluation — describes the multi-phase intervention. Results encompass the main findings from i) a literature review and a concept mapping study as a needs assessment; ii) a Delphi study and health promoting sports club intervention framework to design the matrix of change; iii) a case study among sports clubs and sports federations to select the theory of action; iv) the intervention co-construction to create the program; v) results from a pilot study to validate the plan for adoption; and vi) implementation and presentation of the e-PROSCeSS questionnaire creation and hybrid type-3 protocol as an evaluation method. The discussion explores the tensions created between evidence driven strategies and the habits of sports clubs, the use of top-down versus bottom-up approaches and reflections on the recursive rather than linear process adopted by the authors.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102640"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144502702","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-06-28DOI: 10.1016/j.evalprogplan.2025.102645
Catherine Walker O’Neal , Mallory Lucier-Greer , Evin W. Richardson , Haley E. Miranda , Allan Tate , Brian K. McKay
Federal policy mandates that United States military members receive numerous financial trainings across their career to improve their financial literacy and equip them to make informed financial decisions that, ultimately, promote positive individual and family well-being. Connected to this mandate, systematic evaluation efforts of the Department of the Air Force’s Personal Financial Readiness program were initiated to identify program outcomes and downstream results while simultaneously informing program improvements and modifications. When situated in a discussion of evaluation theory and design practices, documenting these outcome and process evaluation protocols can provide valuable insight for scientist-practitioners designing multi-site program evaluations in the context of real-world constraints, as is often the case for large institutions, including the military. The evaluation design includes a prospective cohort design for the outcome evaluation with surveys completed before and after training and 3- and 6-months following training. The surveys provide data on short-, mid-, and long-term outcomes. Data collected for the process evaluation, include targeted surveys and interviews with individuals conducting and participating in the training. Together, this protocol illustrates a theory-informed evaluation design of a complex, multi-site set of trainings utilizing diverse data collection methods to conduct a rigorous outcome and process evaluation.
{"title":"Protocol for the pragmatic evaluation of the Department of the Air Force’s Personal Financial Readiness Program","authors":"Catherine Walker O’Neal , Mallory Lucier-Greer , Evin W. Richardson , Haley E. Miranda , Allan Tate , Brian K. McKay","doi":"10.1016/j.evalprogplan.2025.102645","DOIUrl":"10.1016/j.evalprogplan.2025.102645","url":null,"abstract":"<div><div>Federal policy mandates that United States military members receive numerous financial trainings across their career to improve their financial literacy and equip them to make informed financial decisions that, ultimately, promote positive individual and family well-being. Connected to this mandate, systematic evaluation efforts of the Department of the Air Force’s Personal Financial Readiness program were initiated to identify program outcomes and downstream results while simultaneously informing program improvements and modifications. When situated in a discussion of evaluation theory and design practices, documenting these outcome and process evaluation protocols can provide valuable insight for scientist-practitioners designing multi-site program evaluations in the context of real-world constraints, as is often the case for large institutions, including the military. The evaluation design includes a prospective cohort design for the <em>outcome</em> evaluation with surveys completed before and after training and 3- and 6-months following training. The surveys provide data on short-, mid-, and long-term outcomes. Data collected for the <em>process</em> evaluation, include targeted surveys and interviews with individuals conducting and participating in the training. Together, this protocol illustrates a theory-informed evaluation design of a complex, multi-site set of trainings utilizing diverse data collection methods to conduct a rigorous outcome and process evaluation.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102645"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144535974","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
扫码关注我们
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号