{"title":"Editor's Remarks / Un mot de la rédactrice","authors":"Jill A. Chouinard","doi":"10.3138/cjpe.37.2.ed","DOIUrl":"https://doi.org/10.3138/cjpe.37.2.ed","url":null,"abstract":"","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47796876","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Empowerment Evaluation (EE) aims to teach program stakeholders, including beneficiaries, how to conduct their own evaluations. In this mixed methods research project we sought to investigate and formally document the involvement of youth in EE of programs targeting youth. Phase 1 surveyed evaluators about the extent to which they involve youth in EE. Phase 2 involved interviews with evaluators and explored what factor(s) facilitate and hinder: the involvement of youth in EE of programs targeting youth. The findings show that youth are involved to some extent in EE, and there are factors that can facilitate and hinder the involvement of youth in EE.
{"title":"Involving Youth in Empowerment Evaluation: Evaluators’ Perspectives","authors":"Sarah Heath, K. Moreau","doi":"10.3138/cjpe.73987","DOIUrl":"https://doi.org/10.3138/cjpe.73987","url":null,"abstract":"Empowerment Evaluation (EE) aims to teach program stakeholders, including beneficiaries, how to conduct their own evaluations. In this mixed methods research project we sought to investigate and formally document the involvement of youth in EE of programs targeting youth. Phase 1 surveyed evaluators about the extent to which they involve youth in EE. Phase 2 involved interviews with evaluators and explored what factor(s) facilitate and hinder: the involvement of youth in EE of programs targeting youth. The findings show that youth are involved to some extent in EE, and there are factors that can facilitate and hinder the involvement of youth in EE.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48455300","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Relationships affect outcomes in the international development sector, yet there are few frameworks or indicators to measure trust as a foundation of relationships. This article describes an emergent framework for evaluating trust in crosscultural relationships. It is based on a case study of Caritas Aotearoa New Zealand and its Indigenous partners. Perspectives on monitoring and evaluation (M&E) and measuring trust are explored from an Indigenous world view. Interviews with five people representing all parties suggest various types of behaviours that indicate trust. Through this exploration, culturally competent M&E and the centrality of relationships in expanding evaluation practice are revealed.
{"title":"Making Relationships Count: Measuring Trust in Relationships Between a Catholic Development Agency and Māori Communities","authors":"Gretchen Leuthart, G. Prinsen","doi":"10.3138/cjpe.66908","DOIUrl":"https://doi.org/10.3138/cjpe.66908","url":null,"abstract":"Relationships affect outcomes in the international development sector, yet there are few frameworks or indicators to measure trust as a foundation of relationships. This article describes an emergent framework for evaluating trust in crosscultural relationships. It is based on a case study of Caritas Aotearoa New Zealand and its Indigenous partners. Perspectives on monitoring and evaluation (M&E) and measuring trust are explored from an Indigenous world view. Interviews with five people representing all parties suggest various types of behaviours that indicate trust. Through this exploration, culturally competent M&E and the centrality of relationships in expanding evaluation practice are revealed.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43108446","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Jean M. Breny and Shannon L. McMorrow. (2021). Photovoice for Social Justice: Visual Representation in Action.","authors":"Kenza Bennani","doi":"10.3138/cjpe.75648","DOIUrl":"https://doi.org/10.3138/cjpe.75648","url":null,"abstract":"","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45336186","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
In this practice note, the authors reflect on their experiences evaluating a three-year behavioural health equity initiative that was conducted with eight community coalitions located across the southeastern United States. The main focus of the practice note is on the challenges the authors experienced in their evaluation, most of which were largely outside their control: unpredictable funding cycle, complexity of problem, level of local knowledge, level of data literacy, and collaborative approach not realized. While they acknowledge the complexity of behavioural health equity issues, they conclude with four key implications for practice that they note can help relieve the stress of some of the challenges they experienced.
{"title":"Challenges Evaluating an Equity-Focused Community Coalition Initiative","authors":"Nicole M. Augustine, J. Chouinard","doi":"10.3138/cjpe.70523","DOIUrl":"https://doi.org/10.3138/cjpe.70523","url":null,"abstract":"In this practice note, the authors reflect on their experiences evaluating a three-year behavioural health equity initiative that was conducted with eight community coalitions located across the southeastern United States. The main focus of the practice note is on the challenges the authors experienced in their evaluation, most of which were largely outside their control: unpredictable funding cycle, complexity of problem, level of local knowledge, level of data literacy, and collaborative approach not realized. While they acknowledge the complexity of behavioural health equity issues, they conclude with four key implications for practice that they note can help relieve the stress of some of the challenges they experienced.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48824167","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This study examined the key qualifications—education, knowledge areas, professional qualities, skills, and tasks—demanded of evaluators by employers in the public, private, and not-for-profi t sectors. Through a content analysis of 50 employment advertisements, it found that the qualifications demanded by employers generally align with the skills identified as important in the evaluation literature and with competencies identified by the Canadian Evaluation Society. The study also found that there is an opportunity to promote the Credentialed Evaluator (CE) designation to those interested in enhancing the evaluation capacity of their organizations.
{"title":"The Evaluation Marketplace in Canada: What Qualifications Do Employers Demand?","authors":"Hanna Holman, Dave Guyadeen, Daniel Henstra","doi":"10.3138/cjpe.72343","DOIUrl":"https://doi.org/10.3138/cjpe.72343","url":null,"abstract":"This study examined the key qualifications—education, knowledge areas, professional qualities, skills, and tasks—demanded of evaluators by employers in the public, private, and not-for-profi t sectors. Through a content analysis of 50 employment advertisements, it found that the qualifications demanded by employers generally align with the skills identified as important in the evaluation literature and with competencies identified by the Canadian Evaluation Society. The study also found that there is an opportunity to promote the Credentialed Evaluator (CE) designation to those interested in enhancing the evaluation capacity of their organizations.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43416512","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jessica Renger, R. Renger, Richard N. Van Eck, M. Basson, Jirina Renger
Despite being a common evaluation metric, milestones are poorly defined, and guidance for their use is underdeveloped in the evaluation literature. This practice note attempts to address this oversight by providing evaluation-specific guidance for tracking and reporting milestones. Using a case study, we share our initial approach to tracking and reporting milestones, as well as how critical reflection guided by the evaluation standards provided us with key insights that allowed us to make improvements to our initial process. We hope this practice note acts as a springboard for elevating the critical dialogue surrounding milestones in the evaluation literature.
{"title":"New Insights for Tracking and Reporting Milestones","authors":"Jessica Renger, R. Renger, Richard N. Van Eck, M. Basson, Jirina Renger","doi":"10.3138/cjpe.74487","DOIUrl":"https://doi.org/10.3138/cjpe.74487","url":null,"abstract":"Despite being a common evaluation metric, milestones are poorly defined, and guidance for their use is underdeveloped in the evaluation literature. This practice note attempts to address this oversight by providing evaluation-specific guidance for tracking and reporting milestones. Using a case study, we share our initial approach to tracking and reporting milestones, as well as how critical reflection guided by the evaluation standards provided us with key insights that allowed us to make improvements to our initial process. We hope this practice note acts as a springboard for elevating the critical dialogue surrounding milestones in the evaluation literature.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48354126","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Un mot de la rédactrice","authors":"Jill A. Chouinard","doi":"10.3138/cjpe.37.3.ed-fr","DOIUrl":"https://doi.org/10.3138/cjpe.37.3.ed-fr","url":null,"abstract":"","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2022-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47059079","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Editor’s Remarks","authors":"Jill A. Chouinard","doi":"10.3138/cjpe.37.3.ed-en","DOIUrl":"https://doi.org/10.3138/cjpe.37.3.ed-en","url":null,"abstract":"","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2022-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48976708","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This article proposes a methodological contribution through the combination of realistic evaluation (RE) and the process tracing method (PTM). In order to overcome some limits of RE’s operationalization, the combination RE-PTM reinforces RE by breaking down the causal mechanisms and testing them with the PTM. This combination was being tested on a project for the professional integration of young people in difficulty. Two business representatives, six supervisors, ten trainers, and fifteen beneficiaries participated in interviews and three focus groups. The research results support that the combination of RE-PTM can address some RE operationalizing challenges. The RE-PTM procedure shows that the PTM can provide RE with guidance on how to collect and assess data that support the contribution made by an intervention in achieving outcomes.
{"title":"Realistic Evaluation and the Process Tracing Method: A Combined Approach to Scrutinize Causal Mechanisms","authors":"Salah eddine Bouyousfi, M. Sabar","doi":"10.3138/cjpe.71050","DOIUrl":"https://doi.org/10.3138/cjpe.71050","url":null,"abstract":"This article proposes a methodological contribution through the combination of realistic evaluation (RE) and the process tracing method (PTM). In order to overcome some limits of RE’s operationalization, the combination RE-PTM reinforces RE by breaking down the causal mechanisms and testing them with the PTM. This combination was being tested on a project for the professional integration of young people in difficulty. Two business representatives, six supervisors, ten trainers, and fifteen beneficiaries participated in interviews and three focus groups. The research results support that the combination of RE-PTM can address some RE operationalizing challenges. The RE-PTM procedure shows that the PTM can provide RE with guidance on how to collect and assess data that support the contribution made by an intervention in achieving outcomes.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2022-04-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42166444","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}