This article discusses differences and similarities between (methodological) rules of thumb of contribution analysis, realist evaluation, and the policy-scientific approach to (program) evaluations. John Mayne’s work and his operating procedures are presented and structured. One of the conclusions is that the three approaches form a ‘family.’ This ‘family’ can substantially contribute to at least six of the 10 “declarations of the Program Theory Manifesto” presented in 2019.
{"title":"John Mayne and Rules of Thumb for Contribution Analysis: A Comparison With Two Related Approaches","authors":"F. Leeuw","doi":"10.3138/cjpe.75448","DOIUrl":"https://doi.org/10.3138/cjpe.75448","url":null,"abstract":"This article discusses differences and similarities between (methodological) rules of thumb of contribution analysis, realist evaluation, and the policy-scientific approach to (program) evaluations. John Mayne’s work and his operating procedures are presented and structured. One of the conclusions is that the three approaches form a ‘family.’ This ‘family’ can substantially contribute to at least six of the 10 “declarations of the Program Theory Manifesto” presented in 2019.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48453306","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
John Mayne was one of the early pioneers of evaluation capacity building in Canada. Based in the newly formed Office of the Comptroller General of Canada (OCG) in the late 70s, John had an opportunity to help shape the practice of evaluation in Canada, instituting many ideas that have withstood the test of time. Equally though, the nature and expectations of the practice of evaluation with the introduction of the new government policy on the evaluation of Programs would resonate in John’s writings throughout his life—a practical bent striving to improve the practice and use of evaluation in organizations.
{"title":"John Mayne and the Origins of Evaluation in the Public Sector in Canada: A Shaping of Both Evaluation and the Evaluator","authors":"R. Lahey","doi":"10.3138/cjpe.75451","DOIUrl":"https://doi.org/10.3138/cjpe.75451","url":null,"abstract":"John Mayne was one of the early pioneers of evaluation capacity building in Canada. Based in the newly formed Office of the Comptroller General of Canada (OCG) in the late 70s, John had an opportunity to help shape the practice of evaluation in Canada, instituting many ideas that have withstood the test of time. Equally though, the nature and expectations of the practice of evaluation with the introduction of the new government policy on the evaluation of Programs would resonate in John’s writings throughout his life—a practical bent striving to improve the practice and use of evaluation in organizations.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49283733","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Front Matter","authors":"","doi":"10.3138/cjpe.37.3.fm","DOIUrl":"https://doi.org/10.3138/cjpe.37.3.fm","url":null,"abstract":"","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":"98 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135185658","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This article is a tribute to John Mayne’s work on Contribution Analysis. It focuses on the causal claims Contribution Analysis aims to address, and on how these have evolved since the approach was first published by John in 1999. It first sets out four types of causality with relevance for Contribution Analysis: counterfactual, generative, INUS, and probabilistic causation. It then describes how John integrated the INUS condition and probabilistic elements into the Contribution Analysis approach, followed by how John’s thinking evolved regarding the question of whether the approach could—and should—also address counterfactual questions. The article concludes with observations on how Contribution Analysis can flexibly integrate elements from different causality types.
{"title":"Causal Claims in Contribution Analysis","authors":"M. Palenberg","doi":"10.3138/cjpe.75428","DOIUrl":"https://doi.org/10.3138/cjpe.75428","url":null,"abstract":"This article is a tribute to John Mayne’s work on Contribution Analysis. It focuses on the causal claims Contribution Analysis aims to address, and on how these have evolved since the approach was first published by John in 1999. It first sets out four types of causality with relevance for Contribution Analysis: counterfactual, generative, INUS, and probabilistic causation. It then describes how John integrated the INUS condition and probabilistic elements into the Contribution Analysis approach, followed by how John’s thinking evolved regarding the question of whether the approach could—and should—also address counterfactual questions. The article concludes with observations on how Contribution Analysis can flexibly integrate elements from different causality types.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45017509","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
John Mayne wrote extensively on results-based management. While his thinking evolved, some key tenets remained. He emphasized the importance of leadership in managing for results. In this article, we elicit his understanding of sound results-based management and the role of leadership. Mayne argued that a salient task for leaders was building and sustaining an evaluative culture, wherein the organization uses and learns from performance information. The authors analyzed his recommendations for leaders and grouped them into four different types of leadership roles. These roles concern setting a results course of expectations, managing operations, managing change, and managing people and systems.
{"title":"John Mayne’s Contribution to Results-Based Management Thinking: A Leadership Legacy","authors":"S. B. Nielsen, S. Montague","doi":"10.3138/cjpe.75432","DOIUrl":"https://doi.org/10.3138/cjpe.75432","url":null,"abstract":"John Mayne wrote extensively on results-based management. While his thinking evolved, some key tenets remained. He emphasized the importance of leadership in managing for results. In this article, we elicit his understanding of sound results-based management and the role of leadership. Mayne argued that a salient task for leaders was building and sustaining an evaluative culture, wherein the organization uses and learns from performance information. The authors analyzed his recommendations for leaders and grouped them into four different types of leadership roles. These roles concern setting a results course of expectations, managing operations, managing change, and managing people and systems.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47228672","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Peer Reviewers for Volume 37 and Manuscripts Submitted in 2022 / Examinateurs des manuscrits du volume 37 et des manuscrits soumis en 2022","authors":"","doi":"10.3138/cjpe.37.3.494","DOIUrl":"https://doi.org/10.3138/cjpe.37.3.494","url":null,"abstract":"","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":"67 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135185670","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"John Creswell and Johanna Creswell Báez. (2020). 30 Essential Skills for the Qualitative Researcher, 2nd edition.","authors":"M. Snow","doi":"10.3138/cjpe.75739","DOIUrl":"https://doi.org/10.3138/cjpe.75739","url":null,"abstract":"","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43966262","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This practice note describes how listening is an essential practice and can be part of honoring relationality and ceremony in Indigenous research and evaluation. Through a research project assessing the quality and availability of culturally attuned services for Native survivors of gender-based violence, the authors describe how they put being a good relative into practice by centering Indigenous values and protocol while utilizing western methodologies. Aligning with the Eastern Door, this note offers insight into the incorporation of Indigenous approaches into how evaluators honored and engaged with the research process.
{"title":"Listening with the Heart: A Reflection on Relationality and Ceremony","authors":"Lauren S. Polansky, Hana Ferronato, J. Herbert","doi":"10.3138/cjpe.74693","DOIUrl":"https://doi.org/10.3138/cjpe.74693","url":null,"abstract":"This practice note describes how listening is an essential practice and can be part of honoring relationality and ceremony in Indigenous research and evaluation. Through a research project assessing the quality and availability of culturally attuned services for Native survivors of gender-based violence, the authors describe how they put being a good relative into practice by centering Indigenous values and protocol while utilizing western methodologies. Aligning with the Eastern Door, this note offers insight into the incorporation of Indigenous approaches into how evaluators honored and engaged with the research process.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43853926","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Systematic evaluation contributes to a strong governance function that leads to improvement and accountability in school systems. Evaluation is integral to the policy development cycle. Elected school board trustees in River City school division were challenged in their governance role by a lack of evaluative feedback on policies. A four-step change process was created to guide the development of an evaluation framework to address the gap and foster an evaluative culture within the board. The change process described could be applied by other school divisions to enhance their policy evaluation function. More broadly, the importance of careful planning and the benefits of a participatory approach to evaluation are integral pieces to any change effort.
{"title":"Fostering an Evaluative Culture by Addressing a Breakdown in the Policy Development Cycle","authors":"Michelle H. Anderson-Draper","doi":"10.3138/cjpe.74582","DOIUrl":"https://doi.org/10.3138/cjpe.74582","url":null,"abstract":"Systematic evaluation contributes to a strong governance function that leads to improvement and accountability in school systems. Evaluation is integral to the policy development cycle. Elected school board trustees in River City school division were challenged in their governance role by a lack of evaluative feedback on policies. A four-step change process was created to guide the development of an evaluation framework to address the gap and foster an evaluative culture within the board. The change process described could be applied by other school divisions to enhance their policy evaluation function. More broadly, the importance of careful planning and the benefits of a participatory approach to evaluation are integral pieces to any change effort.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45109823","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
F. Royer, Jean Bélanger, M. Janosz, Sophie Pascale
Le présent article vise à rendre compte de la procédure de conception ainsi que la validation du questionnaire sur la capacité évaluative des organisations et ses déterminants (QCEOD). 282 répondants issus de deux organisations différentes ont répondu au questionnaire qui, dans sa version définitive, comporte entre 70 et 108 items. Des analyses de consistance interne combinées à des analyses factorielles confirmatoires ont permis de confirmer la validité et la fiabilité du questionnaire. Les limites et les implications de ces résultats pour la recherche et la pratique, notamment en lien avec le renforcement des capacités évaluatives, sont discutées.
{"title":"Validation du questionnaire sur la capacité évaluative des organisations et ses déterminants (QCEOD)","authors":"F. Royer, Jean Bélanger, M. Janosz, Sophie Pascale","doi":"10.3138/cjpe.73451","DOIUrl":"https://doi.org/10.3138/cjpe.73451","url":null,"abstract":"Le présent article vise à rendre compte de la procédure de conception ainsi que la validation du questionnaire sur la capacité évaluative des organisations et ses déterminants (QCEOD). 282 répondants issus de deux organisations différentes ont répondu au questionnaire qui, dans sa version définitive, comporte entre 70 et 108 items. Des analyses de consistance interne combinées à des analyses factorielles confirmatoires ont permis de confirmer la validité et la fiabilité du questionnaire. Les limites et les implications de ces résultats pour la recherche et la pratique, notamment en lien avec le renforcement des capacités évaluatives, sont discutées.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44014534","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：