Paisley Worthington, Cheryl Mak, M. Holden, Michelle Searle
In this practice note, the authors discuss techniques they used to bring the collaborative approaches to evaluation (CAE) principles to life in a virtual setting. Following their CAE evaluation of an extracurricular post-secondary program, the authors examined artifacts of their work using CAE as a deductive framework. Their analysis highlighted numerous strategies to enact the CAE principles and the importance of modern technologies to facilitate crucial evaluation processes in a virtual setting. The authors conclude by discussing four recurring practices that aligned with the CAE principles and sharing technologies they used to enhance evaluation activities with clients, stakeholders, and each other.
{"title":"Behind the Virtual Curtain: Techniques to Bring the CAE Principles to Life","authors":"Paisley Worthington, Cheryl Mak, M. Holden, Michelle Searle","doi":"10.3138/cjpe.75786","DOIUrl":"https://doi.org/10.3138/cjpe.75786","url":null,"abstract":"In this practice note, the authors discuss techniques they used to bring the collaborative approaches to evaluation (CAE) principles to life in a virtual setting. Following their CAE evaluation of an extracurricular post-secondary program, the authors examined artifacts of their work using CAE as a deductive framework. Their analysis highlighted numerous strategies to enact the CAE principles and the importance of modern technologies to facilitate crucial evaluation processes in a virtual setting. The authors conclude by discussing four recurring practices that aligned with the CAE principles and sharing technologies they used to enhance evaluation activities with clients, stakeholders, and each other.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48536908","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Editor’s Remarks","authors":"Jill Anne Chouinard","doi":"10.3138/cjpe.38.1.ed-en","DOIUrl":"https://doi.org/10.3138/cjpe.38.1.ed-en","url":null,"abstract":"","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":"61 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136350963","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
John Mayne brought the results orientation and thinking from evaluation to performance audit. During his time at the Office of the Auditor General of Canada he developed frameworks and applications for a federal government environment, the details of which are discussed in this article. His time at the OAG was highly productive for John personally, for the Office, and the public service.
{"title":"John Mayne’s Contribution to Performance Audit","authors":"M. Barrados","doi":"10.3138/cjpe.75467","DOIUrl":"https://doi.org/10.3138/cjpe.75467","url":null,"abstract":"John Mayne brought the results orientation and thinking from evaluation to performance audit. During his time at the Office of the Auditor General of Canada he developed frameworks and applications for a federal government environment, the details of which are discussed in this article. His time at the OAG was highly productive for John personally, for the Office, and the public service.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43386223","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
We discuss how explicit thinking about a variety of causal pathways, informed by a dynamic systems lens that is responsible for exacerbating and diminishing inequities as well as different types of complexities (related to program pathways), will further help develop theory-driven evaluation approaches such as Contribution Analysis. We argue that contribution claims associated with interventions focused on addressing inequities need to consider the multiple types of causal pathways by which a program can help reduce inequities.
{"title":"Causality and Complexity in Evaluating Equity Interventions: Conceptual Issues That Need to Be Addressed in Theory-Driven Evaluation Approaches","authors":"Sanjeev Sridharan, April Nakaima, A. Pereira","doi":"10.3138/cjpe.75430","DOIUrl":"https://doi.org/10.3138/cjpe.75430","url":null,"abstract":"We discuss how explicit thinking about a variety of causal pathways, informed by a dynamic systems lens that is responsible for exacerbating and diminishing inequities as well as different types of complexities (related to program pathways), will further help develop theory-driven evaluation approaches such as Contribution Analysis. We argue that contribution claims associated with interventions focused on addressing inequities need to consider the multiple types of causal pathways by which a program can help reduce inequities.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41987012","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
John Mayne maintained that an evaluative culture is essential for results-based management to be integrated and be of significance. He described conditions and actions necessary for such a culture. This article presents Mayne’s ideas and the experience of evaluators employing Mayne’s suggestions in their attempt to build an evaluative culture. The conclusion drawn is that more of our evaluation approaches and practices should connect to, or contribute to, an evaluative culture within organizations.
{"title":"Building Evaluation Culture—The Missing Link","authors":"K. Chaytor","doi":"10.3138/cjpe.75431","DOIUrl":"https://doi.org/10.3138/cjpe.75431","url":null,"abstract":"John Mayne maintained that an evaluative culture is essential for results-based management to be integrated and be of significance. He described conditions and actions necessary for such a culture. This article presents Mayne’s ideas and the experience of evaluators employing Mayne’s suggestions in their attempt to build an evaluative culture. The conclusion drawn is that more of our evaluation approaches and practices should connect to, or contribute to, an evaluative culture within organizations.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48228095","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
In this concluding article, we take stock of the diverse and stimulating contributions comprising this special issue. Using concept mapping, we identify eight evaluation themes and concepts central to John Mayne’s collective work: evaluation utilization, results-based management, organizational learning, accountability, evaluation culture, contribution analysis, theory-based evaluation, and causation. The overarching contribution story is that John’s work served to bridge the gaps between evaluation practice and theory; to promote cross-disciplinary synergies across program evaluation, performance auditing, and monitoring; and to translate central themes in evaluation into a cogent system for using evaluative information more sensibly. In so doing, John left a significant institutional and academic legacy in evaluation and in results-based management.
{"title":"Using Evaluative Information Sensibly: The Enduring Contributions of John Mayne","authors":"S. B. Nielsen, S. Lemire, S. Montague","doi":"10.3138/cjpe.75444","DOIUrl":"https://doi.org/10.3138/cjpe.75444","url":null,"abstract":"In this concluding article, we take stock of the diverse and stimulating contributions comprising this special issue. Using concept mapping, we identify eight evaluation themes and concepts central to John Mayne’s collective work: evaluation utilization, results-based management, organizational learning, accountability, evaluation culture, contribution analysis, theory-based evaluation, and causation. The overarching contribution story is that John’s work served to bridge the gaps between evaluation practice and theory; to promote cross-disciplinary synergies across program evaluation, performance auditing, and monitoring; and to translate central themes in evaluation into a cogent system for using evaluative information more sensibly. In so doing, John left a significant institutional and academic legacy in evaluation and in results-based management.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44237449","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Remembering John Mayne—A Practical Thinker and a Thinking Practitioner","authors":"S. B. Nielsen, S. Lemire, S. Montague","doi":"10.3138/cjpe.75515","DOIUrl":"https://doi.org/10.3138/cjpe.75515","url":null,"abstract":"","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44951181","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The late John Mayne’s contribution to evaluation was significant. This article maps his written contributions to evaluation. The authors analyze the number and types of publications produced by John Mayne from 1981 to 2020. They also identify the main themes in his authorship, and how they evolved over time. They further identify his most notable publications and use standard citation metrics to assess his academic impact. Finally, they take stock of his publications record and academic impact and conclude that his contribution to the evaluation community was significant and comparable to other thought leaders in the field of evaluation.
{"title":"Mapping the Contributions of John Mayne: Bridging the Gaps Between Evaluation, Auditing, and Performance Monitoring","authors":"S. B. Nielsen, Stinne Tangsig, S. Lemire","doi":"10.3138/cjpe.75441","DOIUrl":"https://doi.org/10.3138/cjpe.75441","url":null,"abstract":"The late John Mayne’s contribution to evaluation was significant. This article maps his written contributions to evaluation. The authors analyze the number and types of publications produced by John Mayne from 1981 to 2020. They also identify the main themes in his authorship, and how they evolved over time. They further identify his most notable publications and use standard citation metrics to assess his academic impact. Finally, they take stock of his publications record and academic impact and conclude that his contribution to the evaluation community was significant and comparable to other thought leaders in the field of evaluation.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43910938","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This paper focuses on three enduring themes in John Mayne’s work. They are causality; balancing learning and accountability as meta-objectives for evaluations; and program complexity. These themes are all central in his development and elaboration of contribution analysis. Although his work was aimed at practitioners, over time, the sophistication of his approach to evaluation raises challenges for practitioners, particularly given the structure of the evaluation field. The paper concludes with a suggestion to make contribution analysis more accessible, taking advantage of the work done by contributors to the Checklist Project at the University of Western Michigan.
{"title":"Enduring Themes in John Mayne’s Work: Implications for Evaluation Practice","authors":"J. Mcdavid","doi":"10.3138/cjpe.75429","DOIUrl":"https://doi.org/10.3138/cjpe.75429","url":null,"abstract":"This paper focuses on three enduring themes in John Mayne’s work. They are causality; balancing learning and accountability as meta-objectives for evaluations; and program complexity. These themes are all central in his development and elaboration of contribution analysis. Although his work was aimed at practitioners, over time, the sophistication of his approach to evaluation raises challenges for practitioners, particularly given the structure of the evaluation field. The paper concludes with a suggestion to make contribution analysis more accessible, taking advantage of the work done by contributors to the Checklist Project at the University of Western Michigan.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47470331","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This paper provides a thematic review of Mayne’s contributions to Canadian federal evaluation in order to describe his influence on how the function has evolved over the past 40 years. Key themes explored in the paper include Mayne’s influence on the development of a results-based culture in federal departments and agencies, as well as his conceptual grounding of evaluation activities through theory-based evaluation approaches and, most notably, Contribution Analysis. We draw on government publications to link policy directions to Mayne’s work and we provide a prospective view on his continued influence on the function for years to come.
{"title":"Bridging Evaluation Theory and Practice: The Contributions of John Mayne to Canadian Federal Evaluation","authors":"I. Bourgeois, Jane Whynot","doi":"10.3138/cjpe.75457","DOIUrl":"https://doi.org/10.3138/cjpe.75457","url":null,"abstract":"This paper provides a thematic review of Mayne’s contributions to Canadian federal evaluation in order to describe his influence on how the function has evolved over the past 40 years. Key themes explored in the paper include Mayne’s influence on the development of a results-based culture in federal departments and agencies, as well as his conceptual grounding of evaluation activities through theory-based evaluation approaches and, most notably, Contribution Analysis. We draw on government publications to link policy directions to Mayne’s work and we provide a prospective view on his continued influence on the function for years to come.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43471046","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：