This paper describes the process that the faculty at the University of Minnesota used to redesign its graduate programs in evaluation. We build from the premise that evaluator education programs undergo periodic review to remain consistent with program goals and maintain alignment with competency taxonomies. With the retirement of a senior faculty member and the addition of a new junior faculty member, we decided the time had come to examine closely the existing MA and PhD curriculum. We describe our process for conceptualizing the program’s ultimate goals, examining course content, cross-referencing the courses with the AEA Competencies, and aligning all courses and processes with our revised programmatic goals. The result is a redesigned and streamlined curriculum to support evaluation practice for master’s students and both scholarship and practice for doctoral students.
{"title":"Redesigning a University-Based Evaluator Education Program for Scholarship and Practice","authors":"John LaVelle, David Johnson","doi":"10.3138/cjpe.71430","DOIUrl":"https://doi.org/10.3138/cjpe.71430","url":null,"abstract":"This paper describes the process that the faculty at the University of Minnesota used to redesign its graduate programs in evaluation. We build from the premise that evaluator education programs undergo periodic review to remain consistent with program goals and maintain alignment with competency taxonomies. With the retirement of a senior faculty member and the addition of a new junior faculty member, we decided the time had come to examine closely the existing MA and PhD curriculum. We describe our process for conceptualizing the program’s ultimate goals, examining course content, cross-referencing the courses with the AEA Competencies, and aligning all courses and processes with our revised programmatic goals. The result is a redesigned and streamlined curriculum to support evaluation practice for master’s students and both scholarship and practice for doctoral students.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2022-04-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47503209","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This narrative review highlights evaluation approaches, principles, and frameworks for chronic disease interventions in North American Indig-enous contexts. It aims to inform the co-development of an evaluation frame-work for two studies focused on improving diabetes and obesity outcomes for urban Indigenous communities. This review uses a Two-Eyed Seeing perspective that brings Indigenous and Western ways of being, knowing, and doing together. There is a paucity of published evaluation frameworks inclusive of both per-spectives. The themes identified here suggest that evaluation approaches should address gender equity issues, be participatory, be grounded in local context, traditions, and knowledge, and be responsive to community-identified needs and solutions.
{"title":"Collaborative Evaluation Frameworks for Indigenous-Led Community Health Interventions: A Scoping Review","authors":"Diana Gresku, Charlotte Jones, Donna Kurtz","doi":"10.3138/cjpe.71349","DOIUrl":"https://doi.org/10.3138/cjpe.71349","url":null,"abstract":"This narrative review highlights evaluation approaches, principles, and frameworks for chronic disease interventions in North American Indig-enous contexts. It aims to inform the co-development of an evaluation frame-work for two studies focused on improving diabetes and obesity outcomes for urban Indigenous communities. This review uses a Two-Eyed Seeing perspective that brings Indigenous and Western ways of being, knowing, and doing together. There is a paucity of published evaluation frameworks inclusive of both per-spectives. The themes identified here suggest that evaluation approaches should address gender equity issues, be participatory, be grounded in local context, traditions, and knowledge, and be responsive to community-identified needs and solutions.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2022-04-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44438321","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This practice note addresses challenges encountered in assessing client equity in the provision of health services by a large, urban community health services organization. A client equity data-collection tool was designed and health servicesstaff were trained in its use. Anticipated and unanticipated challenges arose in developing training materials, delivering staff training, fostering staff buy-in, administering the data-collection tool, assuring data quality, and interpreting results. Strategies for mitigating the challenges are presented.
{"title":"Assessing Equity in the Provision of Community Based Health Services: A Post-Mortem Analysis","authors":"Francesco Sijinardo, Rishika Williams, M. Badsha","doi":"10.3138/cjpe.68284","DOIUrl":"https://doi.org/10.3138/cjpe.68284","url":null,"abstract":"This practice note addresses challenges encountered in assessing client equity in the provision of health services by a large, urban community health services organization. A client equity data-collection tool was designed and health servicesstaff were trained in its use. Anticipated and unanticipated challenges arose in developing training materials, delivering staff training, fostering staff buy-in, administering the data-collection tool, assuring data quality, and interpreting results. Strategies for mitigating the challenges are presented.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2022-04-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44424255","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
T e professionalization of evaluation means dif erent things to dif erent people, and as a result, the f eld lacks a clear understanding of how to empirically assess evaluator professionalism. T is exploratory study used a sociological model to study the behaviours of practicing evaluators in Canada and the United States using f ve concepts: expertise, ethical disposition, professional autonomy, innovation and research, and credentialing. Results from 27 in-depth interviews and a survey of 456 respondents demonstrated that, depending on their demographic characteristics, perceptions of professionalism dif ered between evaluators in the two countries. T e study determined that theory-based sociological models can provide insights into the professionalization of program evaluation.
{"title":"Professionalism in Program Evaluators: A Comparison of American and Canadian Evaluators","authors":"Sandra Ayoo","doi":"10.3138/cjpe.71300","DOIUrl":"https://doi.org/10.3138/cjpe.71300","url":null,"abstract":"T e professionalization of evaluation means dif erent things to dif erent people, and as a result, the f eld lacks a clear understanding of how to empirically assess evaluator professionalism. T is exploratory study used a sociological model to study the behaviours of practicing evaluators in Canada and the United States using f ve concepts: expertise, ethical disposition, professional autonomy, innovation and research, and credentialing. Results from 27 in-depth interviews and a survey of 456 respondents demonstrated that, depending on their demographic characteristics, perceptions of professionalism dif ered between evaluators in the two countries. T e study determined that theory-based sociological models can provide insights into the professionalization of program evaluation.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2022-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44443035","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Research on program evaluation in the context of patient/family engagement is highly limited. Logically, collaborative approaches to evaluation (CAE) align well with patient/family-centred care philosophy and hold great promise in leveraging desired outcomes. In this longitudinal case intervention study, we tracked a one-year collaborative initiative to engage health care providers and patient/family members in program evaluation, specifically improvement-oriented needs assessment activities. This research on CAE was designed to identify facilitators and barriers, describe the experience of non-evaluator stakeholders, and assess the effects of the collaborative approach. The findings illuminate the lived experiences of health care staff and patient/family members working in tandem with an evaluator to jointly produce evidence intended to improve services. We conclude with implications for ongoing research and practice.
{"title":"Examining the Process and Effects of Engaging Patients/Family in Health Service Evaluation: Results from a one-year prospective study","authors":"Nathalie Gilbert, J. Cousins","doi":"10.3138/cjpe.69932","DOIUrl":"https://doi.org/10.3138/cjpe.69932","url":null,"abstract":"Research on program evaluation in the context of patient/family engagement is highly limited. Logically, collaborative approaches to evaluation (CAE) align well with patient/family-centred care philosophy and hold great promise in leveraging desired outcomes. In this longitudinal case intervention study, we tracked a one-year collaborative initiative to engage health care providers and patient/family members in program evaluation, specifically improvement-oriented needs assessment activities. This research on CAE was designed to identify facilitators and barriers, describe the experience of non-evaluator stakeholders, and assess the effects of the collaborative approach. The findings illuminate the lived experiences of health care staff and patient/family members working in tandem with an evaluator to jointly produce evidence intended to improve services. We conclude with implications for ongoing research and practice.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2022-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43628189","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Culturally responsive approaches to evaluation: Empirical implications for theory and practice.","authors":"Sandra Sellick","doi":"10.3138/cjpe.73771","DOIUrl":"https://doi.org/10.3138/cjpe.73771","url":null,"abstract":"Book review","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2022-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45981563","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The involvement of patients, their families, or their representatives is becomingincreasingly common in health-care research. However, theoretical justif cationof patient engagement (PE) and consistent guidance on how to include patients askey stakeholders on research teams are still lacking. Tis paper describes how the Pri-Care group integrates PE into its program’s governance structure and uses a programlogic perspective to engage patients in the planning phases of a research study basedon resources, processes, and relationships, guided by the SPOR-CIHR’s PE framework.Te PriCare approach facilitates the evaluation and continuous improvement of PE.
{"title":"Planning the Evaluation of Patient Engagement in the PriCare Research Program","authors":"A. Danish","doi":"10.3138/cjpe.70805","DOIUrl":"https://doi.org/10.3138/cjpe.70805","url":null,"abstract":"The involvement of patients, their families, or their representatives is becomingincreasingly common in health-care research. However, theoretical justif cationof patient engagement (PE) and consistent guidance on how to include patients askey stakeholders on research teams are still lacking. Tis paper describes how the Pri-Care group integrates PE into its program’s governance structure and uses a programlogic perspective to engage patients in the planning phases of a research study basedon resources, processes, and relationships, guided by the SPOR-CIHR’s PE framework.Te PriCare approach facilitates the evaluation and continuous improvement of PE.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2022-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49321836","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Limited evaluation capacity, power dynamics, and resource constraints act as organizational barriers that inhibit evaluations in higher education contexts. Evaluation capacity promotes evaluation and minimizes the impact of these barriers.Embedding a synergistic combination of qualitative and quantitative methods withinan evaluation and evaluation capacity building (ECB) initiative was our attempt to address these organizational barriers. In this practice note, we illustrate how MM designs catalyze evaluative thinking that promotes evaluation and supports ECB efforts. Our use and integration of MM strategies to build evaluation capacity andinfuse evaluation into organizational culture informs higher education evaluation capacity-building initiatives.
{"title":"Leveraging Mixed Methods Designs for Promoting Evaluation and Evaluation Capacity","authors":"S. Mahato, Krisanna Machtmes, Bradley A. Cohen","doi":"10.3138/cjpe.71288","DOIUrl":"https://doi.org/10.3138/cjpe.71288","url":null,"abstract":"Limited evaluation capacity, power dynamics, and resource constraints act as organizational barriers that inhibit evaluations in higher education contexts. Evaluation capacity promotes evaluation and minimizes the impact of these barriers.Embedding a synergistic combination of qualitative and quantitative methods withinan evaluation and evaluation capacity building (ECB) initiative was our attempt to address these organizational barriers. In this practice note, we illustrate how MM designs catalyze evaluative thinking that promotes evaluation and supports ECB efforts. Our use and integration of MM strategies to build evaluation capacity andinfuse evaluation into organizational culture informs higher education evaluation capacity-building initiatives.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48370658","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Sofia I. Melendez, Katrina Carbone, Michelle Searle
{"title":"The Mixed Methods Research Workbook: Activities for Designing Implementing, and Publishing Projects by Michael Fetters","authors":"Sofia I. Melendez, Katrina Carbone, Michelle Searle","doi":"10.3138/cjpe.73686","DOIUrl":"https://doi.org/10.3138/cjpe.73686","url":null,"abstract":"","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43904785","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-03-28DOI: 10.3138/cjpe.36.3.ann-fr
Nos racines et nos liens
Annonce de la section Nos racines et nos liens :célébrons l’évaluation autochtone
我们的根和联系:庆祝土著评估
{"title":"Annonce de la section Nos racines et nos liens : célébrons l’évaluation autochtone","authors":"Nos racines et nos liens","doi":"10.3138/cjpe.36.3.ann-fr","DOIUrl":"https://doi.org/10.3138/cjpe.36.3.ann-fr","url":null,"abstract":"Annonce de la section Nos racines et nos liens :célébrons l’évaluation autochtone","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42274584","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：