Pub Date : 2022-03-28DOI: 10.3138/cjpe.36.3.ann-en
Roots and Relations
Announcement from Roots and Relations:Celebrating Good Medicine in Indigenous Evaluation
“根与关系:在土著评价中庆祝好药”的公告
{"title":"Announcement from Roots and Relations: Celebrating Good Medicine in Indigenous Evaluation","authors":"Roots and Relations","doi":"10.3138/cjpe.36.3.ann-en","DOIUrl":"https://doi.org/10.3138/cjpe.36.3.ann-en","url":null,"abstract":"Announcement from Roots and Relations:Celebrating Good Medicine in Indigenous Evaluation","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46270928","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Blen M. Biru, Andrea Taylor, Sowmya Rajan, Kathryn Crissman, O. Ogbuoji, Fernando Fernholz, Siddharth Dixit, Mina Shahid, Pratik A Doshi, A. Finnegan, K. Udayakumar, J. Baumgartner
Th is article describes the integrated, mixed methods (MM) design used to evaluate the Saving Lives at Birth (SL@B) program. SL@B is a multi-stakeholder, donor-supported global health initiative to tackle maternal and neonatal mortality via innovation. Since SL@B’s launch in 2011, the program has supported 116 innovationsthrough 147 awards around the globe. The evaluation for this large and complex program included a largely retrospective MM design aligned with principles of evaluating complexity. This paper highlights these MM evaluation strategies and integration dimensions employed to complete the SL@B evaluation that could inform future evaluations of portfolio-level global health programs.
{"title":"Integrating Data to Evaluate a Global Health Grand Challenge","authors":"Blen M. Biru, Andrea Taylor, Sowmya Rajan, Kathryn Crissman, O. Ogbuoji, Fernando Fernholz, Siddharth Dixit, Mina Shahid, Pratik A Doshi, A. Finnegan, K. Udayakumar, J. Baumgartner","doi":"10.3138/cjpe.71259","DOIUrl":"https://doi.org/10.3138/cjpe.71259","url":null,"abstract":"Th is article describes the integrated, mixed methods (MM) design used to evaluate the Saving Lives at Birth (SL@B) program. SL@B is a multi-stakeholder, donor-supported global health initiative to tackle maternal and neonatal mortality via innovation. Since SL@B’s launch in 2011, the program has supported 116 innovationsthrough 147 awards around the globe. The evaluation for this large and complex program included a largely retrospective MM design aligned with principles of evaluating complexity. This paper highlights these MM evaluation strategies and integration dimensions employed to complete the SL@B evaluation that could inform future evaluations of portfolio-level global health programs.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":"1 1","pages":""},"PeriodicalIF":0.8,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41390455","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Why a Focus on Integration and Complex Mixed Methods Evaluation Designs? : Introducing this Special Issue of the Canadian Journal of Program Evaluation","authors":"C. Poth, Michelle Searle","doi":"10.3138/cjpe.73683","DOIUrl":"https://doi.org/10.3138/cjpe.73683","url":null,"abstract":"Introductory Editorial","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45739282","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This article considers the opportunities and challenges of mixed methods integration within the context of conducting developmental evaluations with diverse stakeholders. The article proposes a four-part planning framework that explicitly maps the eight principles of developmental evaluation to key questions about integration: Why integrate? What will be integrated? When and how will integrationoccur? Th e framework is used to explore and compare two large-scale evaluations that employed mixed methods integration. Ultimately, the work illustrates a need to balance data collection with the momentum of moving initiatives forward, check assumptions about stakeholder co-creation, and cultivate integration literacy.
{"title":"Framework to Combine Mixed Methods Integration and Developmental Evaluation to Study Complex Systems","authors":"Stephen MacGregor, Amanda Cooper","doi":"10.3138/cjpe.71488","DOIUrl":"https://doi.org/10.3138/cjpe.71488","url":null,"abstract":"This article considers the opportunities and challenges of mixed methods integration within the context of conducting developmental evaluations with diverse stakeholders. The article proposes a four-part planning framework that explicitly maps the eight principles of developmental evaluation to key questions about integration: Why integrate? What will be integrated? When and how will integrationoccur? Th e framework is used to explore and compare two large-scale evaluations that employed mixed methods integration. Ultimately, the work illustrates a need to balance data collection with the momentum of moving initiatives forward, check assumptions about stakeholder co-creation, and cultivate integration literacy.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42802353","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
R. Gokiert, Cheryl Poth, B. Kingsley, Btissam El Hassar, Teresa Mejia
For this special issue, our article provides an illustrative example of data integration in a complex mixed methods design. It advances three mixed insights about the evaluation capacity needs of the early childhood field generated by using a mixed methods community-based participatory research (MMCBPR) design. We integrated quantitative findings from an evaluation capacity needs assessment toolwith qualitative themes from community consultations. Findings highlight the pressingneed for practices aimed at enhancing individual capacity through skills-based training, shifting organizational learning culture through resource investment, and cultivating interdependencies between organizational evaluation culture and individual evaluation capacity through engagement and collaborations.
{"title":"Responding to the Evaluation Capacity Needs of the Early Childhood Field: Insights from a Mixed Methods Community-based Participatory Design","authors":"R. Gokiert, Cheryl Poth, B. Kingsley, Btissam El Hassar, Teresa Mejia","doi":"10.3138/cjpe.70920","DOIUrl":"https://doi.org/10.3138/cjpe.70920","url":null,"abstract":"For this special issue, our article provides an illustrative example of data integration in a complex mixed methods design. It advances three mixed insights about the evaluation capacity needs of the early childhood field generated by using a mixed methods community-based participatory research (MMCBPR) design. We integrated quantitative findings from an evaluation capacity needs assessment toolwith qualitative themes from community consultations. Findings highlight the pressingneed for practices aimed at enhancing individual capacity through skills-based training, shifting organizational learning culture through resource investment, and cultivating interdependencies between organizational evaluation culture and individual evaluation capacity through engagement and collaborations.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41513444","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Michelle Searle, Lori C. Kirkpatrick, Chantal Labonté, R. Smyth, Matthew Drabenstott
Th is practice note describes the benefits of integrating mixed methods in a collaborative approach to evaluation with school districts and community partners in southwestern Ontario. We discuss the ways in which the integration ofqualitative and quantitative data generated a multi-faceted perspective about a newmental health professional role as a complex educational phenomenon. The insightsrelated to recognizing the role of context, supporting the use of mixed methods withstakeholders, and responding to evolving needs related to youth mental health and well-being in schools highlight the practical value of using mixed methods in a collaborative approach to evaluation.
{"title":"Learning and Leading: Integrating Mixed Methods in a Collaborative Approach to Educational Evaluation","authors":"Michelle Searle, Lori C. Kirkpatrick, Chantal Labonté, R. Smyth, Matthew Drabenstott","doi":"10.3138/cjpe.71482","DOIUrl":"https://doi.org/10.3138/cjpe.71482","url":null,"abstract":"Th is practice note describes the benefits of integrating mixed methods in a collaborative approach to evaluation with school districts and community partners in southwestern Ontario. We discuss the ways in which the integration ofqualitative and quantitative data generated a multi-faceted perspective about a newmental health professional role as a complex educational phenomenon. The insightsrelated to recognizing the role of context, supporting the use of mixed methods withstakeholders, and responding to evolving needs related to youth mental health and well-being in schools highlight the practical value of using mixed methods in a collaborative approach to evaluation.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47870559","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Integrating Analyses in Mixed Methods Research by Pat Bazeley","authors":"Navida Bachan, C. Poth","doi":"10.3138/cjpe.73685","DOIUrl":"https://doi.org/10.3138/cjpe.73685","url":null,"abstract":"","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47862286","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Given increasingly complex societal issues such as global aging, evaluators must develop essential competencies responding to the messiness of reality. This practice note advances an argument for the inclusion of service learning as a formof experiential learning that engages learners in hands-on practice with guided reflection, and shares a competency-based mixed methods (MM) tool for generating learning evidence in a course-based service-learning model. I aligned key design elements with pedagogical approaches with evaluation competencies. Competency basedguidance is critical to ensure effective assessment and quality course delivery. I conclude with lessons learned for integration of MM within program evaluation education.
{"title":"Advancing a Competency-Based Mixed Methods Tool to Assess a Course-Based Service-Learning Model Integrating Real-World Experience","authors":"S. Hou","doi":"10.3138/cjpe.71043","DOIUrl":"https://doi.org/10.3138/cjpe.71043","url":null,"abstract":"Given increasingly complex societal issues such as global aging, evaluators must develop essential competencies responding to the messiness of reality. This practice note advances an argument for the inclusion of service learning as a formof experiential learning that engages learners in hands-on practice with guided reflection, and shares a competency-based mixed methods (MM) tool for generating learning evidence in a course-based service-learning model. I aligned key design elements with pedagogical approaches with evaluation competencies. Competency basedguidance is critical to ensure effective assessment and quality course delivery. I conclude with lessons learned for integration of MM within program evaluation education.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47985838","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Closing Commentary: The Contributions of Innovations in Integration in Complex Mixed Methods Evaluation Designs in This Issue and Beyond","authors":"T. Guetterman","doi":"10.3138/cjpe.73687","DOIUrl":"https://doi.org/10.3138/cjpe.73687","url":null,"abstract":"Closing Commentary","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44578808","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pamela Musoke, A. Papadimitriou, Peggy Shannon-Baker, C. Tajima
Massive open online courses (MOOCs) are gaining popularity, yet they are rarely evaluated using mixed methods that consider the complexity of participants’ demographics, geographic spread, and MOOC design and curricula. In this article, we critically refl ect on evaluating the Mixed Methods International Research Association (MMIRA) MOOC. A literature review on MOOCs and how they are evaluated is presented along with a logic model. Aft er a description of the MMIRA MOOC and the multi-phase mixed methods evaluation design, the logic model is used to refl ect on conducting a mixed methods evaluation. We conclude with the challenges experienced when evaluating amidst a MOOC’s complexities.
{"title":"Developing a Comprehensive Mixed Methods Evaluation to Address Contextual Complexities of a MOOC","authors":"Pamela Musoke, A. Papadimitriou, Peggy Shannon-Baker, C. Tajima","doi":"10.3138/cjpe.71203","DOIUrl":"https://doi.org/10.3138/cjpe.71203","url":null,"abstract":"Massive open online courses (MOOCs) are gaining popularity, yet they are rarely evaluated using mixed methods that consider the complexity of participants’ demographics, geographic spread, and MOOC design and curricula. In this article, we critically refl ect on evaluating the Mixed Methods International Research Association (MMIRA) MOOC. A literature review on MOOCs and how they are evaluated is presented along with a logic model. Aft er a description of the MMIRA MOOC and the multi-phase mixed methods evaluation design, the logic model is used to refl ect on conducting a mixed methods evaluation. We conclude with the challenges experienced when evaluating amidst a MOOC’s complexities.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48295422","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：