The research-to-practice gap describes the well-documented phenomena of researchers and practitioners working in silos, embedded in vastly different contexts. This “cultural divide” has several causes, including ineffective collaboration, inadequate understanding of context, and insufficient dissemination and translation of research. Evaluation theory and practice have been largely absent from discussions about solving the research-to-practice gap, despite remarkable alignment between these efforts and the core principles and goals of evaluation. In this article, we describe why the research-to-practice gap exists, current models and frameworks to address the gap, and how evaluation aligns with, and extends, efforts to create a bi-directional bridge between research and practice. This article is a call-to-action for professional evaluators who are poised to narrow this gap given that they work at the intersection of research and practice. Through authentic collaboration, researchers, practitioners, and evaluators can leverage our collective strength to address the pressing challenges faced by our communities.
{"title":"The Role of Evaluation Theory and Practice in Narrowing the Research-to-Practice Gap","authors":"Tiffany Berry, Brittany Hite, Michelle Sloper, Haley Umans","doi":"10.1177/10982140231213529","DOIUrl":"https://doi.org/10.1177/10982140231213529","url":null,"abstract":"The research-to-practice gap describes the well-documented phenomena of researchers and practitioners working in silos, embedded in vastly different contexts. This “cultural divide” has several causes, including ineffective collaboration, inadequate understanding of context, and insufficient dissemination and translation of research. Evaluation theory and practice have been largely absent from discussions about solving the research-to-practice gap, despite remarkable alignment between these efforts and the core principles and goals of evaluation. In this article, we describe why the research-to-practice gap exists, current models and frameworks to address the gap, and how evaluation aligns with, and extends, efforts to create a bi-directional bridge between research and practice. This article is a call-to-action for professional evaluators who are poised to narrow this gap given that they work at the intersection of research and practice. Through authentic collaboration, researchers, practitioners, and evaluators can leverage our collective strength to address the pressing challenges faced by our communities.","PeriodicalId":51449,"journal":{"name":"American Journal of Evaluation","volume":" 13","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138961674","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-12-19DOI: 10.1177/10982140231213530
Jeremy G. Acree, Tiffany L. S. Tovey, R. Petrulis
In this reflective case, we examine the role and function of collaboration in use-oriented evaluation approaches. Reflecting on our experience evaluating a program that sought to integrate new technologies into K-12 teaching and pre-service teacher education, we found that the desire and pursuit of making evaluation useful can influence why, with whom, and how we choose to collaborate, in turn shaping the substance of our evaluative questions, methods, and findings. We structured our reflections using the Describe, Analyze, Theorize, Act model (Peters, 1991; Smith et al., 2015), a tool for systematically reflecting on evaluation situations and dilemmas to learn and refine future actions. Through this process, we uncovered both conceptual and practical implications regarding the relationship between use-oriented evaluation approaches and collaboration.
{"title":"Reflections on the Intersections Between Collaboration and Use in Evaluation Practice","authors":"Jeremy G. Acree, Tiffany L. S. Tovey, R. Petrulis","doi":"10.1177/10982140231213530","DOIUrl":"https://doi.org/10.1177/10982140231213530","url":null,"abstract":"In this reflective case, we examine the role and function of collaboration in use-oriented evaluation approaches. Reflecting on our experience evaluating a program that sought to integrate new technologies into K-12 teaching and pre-service teacher education, we found that the desire and pursuit of making evaluation useful can influence why, with whom, and how we choose to collaborate, in turn shaping the substance of our evaluative questions, methods, and findings. We structured our reflections using the Describe, Analyze, Theorize, Act model (Peters, 1991; Smith et al., 2015), a tool for systematically reflecting on evaluation situations and dilemmas to learn and refine future actions. Through this process, we uncovered both conceptual and practical implications regarding the relationship between use-oriented evaluation approaches and collaboration.","PeriodicalId":51449,"journal":{"name":"American Journal of Evaluation","volume":"106 15","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138959319","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-12-13DOI: 10.1177/10982140231204847
Emily F. Gates
Recognition of the complexity of the world raises questions about new theories, methods, and capabilities for evaluation practice. Approaches originating in the systems sciences show promise; however, many require specialized expertise and resources. This article explores rich pictures as an accessible, low-resource method for facilitating sensemaking amid complexity. The method involves the free-hand drawing of a situation to richly illustrate what is happening and why using images, lines, and few words. The process and product are akin to elaborate childhood doodles, yet are remarkably powerful conveyors of tacit knowledge and issues, differing perspectives, and action possibilities. Drawing together methodological guidance, sensemaking theory, and an application with STEM higher education faculty, this article shows how rich pictures support sensemaking amid complexity and identifies potential applications and directions for research on the method.
{"title":"Rich Pictures: A Visual Method for Sensemaking Amid Complexity","authors":"Emily F. Gates","doi":"10.1177/10982140231204847","DOIUrl":"https://doi.org/10.1177/10982140231204847","url":null,"abstract":"Recognition of the complexity of the world raises questions about new theories, methods, and capabilities for evaluation practice. Approaches originating in the systems sciences show promise; however, many require specialized expertise and resources. This article explores rich pictures as an accessible, low-resource method for facilitating sensemaking amid complexity. The method involves the free-hand drawing of a situation to richly illustrate what is happening and why using images, lines, and few words. The process and product are akin to elaborate childhood doodles, yet are remarkably powerful conveyors of tacit knowledge and issues, differing perspectives, and action possibilities. Drawing together methodological guidance, sensemaking theory, and an application with STEM higher education faculty, this article shows how rich pictures support sensemaking amid complexity and identifies potential applications and directions for research on the method.","PeriodicalId":51449,"journal":{"name":"American Journal of Evaluation","volume":"27 14","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139005087","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-11-19DOI: 10.1177/10982140231214709
Rebecca A. Davis
{"title":"Book Review: Cost-Inclusive Evaluation: Planning It, Doing It, Using It by Nadini Persaud & Brian T. Yates","authors":"Rebecca A. Davis","doi":"10.1177/10982140231214709","DOIUrl":"https://doi.org/10.1177/10982140231214709","url":null,"abstract":"","PeriodicalId":51449,"journal":{"name":"American Journal of Evaluation","volume":"95 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139260158","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-10-17DOI: 10.1177/10982140231205150
Jori N. Hall, Laura R. Peck
Issue 4 of Volume 44 marks the seventh and last issue with the two of us as Co-Editors-in-Chief. We embarked on the role in the wake of our prior editor ’ s untimely passing, not knowing each other and expecting to serve for perhaps an issue or two. During this time, we have discovered a rich partnership and also friendship. Although our predecessor George Julnes had an impact on each of us in his life through our relationships with him, it turns out that his posthumous impact is great as well — by his death bringing the two of us together. No control group needed: it is clear that the counterfactual would have been us not coming together in this role, and our professional and personal lives would have been much worse for that. This personal re fl ection also leads us to re fl ect on what we have contributed to the journal along with what we hope will come. In our time as co-editors, we have aimed to curate coherent issues of AJE that feed the intellects and souls of AJE ’ s readers. We have brought to publication important articles that re fl ect rigorous scholarship and thoughtful practice. We can take only a small bit of credit, however, with the authors and reviewers carrying the most weight for this accomplishment. After synthesizing the contributions of this issue, we close with our hopes for AJE ’ s future. This issue contains four articles, an In Memorium Section, and our annual acknowledgement of reviewers. Collectively, the articles offer insights on why and how evaluators are in relationships with citizens, communities, and clients. For example, the lead article, by Pirmin Bundi and Valérie Pattyn, offers a framework for understanding the role of the general public in evaluation, asking: What is the difference between citizens and those directly connected to or involved in the evaluation process? How do citizens contribute to evaluation? Citizens and Evaluation: A Review of Evaluation Models answers these and related questions. The study categories evaluation models, revealing the models that tend to promote public engagement. Although variations exist both within evaluation models and across different stages of the evaluation process, actor-oriented models (those focused on clients and participants)
{"title":"From the Co-Editors: Being in Relationship with Citizens, Communities, and Clients in Evaluation Practice","authors":"Jori N. Hall, Laura R. Peck","doi":"10.1177/10982140231205150","DOIUrl":"https://doi.org/10.1177/10982140231205150","url":null,"abstract":"Issue 4 of Volume 44 marks the seventh and last issue with the two of us as Co-Editors-in-Chief. We embarked on the role in the wake of our prior editor ’ s untimely passing, not knowing each other and expecting to serve for perhaps an issue or two. During this time, we have discovered a rich partnership and also friendship. Although our predecessor George Julnes had an impact on each of us in his life through our relationships with him, it turns out that his posthumous impact is great as well — by his death bringing the two of us together. No control group needed: it is clear that the counterfactual would have been us not coming together in this role, and our professional and personal lives would have been much worse for that. This personal re fl ection also leads us to re fl ect on what we have contributed to the journal along with what we hope will come. In our time as co-editors, we have aimed to curate coherent issues of AJE that feed the intellects and souls of AJE ’ s readers. We have brought to publication important articles that re fl ect rigorous scholarship and thoughtful practice. We can take only a small bit of credit, however, with the authors and reviewers carrying the most weight for this accomplishment. After synthesizing the contributions of this issue, we close with our hopes for AJE ’ s future. This issue contains four articles, an In Memorium Section, and our annual acknowledgement of reviewers. Collectively, the articles offer insights on why and how evaluators are in relationships with citizens, communities, and clients. For example, the lead article, by Pirmin Bundi and Valérie Pattyn, offers a framework for understanding the role of the general public in evaluation, asking: What is the difference between citizens and those directly connected to or involved in the evaluation process? How do citizens contribute to evaluation? Citizens and Evaluation: A Review of Evaluation Models answers these and related questions. The study categories evaluation models, revealing the models that tend to promote public engagement. Although variations exist both within evaluation models and across different stages of the evaluation process, actor-oriented models (those focused on clients and participants)","PeriodicalId":51449,"journal":{"name":"American Journal of Evaluation","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136034378","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-10-11DOI: 10.1177/10982140231205265
Stewart I. Donaldson
{"title":"I Will See You on the Other Side My Friend: A Tribute to Michael Scriven","authors":"Stewart I. Donaldson","doi":"10.1177/10982140231205265","DOIUrl":"https://doi.org/10.1177/10982140231205265","url":null,"abstract":"","PeriodicalId":51449,"journal":{"name":"American Journal of Evaluation","volume":"49 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136213287","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-10-08DOI: 10.1177/10982140231204846
Mike Osiemo Mwirigi
This study aimed to develop and validate the Evaluator Competencies Assessment Tool (ECAT) Cultural Competencies Subscale, which measures cultural competence among evaluators. By addressing the scarcity of validated tools in this area, the study offers professionals a valuable resource to assess their strengths and areas for improvement. The subscale comprises 11 items rated on a seven-point Likert scale, derived from the American Evaluation Association (AEA) Evaluator Competencies. Validation involved a survey of 116 AEA members, employing multiple validity procedures. The subscale demonstrated excellent internal consistency (α=.96) and significant correlation with the Cultural Competence of Program Evaluators scale, confirming its convergent validity. However, the subscale's structural validity yielded mixed results, indicating the need for further exploration. Moreover, the demographic analysis highlighted underrepresentation of Asian and younger members. Overall, the ECAT Cultural Competencies Subscale shows promise for assessing cultural competency, but refinement of its factor structure and additional research are needed.
{"title":"Developing and Validating the Evaluator Competencies Assessment Tool (ECAT) Cultural Competencies Subscale","authors":"Mike Osiemo Mwirigi","doi":"10.1177/10982140231204846","DOIUrl":"https://doi.org/10.1177/10982140231204846","url":null,"abstract":"This study aimed to develop and validate the Evaluator Competencies Assessment Tool (ECAT) Cultural Competencies Subscale, which measures cultural competence among evaluators. By addressing the scarcity of validated tools in this area, the study offers professionals a valuable resource to assess their strengths and areas for improvement. The subscale comprises 11 items rated on a seven-point Likert scale, derived from the American Evaluation Association (AEA) Evaluator Competencies. Validation involved a survey of 116 AEA members, employing multiple validity procedures. The subscale demonstrated excellent internal consistency (α=.96) and significant correlation with the Cultural Competence of Program Evaluators scale, confirming its convergent validity. However, the subscale's structural validity yielded mixed results, indicating the need for further exploration. Moreover, the demographic analysis highlighted underrepresentation of Asian and younger members. Overall, the ECAT Cultural Competencies Subscale shows promise for assessing cultural competency, but refinement of its factor structure and additional research are needed.","PeriodicalId":51449,"journal":{"name":"American Journal of Evaluation","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135197807","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-10-08DOI: 10.1177/10982140231190836
Ayana N. Perkins, Alexandra “Xan” C.H. Nowakowski, Soumya Alva, Nilu Rimal, Melissa Sharer, Nikki Davis, Anne LaFond
Comparatively worse health outcomes persist for historically underserved populations relative to their more privileged peers due to systemic health inequities in the United States and worldwide. The relationship between preventable health differences and social injustice is salient, with recurring media coverage of viral outbreaks and televized court cases of police brutality bringing it to public attention. Rather than waiting for social determinants of health to be explicit in health interventions, an evaluator can use their interest in equity as an entry point. Similar equity-driven strategies were chosen in each case summary, resulting in capacity development, new community perspectives, and measurement of conditions supporting health equity.
{"title":"Expanding the Lens From Health Outcomes to Learn More About Key Stakeholders and the Structural Factors as a Pathway Toward Health Equity","authors":"Ayana N. Perkins, Alexandra “Xan” C.H. Nowakowski, Soumya Alva, Nilu Rimal, Melissa Sharer, Nikki Davis, Anne LaFond","doi":"10.1177/10982140231190836","DOIUrl":"https://doi.org/10.1177/10982140231190836","url":null,"abstract":"Comparatively worse health outcomes persist for historically underserved populations relative to their more privileged peers due to systemic health inequities in the United States and worldwide. The relationship between preventable health differences and social injustice is salient, with recurring media coverage of viral outbreaks and televized court cases of police brutality bringing it to public attention. Rather than waiting for social determinants of health to be explicit in health interventions, an evaluator can use their interest in equity as an entry point. Similar equity-driven strategies were chosen in each case summary, resulting in capacity development, new community perspectives, and measurement of conditions supporting health equity.","PeriodicalId":51449,"journal":{"name":"American Journal of Evaluation","volume":"212 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135197524","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-10-08DOI: 10.1177/10982140231205164
{"title":"Acknowledgement of Reviewers","authors":"","doi":"10.1177/10982140231205164","DOIUrl":"https://doi.org/10.1177/10982140231205164","url":null,"abstract":"","PeriodicalId":51449,"journal":{"name":"American Journal of Evaluation","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135197817","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-18DOI: 10.1177/10982140231185720
Alison Rogers, Amy Gullickson, Jean A. King, Elizabeth McKinley
Based on interviews and case studies in nonprofit organizations, this article examines the perspectives of evaluation advocates undertaking evaluation in culturally diverse contexts where interpersonal barriers may exist. Participants provided insights into how to overcome issues by developing meaningful interpersonal relationships, finding shared goals, and providing encouragement. This article presents practical strategies that anyone promoting evaluation may find helpful to develop positive interpersonal relationships and equitable and inclusive working environments.
{"title":"How Evaluation Advocates Use Interpersonal Skills to Engage Their Colleagues in Evaluation","authors":"Alison Rogers, Amy Gullickson, Jean A. King, Elizabeth McKinley","doi":"10.1177/10982140231185720","DOIUrl":"https://doi.org/10.1177/10982140231185720","url":null,"abstract":"Based on interviews and case studies in nonprofit organizations, this article examines the perspectives of evaluation advocates undertaking evaluation in culturally diverse contexts where interpersonal barriers may exist. Participants provided insights into how to overcome issues by developing meaningful interpersonal relationships, finding shared goals, and providing encouragement. This article presents practical strategies that anyone promoting evaluation may find helpful to develop positive interpersonal relationships and equitable and inclusive working environments.","PeriodicalId":51449,"journal":{"name":"American Journal of Evaluation","volume":"27 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135202916","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：