首页 > 最新文献

New Directions for Evaluation最新文献

英文 中文
Moving beyond methods training: Key directions for decolonizing evaluation education in the global south 超越方法训练:全球南方非殖民化评价教育的主要方向
Q2 Social Sciences Pub Date : 2023-03-01 DOI: 10.1002/ev.20538
Satlaj Dighe
While effective in imparting skills and competencies required for donor‐centric evaluations, the present system of evaluation education in the Global South adds little to the development of Indigenous evaluation theory and practice. As education is the primary tool for building evaluators’ capacity to construct knowledge situated in local epistemologies and culture, deconstructing the colonial character of education is the first step toward the decolonization of evaluation practice. The chapter first discusses the importance of disrupting the colonial episteme as a core feature of the decolonization process. Next, it explores the coloniality of the present education system in Global South evaluation and its implication for the evaluation field. The chapter then proposes five key strategic directions for decolonizing evaluation education and reinstating the voice and agency of Global South communities in the evaluation process: (1) transforming evaluation education to prioritize the learning needs of field‐based organizations, (2) strengthening access to evaluation education for grassroots communities, (3) acknowledging the primacy of local languages in building transformative knowledge, (4) reimagining evaluation educators, and (5) recognizing internal colonialism and social justice in the evaluation curriculum.
全球南方目前的评价教育体系虽然有效地传授了以捐助者为中心的评价所需的技能和能力,但对土著评价理论和实践的发展几乎没有什么帮助。由于教育是培养评估者构建当地认识论和文化知识能力的主要工具,解构教育的殖民特征是实现评估实践非殖民化的第一步。本章首先论述了作为非殖民化进程核心特征的颠覆殖民认识论的重要性。其次,探讨了当前教育体系在全球南方评价中的殖民性及其对评价领域的启示。然后,本章提出了评估教育非殖民化和恢复全球南方社区在评估过程中的发言权和代理权的五个关键战略方向:(1)转变评估教育,优先考虑实地组织的学习需求;(2)加强基层社区获得评估教育的机会,(3)承认地方语言在构建变革性知识方面的首要地位,(4)重新构想评估教育者,以及(5)在评估课程中承认内部殖民主义和社会正义。
{"title":"Moving beyond methods training: Key directions for decolonizing evaluation education in the global south","authors":"Satlaj Dighe","doi":"10.1002/ev.20538","DOIUrl":"https://doi.org/10.1002/ev.20538","url":null,"abstract":"While effective in imparting skills and competencies required for donor‐centric evaluations, the present system of evaluation education in the Global South adds little to the development of Indigenous evaluation theory and practice. As education is the primary tool for building evaluators’ capacity to construct knowledge situated in local epistemologies and culture, deconstructing the colonial character of education is the first step toward the decolonization of evaluation practice. The chapter first discusses the importance of disrupting the colonial episteme as a core feature of the decolonization process. Next, it explores the coloniality of the present education system in Global South evaluation and its implication for the evaluation field. The chapter then proposes five key strategic directions for decolonizing evaluation education and reinstating the voice and agency of Global South communities in the evaluation process: (1) transforming evaluation education to prioritize the learning needs of field‐based organizations, (2) strengthening access to evaluation education for grassroots communities, (3) acknowledging the primacy of local languages in building transformative knowledge, (4) reimagining evaluation educators, and (5) recognizing internal colonialism and social justice in the evaluation curriculum.","PeriodicalId":35250,"journal":{"name":"New Directions for Evaluation","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46126837","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
What we can learn from the international program for development evaluation training (IPDET) 我们可以从国际发展评估培训计划(IPDET)中学到什么
Q2 Social Sciences Pub Date : 2023-03-01 DOI: 10.1002/ev.20540
Linda G Morra Imas, R. Rist
The International Program for Development Evaluation Training, IPDET, ran in its first chapter from 2001–2016 in Ottawa, Canada. In 2018, it began its second chapter in Bern, Switzerland and continues today – an almost unheard‐of longevity for a summer short‐term training program. Over its first 16 years, IPDET trained more than 4000 persons in evaluation from more than 80 countries. During the time we report on in this chapter, IPDET consisted of a mix and match basic 2‐week core program in development evaluation and two subsequent weeks of 2‐ and 3‐day workshops for more in‐depth specialized evaluation training. Workshop topics were updated annually to remain current but included, for example, Cost‐Benefit Analytic Tools for Development Evaluation, Logic Models in Evaluation, Sampling Techniques I and II, Monitoring and Evaluating Governance in Africa, and Assessing the Outcomes and Impacts of Complex Programs. IPDET graduates have made many contributions to the field, such as establishing national evaluation associations, establishing and leading monitoring and evaluation units, producing country evaluation plans and national evaluation policies, and advancing evaluation in non‐profits, foundations, and the private sector. This reflective chapter examines IPDET's successes by identifying good practices for short‐term evaluation training programs. We review nine major factors contributing to IPDET's longevity in increasing the availability and diversity of evaluators worldwide and examine research on good training practices for short‐term adult evaluation training. Based on IPDET's experience, we suggest additional good practices for evaluation training programs.
2001年至2016年,国际发展评估培训计划在加拿大渥太华开展了第一章。2018年,它在瑞士伯尔尼开始了第二个篇章,并一直持续到今天——对于夏季短期训练项目来说,这几乎是闻所未闻的长寿。在最初的16年里,IPDET培训了来自80多个国家的4000多名评估人员。在我们本章报告的时间里,IPDET包括一个混合搭配的基础2周的发展评估核心计划,以及随后两周的2天和3天的研讨会,以进行更深入的专业评估培训。研讨会主题每年更新一次,以保持最新状态,但包括例如发展评估的成本效益分析工具、评估中的逻辑模型、抽样技术I和II、非洲治理的监测和评估以及复杂项目的结果和影响评估。IPDET毕业生在该领域做出了许多贡献,如建立国家评估协会,建立和领导监测和评估单位,制定国家评估计划和国家评估政策,以及推进非营利组织、基金会和私营部门的评估。本反思性章节通过确定短期评估培训计划的良好实践,考察了IPDET的成功。我们回顾了在增加全球评估人员的可用性和多样性方面,有助于IPDET长寿的九个主要因素,并研究了短期成人评估培训的良好培训实践。根据IPDET的经验,我们建议为评估培训计划提供额外的良好实践。
{"title":"What we can learn from the international program for development evaluation training (IPDET)","authors":"Linda G Morra Imas, R. Rist","doi":"10.1002/ev.20540","DOIUrl":"https://doi.org/10.1002/ev.20540","url":null,"abstract":"The International Program for Development Evaluation Training, IPDET, ran in its first chapter from 2001–2016 in Ottawa, Canada. In 2018, it began its second chapter in Bern, Switzerland and continues today – an almost unheard‐of longevity for a summer short‐term training program. Over its first 16 years, IPDET trained more than 4000 persons in evaluation from more than 80 countries. During the time we report on in this chapter, IPDET consisted of a mix and match basic 2‐week core program in development evaluation and two subsequent weeks of 2‐ and 3‐day workshops for more in‐depth specialized evaluation training. Workshop topics were updated annually to remain current but included, for example, Cost‐Benefit Analytic Tools for Development Evaluation, Logic Models in Evaluation, Sampling Techniques I and II, Monitoring and Evaluating Governance in Africa, and Assessing the Outcomes and Impacts of Complex Programs. IPDET graduates have made many contributions to the field, such as establishing national evaluation associations, establishing and leading monitoring and evaluation units, producing country evaluation plans and national evaluation policies, and advancing evaluation in non‐profits, foundations, and the private sector. This reflective chapter examines IPDET's successes by identifying good practices for short‐term evaluation training programs. We review nine major factors contributing to IPDET's longevity in increasing the availability and diversity of evaluators worldwide and examine research on good training practices for short‐term adult evaluation training. Based on IPDET's experience, we suggest additional good practices for evaluation training programs.","PeriodicalId":35250,"journal":{"name":"New Directions for Evaluation","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43341596","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Evaluation amidst crisis: Voices of Ukrainian DRG evaluators 危机中的评估:乌克兰DRG评估者的声音
Q2 Social Sciences Pub Date : 2022-12-01 DOI: 10.1002/ev.20522
Olena Rybiy, Roland Kovats
This chapter focuses on the lived experiences of Ukrainian evaluators currently working amidst political, economic, and social crises. Eight Ukrainian evaluators and evaluation users – drawing from various DRG and DRG‐related programs – were interviewed by Zoom or responded in written form to chapter authors to provide insights to a series of questions regarding how they operate today, and how their priorities and perspectives regarding evaluation have or have not changed. Their responses were summarized by the two main authors. The chapter also provides a background of a DRG program that had to pivot during COVID‐19 and again after Russia's invasion of Ukraine.
本章着重于目前在政治、经济和社会危机中工作的乌克兰评估人员的生活经验。8位乌克兰评估人员和评估用户——来自不同的DRG和与DRG相关的项目——接受了Zoom的采访,或以书面形式回复了章节作者,就他们今天如何运作、他们对评估的优先事项和观点如何改变等一系列问题提供了见解。两位主要作者总结了他们的回答。本章还介绍了DRG计划的背景,该计划在COVID - 19期间和俄罗斯入侵乌克兰后不得不再次转向。
{"title":"Evaluation amidst crisis: Voices of Ukrainian DRG evaluators","authors":"Olena Rybiy, Roland Kovats","doi":"10.1002/ev.20522","DOIUrl":"https://doi.org/10.1002/ev.20522","url":null,"abstract":"This chapter focuses on the lived experiences of Ukrainian evaluators currently working amidst political, economic, and social crises. Eight Ukrainian evaluators and evaluation users – drawing from various DRG and DRG‐related programs – were interviewed by Zoom or responded in written form to chapter authors to provide insights to a series of questions regarding how they operate today, and how their priorities and perspectives regarding evaluation have or have not changed. Their responses were summarized by the two main authors. The chapter also provides a background of a DRG program that had to pivot during COVID‐19 and again after Russia's invasion of Ukraine.","PeriodicalId":35250,"journal":{"name":"New Directions for Evaluation","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45200645","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Theory amidst complexity – using process tracing in ex‐post evaluations 复杂性中的理论——在事后评估中使用过程跟踪
Q2 Social Sciences Pub Date : 2022-12-01 DOI: 10.1002/ev.20524
Kate Krueger, Molly Wright
Evaluators who take a complexity‐aware approach must consider tradeoffs related to theoretical parsimony, falsifiability, and measurement validity. These tradeoffs may be particularly pronounced with ex‐post evaluation designs in which program theory development and monitoring frameworks are often completed before the evaluator is engaged. In this chapter, we argue that theory‐based evaluation (TBE) approaches can address unique ex‐post evaluation challenges that complexity‐aware evaluation (CAE) alone cannot, and that these two sets of approaches are complimentary. We will outline strategies that evaluators may use to conduct rigorous ex‐post evaluations of democracy, human rights, and governance (DRG) interventions that merge CAE's inductive approaches with a theory‐testing structure. It will illustrate these strategies with two case studies of ex‐post evaluation using process tracing (PT).
采用复杂性感知方法的评估人员必须考虑与理论简约性、可证伪性和测量有效性相关的权衡。这些权衡在事后评估设计中可能特别明显,在这种设计中,项目理论开发和监控框架通常在评估人员参与之前完成。在本章中,我们认为基于理论的评估(TBE)方法可以解决复杂性感知评估(CAE)单独无法解决的独特事后评估挑战,这两组方法是互补的。我们将概述评估人员可用于对民主、人权和治理(DRG)干预措施进行严格事后评估的策略,这些干预措施将CAE的归纳方法与理论测试结构相结合。它将通过使用过程跟踪(PT)的两个事后评估案例研究来说明这些策略。
{"title":"Theory amidst complexity – using process tracing in ex‐post evaluations","authors":"Kate Krueger, Molly Wright","doi":"10.1002/ev.20524","DOIUrl":"https://doi.org/10.1002/ev.20524","url":null,"abstract":"Evaluators who take a complexity‐aware approach must consider tradeoffs related to theoretical parsimony, falsifiability, and measurement validity. These tradeoffs may be particularly pronounced with ex‐post evaluation designs in which program theory development and monitoring frameworks are often completed before the evaluator is engaged. In this chapter, we argue that theory‐based evaluation (TBE) approaches can address unique ex‐post evaluation challenges that complexity‐aware evaluation (CAE) alone cannot, and that these two sets of approaches are complimentary. We will outline strategies that evaluators may use to conduct rigorous ex‐post evaluations of democracy, human rights, and governance (DRG) interventions that merge CAE's inductive approaches with a theory‐testing structure. It will illustrate these strategies with two case studies of ex‐post evaluation using process tracing (PT).","PeriodicalId":35250,"journal":{"name":"New Directions for Evaluation","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49649717","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Editors’ note 编者按
Q2 Social Sciences Pub Date : 2022-12-01 DOI: 10.1002/ev.20532
Alysson Akiko Oakley, Kate Krueger
Over the past five decades, democracy, human rights, and governance (DRG) support has gained momentum as a critical sector within international assistance structures. DRG programs support actors such as civil society organizations, independent media, political parties, and governments, who work to build and sustain democratic processes such as free and fair elections or robust human rights protections. Dealing as they do with whose voice matters and whose priorities are addressed, DRG programs are inherently political, focusing on the allocation of power. The role of DRG in the public mind has changed in recent years, influenced by 16 straight years of global democratic crisis and decline (Repucci & Slipowitz, 2022), along with movements that challenge the allocation of political power, such as Black Lives Matter and #MeToo in the United States, and Decolonize/Localize Aid (#ShiftThePower) in international aid. Discussions about whether and how we reform democratic institutions are now commonplace headlines rather than niche topics limited to political scientists and DRG practitioners. Accordingly, this issue is relevant to anyone concerned with how our political institutions can manage political conflict, and our role as evaluators in understanding and contributing to that process. Indeed, in the American Evaluation Association’s Guiding Principles, evaluators are charged to “contribute to the common good and advancement of an equitable and just society,” including advancing a democratic society (American Evaluation Association, n.d.). DRG program evaluators have worked to develop methods and approaches appropriate to the political nature of DRG work. Much of this work takes place in the “black box,” a term that refers to the complex and often poorly specified inner workings of programs that transform inputs into outcomes. DRG programming environments are characterized by shifting power dynamics, ideological conflicts, the competitive allocation of scarce resources, and the interplay between formal and informal institutions. Designing and evaluating programs amidst these environments is complex, and thus “complexity” has often been a rallying call for DRG evaluators struggling to juggle the dynamism of highly politicized contexts and often highly politicized goals. There are three types of individual responses to the challenge of complexity: those that choose to ignore it, those that acknowledge its relevance yet admit that it is not practical to operationalize, and those that fully embrace it. DRG actors – funders, implementers, change agents, and evaluators – fall into these categories equally. Some use complexity to justify ignoring certain research methods or to hide and point to a fuzzy future when change will manifest. Others fully embrace the idea but are stymied by the challenge of making “complexity” programmatically or evaluatively useful. Still others use the term as obfuscating shorthand for a host of interrelated cultural, social, r
在过去的五十年里,民主、人权和治理支持作为国际援助结构中的一个关键部门,势头越来越大。DRG项目支持民间社会组织、独立媒体、政党和政府等行为者,他们致力于建立和维持民主进程,如自由公正的选举或强有力的人权保护。DRG项目本质上是政治性的,专注于权力的分配。近年来,DRG在公众心目中的角色发生了变化,这受到了连续16年全球民主危机和衰落的影响(Repucci&Slipowitz,2022),以及挑战政治权力分配的运动,如美国的“黑人的命也是命”和“我也是”,以及国际援助中的“去殖民化/本地化援助”(#ShiftThePower)。关于我们是否以及如何改革民主制度的讨论现在已经成为常见的头条新闻,而不是仅限于政治科学家和民主变革研究小组从业者的小众话题。因此,这个问题关系到任何关心我们的政治机构如何管理政治冲突的人,以及我们作为评估者在理解和促进这一进程方面的作用。事实上,在美国评估协会的《指导原则》中,评估人员被要求“为共同利益和促进公平公正的社会做出贡献”,包括促进民主社会(美国评估协会,n.d.)。DRG项目评估人员致力于开发适合DRG工作政治性质的方法和方法。这些工作大多发生在“黑匣子”中,这个术语指的是将输入转化为结果的程序的复杂且往往规定不周的内部工作。DRG规划环境的特点是权力动态的变化、意识形态冲突、稀缺资源的竞争性分配以及正式和非正式机构之间的相互作用。在这些环境中设计和评估项目是复杂的,因此“复杂性”往往是DRG评估人员的号召,他们努力兼顾高度政治化的背景和往往高度政治化目标的动态。对于复杂性的挑战,有三种类型的个人反应:选择忽视它的人,承认它的相关性但承认它不实用的人,以及完全接受它的人。DRG参与者——资助者、实施者、变革推动者和评估者——同样属于这些类别。有些人利用复杂性来证明忽视某些研究方法是合理的,或者隐藏起来,指出变化将显现的模糊未来。其他人则完全接受这一想法,但却被使“复杂性”在程序上或评估上有用的挑战所阻碍。还有一些人将这个词用作一系列相互关联的文化、社会、种族、历史、优惠和结构性力量的模糊缩写,而没有提供解决这些问题所需的具体内容。
{"title":"Editors’ note","authors":"Alysson Akiko Oakley, Kate Krueger","doi":"10.1002/ev.20532","DOIUrl":"https://doi.org/10.1002/ev.20532","url":null,"abstract":"Over the past five decades, democracy, human rights, and governance (DRG) support has gained momentum as a critical sector within international assistance structures. DRG programs support actors such as civil society organizations, independent media, political parties, and governments, who work to build and sustain democratic processes such as free and fair elections or robust human rights protections. Dealing as they do with whose voice matters and whose priorities are addressed, DRG programs are inherently political, focusing on the allocation of power. The role of DRG in the public mind has changed in recent years, influenced by 16 straight years of global democratic crisis and decline (Repucci & Slipowitz, 2022), along with movements that challenge the allocation of political power, such as Black Lives Matter and #MeToo in the United States, and Decolonize/Localize Aid (#ShiftThePower) in international aid. Discussions about whether and how we reform democratic institutions are now commonplace headlines rather than niche topics limited to political scientists and DRG practitioners. Accordingly, this issue is relevant to anyone concerned with how our political institutions can manage political conflict, and our role as evaluators in understanding and contributing to that process. Indeed, in the American Evaluation Association’s Guiding Principles, evaluators are charged to “contribute to the common good and advancement of an equitable and just society,” including advancing a democratic society (American Evaluation Association, n.d.). DRG program evaluators have worked to develop methods and approaches appropriate to the political nature of DRG work. Much of this work takes place in the “black box,” a term that refers to the complex and often poorly specified inner workings of programs that transform inputs into outcomes. DRG programming environments are characterized by shifting power dynamics, ideological conflicts, the competitive allocation of scarce resources, and the interplay between formal and informal institutions. Designing and evaluating programs amidst these environments is complex, and thus “complexity” has often been a rallying call for DRG evaluators struggling to juggle the dynamism of highly politicized contexts and often highly politicized goals. There are three types of individual responses to the challenge of complexity: those that choose to ignore it, those that acknowledge its relevance yet admit that it is not practical to operationalize, and those that fully embrace it. DRG actors – funders, implementers, change agents, and evaluators – fall into these categories equally. Some use complexity to justify ignoring certain research methods or to hide and point to a fuzzy future when change will manifest. Others fully embrace the idea but are stymied by the challenge of making “complexity” programmatically or evaluatively useful. Still others use the term as obfuscating shorthand for a host of interrelated cultural, social, r","PeriodicalId":35250,"journal":{"name":"New Directions for Evaluation","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48280068","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluating a woman's leadership journey and impact by adapting contribution mapping and analysis tools 通过调整贡献映射和分析工具来评估女性的领导历程和影响力
Q2 Social Sciences Pub Date : 2022-12-01 DOI: 10.1002/ev.20521
Alejandra Garcia Diaz Villamil, Rodrigo Santos Legaspi, Ophelia Delali A. Akoto
Complexity manifests in no clearer arena than women's political leadership and overall empowerment. The nature of the leadership journey, comprised of multiple events and milestones, paired with environmental factors like COVID‐19, adds to this complexity. This chapter tackles the challenges of measuring program impact in advancing women's leadership by discussing the Vital Voices Global Partnership (VVGP) approach. Using an adapted contribution mapping and analysis tool, VVGP identified contributions at three levels: programmatic, individual, and community. The tool allowed VVGP to collect evidence about VVGP's contributions to improved political leadership and the overall VVGP model's theory of change (TOC).
妇女的政治领导和全面赋权是最为复杂的领域。领导之旅的性质,包括多个事件和里程碑,再加上新冠肺炎等环境因素,增加了这种复杂性。本章通过讨论重要之声全球伙伴关系(VVGP)方法,解决了衡量项目在提高妇女领导力方面的影响的挑战。VVGP使用经过调整的贡献映射和分析工具,确定了三个层面的贡献:方案、个人和社区。该工具使VVGP能够收集有关VVGP对改善政治领导力和整个VVGP模型的变革理论(TOC)的贡献的证据。
{"title":"Evaluating a woman's leadership journey and impact by adapting contribution mapping and analysis tools","authors":"Alejandra Garcia Diaz Villamil, Rodrigo Santos Legaspi, Ophelia Delali A. Akoto","doi":"10.1002/ev.20521","DOIUrl":"https://doi.org/10.1002/ev.20521","url":null,"abstract":"Complexity manifests in no clearer arena than women's political leadership and overall empowerment. The nature of the leadership journey, comprised of multiple events and milestones, paired with environmental factors like COVID‐19, adds to this complexity. This chapter tackles the challenges of measuring program impact in advancing women's leadership by discussing the Vital Voices Global Partnership (VVGP) approach. Using an adapted contribution mapping and analysis tool, VVGP identified contributions at three levels: programmatic, individual, and community. The tool allowed VVGP to collect evidence about VVGP's contributions to improved political leadership and the overall VVGP model's theory of change (TOC).","PeriodicalId":35250,"journal":{"name":"New Directions for Evaluation","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43714473","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Made in Africa: Understanding Indigenous African approaches to democracy, human rights, and governance evaluation through the study of proverbs 非洲制造:通过研究谚语了解非洲原住民对待民主、人权和治理评估的方法
Q2 Social Sciences Pub Date : 2022-12-01 DOI: 10.1002/ev.20526
Sîm‐Yassah Awilêlo Badjo
The African Evaluation Association (AfrEA) plays a unique role as the pan‐Africa umbrella organization of African Voluntary Organizations for Professional Development (VOPEs). This chapter is in a self‐interview format with the former Chief of AfrEA Secretariat and discusses an AfrEA initiative called Made in Africa Evaluation (MAE). Part of MAE considers how Indigenous African proverbs contribute to improved evaluation practices in the African context. This interview discusses the approach to the use of proverbs with reference to democracy assistance, human rights, and governance programs (DRG).
非洲评价协会作为非洲专业发展自愿组织的泛非伞式组织发挥着独特的作用。本章以自我访谈的形式与非洲经委会前秘书处主任进行了交谈,并讨论了非洲经委会的一项名为“非洲制造评估”(MAE)的倡议。MAE的一部分考虑了非洲土著谚语如何有助于改善非洲背景下的评估实践。本次采访讨论了在民主援助、人权和治理计划(DRG)中使用谚语的方法。
{"title":"Made in Africa: Understanding Indigenous African approaches to democracy, human rights, and governance evaluation through the study of proverbs","authors":"Sîm‐Yassah Awilêlo Badjo","doi":"10.1002/ev.20526","DOIUrl":"https://doi.org/10.1002/ev.20526","url":null,"abstract":"The African Evaluation Association (AfrEA) plays a unique role as the pan‐Africa umbrella organization of African Voluntary Organizations for Professional Development (VOPEs). This chapter is in a self‐interview format with the former Chief of AfrEA Secretariat and discusses an AfrEA initiative called Made in Africa Evaluation (MAE). Part of MAE considers how Indigenous African proverbs contribute to improved evaluation practices in the African context. This interview discusses the approach to the use of proverbs with reference to democracy assistance, human rights, and governance programs (DRG).","PeriodicalId":35250,"journal":{"name":"New Directions for Evaluation","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48180607","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Equitable evaluation in remote and sensitive spaces 在偏远和敏感地区进行公平评估
Q2 Social Sciences Pub Date : 2022-12-01 DOI: 10.1002/ev.20525
Megan Guidrey, Emily Bango, A. Ayoob
Democracy, human rights, and governance (DRG) programs work in environments where there are actors that actively undermine program goals, environments with conflict or war, situations where program management is physically distant from program implementation, contexts where target communities live with little or no internet or mobile phone connectivity, and where stakeholders are subject to intimidation and violence. As a result, DRG program monitoring and evaluation activities must apply principles from the Equitable Evaluation Framework™, to meaningfully engage program staff and participants to mitigate risks and innovate approaches for collecting and analyzing data, and communicating results that carefully consider digital, physical, and psychosocial safety and measure sustainable, culturally relevant changes at the individual and community level.
民主、人权和治理(DRG)项目在以下环境中开展工作:存在积极破坏项目目标的行为者、存在冲突或战争的环境、项目管理与项目实施在物理上相距遥远的情况、目标社区很少或根本没有互联网或移动电话连接的情况、以及利益相关者受到恐吓和暴力的情况。因此,DRG项目监测和评估活动必须应用《公平评估框架™》的原则,使项目工作人员和参与者有意地参与进来,以降低风险,创新收集和分析数据的方法,并传达仔细考虑数字、物理和社会心理安全的结果,并在个人和社区层面衡量可持续的、与文化相关的变化。
{"title":"Equitable evaluation in remote and sensitive spaces","authors":"Megan Guidrey, Emily Bango, A. Ayoob","doi":"10.1002/ev.20525","DOIUrl":"https://doi.org/10.1002/ev.20525","url":null,"abstract":"Democracy, human rights, and governance (DRG) programs work in environments where there are actors that actively undermine program goals, environments with conflict or war, situations where program management is physically distant from program implementation, contexts where target communities live with little or no internet or mobile phone connectivity, and where stakeholders are subject to intimidation and violence. As a result, DRG program monitoring and evaluation activities must apply principles from the Equitable Evaluation Framework™, to meaningfully engage program staff and participants to mitigate risks and innovate approaches for collecting and analyzing data, and communicating results that carefully consider digital, physical, and psychosocial safety and measure sustainable, culturally relevant changes at the individual and community level.","PeriodicalId":35250,"journal":{"name":"New Directions for Evaluation","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44075770","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Nimble adaptation: Tailoring monitoring, evaluation, and learning methods to provide actionable data in complex environments 灵活适应:调整监测、评估和学习方法,以便在复杂环境中提供可操作的数据
Q2 Social Sciences Pub Date : 2022-12-01 DOI: 10.1002/ev.20523
Lauren Serpe, Mason C. Ingram, Kate Byom
This chapter examines good practices in implementing effective Monitoring, Evaluation, and Learning (MEL) systems within complex international development Democracy, Human Rights, and Governance (DRG) programs, which are characterized by challenges of non‐linearity, limited evidence of theories of change, and contextual and politically contingent nature of outcomes. The chapter presents three cases of MEL systems in complex projects implemented by Pact across distinct and diverse operating contexts – Zimbabwe, Cambodia, and Somalia – to illustrate those projects’ MEL approaches that enabled continuous adaptation. The authors analyze the cases to respond to two questions: (1) What are the key elements of effective adaptive management‐focused MEL systems in complex environments? (2) What is practical guidance for designing and enabling complexity‐responsive and effective adaptive management‐focused MEL systems? The case studies illustrate three key elements: (1) Information gathering that closely links context, research, and performance data; (2) Systems for reflection that offer scheduled learning moments of varying frequency and intensity, as well as multiple feedback mechanisms; and (3) Enabling structures that promote adaptive mindsets and attitudes within project teams.
本章探讨了在复杂的国际发展民主、人权和治理(DRG)项目中实施有效的监测、评估和学习(MEL)系统的良好实践,这些项目的特点是非线性的挑战、变化理论的有限证据以及结果的背景和政治偶然性。本章介绍了《公约》在津巴布韦、柬埔寨和索马里等不同和不同的运营环境下实施的复杂项目中的MEL系统的三个案例,以说明这些项目的MEL方法能够实现持续适应。作者分析了这些案例,以回答两个问题:(1)在复杂环境中,有效的以自适应管理为重点的MEL系统的关键要素是什么?(2) 设计和启用复杂响应和有效的自适应管理MEL系统的实用指南是什么?案例研究说明了三个关键要素:(1)将背景、研究和绩效数据紧密联系在一起的信息收集;(2) 提供不同频率和强度的计划学习时刻以及多种反馈机制的反思系统;以及(3)在项目团队中促进适应性心态和态度的扶持结构。
{"title":"Nimble adaptation: Tailoring monitoring, evaluation, and learning methods to provide actionable data in complex environments","authors":"Lauren Serpe, Mason C. Ingram, Kate Byom","doi":"10.1002/ev.20523","DOIUrl":"https://doi.org/10.1002/ev.20523","url":null,"abstract":"This chapter examines good practices in implementing effective Monitoring, Evaluation, and Learning (MEL) systems within complex international development Democracy, Human Rights, and Governance (DRG) programs, which are characterized by challenges of non‐linearity, limited evidence of theories of change, and contextual and politically contingent nature of outcomes. The chapter presents three cases of MEL systems in complex projects implemented by Pact across distinct and diverse operating contexts – Zimbabwe, Cambodia, and Somalia – to illustrate those projects’ MEL approaches that enabled continuous adaptation. The authors analyze the cases to respond to two questions: (1) What are the key elements of effective adaptive management‐focused MEL systems in complex environments? (2) What is practical guidance for designing and enabling complexity‐responsive and effective adaptive management‐focused MEL systems? The case studies illustrate three key elements: (1) Information gathering that closely links context, research, and performance data; (2) Systems for reflection that offer scheduled learning moments of varying frequency and intensity, as well as multiple feedback mechanisms; and (3) Enabling structures that promote adaptive mindsets and attitudes within project teams.","PeriodicalId":35250,"journal":{"name":"New Directions for Evaluation","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45654219","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
“Politics is more difficult than physics”: Complexity and the challenge of democracy, human rights, and governance program evaluation “政治比物理更难”:民主、人权和治理方案评估的复杂性和挑战
Q2 Social Sciences Pub Date : 2022-12-01 DOI: 10.1002/ev.20531
Alysson Akiko Oakley
What is democracy, human rights, and governance (DRG) program evaluation? This chapter defines the subfield, outlines major challenges to undertaking evaluation in highly politicized programming environments, and orients its current state with respect to its historical trajectory. The author describes the pendulum swings DRG evaluation has undergone in methodology, paradigms, and interests, organized into four generations: the Cowboys, the Technocratic Disenchantment, the Messy Middle, and the Complexity Crew. The chapter describes how the concept of complexity came to dominate the subfield, emerging out of the importance placed in context and contextual relevance for programs focused on political goals. The author puts forward a framework for operationalizing complexity more consistently within the DRG evaluation sector and concludes with a discussion of current issues and debates in the field.
什么是民主、人权和治理(DRG)项目评估?本章定义了子领域,概述了在高度政治化的编程环境中进行评估的主要挑战,并根据其历史轨迹确定了其现状。作者描述了DRG评估在方法论、范式和兴趣方面所经历的钟摆式摆动,分为四代:牛仔、技术官僚迷魂、混乱的中间派和复杂性团队。本章描述了复杂性的概念是如何在子领域占据主导地位的,它是如何从关注政治目标的项目的上下文和上下文相关性中脱颖而出的。作者提出了一个在DRG评估部门内更一致地操作复杂性的框架,并以对该领域当前问题和辩论的讨论结束。
{"title":"“Politics is more difficult than physics”: Complexity and the challenge of democracy, human rights, and governance program evaluation","authors":"Alysson Akiko Oakley","doi":"10.1002/ev.20531","DOIUrl":"https://doi.org/10.1002/ev.20531","url":null,"abstract":"What is democracy, human rights, and governance (DRG) program evaluation? This chapter defines the subfield, outlines major challenges to undertaking evaluation in highly politicized programming environments, and orients its current state with respect to its historical trajectory. The author describes the pendulum swings DRG evaluation has undergone in methodology, paradigms, and interests, organized into four generations: the Cowboys, the Technocratic Disenchantment, the Messy Middle, and the Complexity Crew. The chapter describes how the concept of complexity came to dominate the subfield, emerging out of the importance placed in context and contextual relevance for programs focused on political goals. The author puts forward a framework for operationalizing complexity more consistently within the DRG evaluation sector and concludes with a discussion of current issues and debates in the field.","PeriodicalId":35250,"journal":{"name":"New Directions for Evaluation","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47385300","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
期刊
New Directions for Evaluation
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1