Pub Date : 2023-01-01DOI: 10.1016/j.peva.2023.102331
Thi Thuy Nga Nguyen , Olivier Brun , Balakrishna J. Prabhu
Resource allocation algorithms in wireless networks can require solving complex optimization problems at every decision epoch. For large scale networks, when decisions need to be taken on time scales of milliseconds, using standard convex optimization solvers for computing the optimum can be a time-consuming affair that may impair real-time decision making. In this paper, we propose to use Data-driven and Deep Feedforward Neural Networks (DFNN) for learning the relation between the inputs and the outputs of two such resource allocation algorithms that were proposed in Nguyen et al. (2019, 2020). On numerical examples with realistic mobility patterns, we show that the learning algorithm yields an approximate yet satisfactory solution with much less computation time.
{"title":"A learning-based scheme for channel allocation to vehicular users in wireless networks","authors":"Thi Thuy Nga Nguyen , Olivier Brun , Balakrishna J. Prabhu","doi":"10.1016/j.peva.2023.102331","DOIUrl":"https://doi.org/10.1016/j.peva.2023.102331","url":null,"abstract":"<div><p>Resource allocation algorithms in wireless networks can require solving complex optimization problems at every decision epoch. For large scale networks, when decisions need to be taken on time scales of milliseconds, using standard convex optimization solvers for computing the optimum can be a time-consuming affair that may impair real-time decision making. In this paper, we propose to use Data-driven and Deep Feedforward Neural Networks (DFNN) for learning the relation between the inputs and the outputs of two such resource allocation algorithms that were proposed in Nguyen et al. (2019, 2020). On numerical examples with realistic mobility patterns, we show that the learning algorithm yields an approximate yet satisfactory solution with much less computation time.</p></div>","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":"159 ","pages":"Article 102331"},"PeriodicalIF":2.2,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49901372","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
With the advent of big data and the emergence of data markets, preserving individuals’ privacy has become of utmost importance. The classical response to this need is anonymization, i.e., sanitizing the information that, directly or indirectly, can allow users’ re-identification. Among the various approaches, -anonymity provides a simple and easy-to-understand protection. However, -anonymity is challenging to achieve in a continuous stream of data and scales poorly when the number of attributes becomes high.
In this paper, we study a novel anonymization property called -anonymity that we explicitly design to deal with data streams, i.e., where the decision to publish a given attribute (atomic information) is made in real time. The idea at the base of -anonymity is to release such attribute about a user only if at least other users have exposed the same attribute in a past time window. Depending on the value of , the output stream results -anonymized with a certain probability. To this end, we present a probabilistic model to map the -anonymity into the -anonymity property. The model is not only helpful in studying the -anonymity property, but also general enough to evaluate the probability of achieving -anonymity in data streams, resulting in a generic contribution.
{"title":"Practical anonymization for data streams: z-anonymity and relation with k-anonymity","authors":"Nikhil Jha , Luca Vassio , Martino Trevisan , Emilio Leonardi , Marco Mellia","doi":"10.1016/j.peva.2022.102329","DOIUrl":"https://doi.org/10.1016/j.peva.2022.102329","url":null,"abstract":"<div><p>With the advent of big data and the emergence of data markets, preserving individuals’ privacy has become of utmost importance. The classical response to this need is anonymization, i.e., sanitizing the information that, directly or indirectly, can allow users’ re-identification. Among the various approaches, <span><math><mi>k</mi></math></span>-anonymity provides a simple and easy-to-understand protection. However, <span><math><mi>k</mi></math></span>-anonymity is challenging to achieve in a continuous stream of data and scales poorly when the number of attributes becomes high.</p><p>In this paper, we study a novel anonymization property called <span><math><mi>z</mi></math></span>-anonymity that we explicitly design to deal with data streams, i.e., where the decision to publish a given attribute (atomic information) is made in real time. The idea at the base of <span><math><mi>z</mi></math></span>-anonymity is to release such attribute about a user only if at least <span><math><mrow><mi>z</mi><mo>−</mo><mn>1</mn></mrow></math></span> other users have exposed the same attribute in a past time window. Depending on the value of <span><math><mi>z</mi></math></span>, the output stream results <span><math><mi>k</mi></math></span>-anonymized with a certain probability. To this end, we present a probabilistic model to map the <span><math><mi>z</mi></math></span>-anonymity into the <span><math><mi>k</mi></math></span>-anonymity property. The model is not only helpful in studying the <span><math><mi>z</mi></math></span>-anonymity property, but also general enough to evaluate the probability of achieving <span><math><mi>k</mi></math></span>-anonymity in data streams, resulting in a generic contribution.</p></div>","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":"159 ","pages":"Article 102329"},"PeriodicalIF":2.2,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49901370","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-01-01DOI: 10.1016/j.peva.2022.102330
Konstantin Avrachenkov , Evsey Morozov , Ruslana Nekrasova
We establish stability criterion for a two-class retrial system with Poisson inputs, general class-dependent service times and class-dependent constant retrial rates. We also characterize an interesting phenomenon of partial stability when one orbit is tight but the other orbit goes to infinity in probability. All theoretical results are illustrated by numerical experiments.
{"title":"Stability analysis of two-class retrial systems with constant retrial rates and general service times","authors":"Konstantin Avrachenkov , Evsey Morozov , Ruslana Nekrasova","doi":"10.1016/j.peva.2022.102330","DOIUrl":"https://doi.org/10.1016/j.peva.2022.102330","url":null,"abstract":"<div><p>We establish stability criterion for a two-class retrial system with Poisson inputs, general class-dependent service times and class-dependent constant retrial rates. We also characterize an interesting phenomenon of partial stability when one orbit is tight but the other orbit goes to infinity in probability. All theoretical results are illustrated by numerical experiments.</p></div>","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":"159 ","pages":"Article 102330"},"PeriodicalIF":2.2,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49901371","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-12-05DOI: 10.1177/13563890221139511
F. Podestà
This article discusses potential ways of combining two methods of evaluation in single-case studies: the synthetic control method and the process tracing method. Both are designed to examine certain events/programmes that take place in given cases but view these events/programmes from different causal perspectives. Seeing an event/programme as a cause, synthetic control estimates its impact on one or more outcomes. Conversely, starting from a certain outcome, process tracing uncovers the causes responsible. One can start from the causal explanation reached via one of the two methods and then proceed to examine that explanation through the other method. Once the causes of an outcome are traced via a process tracing analysis, that account can be validated by estimating the effects of those causes via synthetic control. Equally, once the impact of a certain event is estimated through synthetic control, causal mechanisms traceable via process tracing can be exploited to refine that impact evaluation.
{"title":"Combining process tracing and synthetic control method: Bridging two ways of making causal inference in evaluation research","authors":"F. Podestà","doi":"10.1177/13563890221139511","DOIUrl":"https://doi.org/10.1177/13563890221139511","url":null,"abstract":"This article discusses potential ways of combining two methods of evaluation in single-case studies: the synthetic control method and the process tracing method. Both are designed to examine certain events/programmes that take place in given cases but view these events/programmes from different causal perspectives. Seeing an event/programme as a cause, synthetic control estimates its impact on one or more outcomes. Conversely, starting from a certain outcome, process tracing uncovers the causes responsible. One can start from the causal explanation reached via one of the two methods and then proceed to examine that explanation through the other method. Once the causes of an outcome are traced via a process tracing analysis, that account can be validated by estimating the effects of those causes via synthetic control. Equally, once the impact of a certain event is estimated through synthetic control, causal mechanisms traceable via process tracing can be exploited to refine that impact evaluation.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":"39 1","pages":"50 - 66"},"PeriodicalIF":2.2,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80939793","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-11-27DOI: 10.1177/13563890221137611
G. Ton, F. van Rijn, H. Pamuk
The paper addresses the challenges of evaluating the impact of business coaching programmes with a varied portfolio of firms working across sectors and countries. Observable indicators of changes in business management practices are rarely relevant across sectors. Therefore, evaluators need to rely on the perceptions of the managers who have received coaching. We designed an online survey to compare the effectiveness of business coaching within a portfolio and across programmes. The survey was applied to the portfolio of two private sector development programmes. We derived so-called ‘contribution scores’ from individuals’ perceptions of how business management practices had changed and their perceptions of the role of business coaching in bringing about these changes. The survey included some features to reflect on response reliability. We show that the tool seems fairly reliable for comparative analysis and helped to identify the types of firms and contexts where business coaching support appears more effective.
{"title":"Evaluating the impact of business coaching programmes by taking perceptions seriously","authors":"G. Ton, F. van Rijn, H. Pamuk","doi":"10.1177/13563890221137611","DOIUrl":"https://doi.org/10.1177/13563890221137611","url":null,"abstract":"The paper addresses the challenges of evaluating the impact of business coaching programmes with a varied portfolio of firms working across sectors and countries. Observable indicators of changes in business management practices are rarely relevant across sectors. Therefore, evaluators need to rely on the perceptions of the managers who have received coaching. We designed an online survey to compare the effectiveness of business coaching within a portfolio and across programmes. The survey was applied to the portfolio of two private sector development programmes. We derived so-called ‘contribution scores’ from individuals’ perceptions of how business management practices had changed and their perceptions of the role of business coaching in bringing about these changes. The survey included some features to reflect on response reliability. We show that the tool seems fairly reliable for comparative analysis and helped to identify the types of firms and contexts where business coaching support appears more effective.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":"16 1","pages":"73 - 90"},"PeriodicalIF":2.2,"publicationDate":"2022-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85933611","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-11-26DOI: 10.1177/13563890221138876
F. Schmidli, Lyn E. Pleger, Susanne Hadorn
Policy evaluation literature has stressed the importance of independence of evaluations to guarantee objective evidence collection. The evaluator–client relationship is critical in this respect, since it contains inherent tensions due to the necessity for independent assessments alongside requirements for increased responsiveness to clients’ interests. Despite this distinct relationship, the client perspective has only recently received attention in research. This article presents findings from a survey among US evaluation clients and compares these to existing evidence from Switzerland. Unlike previous studies, we distinguish between constructive and destructive client influences. We show that professional experience and client familiarity with evaluation standards increase the likelihood of constructive influences aimed at improving evaluation results. Nevertheless, the findings indicate that dissatisfaction with an evaluation increases client’s attempts at influence that may be destructive. By discussing both motives behind influence and potential preventive measures, this article seeks to contribute to the increased social impact of policy evaluations.
{"title":"Don’t you forget about me: Independence of evaluations from the perspective of US evaluation clients—An exploratory study","authors":"F. Schmidli, Lyn E. Pleger, Susanne Hadorn","doi":"10.1177/13563890221138876","DOIUrl":"https://doi.org/10.1177/13563890221138876","url":null,"abstract":"Policy evaluation literature has stressed the importance of independence of evaluations to guarantee objective evidence collection. The evaluator–client relationship is critical in this respect, since it contains inherent tensions due to the necessity for independent assessments alongside requirements for increased responsiveness to clients’ interests. Despite this distinct relationship, the client perspective has only recently received attention in research. This article presents findings from a survey among US evaluation clients and compares these to existing evidence from Switzerland. Unlike previous studies, we distinguish between constructive and destructive client influences. We show that professional experience and client familiarity with evaluation standards increase the likelihood of constructive influences aimed at improving evaluation results. Nevertheless, the findings indicate that dissatisfaction with an evaluation increases client’s attempts at influence that may be destructive. By discussing both motives behind influence and potential preventive measures, this article seeks to contribute to the increased social impact of policy evaluations.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":"337 1","pages":"110 - 132"},"PeriodicalIF":2.2,"publicationDate":"2022-11-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76584634","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-11-26DOI: 10.1177/13563890221138739
Nataliya Antoniv, H. I. Kalyta, Dmytro Kondratenko, O. Krasovska, I. Kravchuk, I. Lupashko, Liubov Margolina, Larysa Pylgun, Antonina Rishko-Porcescu, Mykhailo Savva, Yulia Zinovieva
As of mid-September 2022, there are nearly 17.7 million people in need in Ukraine. As many as 14 million Ukrainians have been forced to flee their homes as a result of Russia’s full-scale invasion of Ukraine, including 7.3 million refugees and 7 million displaced persons within Ukraine. The number of confirmed civilian casualties amounted to 13,212 people.1 18.9 per cent of Ukraine’s landmass is occupied by Russian forces, the frontline is constantly changing and all regions of the country, without exception, are a target of constant missile strikes. Russia is clearly not limiting its firing upon military targets but on medical and educational facilities, residential areas, as well as evacuation and volunteer centres. In such conditions, Ukrainian non-governmental organisations (NGOs), government, businesses and volunteers are working on aiding those in need and restoring the devastated territories. The unfolding conflict has made most civil society organisations (CSOs) focus on humanitarian aid and reorient their activities from development into the humanitarian sphere, where they have had to provide vital supplies and essentials in the shortest possible time to a larger number of civilians, the military or participants of the Territorial Defence Forces.
{"title":"Evaluation during war: Current realities and future possibilities of Ukrainian monitoring and evaluation","authors":"Nataliya Antoniv, H. I. Kalyta, Dmytro Kondratenko, O. Krasovska, I. Kravchuk, I. Lupashko, Liubov Margolina, Larysa Pylgun, Antonina Rishko-Porcescu, Mykhailo Savva, Yulia Zinovieva","doi":"10.1177/13563890221138739","DOIUrl":"https://doi.org/10.1177/13563890221138739","url":null,"abstract":"As of mid-September 2022, there are nearly 17.7 million people in need in Ukraine. As many as 14 million Ukrainians have been forced to flee their homes as a result of Russia’s full-scale invasion of Ukraine, including 7.3 million refugees and 7 million displaced persons within Ukraine. The number of confirmed civilian casualties amounted to 13,212 people.1 18.9 per cent of Ukraine’s landmass is occupied by Russian forces, the frontline is constantly changing and all regions of the country, without exception, are a target of constant missile strikes. Russia is clearly not limiting its firing upon military targets but on medical and educational facilities, residential areas, as well as evacuation and volunteer centres. In such conditions, Ukrainian non-governmental organisations (NGOs), government, businesses and volunteers are working on aiding those in need and restoring the devastated territories. The unfolding conflict has made most civil society organisations (CSOs) focus on humanitarian aid and reorient their activities from development into the humanitarian sphere, where they have had to provide vital supplies and essentials in the shortest possible time to a larger number of civilians, the military or participants of the Territorial Defence Forces.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":"15 3-4","pages":"67 - 72"},"PeriodicalIF":2.2,"publicationDate":"2022-11-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72569283","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-11-15DOI: 10.1177/13563890221136890
Debra Hevenstone, Alec Fraser, L. Hobi, Gemma G. M. Geuke
Despite broad consensus on the importance of measuring “impact,” the term is not always understood as estimating counterfactual and causal estimates. We examine a type of public sector financing, “Social Impact Bonds,” a scheme where investors front money for public services, with repayment conditional on impact. We examine five cases in four European countries of Social Impact Bonds financing active labor market programs, testing the claim that Social Impact Bonds would move counterfactual causal impact evaluation to the heart of policy. We examine first how evidence was integrated in contracts, second the overall evidence generated and third, given that neither contracts nor evaluations used counterfactual definitions of impact, we explore stakeholders’ perspectives to better understand the reasons why. We find that although most stakeholders wanted the Social Impact Bonds to generate impact estimates, beliefs about public service reform, incentives, and the logic of experimentation led to the acceptance of non-causal definitions.
{"title":"Why is impact measurement abandoned in practice? Evidence use in evaluation and contracting for five European Social Impact Bonds","authors":"Debra Hevenstone, Alec Fraser, L. Hobi, Gemma G. M. Geuke","doi":"10.1177/13563890221136890","DOIUrl":"https://doi.org/10.1177/13563890221136890","url":null,"abstract":"Despite broad consensus on the importance of measuring “impact,” the term is not always understood as estimating counterfactual and causal estimates. We examine a type of public sector financing, “Social Impact Bonds,” a scheme where investors front money for public services, with repayment conditional on impact. We examine five cases in four European countries of Social Impact Bonds financing active labor market programs, testing the claim that Social Impact Bonds would move counterfactual causal impact evaluation to the heart of policy. We examine first how evidence was integrated in contracts, second the overall evidence generated and third, given that neither contracts nor evaluations used counterfactual definitions of impact, we explore stakeholders’ perspectives to better understand the reasons why. We find that although most stakeholders wanted the Social Impact Bonds to generate impact estimates, beliefs about public service reform, incentives, and the logic of experimentation led to the acceptance of non-causal definitions.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":"116 6 Suppl 1","pages":"91 - 109"},"PeriodicalIF":2.2,"publicationDate":"2022-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86450688","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-11-15DOI: 10.1177/13563890221137610
L. Henley, Nicky Stanley-Clarke, Anuradha Acharya, Smriti Khadka, A. Olsson
Global South non-government organizations rely on international funding and aid for continued service delivery. Service evaluation plays a significant role in ensuring compliance and ongoing service funding. Traditional service evaluation approaches could not take place during 2021 due to COVID-19, alternate mechanisms needed to be embraced. This article reports on the benefits and challenges of undertaking service evaluations online during the pandemic and the learnings and possibilities for a post-pandemic world. It emphasizes the importance of translating a relational approach to service evaluation to the online environment. Key learnings include that while some of the benefits of context and in-person connection are lost, taking a relational approach involving careful planning and reflexivity means the online evaluation process can be successful. Undertaking service evaluations online offers possibilities in a post-pandemic world as cost-effective alternatives to the expensive and time-consuming reality of in-person service evaluation across international borders and within development contexts.
{"title":"Pivoting to online: The benefits, challenges and possibilities for international programme evaluations","authors":"L. Henley, Nicky Stanley-Clarke, Anuradha Acharya, Smriti Khadka, A. Olsson","doi":"10.1177/13563890221137610","DOIUrl":"https://doi.org/10.1177/13563890221137610","url":null,"abstract":"Global South non-government organizations rely on international funding and aid for continued service delivery. Service evaluation plays a significant role in ensuring compliance and ongoing service funding. Traditional service evaluation approaches could not take place during 2021 due to COVID-19, alternate mechanisms needed to be embraced. This article reports on the benefits and challenges of undertaking service evaluations online during the pandemic and the learnings and possibilities for a post-pandemic world. It emphasizes the importance of translating a relational approach to service evaluation to the online environment. Key learnings include that while some of the benefits of context and in-person connection are lost, taking a relational approach involving careful planning and reflexivity means the online evaluation process can be successful. Undertaking service evaluations online offers possibilities in a post-pandemic world as cost-effective alternatives to the expensive and time-consuming reality of in-person service evaluation across international borders and within development contexts.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":"126 1","pages":"7 - 22"},"PeriodicalIF":2.2,"publicationDate":"2022-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86403413","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-10-25DOI: 10.1177/13563890221129640
Emily F. Gates, Glenn Page, J. M. Crespo, Mauricio Nuñez Oporto, Juliana Bohórquez
Evaluation that supports social, ecological, and governance systems change and transformation raises ethical questions about what and whose worldviews do and should ground evaluative processes. This article illustrates one approach to ethical analysis within a case study of the first phase of an initiative to co-create a monitoring, evaluation, and learning system. The case drew on the principles of Blue Marble Evaluation in partnership with local staff and Indigenous leaders of the Amazon Sacred Headwaters Initiative. The approach uses critical and relational systems thinking to examine the sources of motivation, power, knowledge, and legitimacy that influence and should influence an evaluation system. Results reframe typical early phase evaluation process work from a contractual agreement to a co-created ethical space that engenders the legitimacy of the evaluation process. Contributions include a conceptual framework and process for ethical analysis that could be adapted by others.
{"title":"Ethics of evaluation for socio-ecological transformation: Case-based critical systems analysis of motivation, power, expertise, and legitimacy","authors":"Emily F. Gates, Glenn Page, J. M. Crespo, Mauricio Nuñez Oporto, Juliana Bohórquez","doi":"10.1177/13563890221129640","DOIUrl":"https://doi.org/10.1177/13563890221129640","url":null,"abstract":"Evaluation that supports social, ecological, and governance systems change and transformation raises ethical questions about what and whose worldviews do and should ground evaluative processes. This article illustrates one approach to ethical analysis within a case study of the first phase of an initiative to co-create a monitoring, evaluation, and learning system. The case drew on the principles of Blue Marble Evaluation in partnership with local staff and Indigenous leaders of the Amazon Sacred Headwaters Initiative. The approach uses critical and relational systems thinking to examine the sources of motivation, power, knowledge, and legitimacy that influence and should influence an evaluation system. Results reframe typical early phase evaluation process work from a contractual agreement to a co-created ethical space that engenders the legitimacy of the evaluation process. Contributions include a conceptual framework and process for ethical analysis that could be adapted by others.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":"30 1","pages":"23 - 49"},"PeriodicalIF":2.2,"publicationDate":"2022-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81492020","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
扫码关注我们
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号