Pub Date : 2022-10-01DOI: 10.1016/j.peva.2022.102314
Kalpana Devarajan , Muthukrishnan Senthilkumar
The present research aims to study the strategic behaviour of users in an Internet of Things(IoT) system that is impeded by an unreliable server. In the system, an IoT device is equipped with an energy harvesting unit. The IoT system under study is employed as a Markovian retrial queueing system that is used in a single server, subject to active failures. The failed server is repaired immediately, while the user who was served before the system’s breakdown event waits in the server until the server is repaired. The generating function approach is used to identify important system performance metrics. Moreover, queueing theory concepts are incorporated into game theory for the analysis of the users’ strategies. The users in the IoT system, act to maximize their expected benefit without being perturbed by other users in the system and determine their equilibrium joining strategies. Furthermore, taking into account social welfare factors, the IoT device acts as a social planner, and as a consequence, socially optimal joining strategies are also analysed. Finally, the analytical findings are validated with numerical examples.
{"title":"Strategic access in a Green IoT(Internet of Things) system with an unreliable server","authors":"Kalpana Devarajan , Muthukrishnan Senthilkumar","doi":"10.1016/j.peva.2022.102314","DOIUrl":"10.1016/j.peva.2022.102314","url":null,"abstract":"<div><p>The present research aims to study the strategic behaviour of users in an Internet of Things(IoT) system that is impeded by an unreliable server. In the system, an IoT device is equipped with an energy harvesting<span> unit. The IoT system under study is employed as a Markovian retrial queueing system<span> that is used in a single server, subject to active failures. The failed server is repaired immediately, while the user who was served before the system’s breakdown event waits in the server until the server is repaired. The generating function approach is used to identify important system performance metrics. Moreover, queueing theory concepts are incorporated into game theory for the analysis of the users’ strategies. The users in the IoT system, act to maximize their expected benefit without being perturbed by other users in the system and determine their equilibrium joining strategies. Furthermore, taking into account social welfare factors, the IoT device acts as a social planner, and as a consequence, socially optimal joining strategies are also analysed. Finally, the analytical findings are validated with numerical examples.</span></span></p></div>","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74338509","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-10-01DOI: 10.1016/j.peva.2022.102319
Vineeth B.S. , Chandramani Singh
We consider a single-source single-destination delay tolerant network (DTN) with Poisson packet arrivals. The source uses a store and forward protocol which makes multiple copies of a packet to relays which buffer them until delivery to the destination. We characterize the stability threshold, defined as the maximum value of arrival rate for which the source has finite average queue length, as a function of number of relays, relay contact rate, relay packet buffer capacity, and number of packet copies. We analyse DTNs without packet delivery feedback and with instantaneous feedback. For DTNs without packet delivery feedback, we obtain a non-asymptotic analytical stability threshold and show that it only doubles as the relay-buffer capacity increases from one to infinity. For DTNs with instantaneous packet delivery feedback, we characterize the stability threshold using simulations. We also present an analytical approximation for the stability threshold in the case of unit relay-buffer capacity, and show that it is approximately double of that without feedback for large number of packet copies and relays. For DTNs with and without feedback, we also study the average delay performance through simulations. We obtain analytical approximations for the average delays of the packets for DTNs without feedback. We observe that the last-in-first-out relay to destination packet transmission policy has the minimum delay.
{"title":"Stability and average delay in delay tolerant networks with Poisson packet arrivals and buffered relay nodes","authors":"Vineeth B.S. , Chandramani Singh","doi":"10.1016/j.peva.2022.102319","DOIUrl":"10.1016/j.peva.2022.102319","url":null,"abstract":"<div><p><span><span>We consider a single-source single-destination delay tolerant network (DTN) with Poisson </span>packet arrivals. The source uses a store and forward protocol which makes multiple copies of a packet to relays which buffer them until delivery to the destination. We characterize the stability threshold, defined as the maximum value of </span>arrival rate<span><span><span> for which the source has finite average queue length, as a function of number of relays, relay contact rate, relay packet buffer capacity, and number of packet copies. We analyse DTNs without </span>packet delivery feedback and with instantaneous feedback. For DTNs without packet delivery feedback, we obtain a non-asymptotic analytical stability threshold and show that it only doubles as the relay-buffer capacity increases from one to infinity. For DTNs with instantaneous packet delivery feedback, we characterize the stability threshold using simulations. We also present an analytical </span>approximation<span> for the stability threshold in the case of unit relay-buffer capacity, and show that it is approximately double of that without feedback for large number of packet copies and relays. For DTNs with and without feedback, we also study the average delay performance through simulations. We obtain analytical approximations for the average delays of the packets for DTNs without feedback. We observe that the last-in-first-out relay to destination packet transmission policy has the minimum delay.</span></span></p></div>","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85777097","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-09-27DOI: 10.1177/13563890221126744
M. Coldwell, Sarah Pearson, Ian D. Wilson
This article focuses on the evaluation of the Children’s Community programme, addressing the question: how can evaluators effectively address complex place-based system change initiatives, particularly those working across differing contexts? After considering alternatives, including what we describe as ‘first-generation’ linear, logic model-based approaches and second-generation Theory of Change approaches, we discuss the development of ‘third-generation’ systems-change evaluations and articulate a novel comparative maturity matrix approach, developed for the evaluation of Children’s Communities with potential wider applicability for evaluation of complex systems change interventions. The article discusses the evaluation approach in depth and concludes with reflection on what learning points may be derived for use in subsequent evaluations of place-based and complex systems change initiatives.
{"title":"Evaluating local system change using a comparative maturity matrix","authors":"M. Coldwell, Sarah Pearson, Ian D. Wilson","doi":"10.1177/13563890221126744","DOIUrl":"https://doi.org/10.1177/13563890221126744","url":null,"abstract":"This article focuses on the evaluation of the Children’s Community programme, addressing the question: how can evaluators effectively address complex place-based system change initiatives, particularly those working across differing contexts? After considering alternatives, including what we describe as ‘first-generation’ linear, logic model-based approaches and second-generation Theory of Change approaches, we discuss the development of ‘third-generation’ systems-change evaluations and articulate a novel comparative maturity matrix approach, developed for the evaluation of Children’s Communities with potential wider applicability for evaluation of complex systems change interventions. The article discusses the evaluation approach in depth and concludes with reflection on what learning points may be derived for use in subsequent evaluations of place-based and complex systems change initiatives.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80529756","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-09-27DOI: 10.1177/13563890221129496
clés: Groupes de discussion; entretiens de groupe; évaluation fondée sur la théorie; évaluation réaliste; théorie de moyenne portée; théorie de programme de matrice comparative de maturité, développée pour l’évaluation des Réseaux pour l’Enfance, et susceptible d’une application plus large à l’évaluation des inter-ventions complexes de changement systémique. L’article formule une analyse approfondie de la méthode d’évaluation et conclut sur une réflexion portant sur les enseignements pratiques que l’on peut en tirer pour les évaluations à venir d’initiatives de changements systémiques localisés et complexes.
{"title":"French language abstracts","authors":"","doi":"10.1177/13563890221129496","DOIUrl":"https://doi.org/10.1177/13563890221129496","url":null,"abstract":"clés: Groupes de discussion; entretiens de groupe; évaluation fondée sur la théorie; évaluation réaliste; théorie de moyenne portée; théorie de programme de matrice comparative de maturité, développée pour l’évaluation des Réseaux pour l’Enfance, et susceptible d’une application plus large à l’évaluation des inter-ventions complexes de changement systémique. L’article formule une analyse approfondie de la méthode d’évaluation et conclut sur une réflexion portant sur les enseignements pratiques que l’on peut en tirer pour les évaluations à venir d’initiatives de changements systémiques localisés et complexes.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77948035","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-09-15DOI: 10.1177/13563890221124713
Tze-Chang Liu
The aim of this study is to demonstrate the challenges encountered in youth participatory evaluation and how digital technology may assist in overcoming these challenges. The study explores the meaning of youth participatory evaluation and examines the challenges faced in utilizing the approach. We argue that using digital technology can help overcome many challenges of youth participatory evaluations, with the added benefit that such technology may also attract and influence young people to engage more fully with evaluation processes. These findings show that digital technology helps decrease adultism, increase adults’ capacity to engage with youth, and respond to and empower youth. Some practical guidelines and challenges are also discussed.
{"title":"Using digital technology to enhance youth participatory evaluation","authors":"Tze-Chang Liu","doi":"10.1177/13563890221124713","DOIUrl":"https://doi.org/10.1177/13563890221124713","url":null,"abstract":"The aim of this study is to demonstrate the challenges encountered in youth participatory evaluation and how digital technology may assist in overcoming these challenges. The study explores the meaning of youth participatory evaluation and examines the challenges faced in utilizing the approach. We argue that using digital technology can help overcome many challenges of youth participatory evaluations, with the added benefit that such technology may also attract and influence young people to engage more fully with evaluation processes. These findings show that digital technology helps decrease adultism, increase adults’ capacity to engage with youth, and respond to and empower youth. Some practical guidelines and challenges are also discussed.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74694867","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-09-10DOI: 10.1177/13563890221123821
E. Zucchini, M. Carbon, Christine Bosch, F. Felloni
This study explores the use of Participatory Narrative Inquiry (PNI) in evaluating development interventions by contributing to the debate of using participatory narrative methods. Stories on personal experience are used to evaluate the project’s effects as with similar methods such as Most Significant Change and Sensemaking. To the authors’ knowledge, this is one of the early applications of PNI to the evaluation of international development programmes. The study discusses advantages and limitations, and provides a scholarly reflection based on an application of PNI in the evaluation of gender and women’s empowerment in Niger. The study concludes that PNI is a powerful alternative to existing qualitative and participatory narrative evaluation methods. Within mixed-method approaches, PNI allows for greater inclusion of project beneficiaries in the evaluation process, while helping to elaborate a thorough theory of change, understand the complexity of the context, identify and assess outcome pathways, and provide an evidence-based evaluation.
{"title":"Evaluation through narratives: A practical case of Participatory Narrative Inquiry in women empowerment evaluation in Niger","authors":"E. Zucchini, M. Carbon, Christine Bosch, F. Felloni","doi":"10.1177/13563890221123821","DOIUrl":"https://doi.org/10.1177/13563890221123821","url":null,"abstract":"This study explores the use of Participatory Narrative Inquiry (PNI) in evaluating development interventions by contributing to the debate of using participatory narrative methods. Stories on personal experience are used to evaluate the project’s effects as with similar methods such as Most Significant Change and Sensemaking. To the authors’ knowledge, this is one of the early applications of PNI to the evaluation of international development programmes. The study discusses advantages and limitations, and provides a scholarly reflection based on an application of PNI in the evaluation of gender and women’s empowerment in Niger. The study concludes that PNI is a powerful alternative to existing qualitative and participatory narrative evaluation methods. Within mixed-method approaches, PNI allows for greater inclusion of project beneficiaries in the evaluation process, while helping to elaborate a thorough theory of change, understand the complexity of the context, identify and assess outcome pathways, and provide an evidence-based evaluation.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76770121","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-09-09DOI: 10.1177/13563890221123822
M. Dean
Over the past few decades, a number of participatory multi-criteria analysis methods, combining deliberative procedures with multiple decision criteria assessment techniques, have been developed to tackle complex policy problems. However, several important aspects of such methods, including the way in which different and often contrasting viewpoints should be included in the analysis, appear to have been largely neglected by previous studies. Possible problems and drawbacks that may hamper the applicability and feasibility of multi-actor multi-criteria exercises and the utility and reliability of their outcomes also deserve further investigation. This article seeks to fill this knowledge gap by proposing a conceptual framework and classification scheme that illustrates the different possible approaches for identifying the key elements of the multi-criteria problem (i.e. options, objectives/criteria, weights and scores), while dealing with different points of view. It also discusses the potential advantages, disadvantages and issues of each approach and ultimately defines the overarching factors that should orientate the selection of one specific approach over the others.
{"title":"Including multiple perspectives in participatory multi-criteria analysis: A framework for investigation","authors":"M. Dean","doi":"10.1177/13563890221123822","DOIUrl":"https://doi.org/10.1177/13563890221123822","url":null,"abstract":"Over the past few decades, a number of participatory multi-criteria analysis methods, combining deliberative procedures with multiple decision criteria assessment techniques, have been developed to tackle complex policy problems. However, several important aspects of such methods, including the way in which different and often contrasting viewpoints should be included in the analysis, appear to have been largely neglected by previous studies. Possible problems and drawbacks that may hamper the applicability and feasibility of multi-actor multi-criteria exercises and the utility and reliability of their outcomes also deserve further investigation. This article seeks to fill this knowledge gap by proposing a conceptual framework and classification scheme that illustrates the different possible approaches for identifying the key elements of the multi-criteria problem (i.e. options, objectives/criteria, weights and scores), while dealing with different points of view. It also discusses the potential advantages, disadvantages and issues of each approach and ultimately defines the overarching factors that should orientate the selection of one specific approach over the others.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74639094","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-09-04DOI: 10.1177/13563890221110257
Robyn Doherty, N. Quinn, A. Colson, Amy Tucker, J. Cameron
Over the past few years, levels of mental health problems among children and adolescents have risen alongside an increased demand for services, which has driven the demand for a transformative systems change in how child and adolescent mental health services are delivered. Theory of change methodology is a valuable approach for advancing systems change. This article describes the theory of change process to evaluate a strategic partnership approach to advancing systems change improvements in child and adolescent’s mental health. This article describes the development and application of a theory of change methodology for these strategic partnerships, discussing the benefits derived from developing the theory of change and its use by the programme staff and evaluation team. This article also discusses the challenges and limitations of using this approach and recommendations for use more widely.
{"title":"Developing a theory of change methodology to support the evaluation of place-based systems change interventions to support child and adolescent mental health and well-being","authors":"Robyn Doherty, N. Quinn, A. Colson, Amy Tucker, J. Cameron","doi":"10.1177/13563890221110257","DOIUrl":"https://doi.org/10.1177/13563890221110257","url":null,"abstract":"Over the past few years, levels of mental health problems among children and adolescents have risen alongside an increased demand for services, which has driven the demand for a transformative systems change in how child and adolescent mental health services are delivered. Theory of change methodology is a valuable approach for advancing systems change. This article describes the theory of change process to evaluate a strategic partnership approach to advancing systems change improvements in child and adolescent’s mental health. This article describes the development and application of a theory of change methodology for these strategic partnerships, discussing the benefits derived from developing the theory of change and its use by the programme staff and evaluation team. This article also discusses the challenges and limitations of using this approach and recommendations for use more widely.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90972544","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-07-01DOI: 10.1177/13563890221109620
Lotte Levelt, Nicky R. M. Pouw
‘Evidence-based’ development policy has caused impact evaluations to prioritise accountability over addressing processual learning questions. Moreover, evaluation scholarship is dominated by surveys, whereas qualitative research remains scant. This article traces one particular evaluation, within the independent Evaluation Department of the Dutch Ministry of Foreign Affairs. It asks, ‘How do evaluators and policymakers interact and what adjustments follow from the illustrative evaluation?’ It used participant observations, documents and interviews with policymakers and evaluators. An in-depth thematic analysis resulted in a typology of evaluator roles: (1) knowledge broker, (2) facilitator, (3) archive, (4) truth-revealing and (5) critical voice. Finally, policymakers and managers adjusted in three ways: symbolic, instrumental and empowerment. These results imply that if evaluators deliberate a suitable role, they (1) increase their partial understandings of the programme under scrutiny and the involved stakeholders, and (2) enhance the potential of synergies in collective learning to emerge in an evaluation team and the broader institution.
{"title":"Speaking truth to power: Exploring a Ministry’s evaluation department through evaluators’ and policymakers’ eyes","authors":"Lotte Levelt, Nicky R. M. Pouw","doi":"10.1177/13563890221109620","DOIUrl":"https://doi.org/10.1177/13563890221109620","url":null,"abstract":"‘Evidence-based’ development policy has caused impact evaluations to prioritise accountability over addressing processual learning questions. Moreover, evaluation scholarship is dominated by surveys, whereas qualitative research remains scant. This article traces one particular evaluation, within the independent Evaluation Department of the Dutch Ministry of Foreign Affairs. It asks, ‘How do evaluators and policymakers interact and what adjustments follow from the illustrative evaluation?’ It used participant observations, documents and interviews with policymakers and evaluators. An in-depth thematic analysis resulted in a typology of evaluator roles: (1) knowledge broker, (2) facilitator, (3) archive, (4) truth-revealing and (5) critical voice. Finally, policymakers and managers adjusted in three ways: symbolic, instrumental and empowerment. These results imply that if evaluators deliberate a suitable role, they (1) increase their partial understandings of the programme under scrutiny and the involved stakeholders, and (2) enhance the potential of synergies in collective learning to emerge in an evaluation team and the broader institution.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86378747","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-07-01DOI: 10.1177/13563890221105537
Jess MacArthur, N. Carrard, Toeur Veasna, Tyler Kozole, J. Willetts
Evaluations of gender equality initiatives in development programmes traditionally assess cognitive dimensions such as knowledge, attitudes, and awareness; and often rely solely on women’s perspectives. Leveraging story-based evaluation methods, this article explores the assessment of complex gender-transformations and focuses on effective question prompts to elicit significant and meaningful narratives of change from both women and men. In collaboration with a development programme in Cambodia, a staff assessment process led to a set of criteria for considering the quality of respondent stories and testing the efficacy of four different question prompts (n = 176): verb-, value-, sphere-, and theme-based. Highlighting aspects of embodiment, the study suggests that verb-based prompts were the most effective at eliciting stories that reflect diverse experiences of both women and men in processes of gender-transformation. Findings from our analysis can support evaluators in balancing simplicity and specificity of questions in assessing the unique experiences of individuals undergoing complex change.
{"title":"Eliciting stories of gender-transformative change: Investigating the effectiveness of question prompt formulations in qualitative gender assessments","authors":"Jess MacArthur, N. Carrard, Toeur Veasna, Tyler Kozole, J. Willetts","doi":"10.1177/13563890221105537","DOIUrl":"https://doi.org/10.1177/13563890221105537","url":null,"abstract":"Evaluations of gender equality initiatives in development programmes traditionally assess cognitive dimensions such as knowledge, attitudes, and awareness; and often rely solely on women’s perspectives. Leveraging story-based evaluation methods, this article explores the assessment of complex gender-transformations and focuses on effective question prompts to elicit significant and meaningful narratives of change from both women and men. In collaboration with a development programme in Cambodia, a staff assessment process led to a set of criteria for considering the quality of respondent stories and testing the efficacy of four different question prompts (n = 176): verb-, value-, sphere-, and theme-based. Highlighting aspects of embodiment, the study suggests that verb-based prompts were the most effective at eliciting stories that reflect diverse experiences of both women and men in processes of gender-transformation. Findings from our analysis can support evaluators in balancing simplicity and specificity of questions in assessing the unique experiences of individuals undergoing complex change.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87548229","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}