首页 > 最新文献

Performance Evaluation最新文献

英文 中文
Strategic access in a Green IoT(Internet of Things) system with an unreliable server 服务器不可靠的绿色物联网(IoT)系统中的战略访问
IF 2.2 4区 计算机科学 Q2 Mathematics Pub Date : 2022-10-01 DOI: 10.1016/j.peva.2022.102314
Kalpana Devarajan , Muthukrishnan Senthilkumar

The present research aims to study the strategic behaviour of users in an Internet of Things(IoT) system that is impeded by an unreliable server. In the system, an IoT device is equipped with an energy harvesting unit. The IoT system under study is employed as a Markovian retrial queueing system that is used in a single server, subject to active failures. The failed server is repaired immediately, while the user who was served before the system’s breakdown event waits in the server until the server is repaired. The generating function approach is used to identify important system performance metrics. Moreover, queueing theory concepts are incorporated into game theory for the analysis of the users’ strategies. The users in the IoT system, act to maximize their expected benefit without being perturbed by other users in the system and determine their equilibrium joining strategies. Furthermore, taking into account social welfare factors, the IoT device acts as a social planner, and as a consequence, socially optimal joining strategies are also analysed. Finally, the analytical findings are validated with numerical examples.

本研究旨在研究受不可靠服务器阻碍的物联网(IoT)系统中用户的战略行为。在该系统中,物联网设备配备了能量收集单元。所研究的物联网系统被用作在单个服务器中使用的马尔可夫重试排队系统,受主动故障的影响。发生故障的服务器立即得到修复,而在系统故障事件之前得到服务的用户则在服务器中等待,直到服务器得到修复。生成函数方法用于识别重要的系统性能指标。此外,将排队理论的概念引入博弈论,分析用户的策略。物联网系统中的用户在不受系统中其他用户干扰的情况下,以最大限度地提高其预期收益为目标,并确定其均衡加入策略。此外,考虑到社会福利因素,物联网设备充当社会规划师,因此,还分析了社会最佳加入策略。最后,通过数值算例对分析结果进行了验证。
{"title":"Strategic access in a Green IoT(Internet of Things) system with an unreliable server","authors":"Kalpana Devarajan ,&nbsp;Muthukrishnan Senthilkumar","doi":"10.1016/j.peva.2022.102314","DOIUrl":"10.1016/j.peva.2022.102314","url":null,"abstract":"<div><p>The present research aims to study the strategic behaviour of users in an Internet of Things(IoT) system that is impeded by an unreliable server. In the system, an IoT device is equipped with an energy harvesting<span> unit. The IoT system under study is employed as a Markovian retrial queueing system<span> that is used in a single server, subject to active failures. The failed server is repaired immediately, while the user who was served before the system’s breakdown event waits in the server until the server is repaired. The generating function approach is used to identify important system performance metrics. Moreover, queueing theory concepts are incorporated into game theory for the analysis of the users’ strategies. The users in the IoT system, act to maximize their expected benefit without being perturbed by other users in the system and determine their equilibrium joining strategies. Furthermore, taking into account social welfare factors, the IoT device acts as a social planner, and as a consequence, socially optimal joining strategies are also analysed. Finally, the analytical findings are validated with numerical examples.</span></span></p></div>","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74338509","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Stability and average delay in delay tolerant networks with Poisson packet arrivals and buffered relay nodes 具有泊松包到达和缓冲中继节点的时延容忍网络的稳定性和平均时延
IF 2.2 4区 计算机科学 Q2 Mathematics Pub Date : 2022-10-01 DOI: 10.1016/j.peva.2022.102319
Vineeth B.S. , Chandramani Singh

We consider a single-source single-destination delay tolerant network (DTN) with Poisson packet arrivals. The source uses a store and forward protocol which makes multiple copies of a packet to relays which buffer them until delivery to the destination. We characterize the stability threshold, defined as the maximum value of arrival rate for which the source has finite average queue length, as a function of number of relays, relay contact rate, relay packet buffer capacity, and number of packet copies. We analyse DTNs without packet delivery feedback and with instantaneous feedback. For DTNs without packet delivery feedback, we obtain a non-asymptotic analytical stability threshold and show that it only doubles as the relay-buffer capacity increases from one to infinity. For DTNs with instantaneous packet delivery feedback, we characterize the stability threshold using simulations. We also present an analytical approximation for the stability threshold in the case of unit relay-buffer capacity, and show that it is approximately double of that without feedback for large number of packet copies and relays. For DTNs with and without feedback, we also study the average delay performance through simulations. We obtain analytical approximations for the average delays of the packets for DTNs without feedback. We observe that the last-in-first-out relay to destination packet transmission policy has the minimum delay.

考虑一个具有泊松包到达的单源单目的容错延迟网络(DTN)。源使用存储和转发协议,该协议将数据包的多个副本发送给中继器,中继器缓冲它们,直到发送到目的地。我们将稳定性阈值定义为源具有有限平均队列长度时到达率的最大值,作为中继数量、中继接触率、中继数据包缓冲容量和数据包副本数量的函数。我们分析了没有分组传递反馈和有瞬时反馈的dtn。对于没有分组传递反馈的ddn,我们得到了一个非渐近的解析稳定性阈值,并且表明它只在中继缓冲容量从1增加到无穷大时加倍。对于具有瞬时数据包传递反馈的dtn,我们使用仿真来表征稳定性阈值。我们还给出了单位中继缓冲容量情况下的稳定性阈值的解析近似,并表明对于大量数据包副本和中继,其稳定性阈值大约是无反馈情况下的两倍。对于有反馈和无反馈的ddn,我们还通过仿真研究了平均延迟性能。我们得到了无反馈ddn的分组平均延迟的解析近似。我们观察到后进先出中继到目的数据包传输策略具有最小的延迟。
{"title":"Stability and average delay in delay tolerant networks with Poisson packet arrivals and buffered relay nodes","authors":"Vineeth B.S. ,&nbsp;Chandramani Singh","doi":"10.1016/j.peva.2022.102319","DOIUrl":"10.1016/j.peva.2022.102319","url":null,"abstract":"<div><p><span><span>We consider a single-source single-destination delay tolerant network (DTN) with Poisson </span>packet arrivals. The source uses a store and forward protocol which makes multiple copies of a packet to relays which buffer them until delivery to the destination. We characterize the stability threshold, defined as the maximum value of </span>arrival rate<span><span><span> for which the source has finite average queue length, as a function of number of relays, relay contact rate, relay packet buffer capacity, and number of packet copies. We analyse DTNs without </span>packet delivery feedback and with instantaneous feedback. For DTNs without packet delivery feedback, we obtain a non-asymptotic analytical stability threshold and show that it only doubles as the relay-buffer capacity increases from one to infinity. For DTNs with instantaneous packet delivery feedback, we characterize the stability threshold using simulations. We also present an analytical </span>approximation<span> for the stability threshold in the case of unit relay-buffer capacity, and show that it is approximately double of that without feedback for large number of packet copies and relays. For DTNs with and without feedback, we also study the average delay performance through simulations. We obtain analytical approximations for the average delays of the packets for DTNs without feedback. We observe that the last-in-first-out relay to destination packet transmission policy has the minimum delay.</span></span></p></div>","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85777097","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluating local system change using a comparative maturity matrix 使用比较成熟度矩阵评估局部系统变化
IF 2.2 4区 计算机科学 Q2 Mathematics Pub Date : 2022-09-27 DOI: 10.1177/13563890221126744
M. Coldwell, Sarah Pearson, Ian D. Wilson
This article focuses on the evaluation of the Children’s Community programme, addressing the question: how can evaluators effectively address complex place-based system change initiatives, particularly those working across differing contexts? After considering alternatives, including what we describe as ‘first-generation’ linear, logic model-based approaches and second-generation Theory of Change approaches, we discuss the development of ‘third-generation’ systems-change evaluations and articulate a novel comparative maturity matrix approach, developed for the evaluation of Children’s Communities with potential wider applicability for evaluation of complex systems change interventions. The article discusses the evaluation approach in depth and concludes with reflection on what learning points may be derived for use in subsequent evaluations of place-based and complex systems change initiatives.
本文重点关注儿童社区项目的评估,解决以下问题:评估人员如何有效地处理复杂的基于地点的系统变革倡议,特别是那些在不同背景下工作的倡议?在考虑了替代方法,包括我们所描述的“第一代”线性、基于逻辑模型的方法和第二代变化理论方法之后,我们讨论了“第三代”系统变化评估的发展,并阐明了一种新的比较成熟度矩阵方法,该方法是为评估儿童社区而开发的,具有更广泛的应用于评估复杂系统变化干预措施的潜力。这篇文章深入地讨论了评估方法,并总结了在后续的基于地点和复杂系统变化计划的评估中可以得到哪些学习点。
{"title":"Evaluating local system change using a comparative maturity matrix","authors":"M. Coldwell, Sarah Pearson, Ian D. Wilson","doi":"10.1177/13563890221126744","DOIUrl":"https://doi.org/10.1177/13563890221126744","url":null,"abstract":"This article focuses on the evaluation of the Children’s Community programme, addressing the question: how can evaluators effectively address complex place-based system change initiatives, particularly those working across differing contexts? After considering alternatives, including what we describe as ‘first-generation’ linear, logic model-based approaches and second-generation Theory of Change approaches, we discuss the development of ‘third-generation’ systems-change evaluations and articulate a novel comparative maturity matrix approach, developed for the evaluation of Children’s Communities with potential wider applicability for evaluation of complex systems change interventions. The article discusses the evaluation approach in depth and concludes with reflection on what learning points may be derived for use in subsequent evaluations of place-based and complex systems change initiatives.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80529756","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
French language abstracts 法语摘要
IF 2.2 4区 计算机科学 Q2 Mathematics Pub Date : 2022-09-27 DOI: 10.1177/13563890221129496
clés: Groupes de discussion; entretiens de groupe; évaluation fondée sur la théorie; évaluation réaliste; théorie de moyenne portée; théorie de programme de matrice comparative de maturité, développée pour l’évaluation des Réseaux pour l’Enfance, et susceptible d’une application plus large à l’évaluation des inter-ventions complexes de changement systémique. L’article formule une analyse approfondie de la méthode d’évaluation et conclut sur une réflexion portant sur les enseignements pratiques que l’on peut en tirer pour les évaluations à venir d’initiatives de changements systémiques localisés et complexes.
关键字:焦点小组;小组访谈;基于理论的评价;现实的评估;中程理论;比较矩阵成熟度计划理论,为评估儿童网络而发展,并可能更广泛地应用于评估复杂的系统变化干预。本文对评估方法进行了深入的分析,并总结了对未来评估局部和复杂的系统性变革举措的实践经验的反思。
{"title":"French language abstracts","authors":"","doi":"10.1177/13563890221129496","DOIUrl":"https://doi.org/10.1177/13563890221129496","url":null,"abstract":"clés: Groupes de discussion; entretiens de groupe; évaluation fondée sur la théorie; évaluation réaliste; théorie de moyenne portée; théorie de programme de matrice comparative de maturité, développée pour l’évaluation des Réseaux pour l’Enfance, et susceptible d’une application plus large à l’évaluation des inter-ventions complexes de changement systémique. L’article formule une analyse approfondie de la méthode d’évaluation et conclut sur une réflexion portant sur les enseignements pratiques que l’on peut en tirer pour les évaluations à venir d’initiatives de changements systémiques localisés et complexes.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77948035","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using digital technology to enhance youth participatory evaluation 利用数字技术加强青年参与性评价
IF 2.2 4区 计算机科学 Q2 Mathematics Pub Date : 2022-09-15 DOI: 10.1177/13563890221124713
Tze-Chang Liu
The aim of this study is to demonstrate the challenges encountered in youth participatory evaluation and how digital technology may assist in overcoming these challenges. The study explores the meaning of youth participatory evaluation and examines the challenges faced in utilizing the approach. We argue that using digital technology can help overcome many challenges of youth participatory evaluations, with the added benefit that such technology may also attract and influence young people to engage more fully with evaluation processes. These findings show that digital technology helps decrease adultism, increase adults’ capacity to engage with youth, and respond to and empower youth. Some practical guidelines and challenges are also discussed.
本研究的目的是展示青年参与性评估遇到的挑战,以及数字技术如何帮助克服这些挑战。本研究探讨了青年参与性评估的意义,并探讨了使用这种方法所面临的挑战。我们认为,使用数字技术可以帮助克服青年参与性评价的许多挑战,这种技术还可以吸引和影响年轻人更充分地参与评价进程,这是额外的好处。这些发现表明,数字技术有助于减少成人主义,提高成年人与青年接触的能力,并对青年作出反应并赋予青年权力。还讨论了一些实际的指导方针和挑战。
{"title":"Using digital technology to enhance youth participatory evaluation","authors":"Tze-Chang Liu","doi":"10.1177/13563890221124713","DOIUrl":"https://doi.org/10.1177/13563890221124713","url":null,"abstract":"The aim of this study is to demonstrate the challenges encountered in youth participatory evaluation and how digital technology may assist in overcoming these challenges. The study explores the meaning of youth participatory evaluation and examines the challenges faced in utilizing the approach. We argue that using digital technology can help overcome many challenges of youth participatory evaluations, with the added benefit that such technology may also attract and influence young people to engage more fully with evaluation processes. These findings show that digital technology helps decrease adultism, increase adults’ capacity to engage with youth, and respond to and empower youth. Some practical guidelines and challenges are also discussed.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74694867","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluation through narratives: A practical case of Participatory Narrative Inquiry in women empowerment evaluation in Niger 通过叙述进行评价:参与式叙述调查在尼日尔妇女赋权评价中的实践案例
IF 2.2 4区 计算机科学 Q2 Mathematics Pub Date : 2022-09-10 DOI: 10.1177/13563890221123821
E. Zucchini, M. Carbon, Christine Bosch, F. Felloni
This study explores the use of Participatory Narrative Inquiry (PNI) in evaluating development interventions by contributing to the debate of using participatory narrative methods. Stories on personal experience are used to evaluate the project’s effects as with similar methods such as Most Significant Change and Sensemaking. To the authors’ knowledge, this is one of the early applications of PNI to the evaluation of international development programmes. The study discusses advantages and limitations, and provides a scholarly reflection based on an application of PNI in the evaluation of gender and women’s empowerment in Niger. The study concludes that PNI is a powerful alternative to existing qualitative and participatory narrative evaluation methods. Within mixed-method approaches, PNI allows for greater inclusion of project beneficiaries in the evaluation process, while helping to elaborate a thorough theory of change, understand the complexity of the context, identify and assess outcome pathways, and provide an evidence-based evaluation.
本研究探讨了参与式叙事调查(PNI)在评估发展干预措施中的应用,为使用参与式叙事方法的辩论做出了贡献。个人经历的故事被用来评估项目的效果,与最重要的变化和意义制造类似的方法。据作者所知,这是PNI早期应用于国际发展计划的评价之一。该研究讨论了优势和局限性,并基于PNI在尼日尔性别和妇女赋权评估中的应用提供了学术反思。该研究得出结论,PNI是现有定性和参与式叙事评估方法的有力替代方案。在混合方法中,PNI允许在评估过程中更多地纳入项目受益人,同时有助于详细阐述变革的全面理论,了解背景的复杂性,识别和评估结果路径,并提供基于证据的评估。
{"title":"Evaluation through narratives: A practical case of Participatory Narrative Inquiry in women empowerment evaluation in Niger","authors":"E. Zucchini, M. Carbon, Christine Bosch, F. Felloni","doi":"10.1177/13563890221123821","DOIUrl":"https://doi.org/10.1177/13563890221123821","url":null,"abstract":"This study explores the use of Participatory Narrative Inquiry (PNI) in evaluating development interventions by contributing to the debate of using participatory narrative methods. Stories on personal experience are used to evaluate the project’s effects as with similar methods such as Most Significant Change and Sensemaking. To the authors’ knowledge, this is one of the early applications of PNI to the evaluation of international development programmes. The study discusses advantages and limitations, and provides a scholarly reflection based on an application of PNI in the evaluation of gender and women’s empowerment in Niger. The study concludes that PNI is a powerful alternative to existing qualitative and participatory narrative evaluation methods. Within mixed-method approaches, PNI allows for greater inclusion of project beneficiaries in the evaluation process, while helping to elaborate a thorough theory of change, understand the complexity of the context, identify and assess outcome pathways, and provide an evidence-based evaluation.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76770121","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Including multiple perspectives in participatory multi-criteria analysis: A framework for investigation 参与式多标准分析中的多视角:一种调查框架
IF 2.2 4区 计算机科学 Q2 Mathematics Pub Date : 2022-09-09 DOI: 10.1177/13563890221123822
M. Dean
Over the past few decades, a number of participatory multi-criteria analysis methods, combining deliberative procedures with multiple decision criteria assessment techniques, have been developed to tackle complex policy problems. However, several important aspects of such methods, including the way in which different and often contrasting viewpoints should be included in the analysis, appear to have been largely neglected by previous studies. Possible problems and drawbacks that may hamper the applicability and feasibility of multi-actor multi-criteria exercises and the utility and reliability of their outcomes also deserve further investigation. This article seeks to fill this knowledge gap by proposing a conceptual framework and classification scheme that illustrates the different possible approaches for identifying the key elements of the multi-criteria problem (i.e. options, objectives/criteria, weights and scores), while dealing with different points of view. It also discusses the potential advantages, disadvantages and issues of each approach and ultimately defines the overarching factors that should orientate the selection of one specific approach over the others.
在过去的几十年里,为了解决复杂的政策问题,已经发展了一些参与性的多标准分析方法,将审议程序与多重决策标准评估技术相结合。然而,这些方法的几个重要方面,包括在分析中应该包括不同的和经常是对比的观点的方式,似乎在很大程度上被以前的研究所忽视。可能妨碍多参与者多标准练习的适用性和可行性及其结果的效用和可靠性的问题和缺点也值得进一步调查。本文试图通过提出一个概念框架和分类方案来填补这一知识空白,该方案说明了识别多标准问题的关键要素(即选项、目标/标准、权重和分数)的不同可能方法,同时处理不同的观点。它还讨论了每种方法的潜在优点、缺点和问题,并最终定义了应该指导选择一种特定方法而不是其他方法的首要因素。
{"title":"Including multiple perspectives in participatory multi-criteria analysis: A framework for investigation","authors":"M. Dean","doi":"10.1177/13563890221123822","DOIUrl":"https://doi.org/10.1177/13563890221123822","url":null,"abstract":"Over the past few decades, a number of participatory multi-criteria analysis methods, combining deliberative procedures with multiple decision criteria assessment techniques, have been developed to tackle complex policy problems. However, several important aspects of such methods, including the way in which different and often contrasting viewpoints should be included in the analysis, appear to have been largely neglected by previous studies. Possible problems and drawbacks that may hamper the applicability and feasibility of multi-actor multi-criteria exercises and the utility and reliability of their outcomes also deserve further investigation. This article seeks to fill this knowledge gap by proposing a conceptual framework and classification scheme that illustrates the different possible approaches for identifying the key elements of the multi-criteria problem (i.e. options, objectives/criteria, weights and scores), while dealing with different points of view. It also discusses the potential advantages, disadvantages and issues of each approach and ultimately defines the overarching factors that should orientate the selection of one specific approach over the others.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74639094","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Developing a theory of change methodology to support the evaluation of place-based systems change interventions to support child and adolescent mental health and well-being 发展一种变革理论方法,以支持基于地方的系统的评估,改变干预措施,以支持儿童和青少年的心理健康和福祉
IF 2.2 4区 计算机科学 Q2 Mathematics Pub Date : 2022-09-04 DOI: 10.1177/13563890221110257
Robyn Doherty, N. Quinn, A. Colson, Amy Tucker, J. Cameron
Over the past few years, levels of mental health problems among children and adolescents have risen alongside an increased demand for services, which has driven the demand for a transformative systems change in how child and adolescent mental health services are delivered. Theory of change methodology is a valuable approach for advancing systems change. This article describes the theory of change process to evaluate a strategic partnership approach to advancing systems change improvements in child and adolescent’s mental health. This article describes the development and application of a theory of change methodology for these strategic partnerships, discussing the benefits derived from developing the theory of change and its use by the programme staff and evaluation team. This article also discusses the challenges and limitations of using this approach and recommendations for use more widely.
在过去几年中,儿童和青少年的精神卫生问题水平随着服务需求的增加而上升,这推动了对如何提供儿童和青少年精神卫生服务进行变革性系统变革的需求。变革理论方法论是推进系统变革的一种有价值的方法。这篇文章描述了变化过程的理论,以评估战略伙伴关系的方法来推进系统的变化,改善儿童和青少年的心理健康。本文描述了这些战略伙伴关系的变革理论方法的发展和应用,讨论了从发展变革理论及其在项目工作人员和评价小组中的应用中获得的好处。本文还讨论了使用这种方法的挑战和限制,并提出了更广泛使用这种方法的建议。
{"title":"Developing a theory of change methodology to support the evaluation of place-based systems change interventions to support child and adolescent mental health and well-being","authors":"Robyn Doherty, N. Quinn, A. Colson, Amy Tucker, J. Cameron","doi":"10.1177/13563890221110257","DOIUrl":"https://doi.org/10.1177/13563890221110257","url":null,"abstract":"Over the past few years, levels of mental health problems among children and adolescents have risen alongside an increased demand for services, which has driven the demand for a transformative systems change in how child and adolescent mental health services are delivered. Theory of change methodology is a valuable approach for advancing systems change. This article describes the theory of change process to evaluate a strategic partnership approach to advancing systems change improvements in child and adolescent’s mental health. This article describes the development and application of a theory of change methodology for these strategic partnerships, discussing the benefits derived from developing the theory of change and its use by the programme staff and evaluation team. This article also discusses the challenges and limitations of using this approach and recommendations for use more widely.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90972544","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Speaking truth to power: Exploring a Ministry’s evaluation department through evaluators’ and policymakers’ eyes 对权力说真话:通过评估者和决策者的眼睛探索部委的评估部门
IF 2.2 4区 计算机科学 Q2 Mathematics Pub Date : 2022-07-01 DOI: 10.1177/13563890221109620
Lotte Levelt, Nicky R. M. Pouw
‘Evidence-based’ development policy has caused impact evaluations to prioritise accountability over addressing processual learning questions. Moreover, evaluation scholarship is dominated by surveys, whereas qualitative research remains scant. This article traces one particular evaluation, within the independent Evaluation Department of the Dutch Ministry of Foreign Affairs. It asks, ‘How do evaluators and policymakers interact and what adjustments follow from the illustrative evaluation?’ It used participant observations, documents and interviews with policymakers and evaluators. An in-depth thematic analysis resulted in a typology of evaluator roles: (1) knowledge broker, (2) facilitator, (3) archive, (4) truth-revealing and (5) critical voice. Finally, policymakers and managers adjusted in three ways: symbolic, instrumental and empowerment. These results imply that if evaluators deliberate a suitable role, they (1) increase their partial understandings of the programme under scrutiny and the involved stakeholders, and (2) enhance the potential of synergies in collective learning to emerge in an evaluation team and the broader institution.
“基于证据的”发展政策导致影响评估优先考虑问责制,而不是解决过程学习问题。此外,评价学术主要是通过调查,而定性研究仍然很少。本文追溯荷兰外交部独立评价司内的一项特别评价。它问,“评估人员和政策制定者如何互动,说明性评估之后会有什么调整?”它使用了参与者的观察、文件以及对政策制定者和评估人员的采访。深入的专题分析产生了评估者角色的类型:(1)知识经纪人,(2)促进者,(3)档案,(4)真相揭示和(5)批评声音。最后,政策制定者和管理者以三种方式进行调整:象征性、工具性和赋权。这些结果表明,如果评估人员考虑合适的角色,他们(1)增加他们对被审查项目和相关利益相关者的部分理解,(2)增强集体学习在评估团队和更广泛的机构中出现的协同效应的潜力。
{"title":"Speaking truth to power: Exploring a Ministry’s evaluation department through evaluators’ and policymakers’ eyes","authors":"Lotte Levelt, Nicky R. M. Pouw","doi":"10.1177/13563890221109620","DOIUrl":"https://doi.org/10.1177/13563890221109620","url":null,"abstract":"‘Evidence-based’ development policy has caused impact evaluations to prioritise accountability over addressing processual learning questions. Moreover, evaluation scholarship is dominated by surveys, whereas qualitative research remains scant. This article traces one particular evaluation, within the independent Evaluation Department of the Dutch Ministry of Foreign Affairs. It asks, ‘How do evaluators and policymakers interact and what adjustments follow from the illustrative evaluation?’ It used participant observations, documents and interviews with policymakers and evaluators. An in-depth thematic analysis resulted in a typology of evaluator roles: (1) knowledge broker, (2) facilitator, (3) archive, (4) truth-revealing and (5) critical voice. Finally, policymakers and managers adjusted in three ways: symbolic, instrumental and empowerment. These results imply that if evaluators deliberate a suitable role, they (1) increase their partial understandings of the programme under scrutiny and the involved stakeholders, and (2) enhance the potential of synergies in collective learning to emerge in an evaluation team and the broader institution.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86378747","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Eliciting stories of gender-transformative change: Investigating the effectiveness of question prompt formulations in qualitative gender assessments 引出关于性别变革的故事:调查在性别质量评估中问题提示的有效性
IF 2.2 4区 计算机科学 Q2 Mathematics Pub Date : 2022-07-01 DOI: 10.1177/13563890221105537
Jess MacArthur, N. Carrard, Toeur Veasna, Tyler Kozole, J. Willetts
Evaluations of gender equality initiatives in development programmes traditionally assess cognitive dimensions such as knowledge, attitudes, and awareness; and often rely solely on women’s perspectives. Leveraging story-based evaluation methods, this article explores the assessment of complex gender-transformations and focuses on effective question prompts to elicit significant and meaningful narratives of change from both women and men. In collaboration with a development programme in Cambodia, a staff assessment process led to a set of criteria for considering the quality of respondent stories and testing the efficacy of four different question prompts (n = 176): verb-, value-, sphere-, and theme-based. Highlighting aspects of embodiment, the study suggests that verb-based prompts were the most effective at eliciting stories that reflect diverse experiences of both women and men in processes of gender-transformation. Findings from our analysis can support evaluators in balancing simplicity and specificity of questions in assessing the unique experiences of individuals undergoing complex change.
对发展方案中两性平等倡议的评价传统上评价认知方面,如知识、态度和认识;而且往往只依赖于女性的观点。利用基于故事的评估方法,本文探讨了对复杂性别转变的评估,并着重于有效的问题提示,以引出女性和男性对变化的重要和有意义的叙述。与柬埔寨的一个发展方案合作,一个工作人员评估过程产生了一套标准,用于考虑受访者故事的质量,并测试四种不同问题提示(n = 176)的有效性:动词、价值、领域和主题。该研究强调了具体化的各个方面,表明以动词为基础的提示在引出反映男女在性别转变过程中不同经历的故事时最有效。我们的分析结果可以支持评估者在评估经历复杂变化的个体的独特经历时平衡问题的简单性和特异性。
{"title":"Eliciting stories of gender-transformative change: Investigating the effectiveness of question prompt formulations in qualitative gender assessments","authors":"Jess MacArthur, N. Carrard, Toeur Veasna, Tyler Kozole, J. Willetts","doi":"10.1177/13563890221105537","DOIUrl":"https://doi.org/10.1177/13563890221105537","url":null,"abstract":"Evaluations of gender equality initiatives in development programmes traditionally assess cognitive dimensions such as knowledge, attitudes, and awareness; and often rely solely on women’s perspectives. Leveraging story-based evaluation methods, this article explores the assessment of complex gender-transformations and focuses on effective question prompts to elicit significant and meaningful narratives of change from both women and men. In collaboration with a development programme in Cambodia, a staff assessment process led to a set of criteria for considering the quality of respondent stories and testing the efficacy of four different question prompts (n = 176): verb-, value-, sphere-, and theme-based. Highlighting aspects of embodiment, the study suggests that verb-based prompts were the most effective at eliciting stories that reflect diverse experiences of both women and men in processes of gender-transformation. Findings from our analysis can support evaluators in balancing simplicity and specificity of questions in assessing the unique experiences of individuals undergoing complex change.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87548229","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
期刊
Performance Evaluation
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1