首页 > 最新文献

Performance Evaluation最新文献

英文 中文
Secrecy performance analysis of UAV-based full-duplex two-way relay NOMA system 基于无人机的全双工双向中继NOMA系统保密性能分析
IF 2.2 4区 计算机科学 Q4 COMPUTER SCIENCE, HARDWARE & ARCHITECTURE Pub Date : 2023-09-01 DOI: 10.1016/j.peva.2023.102352
Thanh Trung Nguyen , Van Toan Hoang , Manh Hoang Tran , T. Thanh Huyen Le , Xuan Nam Tran

In this paper, we investigate the secrecy performance of an unmanned aerial vehicle (UAV)-based full-duplex (FD) two-way relay non-orthogonal multiple access (TWR-NOMA) system with two terrestrial users and an eavesdropper. To ensure secure communications, a UAV acts as an aerial relay station, which not only forwards confidential information to legitimate users but also keeps emitting the jamming signal to degrade the performance of any potential eavesdropper. The ergodic secrecy rate (ESR) and secrecy outage probability (SOP) of users and the system are successfully investigated under the assumption of imperfect successive interference and self-interference cancellation. In addition, to provide a better understanding of the secrecy performance, mathematical expressions of asymptotic ESR, secrecy slope, asymptotic SOP, and secrecy diversity order are also studied. Simulation results demonstrate that the FD TWR-NOMA system attains better secrecy performance than that of the FD TWR-NOMA system with a terrestrial relay, the FD TWR-NOMA system without jamming signal, as well as the half-duplex TWR-NOMA system. The secrecy performance of the system is significantly enhanced when UAVs approach the remote user. Furthermore, there is a reasonable power allocation value for jamming and legitimate signals on the UAV to improve secrecy performance.

在本文中,我们研究了一个基于无人机的全双工(FD)双向中继非正交多址(TWR-NOMA)系统的保密性能,该系统具有两个地面用户和一个窃听器。为了确保通信安全,无人机充当空中中继站,不仅将机密信息转发给合法用户,还不断发射干扰信号,以降低任何潜在窃听者的性能。在不完全连续干扰和自干扰消除的假设下,成功地研究了用户和系统的遍历保密率(ESR)和保密中断概率(SOP)。此外,为了更好地理解保密性能,还研究了渐近ESR、保密斜率、渐近SOP和保密分集阶的数学表达式。仿真结果表明,与带地面中继的FD TWR-NOMA系统、无干扰信号的FD TWR-NOMA系统以及半双工TWR-NOMA系统相比,该系统具有更好的保密性能。当无人机接近远程用户时,系统的保密性能显著增强。此外,无人机上的干扰和合法信号有一个合理的功率分配值,以提高保密性能。
{"title":"Secrecy performance analysis of UAV-based full-duplex two-way relay NOMA system","authors":"Thanh Trung Nguyen ,&nbsp;Van Toan Hoang ,&nbsp;Manh Hoang Tran ,&nbsp;T. Thanh Huyen Le ,&nbsp;Xuan Nam Tran","doi":"10.1016/j.peva.2023.102352","DOIUrl":"https://doi.org/10.1016/j.peva.2023.102352","url":null,"abstract":"<div><p><span><span>In this paper, we investigate the secrecy performance of an unmanned aerial vehicle (UAV)-based full-duplex (FD) two-way relay non-orthogonal multiple access (TWR-NOMA) system with two terrestrial users and an eavesdropper. To ensure secure communications, a UAV acts as an aerial relay station, which not only forwards confidential information to legitimate users but also keeps emitting the jamming signal to degrade the performance of any potential eavesdropper. The ergodic secrecy rate (ESR) and secrecy outage </span>probability (SOP) of users and the system are successfully investigated under the assumption of imperfect successive interference and self-interference cancellation. In addition, to provide a better understanding of the secrecy performance, mathematical expressions of asymptotic ESR, secrecy slope, asymptotic SOP, and secrecy </span>diversity order<span> are also studied. Simulation results demonstrate that the FD TWR-NOMA system attains better secrecy performance than that of the FD TWR-NOMA system with a terrestrial relay, the FD TWR-NOMA system without jamming signal, as well as the half-duplex TWR-NOMA system. The secrecy performance of the system is significantly enhanced when UAVs approach the remote user. Furthermore, there is a reasonable power allocation value for jamming and legitimate signals on the UAV to improve secrecy performance.</span></p></div>","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":"161 ","pages":"Article 102352"},"PeriodicalIF":2.2,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49756691","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Resource allocation for URLLC and eMBB traffic in uplink wireless networks 无线上行网络中URLLC和eMBB业务的资源分配
IF 2.2 4区 计算机科学 Q4 COMPUTER SCIENCE, HARDWARE & ARCHITECTURE Pub Date : 2023-09-01 DOI: 10.1016/j.peva.2023.102353
Duan-Shin Lee , Cheng-Shang Chang , Ruhui Zhang , Mao-Pin Lee

In this paper we consider two resource allocation problems of URLLC traffic and eMBB traffic in uplink 5G networks. We propose to divide frequencies into a common region and a grant-based region. Frequencies in the grant-based region can only be used by eMBB traffic, while frequencies in the common region can be used by eMBB traffic as well as URLLC traffic. In the first resource allocation problem we propose a two-player game to address the size of the grant-based region and the size of the common region. We show that this game has specific pure Nash equilibria. In the second resource allocation problem we determine the number of bits that each eMBB user can transmit in a request-grant cycle. We propose a constrained optimization problem to minimize the variance of the number of bits granted to the eMBB users. We show that a water-filling algorithm solves this constrained optimization problem. From simulation, we show that our scheme, consisting of resource allocation according to Nash equilibria of a game, persistent random transmission of URLLC packets and allocation of eMBB packets by a water-filling algorithm, works better than four other heuristic methods.

在本文中,我们考虑了上行链路5G网络中URLLC流量和eMBB流量的两个资源分配问题。我们建议将频率划分为一个共同区域和一个基于拨款的区域。基于授权的区域中的频率只能由eMBB流量使用,而公共区域中的频谱可以由eMBB以及URLLC流量使用。在第一个资源分配问题中,我们提出了一个两人博弈来解决基于授权的区域的大小和公共区域的大小。我们证明了此对策具有特定的纯纳什均衡。在第二个资源分配问题中,我们确定每个eMBB用户在请求授权周期中可以发送的比特数。我们提出了一个约束优化问题,以最小化授予eMBB用户的比特数的方差。我们证明了注水算法解决了这个约束优化问题。通过仿真,我们表明,我们的方案,包括根据博弈的纳什均衡进行资源分配,URLLC分组的持久随机传输和eMBB分组的注水算法分配,比其他四种启发式方法效果更好。
{"title":"Resource allocation for URLLC and eMBB traffic in uplink wireless networks","authors":"Duan-Shin Lee ,&nbsp;Cheng-Shang Chang ,&nbsp;Ruhui Zhang ,&nbsp;Mao-Pin Lee","doi":"10.1016/j.peva.2023.102353","DOIUrl":"https://doi.org/10.1016/j.peva.2023.102353","url":null,"abstract":"<div><p><span><span>In this paper we consider two resource allocation problems of URLLC<span> traffic and eMBB traffic in uplink </span></span>5G networks. We propose to divide frequencies into a common region and a grant-based region. Frequencies in the grant-based region can only be used by eMBB traffic, while frequencies in the common region can be used by eMBB traffic as well as URLLC traffic. In the first resource allocation problem we propose a two-player game to address the size of the grant-based region and the size of the common region. We show that this game has specific pure </span>Nash equilibria<span><span>. In the second resource allocation problem we determine the number of bits that each eMBB user can transmit in a request-grant cycle. We propose a constrained optimization problem to minimize the variance of the number of bits granted to the eMBB users. We show that a water-filling algorithm solves this constrained optimization problem. From simulation, we show that our scheme, consisting of resource allocation according to Nash equilibria of a game, persistent random transmission of URLLC packets and allocation of eMBB packets by a water-filling algorithm, works better than four other </span>heuristic methods.</span></p></div>","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":"161 ","pages":"Article 102353"},"PeriodicalIF":2.2,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49701143","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Stability of a stochastic ring network 随机环网络的稳定性
IF 2.2 4区 计算机科学 Q4 COMPUTER SCIENCE, HARDWARE & ARCHITECTURE Pub Date : 2023-08-28 DOI: 10.1016/j.peva.2023.102355
Pieter Jacob Storm , Wouter Kager , Michel Mandjes , Sem Borst

In this paper we establish a necessary and sufficient stability condition for a stochastic ring network. Such networks naturally appear in a variety of applications within communication, computer, and road traffic systems. They typically involve multiple customer types and some form of priority structure to decide which customer receives service. These two system features tend to complicate the issue of identifying a stability condition, but we demonstrate how the ring topology can be leveraged to solve the problem.

本文建立了随机环网络稳定的一个充要条件。这种网络自然出现在通信、计算机和道路交通系统中的各种应用中。它们通常涉及多种客户类型和某种形式的优先级结构,以决定哪个客户接受服务。这两个系统特征往往会使确定稳定性条件的问题复杂化,但我们展示了如何利用环形拓扑来解决问题。
{"title":"Stability of a stochastic ring network","authors":"Pieter Jacob Storm ,&nbsp;Wouter Kager ,&nbsp;Michel Mandjes ,&nbsp;Sem Borst","doi":"10.1016/j.peva.2023.102355","DOIUrl":"https://doi.org/10.1016/j.peva.2023.102355","url":null,"abstract":"<div><p>In this paper we establish a necessary and sufficient stability condition for a stochastic ring network. Such networks naturally appear in a variety of applications within communication, computer, and road traffic systems. They typically involve <em>multiple customer types</em> and some form of <em>priority structure</em> to decide which customer receives service. These two system features tend to complicate the issue of identifying a stability condition, but we demonstrate how the ring topology can be leveraged to solve the problem.</p></div>","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":"162 ","pages":"Article 102355"},"PeriodicalIF":2.2,"publicationDate":"2023-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49874547","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Efficient and accurate Lyapunov function-based truncation technique for multi-dimensional Markov chains with applications to discriminatory processor sharing and priority queues 基于Lyapunov函数的多维马尔可夫链截断技术及其在判别处理器共享和优先级队列中的应用
IF 2.2 4区 计算机科学 Q4 COMPUTER SCIENCE, HARDWARE & ARCHITECTURE Pub Date : 2023-08-10 DOI: 10.1016/j.peva.2023.102356
Gagan Somashekar , Mohammad Delasay , Anshul Gandhi

Online service providers aim to satisfy the tail performance requirements of customers through Service-Level Objectives (SLOs). One approach to ensure tail performance requirements is to model the service as a Markov chain and obtain its steady-state probability distribution. However, obtaining the distribution can be challenging, if not impossible, for certain types of Markov chains, such as those with multi-dimensional or infinite state-space and state-dependent transitions. Examples include M/M/1 with Discriminatory Processor Sharing (DPS) and preemptive M/M/c with multiple priority classes and customer abandonment.

To address this fundamental problem, we propose a Lyapunov function-based state-space truncation technique that leverages moments or bounds on moments of the state variables. This technique allows us to obtain tight truncation bounds while ensuring arbitrary probability mass guarantees for the truncated chain. We highlight the efficacy of our technique for multi-dimensional DPS and M/M/c priority queue with abandonment, demonstrating a substantial reduction in state space (up to 74%) compared to existing approaches. Additionally, we present three practical use cases that highlight the applicability of our truncation technique by analyzing the performance of the DPS system.

在线服务提供商的目标是通过服务水平目标(service - level Objectives, slo)来满足客户的尾部性能需求。一种确保尾部性能要求的方法是将服务建模为马尔可夫链,并获得其稳态概率分布。然而,对于某些类型的马尔可夫链,例如具有多维或无限状态空间和状态依赖转换的马尔可夫链,获得分布可能是具有挑战性的,如果不是不可能的话。例子包括具有歧视性处理器共享(DPS)的M/M/1和具有多个优先级类和客户放弃的抢占式M/M/c。为了解决这个基本问题,我们提出了一种基于李雅普诺夫函数的状态空间截断技术,该技术利用状态变量的矩或矩界。这种技术允许我们在保证截断链的任意概率质量保证的同时获得严密的截断边界。我们强调了我们的技术在多维DPS和带放弃的M/M/c优先队列中的有效性,与现有方法相比,显示了状态空间的大幅减少(高达74%)。此外,我们提出了三个实际用例,通过分析DPS系统的性能来突出我们的截断技术的适用性。
{"title":"Efficient and accurate Lyapunov function-based truncation technique for multi-dimensional Markov chains with applications to discriminatory processor sharing and priority queues","authors":"Gagan Somashekar ,&nbsp;Mohammad Delasay ,&nbsp;Anshul Gandhi","doi":"10.1016/j.peva.2023.102356","DOIUrl":"https://doi.org/10.1016/j.peva.2023.102356","url":null,"abstract":"<div><p>Online service providers aim to satisfy the tail performance requirements of customers through Service-Level Objectives (SLOs). One approach to ensure tail performance requirements is to model the service as a Markov chain and obtain its steady-state probability distribution. However, obtaining the distribution can be challenging, if not impossible, for certain types of Markov chains, such as those with multi-dimensional or infinite state-space and state-dependent transitions. Examples include M/M/1 with Discriminatory Processor Sharing (DPS) and preemptive M/M/c with multiple priority classes and customer abandonment.</p><p>To address this fundamental problem, we propose a Lyapunov function-based state-space truncation technique that leverages moments or bounds on moments of the state variables. This technique allows us to obtain tight truncation bounds while ensuring arbitrary probability mass guarantees for the truncated chain. We highlight the efficacy of our technique for multi-dimensional DPS and M/M/c priority queue with abandonment, demonstrating a substantial reduction in state space (up to 74%) compared to existing approaches. Additionally, we present three practical use cases that highlight the applicability of our truncation technique by analyzing the performance of the DPS system.</p></div>","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":"162 ","pages":"Article 102356"},"PeriodicalIF":2.2,"publicationDate":"2023-08-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49874544","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Reflections on good practice in evaluating Violence Reduction Units: Experiences from across England and Wales 对评估减少暴力单位良好做法的思考:来自英格兰和威尔士各地的经验
IF 2.2 4区 计算机科学 Q4 COMPUTER SCIENCE, HARDWARE & ARCHITECTURE Pub Date : 2023-07-01 DOI: 10.1177/13563890231183993
L. Caulfield, Z. Quigg, Nicole M. Adams-Quackenbush, H. Timpson, Sophie Wilson
Internationally, interpersonal violence places huge burdens on the health, wellbeing and prosperity of society. In response to a notable increase in serious knife crime, in 2019, the UK Government awarded £35 million for the establishment of 18 Violence Reduction Units (VRUs) across England and Wales. There has been limited evaluation of community-level approaches for violence, with almost no published literature on the impact of VRUs. The article presents the approaches and experiences of two interdisciplinary teams of researchers from public health, psychology, criminology, and systems change, working as evaluators of four VRUs in England and Wales. The article describes the value of adopting a whole-system approach to evaluations, outlines good practice in evaluating VRUs, and elicits challenges to developing and embedding evaluation within complex systems.
在国际上,人际暴力给社会的健康、福祉和繁荣带来巨大负担。为应对严重持刀犯罪的显著增加,2019年,英国政府拨款3500万英镑,在英格兰和威尔士建立了18个减少暴力单位。对社区层面的暴力处理方法的评估有限,几乎没有关于虚拟吸毒者影响的已发表文献。本文介绍了来自公共卫生、心理学、犯罪学和系统变化的两个跨学科研究小组的方法和经验,他们作为英格兰和威尔士四个虚拟现实单位的评估者。本文描述了采用全系统方法进行评估的价值,概述了评估vru的良好做法,并引出了在复杂系统中开发和嵌入评估的挑战。
{"title":"Reflections on good practice in evaluating Violence Reduction Units: Experiences from across England and Wales","authors":"L. Caulfield, Z. Quigg, Nicole M. Adams-Quackenbush, H. Timpson, Sophie Wilson","doi":"10.1177/13563890231183993","DOIUrl":"https://doi.org/10.1177/13563890231183993","url":null,"abstract":"Internationally, interpersonal violence places huge burdens on the health, wellbeing and prosperity of society. In response to a notable increase in serious knife crime, in 2019, the UK Government awarded £35 million for the establishment of 18 Violence Reduction Units (VRUs) across England and Wales. There has been limited evaluation of community-level approaches for violence, with almost no published literature on the impact of VRUs. The article presents the approaches and experiences of two interdisciplinary teams of researchers from public health, psychology, criminology, and systems change, working as evaluators of four VRUs in England and Wales. The article describes the value of adopting a whole-system approach to evaluations, outlines good practice in evaluating VRUs, and elicits challenges to developing and embedding evaluation within complex systems.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":"78 1","pages":"276 - 295"},"PeriodicalIF":2.2,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81446590","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Giving critical theoretical and evaluation practice context to ‘Testing, Testing’ in Jamaica 为牙买加的“测试,测试”提供关键的理论和评估实践背景
IF 2.2 4区 计算机科学 Q4 COMPUTER SCIENCE, HARDWARE & ARCHITECTURE Pub Date : 2023-07-01 DOI: 10.1177/13563890231184274
D. Leslie, Keenan Falconer, Chantol Dormer, Thelma White
This article examines how evaluability assessments can be designed and conducted to generate meaningful and actionable results for reducing youth crime in Jamaica. It draws on case illustrations from the 2021 ‘Testing, Testing’ CAPRI research study report to highlight the nexus between research and evaluation and promote adopting practices that can enhance the quality and relevance of evaluations conducted within the Caribbean region and beyond. The findings suggest that data needed to inform evaluation and evidenced-based policymaking remain limited despite re-energised regional and global efforts to address this challenge. Particularly, low data quality, production, and use continue to hinder measuring progress on the Sustainable Development Goals. The article, therefore, offers an accessible decolonising framework for understanding, supporting and critically assessing how inertia within the context of evaluation practice can be challenged. Concrete suggestions for action include using local knowledge and underutilised techniques such as evaluability assessments.
本文探讨了如何设计和实施可评估性评估,以产生有意义和可操作的结果,以减少牙买加的青少年犯罪。它借鉴了2021年“测试,测试”CAPRI研究报告中的案例说明,以突出研究与评估之间的联系,并促进采用可提高加勒比地区内外开展的评估的质量和相关性的做法。研究结果表明,尽管区域和全球为应对这一挑战重新注入了活力,但为评估和基于证据的决策提供信息所需的数据仍然有限。特别是,低质量的数据、生产和使用继续阻碍衡量可持续发展目标的进展。因此,本文提供了一个易于理解的非殖民化框架,用于理解、支持和批判性地评估如何挑战评估实践背景下的惯性。具体的行动建议包括利用当地知识和未充分利用的技术,如可评价性评估。
{"title":"Giving critical theoretical and evaluation practice context to ‘Testing, Testing’ in Jamaica","authors":"D. Leslie, Keenan Falconer, Chantol Dormer, Thelma White","doi":"10.1177/13563890231184274","DOIUrl":"https://doi.org/10.1177/13563890231184274","url":null,"abstract":"This article examines how evaluability assessments can be designed and conducted to generate meaningful and actionable results for reducing youth crime in Jamaica. It draws on case illustrations from the 2021 ‘Testing, Testing’ CAPRI research study report to highlight the nexus between research and evaluation and promote adopting practices that can enhance the quality and relevance of evaluations conducted within the Caribbean region and beyond. The findings suggest that data needed to inform evaluation and evidenced-based policymaking remain limited despite re-energised regional and global efforts to address this challenge. Particularly, low data quality, production, and use continue to hinder measuring progress on the Sustainable Development Goals. The article, therefore, offers an accessible decolonising framework for understanding, supporting and critically assessing how inertia within the context of evaluation practice can be challenged. Concrete suggestions for action include using local knowledge and underutilised techniques such as evaluability assessments.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":"56 1","pages":"296 - 314"},"PeriodicalIF":2.2,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90322153","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Comprehensive evaluation framework building for integrated development program 综合发展规划综合评价框架构建
IF 2.2 4区 计算机科学 Q4 COMPUTER SCIENCE, HARDWARE & ARCHITECTURE Pub Date : 2023-07-01 DOI: 10.1177/13563890231183990
Jae Eun Shin, Mi Joung Yu, Suk-won Lee
The integrated development program, a cross-sectional development approach targeting a specific region or village, is receiving increasing attention as the 2030 agenda emphasizes a holistic approach in solving the poverty problem. The conventional evaluation designed for a causal inference of project-level outcome is incapable of reflecting the characteristics of the integrated development program. In this regard, we analyzed the unique features of the integrated development program by applying policy design theory to identify the challenges of evaluating this type of program. We then derived the logic of causal inference from the generative causation approach to resolve these challenges and developed practical evaluation tools, including causal maps and the evaluation matrix. These tools can be applied to respond to the evaluation questions related to the characteristics of the integrated development program, such as chain of causality, interactions between the outcomes, and many-to-many correspondence between aid-providers and recipients.
随着2030年可持续发展议程强调以整体方法解决贫困问题,以特定地区或村庄为目标的横向发展方法——综合发展计划正受到越来越多的关注。为项目级结果的因果推理而设计的传统评估无法反映综合开发计划的特征。在这方面,我们通过运用政策设计理论来分析综合发展计划的独特性,以确定评估这类计划的挑战。然后,我们从生成因果关系方法中推导出因果推理的逻辑,以解决这些挑战,并开发出实用的评估工具,包括因果图和评估矩阵。这些工具可用于回答与综合发展项目特征相关的评估问题,如因果链、结果之间的相互作用以及援助国和受援国之间的多对多对应关系。
{"title":"Comprehensive evaluation framework building for integrated development program","authors":"Jae Eun Shin, Mi Joung Yu, Suk-won Lee","doi":"10.1177/13563890231183990","DOIUrl":"https://doi.org/10.1177/13563890231183990","url":null,"abstract":"The integrated development program, a cross-sectional development approach targeting a specific region or village, is receiving increasing attention as the 2030 agenda emphasizes a holistic approach in solving the poverty problem. The conventional evaluation designed for a causal inference of project-level outcome is incapable of reflecting the characteristics of the integrated development program. In this regard, we analyzed the unique features of the integrated development program by applying policy design theory to identify the challenges of evaluating this type of program. We then derived the logic of causal inference from the generative causation approach to resolve these challenges and developed practical evaluation tools, including causal maps and the evaluation matrix. These tools can be applied to respond to the evaluation questions related to the characteristics of the integrated development program, such as chain of causality, interactions between the outcomes, and many-to-many correspondence between aid-providers and recipients.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":"23 1","pages":"356 - 378"},"PeriodicalIF":2.2,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87839959","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
How to develop a realist programme theory using Margaret Archer’s structure–agency–culture framework: The case of adolescent accountability for sexual and reproductive health in urban resource-constrained settings 如何利用玛格丽特·阿彻的结构-机构-文化框架发展现实主义方案理论:在城市资源有限的环境中,青少年对性健康和生殖健康的责任案例
IF 2.2 4区 计算机科学 Q4 COMPUTER SCIENCE, HARDWARE & ARCHITECTURE Pub Date : 2023-06-30 DOI: 10.1177/13563890231185167
Sara Van Belle, I. Abejirinde, A. Ssennyonjo, P. Srinivas, P. Hebbar, B. Marchal
Realist evaluation is in essence a theory-building and testing approach. We argue that in practice, the theory-building potential of realist evaluation, review and research is not fully exploited in the field of global health. Our assumption is that the Structure-Agency-Culture explanatory framework of critical realist Margaret Archer could stimulate realist evaluators to conceptualize and systematically explore how structural and cultural conditions interact with programmes that aim at introducing social change. We propose step-wise guidance towards integrating the Structure–Agency–Culture framework into the development of realist programme theories. We present a worked example from an urban adolescent health study in poor neighbourhoods of Kampala, Mumbai, New Delhi and Cotonou. The guidance aims to bring to the fore the role of agency and context through the analysis of the interactions between structure, culture, agency and mechanisms. This is helpful in realist research in general, and in evaluations of complex interventions oriented towards social change.
现实主义评价本质上是一种理论建构和检验方法。我们认为,在实践中,现实主义评价、审查和研究的理论建设潜力在全球卫生领域没有得到充分利用。我们的假设是,批判现实主义玛格丽特·阿切尔的结构-机构-文化解释框架可以刺激现实主义评估者概念化和系统地探索结构和文化条件如何与旨在引入社会变革的计划相互作用。我们建议逐步指导将结构-机构-文化框架整合到现实主义方案理论的发展中。我们提供了一个在坎帕拉、孟买、新德里和科托努的贫困社区进行的城市青少年健康研究的工作实例。该指南旨在通过分析结构、文化、机构和机制之间的相互作用,突出机构和环境的作用。这在一般的现实主义研究和对面向社会变革的复杂干预措施的评估中是有帮助的。
{"title":"How to develop a realist programme theory using Margaret Archer’s structure–agency–culture framework: The case of adolescent accountability for sexual and reproductive health in urban resource-constrained settings","authors":"Sara Van Belle, I. Abejirinde, A. Ssennyonjo, P. Srinivas, P. Hebbar, B. Marchal","doi":"10.1177/13563890231185167","DOIUrl":"https://doi.org/10.1177/13563890231185167","url":null,"abstract":"Realist evaluation is in essence a theory-building and testing approach. We argue that in practice, the theory-building potential of realist evaluation, review and research is not fully exploited in the field of global health. Our assumption is that the Structure-Agency-Culture explanatory framework of critical realist Margaret Archer could stimulate realist evaluators to conceptualize and systematically explore how structural and cultural conditions interact with programmes that aim at introducing social change. We propose step-wise guidance towards integrating the Structure–Agency–Culture framework into the development of realist programme theories. We present a worked example from an urban adolescent health study in poor neighbourhoods of Kampala, Mumbai, New Delhi and Cotonou. The guidance aims to bring to the fore the role of agency and context through the analysis of the interactions between structure, culture, agency and mechanisms. This is helpful in realist research in general, and in evaluations of complex interventions oriented towards social change.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":"68 1","pages":"259 - 275"},"PeriodicalIF":2.2,"publicationDate":"2023-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78644832","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Understanding evaluation use from an organisational perspective: A review of the literature and a research agenda 从组织角度理解评估使用:文献回顾和研究议程
IF 2.2 4区 计算机科学 Q4 COMPUTER SCIENCE, HARDWARE & ARCHITECTURE Pub Date : 2023-06-30 DOI: 10.1177/13563890231185164
T. Kupiec, Dorota Celińska-Janowicz, V. Pattyn
Why do some types of evaluation use prevail in certain contexts and not in others? The aim of this article is to advance knowledge about organisational factors of evaluation use, that is, determinants of evaluation use grounded in organisational theories. We critically review existing frameworks of organisational factors of evaluation use, highlighting key differences between them and pointing out discrepancies with empirical insights. We discuss the merits of two potential areas for future research that can help concretise theoretical stances: considering organisational legitimacy as a potential direct determinant of evaluation use and incorporating a dynamic perspective in organisational frameworks of evaluation use.
为什么某些类型的评估使用在某些上下文中流行,而在其他上下文中不流行?本文的目的是促进对评价使用的组织因素的认识,即基于组织理论的评价使用的决定因素。我们批判性地审查现有的评估使用的组织因素框架,突出它们之间的关键差异,并指出与经验见解的差异。我们讨论了未来研究的两个潜在领域的优点,可以帮助具体化理论立场:将组织合法性视为评估使用的潜在直接决定因素,并在评估使用的组织框架中纳入动态视角。
{"title":"Understanding evaluation use from an organisational perspective: A review of the literature and a research agenda","authors":"T. Kupiec, Dorota Celińska-Janowicz, V. Pattyn","doi":"10.1177/13563890231185164","DOIUrl":"https://doi.org/10.1177/13563890231185164","url":null,"abstract":"Why do some types of evaluation use prevail in certain contexts and not in others? The aim of this article is to advance knowledge about organisational factors of evaluation use, that is, determinants of evaluation use grounded in organisational theories. We critically review existing frameworks of organisational factors of evaluation use, highlighting key differences between them and pointing out discrepancies with empirical insights. We discuss the merits of two potential areas for future research that can help concretise theoretical stances: considering organisational legitimacy as a potential direct determinant of evaluation use and incorporating a dynamic perspective in organisational frameworks of evaluation use.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":"134 1","pages":"338 - 355"},"PeriodicalIF":2.2,"publicationDate":"2023-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77871560","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Challenges and strategies for implementers and evaluators working in conflict settings 在冲突环境中工作的实施者和评估者面临的挑战和策略
IF 2.2 4区 计算机科学 Q4 COMPUTER SCIENCE, HARDWARE & ARCHITECTURE Pub Date : 2023-05-11 DOI: 10.1177/13563890231171608
Laura Bond, Elizabeth K. Klein, Emily F. Gates
Practitioners implementing and evaluating humanitarian programs in conflict zones face unique challenges requiring context-sensitive guidance. Conflict zones—geographical areas with militarized and non-militarized violence, widespread political instability, and state-sanctioned intimidation and genocidal violence—are rife with logistical, methodological, and ethical challenges that impact implementation and evaluation. Although challenges have been well-documented, few solutions or evaluation frameworks exist to help evaluators in conflict zones confront these challenges. This article examines how the application of implementation science frameworks, specifically, Reach, Effectiveness, Adoption, Implementation, and Maintenance and the Consolidated Framework for Implementation Research, offers useful strategies to mitigate some challenges in conducting evaluations in conflict zones. Areas for future research include collaborative team approaches to using these frameworks, ethical guidance, and reporting and dissemination.
在冲突地区实施和评估人道主义项目的从业人员面临着独特的挑战,需要根据具体情况提供指导。冲突地区——存在军事化和非军事化暴力、广泛的政治不稳定以及国家批准的恐吓和种族灭绝暴力的地理区域——充斥着影响实施和评估的后勤、方法和道德挑战。尽管挑战已经被充分记录,但很少有解决方案或评估框架可以帮助冲突地区的评估人员应对这些挑战。本文考察了实施科学框架的应用,特别是,范围、有效性、采用、实施和维护以及实施研究的统一框架,如何提供有用的策略来减轻在冲突地区进行评估时的一些挑战。未来的研究领域包括使用这些框架的协作团队方法、伦理指导以及报告和传播。
{"title":"Challenges and strategies for implementers and evaluators working in conflict settings","authors":"Laura Bond, Elizabeth K. Klein, Emily F. Gates","doi":"10.1177/13563890231171608","DOIUrl":"https://doi.org/10.1177/13563890231171608","url":null,"abstract":"Practitioners implementing and evaluating humanitarian programs in conflict zones face unique challenges requiring context-sensitive guidance. Conflict zones—geographical areas with militarized and non-militarized violence, widespread political instability, and state-sanctioned intimidation and genocidal violence—are rife with logistical, methodological, and ethical challenges that impact implementation and evaluation. Although challenges have been well-documented, few solutions or evaluation frameworks exist to help evaluators in conflict zones confront these challenges. This article examines how the application of implementation science frameworks, specifically, Reach, Effectiveness, Adoption, Implementation, and Maintenance and the Consolidated Framework for Implementation Research, offers useful strategies to mitigate some challenges in conducting evaluations in conflict zones. Areas for future research include collaborative team approaches to using these frameworks, ethical guidance, and reporting and dissemination.","PeriodicalId":19964,"journal":{"name":"Performance Evaluation","volume":"7 1","pages":"315 - 337"},"PeriodicalIF":2.2,"publicationDate":"2023-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87436242","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Performance Evaluation
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1