首页 > 最新文献

Companion of the 2018 ACM/SPEC International Conference on Performance Engineering最新文献

英文 中文
Elastic Pulsar Functions for Distributed Stream Processing 分布式流处理的弹性脉冲星函数
G. Russo, Antonio Schiazza, V. Cardellini
An increasing number of data-driven applications rely on the ability of processing data flows in a timely manner, exploiting for this purpose Data Stream Processing~(DSP) systems. Elasticity is an essential feature for DSP systems, as workload variability calls for automatic scaling of the application processing capacity, to avoid both overload and resource wastage. In this work, we implement auto-scaling in Pulsar Functions, a function-based streaming framework built on top of Apache Pulsar. The latter is is a distributed publish-subscribe messaging platform that natively supports serverless functions. Considering various state-of-the-art policies, we show that the proposed solution is able to scale application parallelism with minimal overhead.
越来越多的数据驱动应用依赖于及时处理数据流的能力,为此开发了数据流处理(DSP)系统。弹性是DSP系统的基本特征,因为工作负载的可变性要求自动扩展应用程序处理能力,以避免过载和资源浪费。在这项工作中,我们在脉冲星函数中实现了自动缩放,这是一个基于Apache脉冲星的基于函数的流框架。后者是一种分布式发布-订阅消息传递平台,本机支持无服务器功能。考虑到各种最先进的策略,我们证明了所建议的解决方案能够以最小的开销扩展应用程序并行性。
{"title":"Elastic Pulsar Functions for Distributed Stream Processing","authors":"G. Russo, Antonio Schiazza, V. Cardellini","doi":"10.1145/3447545.3451901","DOIUrl":"https://doi.org/10.1145/3447545.3451901","url":null,"abstract":"An increasing number of data-driven applications rely on the ability of processing data flows in a timely manner, exploiting for this purpose Data Stream Processing~(DSP) systems. Elasticity is an essential feature for DSP systems, as workload variability calls for automatic scaling of the application processing capacity, to avoid both overload and resource wastage. In this work, we implement auto-scaling in Pulsar Functions, a function-based streaming framework built on top of Apache Pulsar. The latter is is a distributed publish-subscribe messaging platform that natively supports serverless functions. Considering various state-of-the-art policies, we show that the proposed solution is able to scale application parallelism with minimal overhead.","PeriodicalId":10596,"journal":{"name":"Companion of the 2018 ACM/SPEC International Conference on Performance Engineering","volume":"9 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"83892982","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Investigating the Cause and Effect of an AMD Zen Energy Management Anomaly 调查AMD Zen能量管理异常的原因和影响
C. Elm, T. Ilsche, R. Schöne, Mario Bielert, Markus Schmidl
This paper discusses an architectural anomaly observed on server processors of the AMD Zen microarchitecture: At a specific operating point, increasing the number of active cores reduces system power consumption while increasing performance more than proportionally to the additional cores. The occurrence of the anomaly is rooted in the hardware control loop for energy management and software-independent. Experiments show a connection to the AMD turbo frequency feature Max Core Boost Frequency (MCBF). In less efficient configurations, this feature could be employed from a processor's perspective, even though it is not necessarily used on any core. Voltage measurements indicate that the availability of MCBF leads to a higher voltage from mainboard voltage regulators, subsequently raising power consumption unnecessarily. We describe the impact of this anomaly on the performance and energy-efficiency of several micro-benchmarks. The reduced power consumption when additional cores are enabled can lead to higher core frequencies and increased per-core-performance. The presented findings can be used to avoid inefficient core configurations and reduce the overall energy-to-solution.
本文讨论了在AMD Zen微架构的服务器处理器上观察到的架构异常:在特定的操作点上,增加活动内核的数量可以降低系统功耗,同时提高性能,而不是与额外的内核成比例。异常发生的根源在于硬件控制回路的能源管理和软件无关。实验显示了与AMD turbo频率特征Max Core Boost frequency (MCBF)的连接。在效率较低的配置中,可以从处理器的角度使用此功能,即使它不一定在任何核心上使用。电压测量表明,MCBF的可用性导致主板电压调节器产生更高的电压,随后不必要地增加功耗。我们描述了这种异常对几个微型基准的性能和能效的影响。当启用额外的核心时,降低的功耗可以导致更高的核心频率和提高的每核性能。本文的研究结果可用于避免低效率的堆芯配置,并减少解决方案的总能量。
{"title":"Investigating the Cause and Effect of an AMD Zen Energy Management Anomaly","authors":"C. Elm, T. Ilsche, R. Schöne, Mario Bielert, Markus Schmidl","doi":"10.1145/3447545.3451193","DOIUrl":"https://doi.org/10.1145/3447545.3451193","url":null,"abstract":"This paper discusses an architectural anomaly observed on server processors of the AMD Zen microarchitecture: At a specific operating point, increasing the number of active cores reduces system power consumption while increasing performance more than proportionally to the additional cores. The occurrence of the anomaly is rooted in the hardware control loop for energy management and software-independent. Experiments show a connection to the AMD turbo frequency feature Max Core Boost Frequency (MCBF). In less efficient configurations, this feature could be employed from a processor's perspective, even though it is not necessarily used on any core. Voltage measurements indicate that the availability of MCBF leads to a higher voltage from mainboard voltage regulators, subsequently raising power consumption unnecessarily. We describe the impact of this anomaly on the performance and energy-efficiency of several micro-benchmarks. The reduced power consumption when additional cores are enabled can lead to higher core frequencies and increased per-core-performance. The presented findings can be used to avoid inefficient core configurations and reduce the overall energy-to-solution.","PeriodicalId":10596,"journal":{"name":"Companion of the 2018 ACM/SPEC International Conference on Performance Engineering","volume":"23 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88251687","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Enhancing Observability of Serverless Computing with the Serverless Application Analytics Framework 利用无服务器应用分析框架增强无服务器计算的可观察性
R. Cordingly, Navid Heydari, Hanfei Yu, Varik Hoang, Zohreh Sadeghi, W. Lloyd
To improve the observability of workload performance, resource utilization, and infrastructure underlying serverless Function-as-a-Service (FaaS) platforms, we have developed the Serverless Application Analytics Framework (SAAF). SAAF provides a reusable framework supporting multiple programming languages that developers can leverage to inspect performance, resource utilization, scalability, and infrastructure metrics of function deployments to commercial and open-source FaaS platforms. To automate reproducible FaaS performance experiments, we provide the FaaS Runner as a multithreaded FaaS client. FaaS Runner provides a programmable client that can orchestrate over one thousand concurrent FaaS function calls. The ReportGenerator is then used to aggregate experiment output into CSV files for consumption by popular data analytics tools. SAAF and its supporting tools combined can assess forty-eight distinct metrics to enhance observability of serverless software deployments. In this tutorial paper, we describe SAAF and its supporting tools and provide examples of observability insights that can be derived.
为了提高工作负载性能、资源利用率和底层无服务器功能即服务(FaaS)平台的基础设施的可观察性,我们开发了无服务器应用程序分析框架(SAAF)。SAAF提供了一个支持多种编程语言的可重用框架,开发人员可以利用它来检查性能、资源利用率、可伸缩性,以及商业和开源FaaS平台的功能部署的基础设施指标。为了自动化可重复的FaaS性能实验,我们将FaaS Runner作为多线程的FaaS客户端提供。FaaS Runner提供了一个可编程的客户端,它可以编排超过一千个并发的FaaS函数调用。然后使用ReportGenerator将实验输出聚合到CSV文件中,供流行的数据分析工具使用。SAAF和它的支持工具结合起来可以评估48个不同的指标,以增强无服务器软件部署的可观察性。在这篇教程中,我们描述了SAAF及其支持工具,并提供了可以导出的可观察性见解的示例。
{"title":"Enhancing Observability of Serverless Computing with the Serverless Application Analytics Framework","authors":"R. Cordingly, Navid Heydari, Hanfei Yu, Varik Hoang, Zohreh Sadeghi, W. Lloyd","doi":"10.1145/3447545.3451173","DOIUrl":"https://doi.org/10.1145/3447545.3451173","url":null,"abstract":"To improve the observability of workload performance, resource utilization, and infrastructure underlying serverless Function-as-a-Service (FaaS) platforms, we have developed the Serverless Application Analytics Framework (SAAF). SAAF provides a reusable framework supporting multiple programming languages that developers can leverage to inspect performance, resource utilization, scalability, and infrastructure metrics of function deployments to commercial and open-source FaaS platforms. To automate reproducible FaaS performance experiments, we provide the FaaS Runner as a multithreaded FaaS client. FaaS Runner provides a programmable client that can orchestrate over one thousand concurrent FaaS function calls. The ReportGenerator is then used to aggregate experiment output into CSV files for consumption by popular data analytics tools. SAAF and its supporting tools combined can assess forty-eight distinct metrics to enhance observability of serverless software deployments. In this tutorial paper, we describe SAAF and its supporting tools and provide examples of observability insights that can be derived.","PeriodicalId":10596,"journal":{"name":"Companion of the 2018 ACM/SPEC International Conference on Performance Engineering","volume":"51 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73055646","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
An Online Approach to Determine Correlation between Data Streams 一种确定数据流之间相关性的在线方法
Devesh Kumar Lal, U. Suman
Real time stream processing demands processed outcomes in minimal latency. Massive streams are generated in real time where linear relationship is determined using correlation. Existing approaches are used for correlating static data sets such as, Kandell, Pearson, Spearman etc. These approaches are insufficient to solve noise free online correlation. In this paper, we propose an online ordinal correlation approach having functionalities such as single pass, avoiding recalculation from scratch, removing outliers, and low memory requirements. In this approach, Compare Reduce Aggregate (CRA) algorithm is used for determining association between two feature vectors in real time using single scanning technique. Time and space complexities in CRA algorithm are measured as O(n) and O(1), respectively. This algorithm is used for reducing noise or error in a stream and used as a replacement of rank based correlation. It is recommended to have distinct elements and less variability in the streams for gaining maximum performance of this algorithm.
实时流处理要求以最小的延迟处理结果。海量流是实时生成的,其中线性关系是通过相关性确定的。现有的方法用于关联静态数据集,如Kandell、Pearson、Spearman等。这些方法不足以解决无噪声的在线相关问题。在本文中,我们提出了一种在线有序相关方法,该方法具有单遍、避免从头开始重新计算、去除异常值和低内存要求等功能。该方法采用单次扫描技术,采用CRA算法实时确定两个特征向量之间的关联关系。CRA算法的时间复杂度为O(n),空间复杂度为O(1)。该算法用于减少流中的噪声或误差,并用作基于秩的相关性的替代。建议在流中具有不同的元素和较少的可变性,以获得该算法的最大性能。
{"title":"An Online Approach to Determine Correlation between Data Streams","authors":"Devesh Kumar Lal, U. Suman","doi":"10.1145/3447545.3451900","DOIUrl":"https://doi.org/10.1145/3447545.3451900","url":null,"abstract":"Real time stream processing demands processed outcomes in minimal latency. Massive streams are generated in real time where linear relationship is determined using correlation. Existing approaches are used for correlating static data sets such as, Kandell, Pearson, Spearman etc. These approaches are insufficient to solve noise free online correlation. In this paper, we propose an online ordinal correlation approach having functionalities such as single pass, avoiding recalculation from scratch, removing outliers, and low memory requirements. In this approach, Compare Reduce Aggregate (CRA) algorithm is used for determining association between two feature vectors in real time using single scanning technique. Time and space complexities in CRA algorithm are measured as O(n) and O(1), respectively. This algorithm is used for reducing noise or error in a stream and used as a replacement of rank based correlation. It is recommended to have distinct elements and less variability in the streams for gaining maximum performance of this algorithm.","PeriodicalId":10596,"journal":{"name":"Companion of the 2018 ACM/SPEC International Conference on Performance Engineering","volume":"26 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73393418","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Software Performance Engineering Education: What Topics Should be Covered? 软件性能工程教育:应该涵盖哪些主题?
C. U. Smith
This presentation considers elements of Software Performance Engineering (SPE) and how they have evolved. It addresses both skills needed by practitioners and areas of research. Which topics should be covered? How can the education cover realistic systems and problems? What is the history of SPE and is it relevant today? Are these topics unique to SPE education? How should SPE education be integrated with other specialties in Computer Science and Engineering?
本演讲考虑了软件性能工程(SPE)的元素以及它们是如何演变的。它解决了从业人员和研究领域所需的技能。应该涵盖哪些主题?教育如何涵盖现实的制度和问题?SPE的历史是怎样的?它与今天是否相关?这些主题是SPE教育独有的吗?SPE教育如何与计算机科学与工程的其他专业相结合?
{"title":"Software Performance Engineering Education: What Topics Should be Covered?","authors":"C. U. Smith","doi":"10.1145/3447545.3451200","DOIUrl":"https://doi.org/10.1145/3447545.3451200","url":null,"abstract":"This presentation considers elements of Software Performance Engineering (SPE) and how they have evolved. It addresses both skills needed by practitioners and areas of research. Which topics should be covered? How can the education cover realistic systems and problems? What is the history of SPE and is it relevant today? Are these topics unique to SPE education? How should SPE education be integrated with other specialties in Computer Science and Engineering?","PeriodicalId":10596,"journal":{"name":"Companion of the 2018 ACM/SPEC International Conference on Performance Engineering","volume":"20 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82569037","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Motivations and Challenges for Stream Processing in Edge Computing 边缘计算中流处理的动机和挑战
Vincenzo Gulisano
The 2030 Agenda for Sustainable Development of the United Nations General Assembly defines 17 development goals to be met for a sustainable future. Goals such as Industry, Innovation and Infrastructure and Sustainable Cities and Communities depend on digital systems. As a matter of fact, billions of Euros are invested into digital transformation within the European Union, and many researchers are actively working to push state-of-the-art boundaries for techniques/tools able to extract value and insights from the large amounts of raw data sensed in digital systems. Edge computing aims at supporting such data-to-value transformation. In digital systems that traditionally rely on central data gathering, edge computing proposes to push the analysis towards the devices and data sources, thus leveraging the large cumulative computational power found in modern distributed systems. Some of the ideas promoted in edge computing are not new, though. Continuous and distributed data analysis paradigms such as stream processing have argued about the need for smart distributed analysis for basically 20 years. Starting from this observation, this talk covers a set of standing challenges for smart, distributed, and continuous stream processing in edge computing, with real-world examples and use-cases from smart grids and vehicular networks.
联合国大会《2030年可持续发展议程》确定了17项发展目标,以实现可持续未来。工业、创新和基础设施以及可持续城市和社区等目标依赖于数字系统。事实上,欧盟内部已经投入了数十亿欧元用于数字化转型,许多研究人员正在积极努力推动技术/工具的最新边界,这些技术/工具能够从数字系统中感知的大量原始数据中提取价值和见解。边缘计算旨在支持这种数据到价值的转换。在传统上依赖中央数据收集的数字系统中,边缘计算建议将分析推向设备和数据源,从而利用现代分布式系统中发现的大量累积计算能力。然而,边缘计算中推广的一些想法并不新鲜。连续和分布式数据分析范式(如流处理)已经争论智能分布式分析的必要性长达20年之久。从这一观察开始,本演讲涵盖了边缘计算中智能、分布式和连续流处理的一系列长期挑战,并提供了来自智能电网和车载网络的实际示例和用例。
{"title":"Motivations and Challenges for Stream Processing in Edge Computing","authors":"Vincenzo Gulisano","doi":"10.1145/3447545.3451899","DOIUrl":"https://doi.org/10.1145/3447545.3451899","url":null,"abstract":"The 2030 Agenda for Sustainable Development of the United Nations General Assembly defines 17 development goals to be met for a sustainable future. Goals such as Industry, Innovation and Infrastructure and Sustainable Cities and Communities depend on digital systems. As a matter of fact, billions of Euros are invested into digital transformation within the European Union, and many researchers are actively working to push state-of-the-art boundaries for techniques/tools able to extract value and insights from the large amounts of raw data sensed in digital systems. Edge computing aims at supporting such data-to-value transformation. In digital systems that traditionally rely on central data gathering, edge computing proposes to push the analysis towards the devices and data sources, thus leveraging the large cumulative computational power found in modern distributed systems. Some of the ideas promoted in edge computing are not new, though. Continuous and distributed data analysis paradigms such as stream processing have argued about the need for smart distributed analysis for basically 20 years. Starting from this observation, this talk covers a set of standing challenges for smart, distributed, and continuous stream processing in edge computing, with real-world examples and use-cases from smart grids and vehicular networks.","PeriodicalId":10596,"journal":{"name":"Companion of the 2018 ACM/SPEC International Conference on Performance Engineering","volume":"60 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80264332","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Performance Interference on Key-Value Stores in Multi-tenant Environments: When Block Size and Write Requests Matter 多租户环境中键值存储的性能干扰:当块大小和写请求重要时
Adriano Lange, T. R. Kepe, M. Sunyé
Key-value stores are currently used by major cloud computing vendors, such as Google, Facebook, and LinkedIn, to support large-scale applications with concurrent read and write operations. Based on very simple data access APIs, the key-value stores can deliver outstanding throughput, which have been hooked up to high-performance solid-state drives (SSDs) to boost this performance even further. However, measuring performance interference on SSDs while sharing cloud computing resources is complex and not well covered by current benchmarks and tools. Different applications can access these resources concurrently until becoming overloaded without notice either by the benchmark or the cloud application. In this paper, we define a methodology to measure the problem of performance interference. Depending on the block size and the proportion of concurrent write operations, we show how a key-value store may quickly degrade throughput until becoming almost inoperative while sharing persistent storage resources with other tenants.
键值存储目前被主要的云计算供应商(如Google、Facebook和LinkedIn)用于支持具有并发读写操作的大规模应用程序。基于非常简单的数据访问api,键值存储可以提供出色的吞吐量,这些吞吐量已连接到高性能固态驱动器(ssd)以进一步提高性能。然而,在共享云计算资源的同时测量ssd的性能干扰是复杂的,目前的基准和工具没有很好地涵盖。不同的应用程序可以并发地访问这些资源,直到基准测试或云应用程序不通知就过载为止。本文定义了一种测量性能干扰问题的方法。根据块大小和并发写操作的比例,我们将展示键值存储如何在与其他租户共享持久存储资源时迅速降低吞吐量,直到几乎无法运行。
{"title":"Performance Interference on Key-Value Stores in Multi-tenant Environments: When Block Size and Write Requests Matter","authors":"Adriano Lange, T. R. Kepe, M. Sunyé","doi":"10.1145/3447545.3451191","DOIUrl":"https://doi.org/10.1145/3447545.3451191","url":null,"abstract":"Key-value stores are currently used by major cloud computing vendors, such as Google, Facebook, and LinkedIn, to support large-scale applications with concurrent read and write operations. Based on very simple data access APIs, the key-value stores can deliver outstanding throughput, which have been hooked up to high-performance solid-state drives (SSDs) to boost this performance even further. However, measuring performance interference on SSDs while sharing cloud computing resources is complex and not well covered by current benchmarks and tools. Different applications can access these resources concurrently until becoming overloaded without notice either by the benchmark or the cloud application. In this paper, we define a methodology to measure the problem of performance interference. Depending on the block size and the proportion of concurrent write operations, we show how a key-value store may quickly degrade throughput until becoming almost inoperative while sharing persistent storage resources with other tenants.","PeriodicalId":10596,"journal":{"name":"Companion of the 2018 ACM/SPEC International Conference on Performance Engineering","volume":"192 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89234528","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
The Role of Analytical Models in the Engineering and Science of Computer Systems 分析模型在计算机系统工程和科学中的作用
Y. Tay
2021 is the 50th anniversary of SIGMETRICS, the ACM Special Interest Group on Performance Evaluation. For this occasion, I wrote a review1 of the role played by analytical modeling - a major topic in SIGMETRICS – in the engineering and science of computer systems. This talk is a summary of that review.
2021年是ACM绩效评估特别兴趣小组SIGMETRICS成立50周年。为此,我写了一篇关于分析建模(SIGMETRICS的一个主要主题)在计算机系统工程和科学中所起作用的综述。这次演讲是对那次回顾的总结。
{"title":"The Role of Analytical Models in the Engineering and Science of Computer Systems","authors":"Y. Tay","doi":"10.1145/3447545.3451194","DOIUrl":"https://doi.org/10.1145/3447545.3451194","url":null,"abstract":"2021 is the 50th anniversary of SIGMETRICS, the ACM Special Interest Group on Performance Evaluation. For this occasion, I wrote a review1 of the role played by analytical modeling - a major topic in SIGMETRICS – in the engineering and science of computer systems. This talk is a summary of that review.","PeriodicalId":10596,"journal":{"name":"Companion of the 2018 ACM/SPEC International Conference on Performance Engineering","volume":"17 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72638023","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Experience with Teaching Performance Measurement and Testing in a Course on Functional Testing 在“功能测试”课程中进行绩效测量与测试的教学经验
A. Bondi, R. Saremi
Stevens Institute of Technology offers a graduate course on functional software testing that addresses test planning driven by use cases, the use of software tools, and the derivation of test cases to achieve coverage with minimal effort. The course also contains material on performance testing. Teaching performance testing and measurement in a university setting was challenging because giving the students access to a target system would have required more time, resources, and planning than were available. %neither the students nor the university typically have access to a system that can be tested and measured. We addressed these challenges (a) by showing the students how resource usage could be measured in a controlled way with the instrumentation that comes with most modern laptops by default, and (b) by having the students use JMeter to measure the response times of existing websites . We describe how students were introduced to the concept of a controlled performance test by playing recordings of the same musical piece with and without video. We make recommendations for the future avoidance of the emergent ethical issue that one should not subject one does not own to anything but the most trivial loads. We also describe some successes and pitfalls in this effort.
史蒂文斯技术学院提供了一门关于功能软件测试的研究生课程,该课程涉及由用例驱动的测试计划,软件工具的使用,以及测试用例的派生,以最小的努力实现覆盖。本课程也包含性能测试的材料。在大学环境中进行教学性能测试和测量是具有挑战性的,因为让学生访问目标系统将需要更多的时间、资源和计划。学生和大学通常都无法使用可测试和测量的系统。。我们解决了这些挑战:(a)通过向学生展示如何使用大多数现代笔记本电脑默认配备的仪器以受控的方式测量资源使用情况,以及(b)通过让学生使用JMeter来测量现有网站的响应时间。我们描述了学生如何通过播放带有和不带有视频的同一音乐作品的录音来介绍受控性能测试的概念。我们提出建议,以避免未来出现的道德问题,一个人不应该受制于任何东西,但最微不足道的负荷。我们还描述了这一努力中的一些成功和缺陷。
{"title":"Experience with Teaching Performance Measurement and Testing in a Course on Functional Testing","authors":"A. Bondi, R. Saremi","doi":"10.1145/3447545.3451196","DOIUrl":"https://doi.org/10.1145/3447545.3451196","url":null,"abstract":"Stevens Institute of Technology offers a graduate course on functional software testing that addresses test planning driven by use cases, the use of software tools, and the derivation of test cases to achieve coverage with minimal effort. The course also contains material on performance testing. Teaching performance testing and measurement in a university setting was challenging because giving the students access to a target system would have required more time, resources, and planning than were available. %neither the students nor the university typically have access to a system that can be tested and measured. We addressed these challenges (a) by showing the students how resource usage could be measured in a controlled way with the instrumentation that comes with most modern laptops by default, and (b) by having the students use JMeter to measure the response times of existing websites . We describe how students were introduced to the concept of a controlled performance test by playing recordings of the same musical piece with and without video. We make recommendations for the future avoidance of the emergent ethical issue that one should not subject one does not own to anything but the most trivial loads. We also describe some successes and pitfalls in this effort.","PeriodicalId":10596,"journal":{"name":"Companion of the 2018 ACM/SPEC International Conference on Performance Engineering","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89160386","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Towards Independent Run-Time Cloud Monitoring 迈向独立的运行时云监控
Luuk Klaver, T. Knaap, J. V. Geest, E. Harmsma, B. D. Waaij, P. Pileggi
Cloud computing services are integral to the digital transformation. They deliver greater connectivity, tremendous savings, and lower total cost of ownership. Despite such benefits and benchmarking advances, costs are still quite unpredictable, performance is unclear, security is inconsistent, and there is minimal control over aspects like data and service locality. Estimating performance of cloud environments is very hard for cloud consumers. They would like to make informed decisions about which provider better suits their needs using specialized evaluation mechanisms. Providers have their own tools reporting specific metrics, but they are potentially biased and often incomparable across providers. Current benchmarking tools allow comparison but consumers need more flexibility to evaluate environments under actual operating conditions for specialized applications. Ours is early stage work and a step towards a monitoring solution that enables independent evaluation of clouds for very specific application needs. In this paper, we present our initial architecture of the Cloud Monitor that aims to integrate existing and new benchmarks in a flexible and extensible way. By way of a simplistic demonstrator, we illustrate the concept. We report some preliminary monitoring results after a brief time of monitoring and are able to observe unexpected anomalies. The results suggest an independent monitoring solution is a powerful enabler of next generation cloud computing, not only for the consumer but potentially the whole ecosystem.
云计算服务是数字化转型不可或缺的一部分。它们提供了更好的连接性、巨大的节省和更低的总拥有成本。尽管有这些好处和基准测试方面的进步,但成本仍然不可预测,性能不明确,安全性不一致,并且对数据和服务位置等方面的控制很少。对云用户来说,评估云环境的性能是非常困难的。他们希望通过专门的评估机制,对哪个提供者更适合他们的需求做出明智的决定。供应商有自己的工具来报告特定的指标,但这些工具可能存在偏差,而且在供应商之间往往无法进行比较。目前的基准测试工具允许比较,但消费者需要更大的灵活性来评估专业应用程序在实际操作条件下的环境。我们的工作还处于早期阶段,朝着监控解决方案迈出了一步,该解决方案能够针对非常具体的应用程序需求对云进行独立评估。在本文中,我们介绍了Cloud Monitor的初始架构,该架构旨在以灵活和可扩展的方式集成现有和新的基准测试。通过一个简单的演示,我们来说明这个概念。在短暂的监测后,我们报告了一些初步的监测结果,并能够观察到意想不到的异常。结果表明,独立的监控解决方案是下一代云计算的强大推动者,不仅对消费者,而且可能对整个生态系统都是如此。
{"title":"Towards Independent Run-Time Cloud Monitoring","authors":"Luuk Klaver, T. Knaap, J. V. Geest, E. Harmsma, B. D. Waaij, P. Pileggi","doi":"10.1145/3447545.3451180","DOIUrl":"https://doi.org/10.1145/3447545.3451180","url":null,"abstract":"Cloud computing services are integral to the digital transformation. They deliver greater connectivity, tremendous savings, and lower total cost of ownership. Despite such benefits and benchmarking advances, costs are still quite unpredictable, performance is unclear, security is inconsistent, and there is minimal control over aspects like data and service locality. Estimating performance of cloud environments is very hard for cloud consumers. They would like to make informed decisions about which provider better suits their needs using specialized evaluation mechanisms. Providers have their own tools reporting specific metrics, but they are potentially biased and often incomparable across providers. Current benchmarking tools allow comparison but consumers need more flexibility to evaluate environments under actual operating conditions for specialized applications. Ours is early stage work and a step towards a monitoring solution that enables independent evaluation of clouds for very specific application needs. In this paper, we present our initial architecture of the Cloud Monitor that aims to integrate existing and new benchmarks in a flexible and extensible way. By way of a simplistic demonstrator, we illustrate the concept. We report some preliminary monitoring results after a brief time of monitoring and are able to observe unexpected anomalies. The results suggest an independent monitoring solution is a powerful enabler of next generation cloud computing, not only for the consumer but potentially the whole ecosystem.","PeriodicalId":10596,"journal":{"name":"Companion of the 2018 ACM/SPEC International Conference on Performance Engineering","volume":"29 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90035655","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
期刊
Companion of the 2018 ACM/SPEC International Conference on Performance Engineering
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1