首页 > 最新文献

ACM Cloud and Autonomic Computing Conference最新文献

英文 中文
An adaptive data transfer algorithm using block device reconfiguration in virtual MapReduce clusters 基于块设备重构的虚拟MapReduce集群自适应数据传输算法
Pub Date : 2013-08-09 DOI: 10.1145/2494621.2494645
Kwonyong Lee, Yoonsung Nam, Taekhee Kim, Sungyong Park
With the proliferation of cloud computing and virtual machine technologies, MapReduce applications are increasingly deployed in clouds to leverage the full potential of cloud computing environments. However, the MapReduce, which is generally used for processing large amount of data, suffers from the I/O virtualization overheads and resource competitions among virtual machines when it is run on virtual clouds. This paper proposes an adaptive data transfer algorithm in virtual MapReduce clusters. The proposed algorithm utilizes a block device reconfiguration scheme, where a block device attached to a virtual machine can be dynamically detached and reattached to other virtual machines hosted in the same physical machine. By reconfiguring the block devices, we can easily move files across different virtual machines located at the same physical machine without any network transfers between virtual machines. When the output of each map task is transferred to the reducer, this algorithm adaptively determines an appropriate transfer method between network transfer and block device reconfiguration based on current CPU utilization values and the data size for the transfer. Even in the case of data transfer between virtual machines across multiple physical machines, we can remove the transfer overheads between the virtual machine and the driver domain, which results in reducing the data transfer time and performance effects to other virtual machines in the shuffle phase. We have implemented our algorithm in Hadoop MapReduce. The benchmarking results show that the overheads incurred by transferring data from mapper virtual machines to reducer virtual machines are minimized and the execution times of MapReduce applications are shortened.
随着云计算和虚拟机技术的扩散,MapReduce应用程序越来越多地部署在云中,以充分利用云计算环境的全部潜力。然而,通常用于处理大量数据的MapReduce在虚拟云上运行时,存在I/O虚拟化开销和虚拟机之间的资源竞争问题。提出了一种虚拟MapReduce集群中的自适应数据传输算法。该算法利用块设备重构方案,将虚拟机上的块设备动态分离并重新连接到同一物理机上的其他虚拟机上。通过重新配置块设备,我们可以轻松地在位于同一物理机的不同虚拟机之间移动文件,而无需在虚拟机之间进行任何网络传输。当每个map任务的输出传输到reducer时,该算法根据当前CPU利用率值和传输的数据大小,自适应确定网络传输和块设备重构之间合适的传输方式。即使在跨多个物理机的虚拟机之间传输数据的情况下,我们也可以消除虚拟机和驱动程序域之间的传输开销,从而减少在shuffle阶段向其他虚拟机传输数据的时间和性能影响。我们在Hadoop MapReduce中实现了我们的算法。基准测试结果表明,将数据从mapper虚拟机传输到reducer虚拟机的开销降至最低,缩短了MapReduce应用程序的执行时间。
{"title":"An adaptive data transfer algorithm using block device reconfiguration in virtual MapReduce clusters","authors":"Kwonyong Lee, Yoonsung Nam, Taekhee Kim, Sungyong Park","doi":"10.1145/2494621.2494645","DOIUrl":"https://doi.org/10.1145/2494621.2494645","url":null,"abstract":"With the proliferation of cloud computing and virtual machine technologies, MapReduce applications are increasingly deployed in clouds to leverage the full potential of cloud computing environments. However, the MapReduce, which is generally used for processing large amount of data, suffers from the I/O virtualization overheads and resource competitions among virtual machines when it is run on virtual clouds. This paper proposes an adaptive data transfer algorithm in virtual MapReduce clusters. The proposed algorithm utilizes a block device reconfiguration scheme, where a block device attached to a virtual machine can be dynamically detached and reattached to other virtual machines hosted in the same physical machine. By reconfiguring the block devices, we can easily move files across different virtual machines located at the same physical machine without any network transfers between virtual machines. When the output of each map task is transferred to the reducer, this algorithm adaptively determines an appropriate transfer method between network transfer and block device reconfiguration based on current CPU utilization values and the data size for the transfer. Even in the case of data transfer between virtual machines across multiple physical machines, we can remove the transfer overheads between the virtual machine and the driver domain, which results in reducing the data transfer time and performance effects to other virtual machines in the shuffle phase. We have implemented our algorithm in Hadoop MapReduce. The benchmarking results show that the overheads incurred by transferring data from mapper virtual machines to reducer virtual machines are minimized and the execution times of MapReduce applications are shortened.","PeriodicalId":190559,"journal":{"name":"ACM Cloud and Autonomic Computing Conference","volume":"72 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125294086","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Resilient cloud data storage services 弹性云数据存储服务
Pub Date : 2013-08-09 DOI: 10.1145/2494621.2494634
Hemayamini Kurra, Y. Al-Nashif, S. Hariri
With the advance of cloud computing technologies, there is a huge demand for computing resources and storage. Many organizations prefer to outsource their storage and other resources. As the data reside on the third parties data centers, security is becoming a major concern. In this paper we propose a Resilient Cloud Storage (RCS) architecture that addresses the major security issues for cloud storage such as access control confidentiality, integrity, and secure communications. Our resilient approach is based on moving target defense and key hopping techniques. Data is partitioned into a random number of partitions where different keys are used to encrypt each partition. We also show that by using key hopping technique, we can reduce smaller key length that is normally used to improve performance without compromising the security. Our experimental results show that we can improve performance by 50% when we use a key of length 512 when compared with certificate technique that uses key length of 2048.
随着云计算技术的发展,对计算资源和存储的需求越来越大。许多组织更喜欢外包他们的存储和其他资源。由于数据驻留在第三方数据中心,安全性成为一个主要问题。在本文中,我们提出了一种弹性云存储(RCS)架构,该架构解决了云存储的主要安全问题,如访问控制机密性、完整性和安全通信。我们的弹性方法是基于移动目标防御和关键跳跃技术。数据被随机划分为若干个分区,每个分区使用不同的密钥进行加密。我们还表明,通过使用密钥跳变技术,我们可以减少通常用于提高性能而不损害安全性的较小密钥长度。实验结果表明,与使用密钥长度为2048的证书技术相比,使用密钥长度为512的证书技术可以提高50%的性能。
{"title":"Resilient cloud data storage services","authors":"Hemayamini Kurra, Y. Al-Nashif, S. Hariri","doi":"10.1145/2494621.2494634","DOIUrl":"https://doi.org/10.1145/2494621.2494634","url":null,"abstract":"With the advance of cloud computing technologies, there is a huge demand for computing resources and storage. Many organizations prefer to outsource their storage and other resources. As the data reside on the third parties data centers, security is becoming a major concern. In this paper we propose a Resilient Cloud Storage (RCS) architecture that addresses the major security issues for cloud storage such as access control confidentiality, integrity, and secure communications. Our resilient approach is based on moving target defense and key hopping techniques. Data is partitioned into a random number of partitions where different keys are used to encrypt each partition. We also show that by using key hopping technique, we can reduce smaller key length that is normally used to improve performance without compromising the security. Our experimental results show that we can improve performance by 50% when we use a key of length 512 when compared with certificate technique that uses key length of 2048.","PeriodicalId":190559,"journal":{"name":"ACM Cloud and Autonomic Computing Conference","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115019509","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
A scalable, non-parametric anomaly detection framework for Hadoop 一个可扩展的、非参数的Hadoop异常检测框架
Pub Date : 2013-08-09 DOI: 10.1145/2494621.2494643
Li Yu, Z. Lan
In this paper, we present a scalable and practical problem diagnosis framework for Hadoop environments. Our design features a decentralized approach based on hierarchical grouping and a novel non-parametric diagnostic mechanism. We evaluate our framework under various Hadoop workloads. The experimental results show that our design outperforms traditional methods significantly in the context of complex anomaly patterns and high anomaly probability.
在本文中,我们提出了一个可扩展的、实用的Hadoop环境问题诊断框架。我们的设计特点是基于分层分组的分散方法和一种新的非参数诊断机制。我们在各种Hadoop工作负载下评估我们的框架。实验结果表明,在复杂异常模式和高异常概率的情况下,我们的设计明显优于传统方法。
{"title":"A scalable, non-parametric anomaly detection framework for Hadoop","authors":"Li Yu, Z. Lan","doi":"10.1145/2494621.2494643","DOIUrl":"https://doi.org/10.1145/2494621.2494643","url":null,"abstract":"In this paper, we present a scalable and practical problem diagnosis framework for Hadoop environments. Our design features a decentralized approach based on hierarchical grouping and a novel non-parametric diagnostic mechanism. We evaluate our framework under various Hadoop workloads. The experimental results show that our design outperforms traditional methods significantly in the context of complex anomaly patterns and high anomaly probability.","PeriodicalId":190559,"journal":{"name":"ACM Cloud and Autonomic Computing Conference","volume":"29 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114678826","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 20
A vision for monitoring cloud application platforms as sensor networks 将云应用平台监控为传感器网络的愿景
Pub Date : 2013-08-09 DOI: 10.1145/2494621.2494647
R. Dautov, I. Paraskakis
Autonomic management of clouds has received a lot of attention by both academia and industry putting a lot of efforts into investigation of various solutions, even though the focus has been mainly on the IaaS level, while the PaaS level being less often addressed. However, with ever-expanding software environments of cloud application platforms, the self-management at the PaaS level becomes a major concern. We claim that run-time monitoring and detection of critical situations is a fundamental requirement to achieve autonomic behaviour in service-based cloud platforms. Accordingly, we present our novel vision of cloud application platforms as sensor networks -- computer accessible networks of distributed devices using sensors to monitor conditions at different locations. The vision is based on the similarities between the problem domain of cloud application platform monitoring and such sensor-enabled domains as traffic surveillance, environmental monitoring or home automation. We also discuss potential benefits and shortcomings associated with the presented concepts and ideas.
云的自治管理受到了学术界和业界的广泛关注,他们投入了大量的精力来研究各种解决方案,尽管焦点主要集中在IaaS级别,而PaaS级别很少得到解决。然而,随着云应用平台软件环境的不断扩展,PaaS层的自我管理成为一个主要问题。我们声称,在基于服务的云平台中,运行时监控和检测关键情况是实现自主行为的基本要求。因此,我们提出了云应用平台作为传感器网络的新愿景——使用传感器监测不同位置条件的分布式设备的计算机可访问网络。这一愿景是基于云应用平台监控的问题领域与交通监控、环境监控或家庭自动化等传感器支持领域之间的相似性。我们还讨论了与所提出的概念和想法相关的潜在好处和缺点。
{"title":"A vision for monitoring cloud application platforms as sensor networks","authors":"R. Dautov, I. Paraskakis","doi":"10.1145/2494621.2494647","DOIUrl":"https://doi.org/10.1145/2494621.2494647","url":null,"abstract":"Autonomic management of clouds has received a lot of attention by both academia and industry putting a lot of efforts into investigation of various solutions, even though the focus has been mainly on the IaaS level, while the PaaS level being less often addressed. However, with ever-expanding software environments of cloud application platforms, the self-management at the PaaS level becomes a major concern. We claim that run-time monitoring and detection of critical situations is a fundamental requirement to achieve autonomic behaviour in service-based cloud platforms. Accordingly, we present our novel vision of cloud application platforms as sensor networks -- computer accessible networks of distributed devices using sensors to monitor conditions at different locations. The vision is based on the similarities between the problem domain of cloud application platform monitoring and such sensor-enabled domains as traffic surveillance, environmental monitoring or home automation. We also discuss potential benefits and shortcomings associated with the presented concepts and ideas.","PeriodicalId":190559,"journal":{"name":"ACM Cloud and Autonomic Computing Conference","volume":"66 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125934208","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
Autonomic load balancing mechanisms in the P2P desktop grid P2P桌面网格中的自主负载平衡机制
Pub Date : 2013-08-09 DOI: 10.1145/2494621.2494646
Jik-Soo Kim, Beomseok Nam, A. Sussman
Peer-to-Peer (P2P) desktop grid computing systems circumvent the performance bottleneck and limited scalability of centralized Grid architectures resulting in a massively scalable and robust system. We have designed a set of protocols that implement a distributed, decentralized desktop grid via P2P techniques. Incoming jobs having different types of resource requirements are matched with system nodes through proximity in an N-dimensional resource space. In this paper, we address problems that arise from static load balancing mechanisms for assigning jobs to nodes that can arise for various reasons, including the heterogeneity of the available nodes or the jobs to be run, and from stale information in the P2P system. We greatly improve upon our prior work by providing lightweight yet effective dynamic load balancing mechanisms to overcome load imbalances caused by the limitations of the initial static job assignment scheme. Unlike other systems, we can effectively support resource constraints of jobs during the course of redistribution since we simplify the problem of matchmaking through building a multi-dimensional resource space and mapping jobs and nodes to this space. Throughout extensive simulation results, we show that dynamic load balancing makes the overall system more scalable, by improving system throughput and response time with low additional overhead.
点对点(P2P)桌面网格计算系统绕过了集中式网格体系结构的性能瓶颈和有限的可伸缩性,从而形成了可大规模扩展和健壮的系统。我们设计了一套协议,通过P2P技术实现分布式、去中心化的桌面网格。具有不同类型资源需求的传入作业通过在n维资源空间中的接近度与系统节点相匹配。在本文中,我们解决了静态负载平衡机制为节点分配作业所产生的问题,这些问题可能由于各种原因而出现,包括可用节点或要运行的作业的异构性,以及P2P系统中的过时信息。我们通过提供轻量级但有效的动态负载平衡机制来克服由初始静态作业分配方案的局限性引起的负载不平衡,从而大大改进了之前的工作。与其他系统不同,我们通过构建多维资源空间并将作业和节点映射到该空间,从而简化了配对问题,因此可以有效地支持再分配过程中作业的资源约束。通过广泛的仿真结果,我们表明动态负载平衡通过以较低的额外开销提高系统吞吐量和响应时间,使整个系统更具可扩展性。
{"title":"Autonomic load balancing mechanisms in the P2P desktop grid","authors":"Jik-Soo Kim, Beomseok Nam, A. Sussman","doi":"10.1145/2494621.2494646","DOIUrl":"https://doi.org/10.1145/2494621.2494646","url":null,"abstract":"Peer-to-Peer (P2P) desktop grid computing systems circumvent the performance bottleneck and limited scalability of centralized Grid architectures resulting in a massively scalable and robust system. We have designed a set of protocols that implement a distributed, decentralized desktop grid via P2P techniques. Incoming jobs having different types of resource requirements are matched with system nodes through proximity in an N-dimensional resource space.\u0000 In this paper, we address problems that arise from static load balancing mechanisms for assigning jobs to nodes that can arise for various reasons, including the heterogeneity of the available nodes or the jobs to be run, and from stale information in the P2P system. We greatly improve upon our prior work by providing lightweight yet effective dynamic load balancing mechanisms to overcome load imbalances caused by the limitations of the initial static job assignment scheme. Unlike other systems, we can effectively support resource constraints of jobs during the course of redistribution since we simplify the problem of matchmaking through building a multi-dimensional resource space and mapping jobs and nodes to this space. Throughout extensive simulation results, we show that dynamic load balancing makes the overall system more scalable, by improving system throughput and response time with low additional overhead.","PeriodicalId":190559,"journal":{"name":"ACM Cloud and Autonomic Computing Conference","volume":"55 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115655830","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
On the role of topology in autonomously coping with failures in content dissemination systems 论拓扑在内容传播系统故障自主处理中的作用
Pub Date : 2013-08-09 DOI: 10.1145/2494621.2494635
Ryan Stern, S. Pallickara
Content dissemination systems comprise a large number of nodes that organize themselves into different topologies. In this paper, we explore the role of topologies in autonomously coping with failures. The topologies we consider are based on regular, random, small-world, and power law graphs. Connections within these topologies can account for network proximity and are suitable for real-time communications. We explore specific attributes of a topology that contribute to its failure resiliency. The metrics that we use to profile this resilience include: communication path lengths, network partitions, migration of workloads, and the impact on system throughput. This research will allow designers to choose topologies or configure metrics for a specific topology to achieve their performance objectives.
内容传播系统由大量节点组成,这些节点将自己组织成不同的拓扑结构。在本文中,我们探讨了拓扑在自动处理故障中的作用。我们考虑的拓扑是基于正则、随机、小世界和幂律图的。这些拓扑中的连接可以考虑网络邻近性,并且适合于实时通信。我们探索有助于其故障弹性的拓扑的特定属性。我们用来分析这种弹性的指标包括:通信路径长度、网络分区、工作负载迁移以及对系统吞吐量的影响。这项研究将允许设计人员选择拓扑或配置特定拓扑的指标,以实现他们的性能目标。
{"title":"On the role of topology in autonomously coping with failures in content dissemination systems","authors":"Ryan Stern, S. Pallickara","doi":"10.1145/2494621.2494635","DOIUrl":"https://doi.org/10.1145/2494621.2494635","url":null,"abstract":"Content dissemination systems comprise a large number of nodes that organize themselves into different topologies. In this paper, we explore the role of topologies in autonomously coping with failures. The topologies we consider are based on regular, random, small-world, and power law graphs. Connections within these topologies can account for network proximity and are suitable for real-time communications. We explore specific attributes of a topology that contribute to its failure resiliency. The metrics that we use to profile this resilience include: communication path lengths, network partitions, migration of workloads, and the impact on system throughput. This research will allow designers to choose topologies or configure metrics for a specific topology to achieve their performance objectives.","PeriodicalId":190559,"journal":{"name":"ACM Cloud and Autonomic Computing Conference","volume":"95 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"120874073","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
A truthful approximation mechanism for autonomic virtual machine provisioning and allocation in clouds 云环境中自主虚拟机供应和分配的真实逼近机制
Pub Date : 2013-08-09 DOI: 10.1145/2494621.2494637
Lena Mashayekhy, Mahyar Movahed Nejad, Daniel Grosu
One of the major challenges faced by the cloud providers is to allocate and provision the resources such that their profit is maximized and the resources are utilized efficiently. We address this challenge by designing an autonomic VM (Virtual Machine) provisioning and allocation mechanism that adapts to the changing user demands. We show that the proposed mechanism is a PTAS (Polynomial-Time Approximation Scheme) and that it is truthful, that is, the users do not have incentives to lie about their requested bundles of VM instances and their valuations. We perform extensive experiments in order to investigate the properties of the mechanism.
云提供商面临的主要挑战之一是分配和提供资源,使其利润最大化,并有效利用资源。我们通过设计一个自主的VM(虚拟机)供应和分配机制来应对这一挑战,以适应不断变化的用户需求。我们证明了所提出的机制是一个PTAS(多项式时间近似方案),并且它是真实的,也就是说,用户没有动机对他们请求的VM实例包及其估值撒谎。我们进行了大量的实验,以研究该机制的性质。
{"title":"A truthful approximation mechanism for autonomic virtual machine provisioning and allocation in clouds","authors":"Lena Mashayekhy, Mahyar Movahed Nejad, Daniel Grosu","doi":"10.1145/2494621.2494637","DOIUrl":"https://doi.org/10.1145/2494621.2494637","url":null,"abstract":"One of the major challenges faced by the cloud providers is to allocate and provision the resources such that their profit is maximized and the resources are utilized efficiently. We address this challenge by designing an autonomic VM (Virtual Machine) provisioning and allocation mechanism that adapts to the changing user demands. We show that the proposed mechanism is a PTAS (Polynomial-Time Approximation Scheme) and that it is truthful, that is, the users do not have incentives to lie about their requested bundles of VM instances and their valuations. We perform extensive experiments in order to investigate the properties of the mechanism.","PeriodicalId":190559,"journal":{"name":"ACM Cloud and Autonomic Computing Conference","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121268887","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 19
A flexible elastic control plane for private clouds 为私有云提供灵活的弹性控制平面
Pub Date : 2013-08-09 DOI: 10.1145/2494621.2494626
Upendra Sharma, P. Shenoy, S. Sahu
While public cloud computing platforms have become popular in recent years, private clouds---operated by enterprises for their internal use---have also begun gaining traction. The configuration and continuous tuning of a private cloud to meet user demands is a complex task. While private cloud management frameworks provide a number of flexible configuration options for this purpose, they leave it to the administrator to determine how to best configure and tune the cloud platform for local needs. In this paper, we argue for an adaptive control plane for private clouds that simplifies the tasks of configuring and operating a private cloud such that each control plane service is adaptive to the workload seen due to end-user requests. We present a logistic regression model to automate the provisioning and dynamic reconfiguration of control plane services in a private cloud. We implement our approach for two control plane services---monitoring and messaging---for OpenStack-based private clouds. Our experimental results on a laboratory private cloud testbed and using public cloud workloads demonstrates the ability of our approach to provision and adapt such services from very small to very large private cloud configurations.
虽然公共云计算平台近年来变得流行起来,但私有云——由企业内部使用的私有云——也开始获得关注。配置和持续调优私有云以满足用户需求是一项复杂的任务。虽然私有云管理框架为此目的提供了许多灵活的配置选项,但它们将决定权留给了管理员,由管理员决定如何根据本地需求对云平台进行最佳配置和调优。在本文中,我们支持私有云的自适应控制平面,它简化了配置和操作私有云的任务,这样每个控制平面服务都可以适应由于最终用户请求而看到的工作负载。我们提出了一个逻辑回归模型来实现私有云中控制平面服务的自动供应和动态重新配置。我们为基于openstack的私有云的两个控制平面服务(监控和消息传递)实现了我们的方法。我们在实验室私有云测试平台和使用公共云工作负载上的实验结果表明,我们的方法能够从非常小的私有云配置到非常大的私有云配置提供和调整此类服务。
{"title":"A flexible elastic control plane for private clouds","authors":"Upendra Sharma, P. Shenoy, S. Sahu","doi":"10.1145/2494621.2494626","DOIUrl":"https://doi.org/10.1145/2494621.2494626","url":null,"abstract":"While public cloud computing platforms have become popular in recent years, private clouds---operated by enterprises for their internal use---have also begun gaining traction. The configuration and continuous tuning of a private cloud to meet user demands is a complex task. While private cloud management frameworks provide a number of flexible configuration options for this purpose, they leave it to the administrator to determine how to best configure and tune the cloud platform for local needs. In this paper, we argue for an adaptive control plane for private clouds that simplifies the tasks of configuring and operating a private cloud such that each control plane service is adaptive to the workload seen due to end-user requests. We present a logistic regression model to automate the provisioning and dynamic reconfiguration of control plane services in a private cloud. We implement our approach for two control plane services---monitoring and messaging---for OpenStack-based private clouds. Our experimental results on a laboratory private cloud testbed and using public cloud workloads demonstrates the ability of our approach to provision and adapt such services from very small to very large private cloud configurations.","PeriodicalId":190559,"journal":{"name":"ACM Cloud and Autonomic Computing Conference","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125123189","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
QACO: exploiting partial execution in web servers QACO:利用web服务器中的部分执行
Pub Date : 2013-08-09 DOI: 10.1145/2494621.2494636
Jinha Kim, S. Elnikety, Yuxiong He, Seung-won Hwang, Shaolei Ren
Web servers provide content to users, with the requirement of providing high response quality within a short response time. Meeting these requirements is challenging, especially in the event of load spikes. Meanwhile, we observe that a response to a request can be adapted or partially executed depending on current resource availability at the server. For example, a web server can choose to send a low or medium resolution image instead of sending the original high resolution image under resource contention. In this paper, we exploit partial execution to expose a trade off between resource consumption and service quality. We show how to manage server resources to improve service quality and responsiveness. Specifically, we develop a framework, called Quota-based Control Optimization (QACO). The quota represents the total amount of resources available for all pending requests. QACO consists of two modules: (1) A control module adjusts the quota to meet the response time target. (2) An optimization module exploits partial execution and allocates the quota to pending requests in a manner that improves total response quality. We evaluate the framework using a system implementation in the Apache Web server, and using a simulation study of a Video-on-Demand server. The results show that under a response time target, QACO achieves a higher response quality than traditional techniques that admit or reject requests without exploiting partial execution.
Web服务器向用户提供内容,要求在短的响应时间内提供高质量的响应。满足这些要求是具有挑战性的,特别是在发生负载峰值的情况下。同时,我们观察到,对请求的响应可以根据服务器上当前的资源可用性进行调整或部分执行。例如,在资源竞争的情况下,web服务器可以选择发送低分辨率或中等分辨率的图像,而不是发送原始的高分辨率图像。在本文中,我们利用部分执行来公开资源消耗和服务质量之间的权衡。我们将展示如何管理服务器资源以提高服务质量和响应能力。具体来说,我们开发了一个框架,称为基于配额的控制优化(QACO)。配额表示所有挂起请求可用的资源总量。QACO由两个模块组成:(1)控制模块调整配额以满足响应时间目标。(2)优化模块利用部分执行,以提高总响应质量的方式为待挂请求分配配额。我们使用Apache Web服务器中的系统实现来评估该框架,并使用视频点播服务器的模拟研究。结果表明,在一定的响应时间目标下,QACO比传统的允许或拒绝请求的技术获得了更高的响应质量,而不需要利用部分执行。
{"title":"QACO: exploiting partial execution in web servers","authors":"Jinha Kim, S. Elnikety, Yuxiong He, Seung-won Hwang, Shaolei Ren","doi":"10.1145/2494621.2494636","DOIUrl":"https://doi.org/10.1145/2494621.2494636","url":null,"abstract":"Web servers provide content to users, with the requirement of providing high response quality within a short response time. Meeting these requirements is challenging, especially in the event of load spikes. Meanwhile, we observe that a response to a request can be adapted or partially executed depending on current resource availability at the server. For example, a web server can choose to send a low or medium resolution image instead of sending the original high resolution image under resource contention.\u0000 In this paper, we exploit partial execution to expose a trade off between resource consumption and service quality. We show how to manage server resources to improve service quality and responsiveness. Specifically, we develop a framework, called Quota-based Control Optimization (QACO). The quota represents the total amount of resources available for all pending requests. QACO consists of two modules: (1) A control module adjusts the quota to meet the response time target. (2) An optimization module exploits partial execution and allocates the quota to pending requests in a manner that improves total response quality. We evaluate the framework using a system implementation in the Apache Web server, and using a simulation study of a Video-on-Demand server. The results show that under a response time target, QACO achieves a higher response quality than traditional techniques that admit or reject requests without exploiting partial execution.","PeriodicalId":190559,"journal":{"name":"ACM Cloud and Autonomic Computing Conference","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117189317","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
An integrated management system of virtual resources based on virtualization API and data distribution service 基于虚拟化API和数据分发服务的虚拟资源集成管理系统
Pub Date : 2013-08-09 DOI: 10.1145/2494621.2494648
Yongseong Cho, Jongsun Choi, Jaeyoung Choi
Virtualization technology reduces the costs for server installation, operation, and maintenance and it can simplify the building of distributed systems. Currently, there are various types of virtualization technologies such as Xen, KVM, VMware, etc, and these technologies support various virtualization functions individually on heterogeneous platforms. Therefore, it is required to integrate and manage these heterogeneous virtualized resources in order to build a distributed system supporting current virtualization techniques. In this paper, we propose an integrated management system for managing heterogenous virtual resources. The proposed system is developed based on the following two techniques: a libvirt-based virtualization API and Data Distribution Service (DDS). Libvirt-based virtualization API is to extract information of heterogeneous virtual resources and to control them. DDS is to transmit in real-time the state information and control commands of virtualized resources.
虚拟化技术降低了服务器的安装、运行和维护成本,简化了分布式系统的构建。目前,有各种类型的虚拟化技术,如Xen、KVM、VMware等,这些技术在异构平台上各自支持各种虚拟化功能。因此,为了构建一个支持当前虚拟化技术的分布式系统,需要对这些异构虚拟化资源进行集成和管理。本文提出了一种异构虚拟资源的集成管理系统。该系统是基于以下两种技术开发的:基于libvirt的虚拟化API和数据分发服务(DDS)。基于libvirt的虚拟化API是对异构虚拟资源的信息提取和控制。DDS用于实时传输虚拟化资源的状态信息和控制命令。
{"title":"An integrated management system of virtual resources based on virtualization API and data distribution service","authors":"Yongseong Cho, Jongsun Choi, Jaeyoung Choi","doi":"10.1145/2494621.2494648","DOIUrl":"https://doi.org/10.1145/2494621.2494648","url":null,"abstract":"Virtualization technology reduces the costs for server installation, operation, and maintenance and it can simplify the building of distributed systems. Currently, there are various types of virtualization technologies such as Xen, KVM, VMware, etc, and these technologies support various virtualization functions individually on heterogeneous platforms. Therefore, it is required to integrate and manage these heterogeneous virtualized resources in order to build a distributed system supporting current virtualization techniques. In this paper, we propose an integrated management system for managing heterogenous virtual resources. The proposed system is developed based on the following two techniques: a libvirt-based virtualization API and Data Distribution Service (DDS). Libvirt-based virtualization API is to extract information of heterogeneous virtual resources and to control them. DDS is to transmit in real-time the state information and control commands of virtualized resources.","PeriodicalId":190559,"journal":{"name":"ACM Cloud and Autonomic Computing Conference","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130228427","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
期刊
ACM Cloud and Autonomic Computing Conference
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1