首页 > 最新文献

2010 11th IEEE/ACM International Conference on Grid Computing最新文献

英文 中文
Fine-grained tracking of Grid infections 网格感染的细粒度跟踪
Pub Date : 2010-10-01 DOI: 10.1109/GRID.2010.5697969
Ashish Gehani, Basim Baig, Salman Mahmood, Dawood Tariq, Fareed Zaffar
Previous distributed anomaly detection efforts have operated on summary statistics gathered from each node. This has the advantage that the audit trail is limited in size since event sets can be succinctly represented. While this minimizes the bandwidth consumed and helps scale the detection to a large number of nodes, it limits the infrastructure's ability to identify the source of anomalies. We describe three optimizations that together allow fine-grained tracking of the sources of anomalous activity in a Grid, thereby facilitating precise responses. We demonstrate the scheme's scalability in terms of storage and network bandwidth overhead with an implementation on nodes running BOINC. The results generalize to other types of Grids as well.
以前的分布式异常检测工作是基于从每个节点收集的汇总统计数据进行操作的。这样做的好处是审计跟踪的大小有限,因为事件集可以简洁地表示。虽然这最大限度地减少了带宽消耗,并有助于将检测扩展到大量节点,但它限制了基础设施识别异常来源的能力。我们描述了三种优化,它们一起允许对网格中异常活动的来源进行细粒度跟踪,从而促进精确的响应。我们通过在运行BOINC的节点上实现存储和网络带宽开销来演示该方案的可扩展性。研究结果也适用于其他类型的网格。
{"title":"Fine-grained tracking of Grid infections","authors":"Ashish Gehani, Basim Baig, Salman Mahmood, Dawood Tariq, Fareed Zaffar","doi":"10.1109/GRID.2010.5697969","DOIUrl":"https://doi.org/10.1109/GRID.2010.5697969","url":null,"abstract":"Previous distributed anomaly detection efforts have operated on summary statistics gathered from each node. This has the advantage that the audit trail is limited in size since event sets can be succinctly represented. While this minimizes the bandwidth consumed and helps scale the detection to a large number of nodes, it limits the infrastructure's ability to identify the source of anomalies. We describe three optimizations that together allow fine-grained tracking of the sources of anomalous activity in a Grid, thereby facilitating precise responses. We demonstrate the scheme's scalability in terms of storage and network bandwidth overhead with an implementation on nodes running BOINC. The results generalize to other types of Grids as well.","PeriodicalId":6372,"journal":{"name":"2010 11th IEEE/ACM International Conference on Grid Computing","volume":"32 1","pages":"73-80"},"PeriodicalIF":0.0,"publicationDate":"2010-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89329560","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 17
Accurate energy accounting for shared virtualized environments using PMC-based power modeling techniques 使用基于pmc的功率建模技术实现共享虚拟化环境的准确能源核算
Pub Date : 2010-10-01 DOI: 10.1109/GRID.2010.5697889
Ramon Bertran Monfort, Y. Becerra, David Carrera, Vicencc Beltran, Marc González, X. Martorell, J. Torres, E. Ayguadé
Virtualized infrastructure providers demand new methods to increase the accuracy of the accounting models used to charge their customers. Future data centers will be composed of many-core systems that will host a large number of virtual machines (VMs) each. While resource utilization accounting can be achieved with existing system tools, energy accounting is a complex task when per-VM granularity is the goal. In this paper, we propose a methodology that brings new opportunities to energy accounting by adding an unprecedented degree of accuracy on the per-VM measurements. We present a system -which leverages CPU and memory power models based in performance monitoring counters (PMCs)- to perform energy accounting in virtualized systems. The contribution of this paper is twofold. First, we show that PMC-based power modeling methods are still valid on virtualized environments. And second, we introduce a novel methodology for accounting of energy consumption in virtualized systems. In overall, the results for an Intel® Core™ 2 Duo show errors in energy estimations below the 5%. Such approach brings flexibility to the chargeback models used by service and infrastructure providers. For instance, we show that VMs executed during the same amount of time, present more than 20% differences in energy consumption even only taking into account the consumption of the CPU and the memory.
虚拟化基础设施提供商需要新的方法来提高用于向客户收费的会计模型的准确性。未来的数据中心将由多个核心系统组成,每个核心系统将承载大量虚拟机。虽然可以使用现有的系统工具实现资源利用率核算,但是当以每个vm粒度为目标时,能源核算是一项复杂的任务。在本文中,我们提出了一种方法,通过在每vm测量上增加前所未有的精确度,为能源会计带来了新的机会。我们提出了一个系统——它利用基于性能监控计数器(pmc)的CPU和内存功率模型——在虚拟化系统中执行能源会计。本文的贡献是双重的。首先,我们展示了基于pmc的功率建模方法在虚拟化环境中仍然有效。其次,我们介绍了一种计算虚拟化系统能耗的新方法。总体而言,英特尔®酷睿™2双核的结果显示,能量估计的误差低于5%。这种方法为服务和基础设施提供者使用的退款模型带来了灵活性。例如,我们展示了在相同时间内执行的vm,即使只考虑CPU和内存的消耗,在能耗方面也存在超过20%的差异。
{"title":"Accurate energy accounting for shared virtualized environments using PMC-based power modeling techniques","authors":"Ramon Bertran Monfort, Y. Becerra, David Carrera, Vicencc Beltran, Marc González, X. Martorell, J. Torres, E. Ayguadé","doi":"10.1109/GRID.2010.5697889","DOIUrl":"https://doi.org/10.1109/GRID.2010.5697889","url":null,"abstract":"Virtualized infrastructure providers demand new methods to increase the accuracy of the accounting models used to charge their customers. Future data centers will be composed of many-core systems that will host a large number of virtual machines (VMs) each. While resource utilization accounting can be achieved with existing system tools, energy accounting is a complex task when per-VM granularity is the goal. In this paper, we propose a methodology that brings new opportunities to energy accounting by adding an unprecedented degree of accuracy on the per-VM measurements. We present a system -which leverages CPU and memory power models based in performance monitoring counters (PMCs)- to perform energy accounting in virtualized systems. The contribution of this paper is twofold. First, we show that PMC-based power modeling methods are still valid on virtualized environments. And second, we introduce a novel methodology for accounting of energy consumption in virtualized systems. In overall, the results for an Intel® Core™ 2 Duo show errors in energy estimations below the 5%. Such approach brings flexibility to the chargeback models used by service and infrastructure providers. For instance, we show that VMs executed during the same amount of time, present more than 20% differences in energy consumption even only taking into account the consumption of the CPU and the memory.","PeriodicalId":6372,"journal":{"name":"2010 11th IEEE/ACM International Conference on Grid Computing","volume":"1 1","pages":"1-8"},"PeriodicalIF":0.0,"publicationDate":"2010-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"91328574","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 39
A parallel island-based hybrid genetic algorithm for precedence-constrained applications to minimize energy consumption and makespan 一种基于并行岛的混合遗传算法,用于优先级约束应用,以最小化能耗和完工时间
Pub Date : 2010-10-01 DOI: 10.1109/GRID.2010.5697985
M. Mezmaz, Y. Kessaci, Young Choon Lee, N. Melab, E. Talbi, Albert Y. Zomaya, D. Tuyttens
Task scheduling algorithms are designed mostly with the sole goal of minimizing makespan (completion time). Almost all research works related to this kind of algorithms do not pay much attention to energy consumption.
任务调度算法的设计主要是为了最小化makespan(完成时间)。几乎所有与此类算法相关的研究工作都不太关注能耗问题。
{"title":"A parallel island-based hybrid genetic algorithm for precedence-constrained applications to minimize energy consumption and makespan","authors":"M. Mezmaz, Y. Kessaci, Young Choon Lee, N. Melab, E. Talbi, Albert Y. Zomaya, D. Tuyttens","doi":"10.1109/GRID.2010.5697985","DOIUrl":"https://doi.org/10.1109/GRID.2010.5697985","url":null,"abstract":"Task scheduling algorithms are designed mostly with the sole goal of minimizing makespan (completion time). Almost all research works related to this kind of algorithms do not pay much attention to energy consumption.","PeriodicalId":6372,"journal":{"name":"2010 11th IEEE/ACM International Conference on Grid Computing","volume":"40 1","pages":"274-281"},"PeriodicalIF":0.0,"publicationDate":"2010-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75645545","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 12
High-performance remote data access for remote visualization 用于远程可视化的高性能远程数据访问
Pub Date : 2010-10-01 DOI: 10.1109/GRID.2010.5697967
A. Hutanu, Gabrielle Allen, T. Kosar
Visualization of remote data needs software that is fundamentally designed for distributed processing and high-speed networks. Motivated by and following the requirements of a distributed visualization application, this article describes the design and implementation of a fast and configurable remote data access system called eavivdata. Because wide-area networks may have a high latency, the remote data access system uses an architecture that effectively hides latency. Four remote data access architectures are analyzed and the results show that an architecture that combines bulk and pipeline processing is the best solution for high-throughput remote data access. The resulting system, also supporting high-speed transport protocols and configurable remote operations, is up to 400 times faster than a comparable existing remote data access system.
远程数据的可视化需要从根本上为分布式处理和高速网络设计的软件。受分布式可视化应用程序需求的启发,本文描述了名为eavivdata的快速可配置远程数据访问系统的设计和实现。由于广域网具有较高的时延,远程数据访问系统采用了一种有效地隐藏时延的架构。对四种远程数据访问体系结构进行了分析,结果表明,将批量处理和流水线处理相结合的体系结构是高吞吐量远程数据访问的最佳解决方案。由此产生的系统也支持高速传输协议和可配置的远程操作,比现有的可比远程数据访问系统快400倍。
{"title":"High-performance remote data access for remote visualization","authors":"A. Hutanu, Gabrielle Allen, T. Kosar","doi":"10.1109/GRID.2010.5697967","DOIUrl":"https://doi.org/10.1109/GRID.2010.5697967","url":null,"abstract":"Visualization of remote data needs software that is fundamentally designed for distributed processing and high-speed networks. Motivated by and following the requirements of a distributed visualization application, this article describes the design and implementation of a fast and configurable remote data access system called eavivdata. Because wide-area networks may have a high latency, the remote data access system uses an architecture that effectively hides latency. Four remote data access architectures are analyzed and the results show that an architecture that combines bulk and pipeline processing is the best solution for high-throughput remote data access. The resulting system, also supporting high-speed transport protocols and configurable remote operations, is up to 400 times faster than a comparable existing remote data access system.","PeriodicalId":6372,"journal":{"name":"2010 11th IEEE/ACM International Conference on Grid Computing","volume":"11 1","pages":"121-128"},"PeriodicalIF":0.0,"publicationDate":"2010-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89563770","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Towards automating the configuration of a distributed storage system 迈向分布式存储系统配置自动化
Pub Date : 2010-10-01 DOI: 10.1109/GRID.2010.5697971
L. Costa, M. Ripeanu
Versatile storage systems aim to maximize storage resource utilization by supporting the ability to ‘morph’ the storage system to best match the application's demands. To this end, versatile storage systems significantly extend the deployment- or run-time configurability of the storage system. This flexibility, however, introduces a new problem: a much larger, and potentially dynamic, configuration space makes manually configuring the storage system an undesirable if not unfeasible task. This paper presents our initial progress towards answering the question: “How can we configure a distributed storage system (i.e., enable/disable its various optimizations and configure their parameters) with minimal human intervention?” We discuss why manually configuring the storage system is undesirable; present the success criteria for an automated configuration solution; propose a generic architecture that supports automated configuration; and, finally, instantiate this architecture into a first prototype, which controls the configuration of similarity detection optimizations in the MosaStore distributed storage system. Our evaluation results demonstrate that the prototype can provide performance close to the optimal configuration at the cost of minimal overhead.
通用存储系统的目标是通过支持存储系统的“变形”能力来最大限度地利用存储资源,以最佳地匹配应用程序的需求。为此,多功能存储系统极大地扩展了存储系统的部署或运行时可配置性。然而,这种灵活性带来了一个新问题:更大的、可能是动态的配置空间使得手动配置存储系统成为一项不可取的任务(如果不是不可行的话)。本文介绍了我们在回答这个问题方面的初步进展:“我们如何在最少的人为干预下配置分布式存储系统(即启用/禁用其各种优化并配置其参数)?”我们将讨论为什么不需要手动配置存储系统;提出自动化配置解决方案的成功标准;提出一个支持自动化配置的通用架构;最后,将该架构实例化为第一个原型,该原型控制了MosaStore分布式存储系统中相似性检测优化的配置。我们的评估结果表明,原型可以以最小的开销为代价提供接近最佳配置的性能。
{"title":"Towards automating the configuration of a distributed storage system","authors":"L. Costa, M. Ripeanu","doi":"10.1109/GRID.2010.5697971","DOIUrl":"https://doi.org/10.1109/GRID.2010.5697971","url":null,"abstract":"Versatile storage systems aim to maximize storage resource utilization by supporting the ability to ‘morph’ the storage system to best match the application's demands. To this end, versatile storage systems significantly extend the deployment- or run-time configurability of the storage system. This flexibility, however, introduces a new problem: a much larger, and potentially dynamic, configuration space makes manually configuring the storage system an undesirable if not unfeasible task. This paper presents our initial progress towards answering the question: “How can we configure a distributed storage system (i.e., enable/disable its various optimizations and configure their parameters) with minimal human intervention?” We discuss why manually configuring the storage system is undesirable; present the success criteria for an automated configuration solution; propose a generic architecture that supports automated configuration; and, finally, instantiate this architecture into a first prototype, which controls the configuration of similarity detection optimizations in the MosaStore distributed storage system. Our evaluation results demonstrate that the prototype can provide performance close to the optimal configuration at the cost of minimal overhead.","PeriodicalId":6372,"journal":{"name":"2010 11th IEEE/ACM International Conference on Grid Computing","volume":"68 1","pages":"201-208"},"PeriodicalIF":0.0,"publicationDate":"2010-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78950648","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 25
Dynamic Cloud provisioning for scientific Grid workflows 科学网格工作流的动态云配置
Pub Date : 2010-10-01 DOI: 10.1109/GRID.2010.5697953
S. Ostermann, R. Prodan, T. Fahringer
Scientific computing requires an ever-increasing number of resources to deliver results for growing problem sizes in a reasonable timeframe. In the last decade, while the largest research projects were able to afford expensive supercomputers, others were forced to opt for cheaper resources such as commodity clusters or computational Grids. Today, Cloud computing proposes an alternative by which resources are no longer hosted by the scientists' computational facilities, but leased from specialized data centers only when and for how long they are needed. In this paper, we analyze the problem of dynamic provisioning of Cloud resources to scientific workflows that do not have sufficient Grid resources available, as required by their computational demands. We propose and study four provisioning aspects that deal with the general leasing model encountered in today's commercial Cloud environments based on resource bulks, fuzzy descriptions, and hourly payment intervals: Cloud start, instance type, Grid rescheduling, and Cloud stop. We study the impact of our techniques to the overall execution time, overall cost, and cost per unit of saved time with respect to various instance types offered by the Amazon EC2.
科学计算需要不断增加的资源,以便在合理的时间范围内为不断增长的问题规模交付结果。在过去的十年中,虽然最大的研究项目能够负担得起昂贵的超级计算机,但其他项目被迫选择更便宜的资源,如商品集群或计算网格。今天,云计算提出了另一种选择,即资源不再由科学家的计算设施托管,而是只在需要的时候和需要的时间从专门的数据中心租用。在本文中,我们分析了没有足够网格资源的科学工作流动态提供云资源的问题,以满足其计算需求。我们提出并研究了四个供应方面,这些方面基于资源量、模糊描述和每小时支付间隔处理当今商业云环境中遇到的一般租赁模型:云启动、实例类型、网格重新调度和云停止。我们研究了我们的技术对Amazon EC2提供的各种实例类型的总体执行时间、总体成本和每单位节省时间的成本的影响。
{"title":"Dynamic Cloud provisioning for scientific Grid workflows","authors":"S. Ostermann, R. Prodan, T. Fahringer","doi":"10.1109/GRID.2010.5697953","DOIUrl":"https://doi.org/10.1109/GRID.2010.5697953","url":null,"abstract":"Scientific computing requires an ever-increasing number of resources to deliver results for growing problem sizes in a reasonable timeframe. In the last decade, while the largest research projects were able to afford expensive supercomputers, others were forced to opt for cheaper resources such as commodity clusters or computational Grids. Today, Cloud computing proposes an alternative by which resources are no longer hosted by the scientists' computational facilities, but leased from specialized data centers only when and for how long they are needed. In this paper, we analyze the problem of dynamic provisioning of Cloud resources to scientific workflows that do not have sufficient Grid resources available, as required by their computational demands. We propose and study four provisioning aspects that deal with the general leasing model encountered in today's commercial Cloud environments based on resource bulks, fuzzy descriptions, and hourly payment intervals: Cloud start, instance type, Grid rescheduling, and Cloud stop. We study the impact of our techniques to the overall execution time, overall cost, and cost per unit of saved time with respect to various instance types offered by the Amazon EC2.","PeriodicalId":6372,"journal":{"name":"2010 11th IEEE/ACM International Conference on Grid Computing","volume":"3 1","pages":"97-104"},"PeriodicalIF":0.0,"publicationDate":"2010-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89665264","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 59
A proposal for WS-Agreement Negotiation WS-Agreement协商的建议
Pub Date : 2010-10-01 DOI: 10.1109/GRID.2010.5697976
Dominic Battré, F. Brazier, K. Clark, M. Oey, A. Papaspyrou, Oliver Wäldrich, P. Wieder, W. Ziegler
The Web Services Agreement specification defines a normative language to formulate Service Level Agreements and a basic protocol to expose service-level descriptions, validate service-level requests, and come to an agreement. This protocol, often called “take-it-or-leave-it”, allows a service provider and a service consumer to decide whether to accept or reject a service offer. Although this approach is sufficient for a number of use cases, others exist with requirements for multi-step negotiation or the adaptation of an existing agreement. In this paper, we describe the Web Services Agreement Negotiation protocol, a proposal by the Open Grid Forum to extend the existing specification. This proposal is the result of combining various research activities that have been conducted to define protocols for negotiating service levels or to supersede the existing “take-it-or-leave-it” protocol. The main characteristics of this proposal are the multi-round negotiation capability, renegotiation capability, and compliance with the original specification.
Web服务协议规范定义了一种规范语言来制定服务水平协议,并定义了一个基本协议来公开服务水平描述、验证服务水平请求并达成协议。该协议通常被称为“接受或放弃”,它允许服务提供者和服务消费者决定是否接受或拒绝服务提供。尽管这种方法对于许多用例来说是足够的,但是对于多步骤协商或对现有协议的适应的需求,还存在其他的用例。在本文中,我们描述了Web服务协议协商协议,这是一个由开放网格论坛提出的扩展现有规范的提议。这项建议是综合各种研究活动的结果,这些活动是为了确定谈判服务水平的协议或取代现有的“接受或放弃”协议而进行的。该方案的主要特点是具有多轮协商能力、再协商能力和对原规范的遵从性。
{"title":"A proposal for WS-Agreement Negotiation","authors":"Dominic Battré, F. Brazier, K. Clark, M. Oey, A. Papaspyrou, Oliver Wäldrich, P. Wieder, W. Ziegler","doi":"10.1109/GRID.2010.5697976","DOIUrl":"https://doi.org/10.1109/GRID.2010.5697976","url":null,"abstract":"The Web Services Agreement specification defines a normative language to formulate Service Level Agreements and a basic protocol to expose service-level descriptions, validate service-level requests, and come to an agreement. This protocol, often called “take-it-or-leave-it”, allows a service provider and a service consumer to decide whether to accept or reject a service offer. Although this approach is sufficient for a number of use cases, others exist with requirements for multi-step negotiation or the adaptation of an existing agreement. In this paper, we describe the Web Services Agreement Negotiation protocol, a proposal by the Open Grid Forum to extend the existing specification. This proposal is the result of combining various research activities that have been conducted to define protocols for negotiating service levels or to supersede the existing “take-it-or-leave-it” protocol. The main characteristics of this proposal are the multi-round negotiation capability, renegotiation capability, and compliance with the original specification.","PeriodicalId":6372,"journal":{"name":"2010 11th IEEE/ACM International Conference on Grid Computing","volume":"9 1","pages":"233-241"},"PeriodicalIF":0.0,"publicationDate":"2010-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82129995","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 36
A distributed storage system allowing application users to reserve I/O performance in advance for achieving SLA 分布式存储系统,允许应用用户提前预留I/O性能,实现SLA
Pub Date : 2010-10-01 DOI: 10.1109/GRID.2010.5697948
Y. Tanimura, Hidetaka Koie, T. Kudoh, I. Kojima, Yoshio Tanaka
Performance assurance has become an important aspect in grid and cloud computing which provide services over the Internet, and Service Level Agreements (SLA) are frequently contracted between users and the service providers. However, the I/O performance of the storage or data access service is still provided on a best effort basis. Some distributed storage systems implement performance reservation, but the reservation is implemented inside of the storage and works in an adaptive manner. In order to promise performance guarantees to users, we propose a distributed storage system allowing application users to explicitly make an advanced and time-based reservation for I/O access and storage space. Thus the requested performance is guaranteed during the reserved time. This paper describes our proposed concept and the design architecture of the storage system, including the reservation interface, resource management and I/O control frameworks. Then it explains our prototype which implements a simple resource allocation strategy and I/O control of the storage network along the design. The experiment results using the prototype are also shown. They indicate that the reservation cost entailed only a low performance impact on users, and that the requested performance was achieved by the reservation feature.
性能保证已经成为在互联网上提供服务的网格和云计算中的一个重要方面,服务水平协议(SLA)经常在用户和服务提供商之间签订。但是,存储或数据访问服务的I/O性能仍然是尽力而为的。有些分布式存储系统实现了性能预留,但这种预留是在存储内部实现的,并且以自适应的方式工作。为了向用户承诺性能保证,我们提出了一种分布式存储系统,允许应用程序用户显式地对I/O访问和存储空间进行高级和基于时间的预订。因此,在预留时间内保证所要求的性能。本文描述了我们提出的存储系统的概念和设计体系结构,包括预留接口、资源管理和I/O控制框架。然后介绍了我们的原型,实现了一个简单的资源分配策略和存储网络的I/O控制。最后给出了样机的实验结果。它们表明,预订成本对用户的性能影响很小,所要求的性能是通过预订特性实现的。
{"title":"A distributed storage system allowing application users to reserve I/O performance in advance for achieving SLA","authors":"Y. Tanimura, Hidetaka Koie, T. Kudoh, I. Kojima, Yoshio Tanaka","doi":"10.1109/GRID.2010.5697948","DOIUrl":"https://doi.org/10.1109/GRID.2010.5697948","url":null,"abstract":"Performance assurance has become an important aspect in grid and cloud computing which provide services over the Internet, and Service Level Agreements (SLA) are frequently contracted between users and the service providers. However, the I/O performance of the storage or data access service is still provided on a best effort basis. Some distributed storage systems implement performance reservation, but the reservation is implemented inside of the storage and works in an adaptive manner. In order to promise performance guarantees to users, we propose a distributed storage system allowing application users to explicitly make an advanced and time-based reservation for I/O access and storage space. Thus the requested performance is guaranteed during the reserved time. This paper describes our proposed concept and the design architecture of the storage system, including the reservation interface, resource management and I/O control frameworks. Then it explains our prototype which implements a simple resource allocation strategy and I/O control of the storage network along the design. The experiment results using the prototype are also shown. They indicate that the reservation cost entailed only a low performance impact on users, and that the requested performance was achieved by the reservation feature.","PeriodicalId":6372,"journal":{"name":"2010 11th IEEE/ACM International Conference on Grid Computing","volume":"25 31","pages":"193-200"},"PeriodicalIF":0.0,"publicationDate":"2010-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"91479569","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 17
Cloud auto-scaling with deadline and budget constraints 具有截止日期和预算限制的云自动扩展
Pub Date : 2010-10-01 DOI: 10.1109/GRID.2010.5697966
Ming Mao, Jie Li, M. Humphrey
Clouds have become an attractive computing platform which offers on-demand computing power and storage capacity. Its dynamic scalability enables users to quickly scale up and scale down underlying infrastructure in response to business volume, performance desire and other dynamic behaviors. However, challenges arise when considering computing instance non-deterministic acquisition time, multiple VM instance types, unique cloud billing models and user budget constraints. Planning enough computing resources for user desired performance with less cost, which can also automatically adapt to workload changes, is not a trivial problem. In this paper, we present a cloud auto-scaling mechanism to automatically scale computing instances based on workload information and performance desire. Our mechanism schedules VM instance startup and shut-down activities. It enables cloud applications to finish submitted jobs within the deadline by controlling underlying instance numbers and reduces user cost by choosing appropriate instance types. We have implemented our mechanism in Windows Azure platform, and evaluated it using both simulations and a real scientific cloud application. Results show that our cloud auto-scaling mechanism can meet user specified performance goal with less cost.
云已经成为一个有吸引力的计算平台,它提供按需计算能力和存储容量。它的动态可伸缩性使用户能够根据业务量、性能需求和其他动态行为快速扩展和缩减底层基础设施。然而,当考虑到计算实例的非确定性获取时间、多个VM实例类型、独特的云计费模型和用户预算约束时,挑战就出现了。以更低的成本为用户所需的性能规划足够的计算资源,这也可以自动适应工作负载的变化,这不是一个简单的问题。在本文中,我们提出了一种基于工作负载信息和性能需求的云计算自动扩展机制。我们的机制安排VM实例启动和关闭活动。它使云应用程序能够通过控制底层实例数在截止日期内完成提交的作业,并通过选择适当的实例类型降低用户成本。我们已经在Windows Azure平台上实现了我们的机制,并使用模拟和真实的科学云应用程序对其进行了评估。结果表明,我们的云自动扩展机制能够以较低的成本满足用户指定的性能目标。
{"title":"Cloud auto-scaling with deadline and budget constraints","authors":"Ming Mao, Jie Li, M. Humphrey","doi":"10.1109/GRID.2010.5697966","DOIUrl":"https://doi.org/10.1109/GRID.2010.5697966","url":null,"abstract":"Clouds have become an attractive computing platform which offers on-demand computing power and storage capacity. Its dynamic scalability enables users to quickly scale up and scale down underlying infrastructure in response to business volume, performance desire and other dynamic behaviors. However, challenges arise when considering computing instance non-deterministic acquisition time, multiple VM instance types, unique cloud billing models and user budget constraints. Planning enough computing resources for user desired performance with less cost, which can also automatically adapt to workload changes, is not a trivial problem. In this paper, we present a cloud auto-scaling mechanism to automatically scale computing instances based on workload information and performance desire. Our mechanism schedules VM instance startup and shut-down activities. It enables cloud applications to finish submitted jobs within the deadline by controlling underlying instance numbers and reduces user cost by choosing appropriate instance types. We have implemented our mechanism in Windows Azure platform, and evaluated it using both simulations and a real scientific cloud application. Results show that our cloud auto-scaling mechanism can meet user specified performance goal with less cost.","PeriodicalId":6372,"journal":{"name":"2010 11th IEEE/ACM International Conference on Grid Computing","volume":"10 1","pages":"41-48"},"PeriodicalIF":0.0,"publicationDate":"2010-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77340886","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 336
How dynamic is the Grid? Towards a quality metric for Grid information systems 网格有多动态?面向网格信息系统的质量度量
Pub Date : 2010-10-01 DOI: 10.1109/GRID.2010.5697957
L. Field, R. Sakellariou
Grid information systems play a core role in today's production Grid Infrastructures. They provide a coherent view of the Grid services in the infrastructure while addressing the performance, robustness and scalability issues that occur in dynamic, large-scale, distributed systems. Quality metrics for Grid information systems are required in order to compare different implementations and to evaluate suggested improvements. This paper proposes the adoption of a quality metric, first used in the domain of Web search, to measure the quality of Grid information systems with respect to their information content. The application of this metric requires an understanding of the dynamic nature of Grid information. An empirical study based on information from the EGEE Grid infrastructure is carried out to estimate the frequency of change for different types of Grid information. Using this data, the proposed metric is assessed with regards to its applicability to measuring the quality of Grid information systems.
网格信息系统在当今生产网格基础设施中起着核心作用。它们提供了基础设施中网格服务的一致视图,同时解决了动态、大规模分布式系统中出现的性能、健壮性和可伸缩性问题。为了比较不同的实现和评估建议的改进,需要网格信息系统的质量度量。本文提出采用一种质量度量,该度量首先用于Web搜索领域,根据其信息内容度量网格信息系统的质量。这个度量的应用需要理解网格信息的动态性。基于EGEE网格基础设施的信息进行了实证研究,估计了不同类型网格信息的变化频率。利用这些数据,评估了所提出的度量标准在测量网格信息系统质量方面的适用性。
{"title":"How dynamic is the Grid? Towards a quality metric for Grid information systems","authors":"L. Field, R. Sakellariou","doi":"10.1109/GRID.2010.5697957","DOIUrl":"https://doi.org/10.1109/GRID.2010.5697957","url":null,"abstract":"Grid information systems play a core role in today's production Grid Infrastructures. They provide a coherent view of the Grid services in the infrastructure while addressing the performance, robustness and scalability issues that occur in dynamic, large-scale, distributed systems. Quality metrics for Grid information systems are required in order to compare different implementations and to evaluate suggested improvements. This paper proposes the adoption of a quality metric, first used in the domain of Web search, to measure the quality of Grid information systems with respect to their information content. The application of this metric requires an understanding of the dynamic nature of Grid information. An empirical study based on information from the EGEE Grid infrastructure is carried out to estimate the frequency of change for different types of Grid information. Using this data, the proposed metric is assessed with regards to its applicability to measuring the quality of Grid information systems.","PeriodicalId":6372,"journal":{"name":"2010 11th IEEE/ACM International Conference on Grid Computing","volume":"205 1","pages":"113-120"},"PeriodicalIF":0.0,"publicationDate":"2010-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76679809","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
期刊
2010 11th IEEE/ACM International Conference on Grid Computing
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1