首页 > 最新文献

2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid最新文献

英文 中文
Online Risk Analytics on the Cloud 云上的在线风险分析
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.82
Hyunjoo Kim, Shivangi Chaudhari, M. Parashar, Christopher Marty
In todays turbulent market conditions, the ability to generate accurate and timely risk measures has become critical to operating successfully, and necessary for survival. Value-at-Risk (VaR) is a market standard risk measure used by senior management and regulators to quantify the risk level of a firm's holdings. However, the time-critical nature and dynamic computational workloads of VaR applications, make it essential for computing infrastructures to handle bursts in computing and storage resources needs. This requires on-demand scalability, dynamic provisioning, and the integration of distributed resources. While emerging utility computing services and clouds have the potential for cost-effectively supporting such spikes in resource requirements, integrating clouds with computing platforms and data centers, as well as developing and managing applications to utilize the platform remains a challenge. In this paper, we focus on the dynamic resource requirements of online risk analytics applications and how they can be addressed by cloud environments. Specifically, we demonstrate how the CometCloud autonomic computing engine can support online multi-resolution VaR analytics using and integration of private and Internet cloud resources.
在当今动荡的市场环境下,能够及时准确地衡量风险已成为成功运营的关键,也是生存的必要条件。风险价值(VaR)是高级管理层和监管机构用来量化公司持股风险水平的市场标准风险度量。然而,VaR应用程序的时间关键性质和动态计算工作负载使得计算基础设施必须处理计算和存储资源需求的突发情况。这需要按需可伸缩性、动态供应和分布式资源的集成。虽然新兴的公用事业计算服务和云具有经济有效地支持资源需求激增的潜力,但将云与计算平台和数据中心集成,以及开发和管理利用该平台的应用程序仍然是一个挑战。在本文中,我们关注在线风险分析应用程序的动态资源需求,以及如何通过云环境来解决这些需求。具体来说,我们演示了CometCloud自主计算引擎如何使用和集成私有云和互联网云资源来支持在线多分辨率VaR分析。
{"title":"Online Risk Analytics on the Cloud","authors":"Hyunjoo Kim, Shivangi Chaudhari, M. Parashar, Christopher Marty","doi":"10.1109/CCGRID.2009.82","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.82","url":null,"abstract":"In todays turbulent market conditions, the ability to generate accurate and timely risk measures has become critical to operating successfully, and necessary for survival. Value-at-Risk (VaR) is a market standard risk measure used by senior management and regulators to quantify the risk level of a firm's holdings. However, the time-critical nature and dynamic computational workloads of VaR applications, make it essential for computing infrastructures to handle bursts in computing and storage resources needs. This requires on-demand scalability, dynamic provisioning, and the integration of distributed resources. While emerging utility computing services and clouds have the potential for cost-effectively supporting such spikes in resource requirements, integrating clouds with computing platforms and data centers, as well as developing and managing applications to utilize the platform remains a challenge. In this paper, we focus on the dynamic resource requirements of online risk analytics applications and how they can be addressed by cloud environments. Specifically, we demonstrate how the CometCloud autonomic computing engine can support online multi-resolution VaR analytics using and integration of private and Internet cloud resources.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"55 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121502379","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 44
Resource Information Aggregation in Hierarchical Grid Networks 分层网格网络中的资源信息聚合
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.63
P. Kokkinos, Emmanouel Varvarigos
We propose information aggregation as a method for summarizing the resource-related information, used by the task scheduler. Through this method the information of a set of resources can be uniformly represented, reducing at the same time the amount of information transferred in a Grid network. A number of techniques are described for aggregating the information of the resources belonging to a hierarchical Grid domain. This information includes the cpu and storage capacities at a site, the number of tasks queued, and other resource-related parameters. The quality of the aggregation scheme affects the efficiency of the scheduler’s decisions. We use as a metric of aggregation efficiency the Stretch Factor (SF), defined as the ratio of the task delay when the task is scheduled using complete resource information over the task delay when an aggregation scheme is used. The simulation experiments performed show that the proposed aggregation schemes achieve large information reduction, while enabling good task scheduling decisions as indicated by the SF achieved.
我们提出信息聚合作为任务调度程序使用的汇总资源相关信息的方法。通过该方法可以统一表示一组资源的信息,同时减少了网格网络中传递的信息量。描述了用于聚合属于分层网格域的资源信息的许多技术。这些信息包括站点的cpu和存储容量、排队的任务数量以及其他与资源相关的参数。聚合方案的质量影响调度器决策的效率。我们使用拉伸因子(SF)作为聚合效率的度量,它定义为使用完整资源信息调度任务时的任务延迟与使用聚合方案时的任务延迟之比。仿真实验表明,所提出的聚合方案实现了大量的信息缩减,同时实现了良好的任务调度决策,如所实现的SF所示。
{"title":"Resource Information Aggregation in Hierarchical Grid Networks","authors":"P. Kokkinos, Emmanouel Varvarigos","doi":"10.1109/CCGRID.2009.63","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.63","url":null,"abstract":"We propose information aggregation as a method for summarizing the resource-related information, used by the task scheduler. Through this method the information of a set of resources can be uniformly represented, reducing at the same time the amount of information transferred in a Grid network. A number of techniques are described for aggregating the information of the resources belonging to a hierarchical Grid domain. This information includes the cpu and storage capacities at a site, the number of tasks queued, and other resource-related parameters. The quality of the aggregation scheme affects the efficiency of the scheduler’s decisions. We use as a metric of aggregation efficiency the Stretch Factor (SF), defined as the ratio of the task delay when the task is scheduled using complete resource information over the task delay when an aggregation scheme is used. The simulation experiments performed show that the proposed aggregation schemes achieve large information reduction, while enabling good task scheduling decisions as indicated by the SF achieved.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"48 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114933895","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
Multi-scale Real-Time Grid Monitoring with Job Stream Mining 基于作业流挖掘的多尺度实时网格监控
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.20
Xiangliang Zhang, M. Sebag, C. Germain
The ever increasing scale and complexity of large computational systems ask for sophisticated management tools, paving the way toward Autonomic Computing. A first step toward Autonomic Grids is presented in this paper; the interactions between the grid middleware and the stream of computational queries are modeled using statistical learning. The approach is implemented and validated in the context of the EGEE grid. The GStrAP system, embedding the StrAP Data Streaming algorithm, provides manageable and understandable views of the computational workload based on gLite reporting services. An online monitoring module shows the instant distribution of the jobs in real-time and its dynamics, enabling anomaly detection. An offline monitoring module provides the administratorwith a consolidated view of the workload, enabling the visual inspection of its long-term trends.
不断增长的规模和复杂性的大型计算系统需要复杂的管理工具,铺平道路走向自主计算。本文提出了迈向自主网格的第一步;网格中间件和计算查询流之间的交互使用统计学习建模。该方法在EGEE网格环境中得到了实现和验证。GStrAP系统嵌入了StrAP数据流算法,提供了基于gLite报告服务的可管理和可理解的计算工作量视图。在线监控模块实时显示作业的即时分布及其动态,从而实现异常检测。离线监控模块为管理员提供了工作负载的统一视图,从而可以直观地查看其长期趋势。
{"title":"Multi-scale Real-Time Grid Monitoring with Job Stream Mining","authors":"Xiangliang Zhang, M. Sebag, C. Germain","doi":"10.1109/CCGRID.2009.20","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.20","url":null,"abstract":"The ever increasing scale and complexity of large computational systems ask for sophisticated management tools, paving the way toward Autonomic Computing. A first step toward Autonomic Grids is presented in this paper; the interactions between the grid middleware and the stream of computational queries are modeled using statistical learning. The approach is implemented and validated in the context of the EGEE grid. The GStrAP system, embedding the StrAP Data Streaming algorithm, provides manageable and understandable views of the computational workload based on gLite reporting services. An online monitoring module shows the instant distribution of the jobs in real-time and its dynamics, enabling anomaly detection. An offline monitoring module provides the administratorwith a consolidated view of the workload, enabling the visual inspection of its long-term trends.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132444563","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
The Grid Enablement and Sustainable Simulation of Multiscale Physics Applications 多尺度物理应用的网格实现与可持续模拟
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.33
Yingwen Song, Yoshio Tanaka, H. Takemiya, A. Nakano, S. Ogata, S. Sekiguchi
The understanding of H diffusion in materials is pivotal to designing suitable processes. Though a nudged elastic band (NEB)+molecular dynamics (MD)/quantum mechanics (QM) algorithm has been developed to simulate H diffusion in materials by our group, it is often not computationally feasible for large-scale models on a conventional single system. We thus gridify the NEB+MD/QM algorithm on the top of an integrated framework developed by our group. A two days simulation on H diffusion in alumina has been successfully carried out over a Trans-Pacific Grid infrastructure consisting of supercomputers provided by TeraGrid and AIST. In this paper, we describe the NEB+MD/QM algorithm, briefly introduce the framework middleware, present the grid enablement work, and report the techniques to achieve fault-tolerance and load-balance for sustainable simulation. We believe our experience is of benefit to both middleware developers and application users.
对材料中氢扩散的理解对于设计合适的工艺至关重要。虽然我们已经开发了一种微推弹性带(NEB)+分子动力学(MD)/量子力学(QM)算法来模拟材料中的H扩散,但对于传统单一系统上的大规模模型来说,它通常在计算上是不可行的。因此,我们将NEB+MD/QM算法网格化在我们小组开发的集成框架之上。在由TeraGrid和AIST提供的超级计算机组成的跨太平洋网格基础设施上,成功地进行了为期两天的氧化铝H扩散模拟。在本文中,我们描述了NEB+MD/QM算法,简要介绍了框架中间件,给出了网格实现工作,并报告了实现可持续仿真容错和负载平衡的技术。我们相信我们的经验对中间件开发人员和应用程序用户都有好处。
{"title":"The Grid Enablement and Sustainable Simulation of Multiscale Physics Applications","authors":"Yingwen Song, Yoshio Tanaka, H. Takemiya, A. Nakano, S. Ogata, S. Sekiguchi","doi":"10.1109/CCGRID.2009.33","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.33","url":null,"abstract":"The understanding of H diffusion in materials is pivotal to designing suitable processes. Though a nudged elastic band (NEB)+molecular dynamics (MD)/quantum mechanics (QM) algorithm has been developed to simulate H diffusion in materials by our group, it is often not computationally feasible for large-scale models on a conventional single system. We thus gridify the NEB+MD/QM algorithm on the top of an integrated framework developed by our group. A two days simulation on H diffusion in alumina has been successfully carried out over a Trans-Pacific Grid infrastructure consisting of supercomputers provided by TeraGrid and AIST. In this paper, we describe the NEB+MD/QM algorithm, briefly introduce the framework middleware, present the grid enablement work, and report the techniques to achieve fault-tolerance and load-balance for sustainable simulation. We believe our experience is of benefit to both middleware developers and application users.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122461088","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
WSRF-Based Distributed Visualization 基于wsrf的分布式可视化
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.64
Yi Liu, Shu Gao
This paper presents a framework that extends traditional visualization for supporting distributed visualization in Grid environments. This framework adopts the emerging Web Services Resource Framework (WSRF) to deploy visualization algorithms as Web Service on Grid nodes. These visualization algorithms are developed by Visualization ToolKit (VTK) library. Triana, an open source problem solving environment, is used to fulfill a user’s requests for any deployed visualization algorithm on local or remote Computing node. And Ganglia, a scalable distributed monitoring system for high-performance computing systems such as clusters and Grids, by getting state information of each Grid node, can help a user to select the appropriate Grid nodes as Computing nodes executing distributed visualization tasks. To evaluate the feasibility of the proposed framework, a case study is presented.
本文提出了一个扩展传统可视化的框架,以支持网格环境中的分布式可视化。该框架采用新兴的Web服务资源框架(WSRF)将可视化算法部署为网格节点上的Web服务。这些可视化算法是由visualtoolkit (VTK)库开发的。Triana是一个开源的问题解决环境,用于满足用户对本地或远程计算节点上部署的任何可视化算法的请求。Ganglia是一种针对高性能计算系统(如集群和网格)的可伸缩分布式监控系统,通过获取每个网格节点的状态信息,可以帮助用户选择合适的网格节点作为执行分布式可视化任务的计算节点。为了评估所提出的框架的可行性,给出了一个案例研究。
{"title":"WSRF-Based Distributed Visualization","authors":"Yi Liu, Shu Gao","doi":"10.1109/CCGRID.2009.64","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.64","url":null,"abstract":"This paper presents a framework that extends traditional visualization for supporting distributed visualization in Grid environments. This framework adopts the emerging Web Services Resource Framework (WSRF) to deploy visualization algorithms as Web Service on Grid nodes. These visualization algorithms are developed by Visualization ToolKit (VTK) library. Triana, an open source problem solving environment, is used to fulfill a user’s requests for any deployed visualization algorithm on local or remote Computing node. And Ganglia, a scalable distributed monitoring system for high-performance computing systems such as clusters and Grids, by getting state information of each Grid node, can help a user to select the appropriate Grid nodes as Computing nodes executing distributed visualization tasks. To evaluate the feasibility of the proposed framework, a case study is presented.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"197 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122988306","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Failure-Aware Construction and Reconfiguration of Distributed Virtual Machines for High Availability Computing 面向高可用性计算的分布式虚拟机故障感知构建与重构
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.21
S. Fu
In large-scale clusters and computational grids, component failures become norms instead of exceptions. Failure occurrence as well as its impact on system performance and operation costs have become an increasingly important concern to system designers and administrators. In this paper, we study how to efficiently utilize system resources for high-availability clusters with the support of the virtual machine (VM) technology. We design a reconfigurable distributed virtual machine (RDVM) infrastructure for clusters computing. We propose failure-aware node selection strategies for the construction and reconfiguration of RDVMs. We leverage the proactive failure management techniques in calculating nodes' reliability status. We consider both the performance and reliability status of compute nodes in making selection decisions. We define a capacity-reliability metric to combine the effects of both factors in node selection, and propose Best-fit algorithms to find the best qualified nodes on which to instantiate VMs to run parallel jobs. We have conducted experiments using failure traces from production clusters and the NAS Parallel Benchmark programs on a real cluster. The results show the enhancement of system productivity and dependability by using the proposed strategies. With the Best-fit strategies, the job completion rate is increased by 17.6% compared with that achieved in the current LANL HPC cluster, and the task completion rate reaches 91.7%.
在大规模集群和计算网格中,组件故障成为常态而不是例外。故障的发生及其对系统性能和运行成本的影响已成为系统设计者和管理员日益关注的问题。本文研究了在虚拟机技术的支持下,如何有效地利用高可用性集群的系统资源。我们为集群计算设计了一个可重构的分布式虚拟机(RDVM)基础架构。我们提出了故障感知节点选择策略,用于rdvm的构建和重构。我们利用主动故障管理技术计算节点的可靠性状态。在进行选择决策时,我们同时考虑计算节点的性能和可靠性状况。我们定义了一个容量-可靠性度量来结合节点选择中这两个因素的影响,并提出了最佳拟合算法来找到最符合条件的节点,在这些节点上实例化vm以运行并行作业。我们已经在一个真实的集群上使用来自生产集群的故障跟踪和NAS并行基准程序进行了实验。结果表明,该策略提高了系统的生产率和可靠性。采用Best-fit策略后,任务完成率比现有LANL HPC集群提高了17.6%,任务完成率达到91.7%。
{"title":"Failure-Aware Construction and Reconfiguration of Distributed Virtual Machines for High Availability Computing","authors":"S. Fu","doi":"10.1109/CCGRID.2009.21","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.21","url":null,"abstract":"In large-scale clusters and computational grids, component failures become norms instead of exceptions. Failure occurrence as well as its impact on system performance and operation costs have become an increasingly important concern to system designers and administrators. In this paper, we study how to efficiently utilize system resources for high-availability clusters with the support of the virtual machine (VM) technology. We design a reconfigurable distributed virtual machine (RDVM) infrastructure for clusters computing. We propose failure-aware node selection strategies for the construction and reconfiguration of RDVMs. We leverage the proactive failure management techniques in calculating nodes' reliability status. We consider both the performance and reliability status of compute nodes in making selection decisions. We define a capacity-reliability metric to combine the effects of both factors in node selection, and propose Best-fit algorithms to find the best qualified nodes on which to instantiate VMs to run parallel jobs. We have conducted experiments using failure traces from production clusters and the NAS Parallel Benchmark programs on a real cluster. The results show the enhancement of system productivity and dependability by using the proposed strategies. With the Best-fit strategies, the job completion rate is increased by 17.6% compared with that achieved in the current LANL HPC cluster, and the task completion rate reaches 91.7%.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126843565","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 36
A Model-Based Algorithm for Optimizing I/O Intensive Applications in Clouds Using VM-Based Migration 一种基于模型的基于虚拟机迁移的I/O密集型云应用优化算法
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.24
Kento Sato, Hitoshi Sato, S. Matsuoka
Federated storage resources in geographically distributed environments are becoming viable platforms for data-intensive cloud and grid applications. To improveI /O performance in such environments, we propose a novel model-based I/O performance optimization algorithm for data-intensive applications running on a virtual cluster, which determines virtual machine (VM) migration strategies,i.e., when and where a VM should be migrated, while minimizing the expected value of file access time. We solve this problem as a shortest path problem of a weighted direct acyclic graph (DAG), where the weighted vertex represents a location of a VM and expected file access time from the location, and the weighted edge represents a migration of a VM and time. We construct the DAG from our markov model which represents the dependency of files. Our simulation-based studies suggest that our proposed algorithm can achieve higher performance than simple techniques, such as ones that never migrate VMs: 38% or always migrate VMs onto the locations that hold target files: 47%.
地理分布环境中的联邦存储资源正在成为数据密集型云和网格应用程序的可行平台。为了提高这种环境下的I/O性能,我们提出了一种新的基于模型的I/O性能优化算法,用于运行在虚拟集群上的数据密集型应用程序,该算法决定了虚拟机(VM)迁移策略,即:即迁移虚拟机的时间和地点,同时最小化文件访问时间的期望值。我们将此问题作为加权直接无环图(DAG)的最短路径问题来解决,其中加权顶点表示VM的位置和从该位置的期望文件访问时间,加权边表示VM的迁移和时间。我们从表示文件依赖关系的马尔可夫模型中构造DAG。我们基于模拟的研究表明,我们提出的算法可以实现比简单技术更高的性能,例如从不迁移vm: 38%或始终将vm迁移到保存目标文件的位置:47%。
{"title":"A Model-Based Algorithm for Optimizing I/O Intensive Applications in Clouds Using VM-Based Migration","authors":"Kento Sato, Hitoshi Sato, S. Matsuoka","doi":"10.1109/CCGRID.2009.24","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.24","url":null,"abstract":"Federated storage resources in geographically distributed environments are becoming viable platforms for data-intensive cloud and grid applications. To improveI /O performance in such environments, we propose a novel model-based I/O performance optimization algorithm for data-intensive applications running on a virtual cluster, which determines virtual machine (VM) migration strategies,i.e., when and where a VM should be migrated, while minimizing the expected value of file access time. We solve this problem as a shortest path problem of a weighted direct acyclic graph (DAG), where the weighted vertex represents a location of a VM and expected file access time from the location, and the weighted edge represents a migration of a VM and time. We construct the DAG from our markov model which represents the dependency of files. Our simulation-based studies suggest that our proposed algorithm can achieve higher performance than simple techniques, such as ones that never migrate VMs: 38% or always migrate VMs onto the locations that hold target files: 47%.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"575 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127086019","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 45
Energy-Efficient Cluster Computing via Accurate Workload Characterization 基于精确工作负载特征的高效集群计算
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.88
S. Huang, W. Feng
This paper presents an eco-friendly daemon that reduces power and energy consumption while better maintaining high performance via an accurate workload characterization that infers “processor stall cycles due to off-chip activities.” The eco-friendly daemon is an interval-based, run-time algorithm that uses the workload characterization to dynamically adjust a processor’s frequency and voltage to reduce power and energy consumption with little impact on application performance. Using the NAS Parallel Benchmarks as our workload, we then evaluate our eco-friendly daemon on a cluster computer. The results indicate that our workload characterization allows the power-aware daemon to more tightly control performance (5% loss instead of 11%) while delivering substantial energy savings (11% instead of 8%).
本文介绍了一个生态友好的守护进程,它通过准确的工作负载特征来推断“由于芯片外活动导致的处理器停滞周期”,从而降低了功耗和能耗,同时更好地保持了高性能。生态友好型守护进程是一种基于间隔的运行时算法,它使用工作负载特征来动态调整处理器的频率和电压,从而在对应用程序性能影响很小的情况下降低功耗和能耗。使用NAS并行基准测试作为我们的工作负载,然后我们在集群计算机上评估我们的环保守护进程。结果表明,我们的工作负载特性允许功率感知守护进程更严格地控制性能(损失5%而不是11%),同时提供大量的能源节省(11%而不是8%)。
{"title":"Energy-Efficient Cluster Computing via Accurate Workload Characterization","authors":"S. Huang, W. Feng","doi":"10.1109/CCGRID.2009.88","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.88","url":null,"abstract":"This paper presents an eco-friendly daemon that reduces power and energy consumption while better maintaining high performance via an accurate workload characterization that infers “processor stall cycles due to off-chip activities.” The eco-friendly daemon is an interval-based, run-time algorithm that uses the workload characterization to dynamically adjust a processor’s frequency and voltage to reduce power and energy consumption with little impact on application performance. Using the NAS Parallel Benchmarks as our workload, we then evaluate our eco-friendly daemon on a cluster computer. The results indicate that our workload characterization allows the power-aware daemon to more tightly control performance (5% loss instead of 11%) while delivering substantial energy savings (11% instead of 8%).","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"60 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126217943","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 110
MPISec I/O: Providing Data Confidentiality in MPI-I/O MPISec I/O:在MPI-I/O中提供数据机密性
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.53
R. Prabhakar, C. Patrick, M. Kandemir
Applications performing scientific computations or processing streaming media benefit from parallel I/O significantly, as they operate on large data sets that require large I/O. MPI-I/O is a commonly used library interface in parallel applications to perform I/O efficiently. Optimizations like collective-I/O embedded in MPI-I/O allow multiple processes executing in parallel to perform I/O by merging requests of other processes and sharing them later. In such a scenario, preserving confidentiality of disk-resident data from unauthorized accesses by processes without significantly impacting performance of the application is a challenging task. In this paper, we evaluate the impact of ensuring data-confidentiality in MPI-I/O on the performance of parallel applications and provide an enhanced interface, called MPISec I/O, which brings an average overhead of only 5.77% over MPI-I/O in the best case, and about 7.82% in the average case.
执行科学计算或处理流媒体的应用程序明显受益于并行I/O,因为它们操作的是需要大量I/O的大型数据集。MPI-I/O是并行应用程序中常用的库接口,用于高效地执行I/O。像MPI-I/O中嵌入的集体I/O这样的优化允许并行执行的多个进程通过合并其他进程的请求并稍后共享它们来执行I/O。在这种场景中,在不显著影响应用程序性能的情况下,保持磁盘驻留数据的机密性,防止进程进行未经授权的访问,是一项具有挑战性的任务。在本文中,我们评估了在MPI-I/O中确保数据保密性对并行应用程序性能的影响,并提供了一个增强的接口,称为MPISec I/O,在最佳情况下,它比MPI-I/O带来的平均开销仅为5.77%,在平均情况下约为7.82%。
{"title":"MPISec I/O: Providing Data Confidentiality in MPI-I/O","authors":"R. Prabhakar, C. Patrick, M. Kandemir","doi":"10.1109/CCGRID.2009.53","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.53","url":null,"abstract":"Applications performing scientific computations or processing streaming media benefit from parallel I/O significantly, as they operate on large data sets that require large I/O. MPI-I/O is a commonly used library interface in parallel applications to perform I/O efficiently. Optimizations like collective-I/O embedded in MPI-I/O allow multiple processes executing in parallel to perform I/O by merging requests of other processes and sharing them later. In such a scenario, preserving confidentiality of disk-resident data from unauthorized accesses by processes without significantly impacting performance of the application is a challenging task. In this paper, we evaluate the impact of ensuring data-confidentiality in MPI-I/O on the performance of parallel applications and provide an enhanced interface, called MPISec I/O, which brings an average overhead of only 5.77% over MPI-I/O in the best case, and about 7.82% in the average case.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"2019 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128040472","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
Risk Informed Computer Economics 基于风险的计算机经济学
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.18
Bin Li, Lee Gillam
Grid computing continues to hold promise for the high-availability of a wide range of computational systems and techniques. It is suggested that Grids will attain greater acceptance by a larger audience of commercial end-users if binding Service Level Agreements (SLAs) are provided. We discuss Grid commoditization, the use of Grid technologies for financial risk analysis, and the potential formulation of the Grid Economy. Our aim is to predict availability and capability for risk analysis in and of Grids. The considerations involved may be more widely applicable to the configuration and management of related architectures including those of P2P systems and Clouds. In this paper, we explore and evaluate some of the factors involved in the automatic construction of SLAs for the Grid Economy.
网格计算继续为各种计算系统和技术的高可用性带来希望。有人建议,如果提供了绑定的服务水平协议(Service Level Agreements, sla),网格将被更多的商业终端用户更广泛地接受。我们将讨论网格商品化,网格技术在金融风险分析中的应用,以及网格经济的潜在形成。我们的目标是预测电网风险分析的可用性和能力。所涉及的考虑可能更广泛地适用于相关体系结构的配置和管理,包括P2P系统和云。在本文中,我们探讨和评估一些因素涉及到自动化建设的sla为网格经济。
{"title":"Risk Informed Computer Economics","authors":"Bin Li, Lee Gillam","doi":"10.1109/CCGRID.2009.18","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.18","url":null,"abstract":"Grid computing continues to hold promise for the high-availability of a wide range of computational systems and techniques. It is suggested that Grids will attain greater acceptance by a larger audience of commercial end-users if binding Service Level Agreements (SLAs) are provided. We discuss Grid commoditization, the use of Grid technologies for financial risk analysis, and the potential formulation of the Grid Economy. Our aim is to predict availability and capability for risk analysis in and of Grids. The considerations involved may be more widely applicable to the configuration and management of related architectures including those of P2P systems and Clouds. In this paper, we explore and evaluate some of the factors involved in the automatic construction of SLAs for the Grid Economy.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127198982","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
期刊
2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1