首页 > 最新文献

2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid最新文献

英文 中文
Flexible and Efficient In-Vivo Enhancement for Grid Applications 网格应用灵活高效的活体增强
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.61
Dong Kwan Kim, Yang Jiao, E. Tilevich
In a grid application, some requirements may change while the execution is in progress. This paper presents in-vivo enhancement--updating running grid applications to facilitate their perfective maintenance. Because applications in this domain are not only typically long-running, but also time-consuming to deploy, we propose a dynamic update technique that can change a running application flexibly and efficiently. Specifically, this paper presents a novel technique for dynamically updating grid applications deployed on the Java Virtual Machine (JVM). Our technique overcomes constraints of JVM HotSwap, a facility for replacing classes at runtime. While HotSwap precludes the programmer from adding new methods and fields, changing the signatures of existing methods, and has no support for transferring state between old and new objects, our approach effectively removes these constraints by rewriting program bytecode. Further, the rewritten programs incur only minimal performance overhead (less than 2% on average). We demonstrate the efficiency and extensibility of our approach through micro and macro benchmarks, as well as through a case study of dynamically updating a parallel bioinformatics application.
在网格应用程序中,一些需求可能在执行过程中发生变化。本文提出了活体增强——更新正在运行的网格应用程序,以促进它们的完美维护。由于该领域中的应用程序不仅通常是长时间运行的,而且部署也很耗时,因此我们提出了一种动态更新技术,可以灵活有效地更改正在运行的应用程序。具体来说,本文提出了一种动态更新部署在Java虚拟机(JVM)上的网格应用程序的新技术。我们的技术克服了JVM HotSwap(一种在运行时替换类的工具)的限制。虽然HotSwap阻止程序员添加新方法和字段,改变现有方法的签名,并且不支持在新旧对象之间传输状态,但我们的方法通过重写程序字节码有效地消除了这些限制。此外,重写的程序只产生最小的性能开销(平均不到2%)。我们通过微观和宏观基准,以及动态更新并行生物信息学应用的案例研究,证明了我们的方法的效率和可扩展性。
{"title":"Flexible and Efficient In-Vivo Enhancement for Grid Applications","authors":"Dong Kwan Kim, Yang Jiao, E. Tilevich","doi":"10.1109/CCGRID.2009.61","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.61","url":null,"abstract":"In a grid application, some requirements may change while the execution is in progress. This paper presents in-vivo enhancement--updating running grid applications to facilitate their perfective maintenance. Because applications in this domain are not only typically long-running, but also time-consuming to deploy, we propose a dynamic update technique that can change a running application flexibly and efficiently. Specifically, this paper presents a novel technique for dynamically updating grid applications deployed on the Java Virtual Machine (JVM). Our technique overcomes constraints of JVM HotSwap, a facility for replacing classes at runtime. While HotSwap precludes the programmer from adding new methods and fields, changing the signatures of existing methods, and has no support for transferring state between old and new objects, our approach effectively removes these constraints by rewriting program bytecode. Further, the rewritten programs incur only minimal performance overhead (less than 2% on average). We demonstrate the efficiency and extensibility of our approach through micro and macro benchmarks, as well as through a case study of dynamically updating a parallel bioinformatics application.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"35 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126071526","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
BloomCast: Efficient Full-Text Retrieval over Unstructured P2Ps with Guaranteed Recall 高效全文检索与保证召回的非结构化p2p
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.50
Hanhua Chen, Hai Jin, Xucheng Luo, Yunhao Liu, L. Ni
Efficient and effective full-text retrieval in unstructured peer-to-peer networks remains a challenge in the research community. First, it is difficult, if not impossible, for unstructured P2P search protocols to effectively locate items with guaranteed recall rate. Second, existing schemes to improve search successful rate often rely on replicating a large number of item replicas across the wide area network, incurring a large amount of communication and storage cost. In this paper we propose BloomCast, an efficient and effective full-text retrieval scheme, in unstructured P2P networks. BloomCast is effective because it guarantees perfect recall rate with high probability. It is efficient because the overall communication cost of full-text search is reduced below a formal bound. Furthermore, by casting Bloom Filters instead of the raw documents across the network, BloomCast significantly reduces the communication cost and storage cost for replication. We demonstrate the power of BloomCast design through both mathematical proof and comprehensive simulations. Results show that BloomCast outperforms existing schemes in terms of both recall rate and communication cost.
在非结构化点对点网络中实现高效的全文检索一直是研究领域面临的挑战。首先,非结构化P2P搜索协议很难(如果不是不可能的话)有效地定位具有保证召回率的项目。其次,现有的提高搜索成功率的方案往往依赖于在广域网中复制大量的条目副本,这会产生大量的通信和存储成本。本文提出了一种在非结构化P2P网络中高效的全文检索方案BloomCast。BloomCast是有效的,因为它保证了高概率的完美召回率。它是高效的,因为全文搜索的总体通信成本降低到一个正式的界限以下。此外,通过在网络上使用Bloom Filters而不是原始文档,BloomCast显著降低了复制的通信成本和存储成本。我们通过数学证明和综合模拟来展示BloomCast设计的强大功能。结果表明,该方法在召回率和通信成本方面都优于现有方案。
{"title":"BloomCast: Efficient Full-Text Retrieval over Unstructured P2Ps with Guaranteed Recall","authors":"Hanhua Chen, Hai Jin, Xucheng Luo, Yunhao Liu, L. Ni","doi":"10.1109/CCGRID.2009.50","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.50","url":null,"abstract":"Efficient and effective full-text retrieval in unstructured peer-to-peer networks remains a challenge in the research community. First, it is difficult, if not impossible, for unstructured P2P search protocols to effectively locate items with guaranteed recall rate. Second, existing schemes to improve search successful rate often rely on replicating a large number of item replicas across the wide area network, incurring a large amount of communication and storage cost. In this paper we propose BloomCast, an efficient and effective full-text retrieval scheme, in unstructured P2P networks. BloomCast is effective because it guarantees perfect recall rate with high probability. It is efficient because the overall communication cost of full-text search is reduced below a formal bound. Furthermore, by casting Bloom Filters instead of the raw documents across the network, BloomCast significantly reduces the communication cost and storage cost for replication. We demonstrate the power of BloomCast design through both mathematical proof and comprehensive simulations. Results show that BloomCast outperforms existing schemes in terms of both recall rate and communication cost.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127214586","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Modeling Job Arrival Process with Long Range Dependence and Burstiness Characteristics 具有长距离依赖性和突发性特征的工作到达过程建模
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.35
T. Minh, L. Wolters
Workload modeling plays a significant role in performance evaluation of large-scale parallel systems such as clusters and grids. It helps to generate synthetic workloads which capture some dominant characteristics of traces (real workloads). Modeling job arrival process is an essential part of workload modeling. Although a job arrival process has many important characteristics such as long range dependence (LRD) and burstiness, most researchers, for simplicity, assume it as a poisson process in their evaluation work. Furthermore, there is currently almost no research focusing on both LRD and burstiness at the same time according to our investigation. With respect to this research trend, the multifractal wavelet model (MWM) recently has been introduced as a good choice to yield LRD for a job arrival process. Though LRD is well controlled, we observe that a job arrival process produced by MWM does not keep burstiness. In this paper, we present our study on modifying MWM so that not only LRD but also burstiness are kept in the job arrival process. In addition, our modification also fits the marginal distribution better than MWM.
负载建模在集群和网格等大规模并行系统的性能评估中起着重要的作用。它有助于生成合成的工作负载,这些工作负载捕获轨迹的一些主要特征(实际工作负载)。作业到达过程建模是工作量建模的重要组成部分。虽然工作到达过程具有长距离依赖性和突发性等重要特征,但为了简单起见,大多数研究者在评价工作中都将其假设为泊松过程。此外,根据我们的调查,目前几乎没有同时关注LRD和爆发的研究。针对这一研究趋势,最近引入了多重分形小波模型(MWM)作为作业到达过程产生LRD的良好选择。虽然LRD得到了很好的控制,但我们观察到MWM产生的作业到达过程并不保持突发性。在本文中,我们研究了如何修改MWM,使其在作业到达过程中既保持LRD,又保持突发性。此外,我们的修正也比MWM更适合边际分布。
{"title":"Modeling Job Arrival Process with Long Range Dependence and Burstiness Characteristics","authors":"T. Minh, L. Wolters","doi":"10.1109/CCGRID.2009.35","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.35","url":null,"abstract":"Workload modeling plays a significant role in performance evaluation of large-scale parallel systems such as clusters and grids. It helps to generate synthetic workloads which capture some dominant characteristics of traces (real workloads). Modeling job arrival process is an essential part of workload modeling. Although a job arrival process has many important characteristics such as long range dependence (LRD) and burstiness, most researchers, for simplicity, assume it as a poisson process in their evaluation work. Furthermore, there is currently almost no research focusing on both LRD and burstiness at the same time according to our investigation. With respect to this research trend, the multifractal wavelet model (MWM) recently has been introduced as a good choice to yield LRD for a job arrival process. Though LRD is well controlled, we observe that a job arrival process produced by MWM does not keep burstiness. In this paper, we present our study on modifying MWM so that not only LRD but also burstiness are kept in the job arrival process. In addition, our modification also fits the marginal distribution better than MWM.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125971624","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 13
The Grid Enablement and Sustainable Simulation of Multiscale Physics Applications 多尺度物理应用的网格实现与可持续模拟
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.33
Yingwen Song, Yoshio Tanaka, H. Takemiya, A. Nakano, S. Ogata, S. Sekiguchi
The understanding of H diffusion in materials is pivotal to designing suitable processes. Though a nudged elastic band (NEB)+molecular dynamics (MD)/quantum mechanics (QM) algorithm has been developed to simulate H diffusion in materials by our group, it is often not computationally feasible for large-scale models on a conventional single system. We thus gridify the NEB+MD/QM algorithm on the top of an integrated framework developed by our group. A two days simulation on H diffusion in alumina has been successfully carried out over a Trans-Pacific Grid infrastructure consisting of supercomputers provided by TeraGrid and AIST. In this paper, we describe the NEB+MD/QM algorithm, briefly introduce the framework middleware, present the grid enablement work, and report the techniques to achieve fault-tolerance and load-balance for sustainable simulation. We believe our experience is of benefit to both middleware developers and application users.
对材料中氢扩散的理解对于设计合适的工艺至关重要。虽然我们已经开发了一种微推弹性带(NEB)+分子动力学(MD)/量子力学(QM)算法来模拟材料中的H扩散,但对于传统单一系统上的大规模模型来说,它通常在计算上是不可行的。因此,我们将NEB+MD/QM算法网格化在我们小组开发的集成框架之上。在由TeraGrid和AIST提供的超级计算机组成的跨太平洋网格基础设施上,成功地进行了为期两天的氧化铝H扩散模拟。在本文中,我们描述了NEB+MD/QM算法,简要介绍了框架中间件,给出了网格实现工作,并报告了实现可持续仿真容错和负载平衡的技术。我们相信我们的经验对中间件开发人员和应用程序用户都有好处。
{"title":"The Grid Enablement and Sustainable Simulation of Multiscale Physics Applications","authors":"Yingwen Song, Yoshio Tanaka, H. Takemiya, A. Nakano, S. Ogata, S. Sekiguchi","doi":"10.1109/CCGRID.2009.33","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.33","url":null,"abstract":"The understanding of H diffusion in materials is pivotal to designing suitable processes. Though a nudged elastic band (NEB)+molecular dynamics (MD)/quantum mechanics (QM) algorithm has been developed to simulate H diffusion in materials by our group, it is often not computationally feasible for large-scale models on a conventional single system. We thus gridify the NEB+MD/QM algorithm on the top of an integrated framework developed by our group. A two days simulation on H diffusion in alumina has been successfully carried out over a Trans-Pacific Grid infrastructure consisting of supercomputers provided by TeraGrid and AIST. In this paper, we describe the NEB+MD/QM algorithm, briefly introduce the framework middleware, present the grid enablement work, and report the techniques to achieve fault-tolerance and load-balance for sustainable simulation. We believe our experience is of benefit to both middleware developers and application users.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122461088","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
WSRF-Based Distributed Visualization 基于wsrf的分布式可视化
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.64
Yi Liu, Shu Gao
This paper presents a framework that extends traditional visualization for supporting distributed visualization in Grid environments. This framework adopts the emerging Web Services Resource Framework (WSRF) to deploy visualization algorithms as Web Service on Grid nodes. These visualization algorithms are developed by Visualization ToolKit (VTK) library. Triana, an open source problem solving environment, is used to fulfill a user’s requests for any deployed visualization algorithm on local or remote Computing node. And Ganglia, a scalable distributed monitoring system for high-performance computing systems such as clusters and Grids, by getting state information of each Grid node, can help a user to select the appropriate Grid nodes as Computing nodes executing distributed visualization tasks. To evaluate the feasibility of the proposed framework, a case study is presented.
本文提出了一个扩展传统可视化的框架,以支持网格环境中的分布式可视化。该框架采用新兴的Web服务资源框架(WSRF)将可视化算法部署为网格节点上的Web服务。这些可视化算法是由visualtoolkit (VTK)库开发的。Triana是一个开源的问题解决环境,用于满足用户对本地或远程计算节点上部署的任何可视化算法的请求。Ganglia是一种针对高性能计算系统(如集群和网格)的可伸缩分布式监控系统,通过获取每个网格节点的状态信息,可以帮助用户选择合适的网格节点作为执行分布式可视化任务的计算节点。为了评估所提出的框架的可行性,给出了一个案例研究。
{"title":"WSRF-Based Distributed Visualization","authors":"Yi Liu, Shu Gao","doi":"10.1109/CCGRID.2009.64","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.64","url":null,"abstract":"This paper presents a framework that extends traditional visualization for supporting distributed visualization in Grid environments. This framework adopts the emerging Web Services Resource Framework (WSRF) to deploy visualization algorithms as Web Service on Grid nodes. These visualization algorithms are developed by Visualization ToolKit (VTK) library. Triana, an open source problem solving environment, is used to fulfill a user’s requests for any deployed visualization algorithm on local or remote Computing node. And Ganglia, a scalable distributed monitoring system for high-performance computing systems such as clusters and Grids, by getting state information of each Grid node, can help a user to select the appropriate Grid nodes as Computing nodes executing distributed visualization tasks. To evaluate the feasibility of the proposed framework, a case study is presented.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"197 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122988306","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Failure-Aware Construction and Reconfiguration of Distributed Virtual Machines for High Availability Computing 面向高可用性计算的分布式虚拟机故障感知构建与重构
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.21
S. Fu
In large-scale clusters and computational grids, component failures become norms instead of exceptions. Failure occurrence as well as its impact on system performance and operation costs have become an increasingly important concern to system designers and administrators. In this paper, we study how to efficiently utilize system resources for high-availability clusters with the support of the virtual machine (VM) technology. We design a reconfigurable distributed virtual machine (RDVM) infrastructure for clusters computing. We propose failure-aware node selection strategies for the construction and reconfiguration of RDVMs. We leverage the proactive failure management techniques in calculating nodes' reliability status. We consider both the performance and reliability status of compute nodes in making selection decisions. We define a capacity-reliability metric to combine the effects of both factors in node selection, and propose Best-fit algorithms to find the best qualified nodes on which to instantiate VMs to run parallel jobs. We have conducted experiments using failure traces from production clusters and the NAS Parallel Benchmark programs on a real cluster. The results show the enhancement of system productivity and dependability by using the proposed strategies. With the Best-fit strategies, the job completion rate is increased by 17.6% compared with that achieved in the current LANL HPC cluster, and the task completion rate reaches 91.7%.
在大规模集群和计算网格中,组件故障成为常态而不是例外。故障的发生及其对系统性能和运行成本的影响已成为系统设计者和管理员日益关注的问题。本文研究了在虚拟机技术的支持下,如何有效地利用高可用性集群的系统资源。我们为集群计算设计了一个可重构的分布式虚拟机(RDVM)基础架构。我们提出了故障感知节点选择策略,用于rdvm的构建和重构。我们利用主动故障管理技术计算节点的可靠性状态。在进行选择决策时,我们同时考虑计算节点的性能和可靠性状况。我们定义了一个容量-可靠性度量来结合节点选择中这两个因素的影响,并提出了最佳拟合算法来找到最符合条件的节点,在这些节点上实例化vm以运行并行作业。我们已经在一个真实的集群上使用来自生产集群的故障跟踪和NAS并行基准程序进行了实验。结果表明,该策略提高了系统的生产率和可靠性。采用Best-fit策略后,任务完成率比现有LANL HPC集群提高了17.6%,任务完成率达到91.7%。
{"title":"Failure-Aware Construction and Reconfiguration of Distributed Virtual Machines for High Availability Computing","authors":"S. Fu","doi":"10.1109/CCGRID.2009.21","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.21","url":null,"abstract":"In large-scale clusters and computational grids, component failures become norms instead of exceptions. Failure occurrence as well as its impact on system performance and operation costs have become an increasingly important concern to system designers and administrators. In this paper, we study how to efficiently utilize system resources for high-availability clusters with the support of the virtual machine (VM) technology. We design a reconfigurable distributed virtual machine (RDVM) infrastructure for clusters computing. We propose failure-aware node selection strategies for the construction and reconfiguration of RDVMs. We leverage the proactive failure management techniques in calculating nodes' reliability status. We consider both the performance and reliability status of compute nodes in making selection decisions. We define a capacity-reliability metric to combine the effects of both factors in node selection, and propose Best-fit algorithms to find the best qualified nodes on which to instantiate VMs to run parallel jobs. We have conducted experiments using failure traces from production clusters and the NAS Parallel Benchmark programs on a real cluster. The results show the enhancement of system productivity and dependability by using the proposed strategies. With the Best-fit strategies, the job completion rate is increased by 17.6% compared with that achieved in the current LANL HPC cluster, and the task completion rate reaches 91.7%.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126843565","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 36
A Model-Based Algorithm for Optimizing I/O Intensive Applications in Clouds Using VM-Based Migration 一种基于模型的基于虚拟机迁移的I/O密集型云应用优化算法
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.24
Kento Sato, Hitoshi Sato, S. Matsuoka
Federated storage resources in geographically distributed environments are becoming viable platforms for data-intensive cloud and grid applications. To improveI /O performance in such environments, we propose a novel model-based I/O performance optimization algorithm for data-intensive applications running on a virtual cluster, which determines virtual machine (VM) migration strategies,i.e., when and where a VM should be migrated, while minimizing the expected value of file access time. We solve this problem as a shortest path problem of a weighted direct acyclic graph (DAG), where the weighted vertex represents a location of a VM and expected file access time from the location, and the weighted edge represents a migration of a VM and time. We construct the DAG from our markov model which represents the dependency of files. Our simulation-based studies suggest that our proposed algorithm can achieve higher performance than simple techniques, such as ones that never migrate VMs: 38% or always migrate VMs onto the locations that hold target files: 47%.
地理分布环境中的联邦存储资源正在成为数据密集型云和网格应用程序的可行平台。为了提高这种环境下的I/O性能,我们提出了一种新的基于模型的I/O性能优化算法,用于运行在虚拟集群上的数据密集型应用程序,该算法决定了虚拟机(VM)迁移策略,即:即迁移虚拟机的时间和地点,同时最小化文件访问时间的期望值。我们将此问题作为加权直接无环图(DAG)的最短路径问题来解决,其中加权顶点表示VM的位置和从该位置的期望文件访问时间,加权边表示VM的迁移和时间。我们从表示文件依赖关系的马尔可夫模型中构造DAG。我们基于模拟的研究表明,我们提出的算法可以实现比简单技术更高的性能,例如从不迁移vm: 38%或始终将vm迁移到保存目标文件的位置:47%。
{"title":"A Model-Based Algorithm for Optimizing I/O Intensive Applications in Clouds Using VM-Based Migration","authors":"Kento Sato, Hitoshi Sato, S. Matsuoka","doi":"10.1109/CCGRID.2009.24","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.24","url":null,"abstract":"Federated storage resources in geographically distributed environments are becoming viable platforms for data-intensive cloud and grid applications. To improveI /O performance in such environments, we propose a novel model-based I/O performance optimization algorithm for data-intensive applications running on a virtual cluster, which determines virtual machine (VM) migration strategies,i.e., when and where a VM should be migrated, while minimizing the expected value of file access time. We solve this problem as a shortest path problem of a weighted direct acyclic graph (DAG), where the weighted vertex represents a location of a VM and expected file access time from the location, and the weighted edge represents a migration of a VM and time. We construct the DAG from our markov model which represents the dependency of files. Our simulation-based studies suggest that our proposed algorithm can achieve higher performance than simple techniques, such as ones that never migrate VMs: 38% or always migrate VMs onto the locations that hold target files: 47%.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"575 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127086019","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 45
Energy-Efficient Cluster Computing via Accurate Workload Characterization 基于精确工作负载特征的高效集群计算
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.88
S. Huang, W. Feng
This paper presents an eco-friendly daemon that reduces power and energy consumption while better maintaining high performance via an accurate workload characterization that infers “processor stall cycles due to off-chip activities.” The eco-friendly daemon is an interval-based, run-time algorithm that uses the workload characterization to dynamically adjust a processor’s frequency and voltage to reduce power and energy consumption with little impact on application performance. Using the NAS Parallel Benchmarks as our workload, we then evaluate our eco-friendly daemon on a cluster computer. The results indicate that our workload characterization allows the power-aware daemon to more tightly control performance (5% loss instead of 11%) while delivering substantial energy savings (11% instead of 8%).
本文介绍了一个生态友好的守护进程,它通过准确的工作负载特征来推断“由于芯片外活动导致的处理器停滞周期”,从而降低了功耗和能耗,同时更好地保持了高性能。生态友好型守护进程是一种基于间隔的运行时算法,它使用工作负载特征来动态调整处理器的频率和电压,从而在对应用程序性能影响很小的情况下降低功耗和能耗。使用NAS并行基准测试作为我们的工作负载,然后我们在集群计算机上评估我们的环保守护进程。结果表明,我们的工作负载特性允许功率感知守护进程更严格地控制性能(损失5%而不是11%),同时提供大量的能源节省(11%而不是8%)。
{"title":"Energy-Efficient Cluster Computing via Accurate Workload Characterization","authors":"S. Huang, W. Feng","doi":"10.1109/CCGRID.2009.88","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.88","url":null,"abstract":"This paper presents an eco-friendly daemon that reduces power and energy consumption while better maintaining high performance via an accurate workload characterization that infers “processor stall cycles due to off-chip activities.” The eco-friendly daemon is an interval-based, run-time algorithm that uses the workload characterization to dynamically adjust a processor’s frequency and voltage to reduce power and energy consumption with little impact on application performance. Using the NAS Parallel Benchmarks as our workload, we then evaluate our eco-friendly daemon on a cluster computer. The results indicate that our workload characterization allows the power-aware daemon to more tightly control performance (5% loss instead of 11%) while delivering substantial energy savings (11% instead of 8%).","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"60 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126217943","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 110
MPISec I/O: Providing Data Confidentiality in MPI-I/O MPISec I/O:在MPI-I/O中提供数据机密性
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.53
R. Prabhakar, C. Patrick, M. Kandemir
Applications performing scientific computations or processing streaming media benefit from parallel I/O significantly, as they operate on large data sets that require large I/O. MPI-I/O is a commonly used library interface in parallel applications to perform I/O efficiently. Optimizations like collective-I/O embedded in MPI-I/O allow multiple processes executing in parallel to perform I/O by merging requests of other processes and sharing them later. In such a scenario, preserving confidentiality of disk-resident data from unauthorized accesses by processes without significantly impacting performance of the application is a challenging task. In this paper, we evaluate the impact of ensuring data-confidentiality in MPI-I/O on the performance of parallel applications and provide an enhanced interface, called MPISec I/O, which brings an average overhead of only 5.77% over MPI-I/O in the best case, and about 7.82% in the average case.
执行科学计算或处理流媒体的应用程序明显受益于并行I/O,因为它们操作的是需要大量I/O的大型数据集。MPI-I/O是并行应用程序中常用的库接口,用于高效地执行I/O。像MPI-I/O中嵌入的集体I/O这样的优化允许并行执行的多个进程通过合并其他进程的请求并稍后共享它们来执行I/O。在这种场景中,在不显著影响应用程序性能的情况下,保持磁盘驻留数据的机密性,防止进程进行未经授权的访问,是一项具有挑战性的任务。在本文中,我们评估了在MPI-I/O中确保数据保密性对并行应用程序性能的影响,并提供了一个增强的接口,称为MPISec I/O,在最佳情况下,它比MPI-I/O带来的平均开销仅为5.77%,在平均情况下约为7.82%。
{"title":"MPISec I/O: Providing Data Confidentiality in MPI-I/O","authors":"R. Prabhakar, C. Patrick, M. Kandemir","doi":"10.1109/CCGRID.2009.53","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.53","url":null,"abstract":"Applications performing scientific computations or processing streaming media benefit from parallel I/O significantly, as they operate on large data sets that require large I/O. MPI-I/O is a commonly used library interface in parallel applications to perform I/O efficiently. Optimizations like collective-I/O embedded in MPI-I/O allow multiple processes executing in parallel to perform I/O by merging requests of other processes and sharing them later. In such a scenario, preserving confidentiality of disk-resident data from unauthorized accesses by processes without significantly impacting performance of the application is a challenging task. In this paper, we evaluate the impact of ensuring data-confidentiality in MPI-I/O on the performance of parallel applications and provide an enhanced interface, called MPISec I/O, which brings an average overhead of only 5.77% over MPI-I/O in the best case, and about 7.82% in the average case.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"2019 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128040472","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
Risk Informed Computer Economics 基于风险的计算机经济学
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.18
Bin Li, Lee Gillam
Grid computing continues to hold promise for the high-availability of a wide range of computational systems and techniques. It is suggested that Grids will attain greater acceptance by a larger audience of commercial end-users if binding Service Level Agreements (SLAs) are provided. We discuss Grid commoditization, the use of Grid technologies for financial risk analysis, and the potential formulation of the Grid Economy. Our aim is to predict availability and capability for risk analysis in and of Grids. The considerations involved may be more widely applicable to the configuration and management of related architectures including those of P2P systems and Clouds. In this paper, we explore and evaluate some of the factors involved in the automatic construction of SLAs for the Grid Economy.
网格计算继续为各种计算系统和技术的高可用性带来希望。有人建议,如果提供了绑定的服务水平协议(Service Level Agreements, sla),网格将被更多的商业终端用户更广泛地接受。我们将讨论网格商品化,网格技术在金融风险分析中的应用,以及网格经济的潜在形成。我们的目标是预测电网风险分析的可用性和能力。所涉及的考虑可能更广泛地适用于相关体系结构的配置和管理,包括P2P系统和云。在本文中,我们探讨和评估一些因素涉及到自动化建设的sla为网格经济。
{"title":"Risk Informed Computer Economics","authors":"Bin Li, Lee Gillam","doi":"10.1109/CCGRID.2009.18","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.18","url":null,"abstract":"Grid computing continues to hold promise for the high-availability of a wide range of computational systems and techniques. It is suggested that Grids will attain greater acceptance by a larger audience of commercial end-users if binding Service Level Agreements (SLAs) are provided. We discuss Grid commoditization, the use of Grid technologies for financial risk analysis, and the potential formulation of the Grid Economy. Our aim is to predict availability and capability for risk analysis in and of Grids. The considerations involved may be more widely applicable to the configuration and management of related architectures including those of P2P systems and Clouds. In this paper, we explore and evaluate some of the factors involved in the automatic construction of SLAs for the Grid Economy.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127198982","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
期刊
2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1