首页 > 最新文献

2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid最新文献

英文 中文
C-Meter: A Framework for Performance Analysis of Computing Clouds C-Meter:计算云的性能分析框架
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.40
N. Yigitbasi, A. Iosup, D. Epema, S. Ostermann
Cloud computing has emerged as a new technology that provides large amounts of computing and data storage capacity to its users with a promise of increased scalability, high availability, and reduced administration and maintenance costs. As the use of cloud computing environments increases, it becomes crucial to understand the performance of these environments. So, it is of great importance to assess the performance of computing clouds in terms of various metrics, such as the overhead of acquiring and releasing the virtual computing resources, and other virtualization and network communications overheads. To address these issues, we have designed and implemented C-Meter, which is a portable, extensible, and easy-to-use framework for generating and submitting test workloads to computing clouds. In this paper, first we state the requirements for frameworks to assess the performance of computing clouds. Then, we present the architecture of the C-Meter framework and discuss several cloud resource management alternatives. Finally, we present ourearly experiences with C-Meter in Amazon EC2. We show how C-Meter can be used for assessing the overhead of acquiring and releasing the virtual computing resources, for comparing different configurations, and for evaluating different scheduling algorithms.
云计算已经成为一种新技术,它向用户提供大量的计算和数据存储能力,并承诺提高可伸缩性、高可用性和降低管理和维护成本。随着云计算环境使用的增加,理解这些环境的性能变得至关重要。因此,根据各种指标评估计算云的性能非常重要,例如获取和释放虚拟计算资源的开销,以及其他虚拟化和网络通信开销。为了解决这些问题,我们设计并实现了C-Meter,它是一个可移植的、可扩展的、易于使用的框架,用于生成和提交测试工作负载到计算云。在本文中,我们首先陈述了评估计算云性能的框架需求。然后,我们介绍了C-Meter框架的架构,并讨论了几种云资源管理方案。最后,我们将介绍我们在Amazon EC2中使用C-Meter的早期经验。我们将展示如何使用C-Meter来评估获取和释放虚拟计算资源的开销、比较不同的配置以及评估不同的调度算法。
{"title":"C-Meter: A Framework for Performance Analysis of Computing Clouds","authors":"N. Yigitbasi, A. Iosup, D. Epema, S. Ostermann","doi":"10.1109/CCGRID.2009.40","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.40","url":null,"abstract":"Cloud computing has emerged as a new technology that provides large amounts of computing and data storage capacity to its users with a promise of increased scalability, high availability, and reduced administration and maintenance costs. As the use of cloud computing environments increases, it becomes crucial to understand the performance of these environments. So, it is of great importance to assess the performance of computing clouds in terms of various metrics, such as the overhead of acquiring and releasing the virtual computing resources, and other virtualization and network communications overheads. To address these issues, we have designed and implemented C-Meter, which is a portable, extensible, and easy-to-use framework for generating and submitting test workloads to computing clouds. In this paper, first we state the requirements for frameworks to assess the performance of computing clouds. Then, we present the architecture of the C-Meter framework and discuss several cloud resource management alternatives. Finally, we present ourearly experiences with C-Meter in Amazon EC2. We show how C-Meter can be used for assessing the overhead of acquiring and releasing the virtual computing resources, for comparing different configurations, and for evaluating different scheduling algorithms.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"141 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124472809","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 169
Measuring Fragmentation of Two-Dimensional Resources Applied to Advance Reservation Grid Scheduling 二维资源碎片度量在提前预约网格调度中的应用
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.81
J. Gehr, Jörg Schneider
Whenever a resource allocation fails although enough free capacity being available, fragmentation is easily spotted as cause. But how the fragmentation in a system requiring continuous allocations like time schedules or memory can be quantified is hardly analyzed. A Grid environment using advance reservation even combines two-dimensions: time and resource dimension.  In this paper a new way to measure the fragmentation of a system in one dimension is proposed. This measure is then extended to incorporate also the second dimension. Extensive simulations showed that the proposed fragmentation measure is a good indicator of the state of the system.
每当资源分配失败时,尽管有足够的可用容量,碎片很容易被发现是原因。但是,在需要连续分配(如时间计划或内存)的系统中,如何量化碎片却很少被分析。使用提前预约的网格环境甚至结合了两个维度:时间维度和资源维度。本文提出了一种在一维尺度上测量系统碎片性的新方法。然后将该度量扩展到包含第二个维度。大量的仿真表明,提出的碎片度量是系统状态的一个很好的指标。
{"title":"Measuring Fragmentation of Two-Dimensional Resources Applied to Advance Reservation Grid Scheduling","authors":"J. Gehr, Jörg Schneider","doi":"10.1109/CCGRID.2009.81","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.81","url":null,"abstract":"Whenever a resource allocation fails although enough free capacity being available, fragmentation is easily spotted as cause. But how the fragmentation in a system requiring continuous allocations like time schedules or memory can be quantified is hardly analyzed. A Grid environment using advance reservation even combines two-dimensions: time and resource dimension.  In this paper a new way to measure the fragmentation of a system in one dimension is proposed. This measure is then extended to incorporate also the second dimension. Extensive simulations showed that the proposed fragmentation measure is a good indicator of the state of the system.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"70 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123440541","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 26
Cesar-FD: An Effective Stateful Fault Detection Mechanism in Drug Discovery Grid Cesar-FD:一种有效的药物发现网格状态故障检测机制
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.28
Yongjian Wang, Yinan Ren, Ting-Wen Chen, Yuanqiang Huang, Zhongzhi Luan, Zhongxin Wu, D. Qian
Workflow management system is widely accepted and used in the wide area network environment, especially in the e-Science application scenarios, to coordinate the operation of different functional components and to provide more powerful functions. The error-prone nature of the wide area network environment makes the fault-tolerance requirements of workflow management become more and more urgent. In this paper, we propose Cesar-FD, a stateful fault detection mechanism, which builds up states related to the runtime and external environments of workflow management system by aggregating multiple messages and provides more accurate notifications asynchronously. We demonstrate the use of this mechanism in the Drug Discovery Grid environment by two use cases. We also show that it can be used to detect faulty situations more accurately.
工作流管理系统在广域网环境中,特别是在e-Science应用场景中,被广泛接受和使用,以协调不同功能组件的运行,提供更强大的功能。广域网环境易出错的特性使得工作流管理的容错要求越来越迫切。本文提出了一种有状态故障检测机制Cesar-FD,该机制通过聚合多个消息来构建与工作流管理系统运行时和外部环境相关的状态,并提供更准确的异步通知。我们通过两个用例演示了该机制在药物发现网格环境中的使用。我们还表明,它可以用于更准确地检测故障情况。
{"title":"Cesar-FD: An Effective Stateful Fault Detection Mechanism in Drug Discovery Grid","authors":"Yongjian Wang, Yinan Ren, Ting-Wen Chen, Yuanqiang Huang, Zhongzhi Luan, Zhongxin Wu, D. Qian","doi":"10.1109/CCGRID.2009.28","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.28","url":null,"abstract":"Workflow management system is widely accepted and used in the wide area network environment, especially in the e-Science application scenarios, to coordinate the operation of different functional components and to provide more powerful functions. The error-prone nature of the wide area network environment makes the fault-tolerance requirements of workflow management become more and more urgent. In this paper, we propose Cesar-FD, a stateful fault detection mechanism, which builds up states related to the runtime and external environments of workflow management system by aggregating multiple messages and provides more accurate notifications asynchronously. We demonstrate the use of this mechanism in the Drug Discovery Grid environment by two use cases. We also show that it can be used to detect faulty situations more accurately.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121682333","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
File Clustering Based Replication Algorithm in a Grid Environment 网格环境下基于文件聚类的复制算法
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.73
Hitoshi Sato, S. Matsuoka, Toshio Endo
Replication in grid file systems can significantly improve I/O performance of data-intensive applications. However, most of existing replication techniques apply to individual files, which may introduce inefficient replication overheads for a large number of files. We propose a file clustering based replication algorithm for grid file systems. Our algorithm groups files according to a relationship of simultaneous accesses between files and stores replicas of the clustered files into storage nodes, to satisfy expected most of future read access times to the clustered files and replication times for individual files being minimized under the given storage capacity limitation. Our experiments on a given grid environment, 20 nodes of 5 sites, suggest that the proposed algorithm achieves accurate file clustering and efficient replica management; our clustering policy with the file cluster size limit of 5120 MB and the storage capacity limit for replicas of 10240 MB exhibits 1.58 times efficiency than the policy that never groups related files. The results also indicate that the overheads required for introducing our algorithm significantly affect I/O performance of running applications.
网格文件系统中的复制可以显著提高数据密集型应用程序的I/O性能。但是,大多数现有的复制技术都适用于单个文件,这可能会为大量文件带来低效的复制开销。提出了一种基于文件集群的网格文件系统复制算法。我们的算法根据文件之间的同时访问关系对文件进行分组,并将集群文件的副本存储到存储节点中,以满足在给定存储容量限制下期望的对集群文件的大部分未来读访问次数和单个文件的复制次数最小化。在给定网格环境下,5个站点20个节点的实验表明,该算法实现了准确的文件聚类和高效的副本管理;文件集群大小限制为5120 MB,副本存储容量限制为10240 MB的集群策略的效率是不分组相关文件的策略的1.58倍。结果还表明,引入我们的算法所需的开销会显著影响正在运行的应用程序的I/O性能。
{"title":"File Clustering Based Replication Algorithm in a Grid Environment","authors":"Hitoshi Sato, S. Matsuoka, Toshio Endo","doi":"10.1109/CCGRID.2009.73","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.73","url":null,"abstract":"Replication in grid file systems can significantly improve I/O performance of data-intensive applications. However, most of existing replication techniques apply to individual files, which may introduce inefficient replication overheads for a large number of files. We propose a file clustering based replication algorithm for grid file systems. Our algorithm groups files according to a relationship of simultaneous accesses between files and stores replicas of the clustered files into storage nodes, to satisfy expected most of future read access times to the clustered files and replication times for individual files being minimized under the given storage capacity limitation. Our experiments on a given grid environment, 20 nodes of 5 sites, suggest that the proposed algorithm achieves accurate file clustering and efficient replica management; our clustering policy with the file cluster size limit of 5120 MB and the storage capacity limit for replicas of 10240 MB exhibits 1.58 times efficiency than the policy that never groups related files. The results also indicate that the overheads required for introducing our algorithm significantly affect I/O performance of running applications.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"53 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126730950","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 27
Harvesting Large-Scale Grids for Software Resources 获取软件资源的大规模网格
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.51
Asterios Katsifodimos, G. Pallis, M. Dikaiakos
Grid infrastructures are in operation around the world, federating an impressive collection of computational resources and a wide variety of application software. In this context, it is important to establish advanced software discovery services that could help end-users locate software components suitable to their needs. In this paper, we present the design, architecture and implementation of an open-source keyword-based paradigm for the search of software resources in Grid infrastructures, called Minersoft. A key goal of Minersoft is to annotate automatically all the software resources with keyword-rich metadata. Using advanced Information Retrieval techniques, we locate software resources with respect to users queries. Experiments were conducted in EGEE, one of the largest Grid production services currently in operation. Results showed that Minersoft successfully crawled 12.3 million valid files (620 GB size) and sustained, in most sites, high crawling rates.
网格基础设施在世界各地运行,联合了大量的计算资源和各种各样的应用软件。在这种情况下,建立高级软件发现服务是很重要的,它可以帮助最终用户定位适合他们需要的软件组件。在本文中,我们提出了一个开源的基于关键字的范例的设计、架构和实现,用于在网格基础设施中搜索软件资源,称为Minersoft。Minersoft的一个关键目标是用关键字丰富的元数据自动注释所有的软件资源。利用先进的信息检索技术,我们根据用户查询定位软件资源。实验是在EGEE中进行的,EGEE是目前运行的最大的网格生产服务之一。结果显示,Minersoft成功抓取了1230万个有效文件(620 GB大小),并在大多数网站上保持了很高的抓取率。
{"title":"Harvesting Large-Scale Grids for Software Resources","authors":"Asterios Katsifodimos, G. Pallis, M. Dikaiakos","doi":"10.1109/CCGRID.2009.51","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.51","url":null,"abstract":"Grid infrastructures are in operation around the world, federating an impressive collection of computational resources and a wide variety of application software. In this context, it is important to establish advanced software discovery services that could help end-users locate software components suitable to their needs. In this paper, we present the design, architecture and implementation of an open-source keyword-based paradigm for the search of software resources in Grid infrastructures, called Minersoft. A key goal of Minersoft is to annotate automatically all the software resources with keyword-rich metadata. Using advanced Information Retrieval techniques, we locate software resources with respect to users queries. Experiments were conducted in EGEE, one of the largest Grid production services currently in operation. Results showed that Minersoft successfully crawled 12.3 million valid files (620 GB size) and sustained, in most sites, high crawling rates.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"59 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130534934","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
Transient Analysis of an Overlay Multicast Protocol 一种覆盖组播协议的瞬态分析
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.27
Xiaobing Hou, S. Wu
This paper presents the transient performancestudy on the adaptability of an application layer multicastprotocol, namely Adaptive Overlay Multicast (AOM). The studyfocuses on how the application layer multicast tree structure adapts to network dynamics and faults by using efficient tree management and adaptation algorithms, thus reducing the adverse effects of network faults on the application performance. We present extensive simulation studies as well as studies using real Internet data The results show that AOM is highly adaptive to network dynamics while incurring low overhead.
本文研究了应用层多播协议自适应覆盖组播(AOM)的瞬态自适应性能。研究了应用层组播树结构如何通过有效的树管理和自适应算法来适应网络动态和故障,从而减少网络故障对应用性能的不利影响。我们进行了大量的仿真研究和使用真实互联网数据的研究,结果表明,AOM对网络动态具有高度的适应性,同时产生低开销。
{"title":"Transient Analysis of an Overlay Multicast Protocol","authors":"Xiaobing Hou, S. Wu","doi":"10.1109/CCGRID.2009.27","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.27","url":null,"abstract":"This paper presents the transient performancestudy on the adaptability of an application layer multicastprotocol, namely Adaptive Overlay Multicast (AOM). The studyfocuses on how the application layer multicast tree structure adapts to network dynamics and faults by using efficient tree management and adaptation algorithms, thus reducing the adverse effects of network faults on the application performance. We present extensive simulation studies as well as studies using real Internet data The results show that AOM is highly adaptive to network dynamics while incurring low overhead.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"38 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115864684","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Supporting Distributed Visualization Services for High Performance Science and Engineering Applications A Service Provider Perspective 支持高性能科学和工程应用的分布式可视化服务——服务提供商视角
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.94
L. Sastry, R. Fowler, S. Nagella, J. Churchill
The Science & Technology Facilities Council is home to international Facilities such as the ISIS Neutron Spallation Source ≪http://www.isis.rl.ac.uk≫, Central Laser Facility ≪http://www.clf.rl.ac.uk/≫ and Diamond Light Source ≪http://www.diamond.ac.uk/default.htm≫, the National Grid Service ≪http://www.grid-support.ac.uk/≫  including national super computers ≪http://www.cse.scitech.ac.uk≫, Tier1 data service for CERN particle physics experiment,  the British Atmospheric data Centre and the British Oceanographic Data Centre at the Space Science and Technology department.  Together these Facilities generate several Terabytes of data per month which needs to be handled, catalogued and provided access to. In addition, the scientists within STFC departments also develop complex simulations and undertake data analysis for their own experiments. Facilities also have strong ongoing collaborations with UK academic and commercial users through their involvement with Collaborative Computational Programme, generating very large simulation datasets. There is thus the need to support high resolution data analysis using distributed compute, data and visualization resources. At the same time, these requirements offer the computational and visualization scientists within STFC unique opportunities to advocate the take up of advanced visualization techniques and toolkits in distributed high performance, high resolution hardware environment. It gives an opportunity to understand the requirements and usefulness of distributed visualization. Given this seemingly advantageous position, the STFC vizNET ≪http://www.viznet.ac.uk/≫ partners have been actively pursuing visualization awareness activities and services aimed at application holders of various scientific disciplines. These activities include holding workshops, hands-on tutorials, show case demonstrations and the setting up of hardware based visualization services with technical support. This report provides details of these activities, the outcomes, the status and some suggestions as to the way forward.
科学技术设施委员会是国际设施的所在地,如ISIS中子散裂源《http://www.isis.rl.ac.uk》、中央激光设备《http://www.clf.rl.ac.uk/》和钻石光源《http://www.diamond.ac.uk/default.htm》,国家电网服务《http://www.grid-support.ac.uk/》包括国家超级计算机《http://www.cse.scitech.ac.uk》,为欧洲核子研究中心粒子物理实验、英国大气数据中心和英国海洋数据中心提供Tier1数据服务。这些设施每月产生数tb的数据,需要处理、编目和提供查阅。此外,STFC各部门的科学家也为自己的实验开发复杂的模拟并进行数据分析。通过参与协作计算程序,设施还与英国学术和商业用户进行了强有力的持续合作,生成了非常大的模拟数据集。因此,需要使用分布式计算、数据和可视化资源来支持高分辨率数据分析。同时,这些需求为STFC内的计算和可视化科学家提供了独特的机会,以倡导在分布式高性能、高分辨率硬件环境中采用先进的可视化技术和工具包。它提供了一个理解分布式可视化的需求和有用性的机会。鉴于这一看似有利的地位,STFC vizNET的合作伙伴《http://www.viznet.ac.uk/》一直在积极开展可视化宣传活动,并为不同科学学科的应用持有人提供服务。这些活动包括举办研讨会、实践教程、展示案例演示以及在技术支持下建立基于硬件的可视化服务。本报告详细介绍了这些活动、成果、现状和对未来的一些建议。
{"title":"Supporting Distributed Visualization Services for High Performance Science and Engineering Applications A Service Provider Perspective","authors":"L. Sastry, R. Fowler, S. Nagella, J. Churchill","doi":"10.1109/CCGRID.2009.94","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.94","url":null,"abstract":"The Science & Technology Facilities Council is home to international Facilities such as the ISIS Neutron Spallation Source ≪http://www.isis.rl.ac.uk≫, Central Laser Facility ≪http://www.clf.rl.ac.uk/≫ and Diamond Light Source ≪http://www.diamond.ac.uk/default.htm≫, the National Grid Service ≪http://www.grid-support.ac.uk/≫  including national super computers ≪http://www.cse.scitech.ac.uk≫, Tier1 data service for CERN particle physics experiment,  the British Atmospheric data Centre and the British Oceanographic Data Centre at the Space Science and Technology department.  Together these Facilities generate several Terabytes of data per month which needs to be handled, catalogued and provided access to. In addition, the scientists within STFC departments also develop complex simulations and undertake data analysis for their own experiments. Facilities also have strong ongoing collaborations with UK academic and commercial users through their involvement with Collaborative Computational Programme, generating very large simulation datasets. There is thus the need to support high resolution data analysis using distributed compute, data and visualization resources. At the same time, these requirements offer the computational and visualization scientists within STFC unique opportunities to advocate the take up of advanced visualization techniques and toolkits in distributed high performance, high resolution hardware environment. It gives an opportunity to understand the requirements and usefulness of distributed visualization. Given this seemingly advantageous position, the STFC vizNET ≪http://www.viznet.ac.uk/≫ partners have been actively pursuing visualization awareness activities and services aimed at application holders of various scientific disciplines. These activities include holding workshops, hands-on tutorials, show case demonstrations and the setting up of hardware based visualization services with technical support. This report provides details of these activities, the outcomes, the status and some suggestions as to the way forward.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124973855","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Framework for Decentralizing Legacy Applications 用于分散遗留应用程序的框架
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.75
J. Hautakorpi, G. Camarillo, David López
Today many Peer-to-peer (P2P) applications are widely used on the Internet. Especially file sharing is a popular P2P application that has, at least partially, replaced the centralized file sharing infrastructure. However, there are still a number of legacy applications that utilize a centralized infrastructure as opposed to a decentralized approach. In this paper we present a generic framework for decentralizing legacy applications. Even though we focus especially on Voice over IP (VoIP), email, and web applications, we believe that our framework could also be utilized with other legacy applications. A notable feature of our framework is that it does not require any changes to legacy applications.
今天,许多点对点(P2P)应用程序在互联网上被广泛使用。特别是文件共享是一种流行的P2P应用程序,它至少部分地取代了集中式文件共享基础设施。然而,仍然有许多遗留应用程序利用集中式基础设施,而不是分散的方法。在本文中,我们提出了一个用于分散遗留应用程序的通用框架。尽管我们特别关注IP语音(VoIP)、电子邮件和web应用程序,但我们相信我们的框架也可以用于其他遗留应用程序。我们框架的一个显著特性是,它不需要对遗留应用程序进行任何更改。
{"title":"Framework for Decentralizing Legacy Applications","authors":"J. Hautakorpi, G. Camarillo, David López","doi":"10.1109/CCGRID.2009.75","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.75","url":null,"abstract":"Today many Peer-to-peer (P2P) applications are widely used on the Internet. Especially file sharing is a popular P2P application that has, at least partially, replaced the centralized file sharing infrastructure. However, there are still a number of legacy applications that utilize a centralized infrastructure as opposed to a decentralized approach. In this paper we present a generic framework for decentralizing legacy applications. Even though we focus especially on Voice over IP (VoIP), email, and web applications, we believe that our framework could also be utilized with other legacy applications. A notable feature of our framework is that it does not require any changes to legacy applications.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"108 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122756914","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Range Query Using Learning-Aware RPS in DHT-Based Peer-to-Peer Networks 基于dht的对等网络中使用学习感知RPS的范围查询
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.25
Ze Deng, D. Feng, Ke Zhou, Zhan Shi, Chao Luo
Range query in Peer-to-Peer networks based on Distributed Hash Table (DHT) is still an open problem. The traditional way uses order-preserving hashing functions to create value indexes that are placed and stored on the corresponding peers to support range query. The way, however, suffers from high index maintenance costs. To avoid the issue, a scalable blind search method over DHTs - recursive partition search (RPS) can be used. But, RPS still easily incurs high network overhead as network size grows. Thus, in this paper, a learning-aware RPS (LARPS) is proposed to overcome the disadvantages of two approaches above mentioned. Extensive experiments show LARPS is a scalable and robust approach for range query, especially in the following cases: a) query range is wide, b) the requested resources follow Zipf distribution, and c) the number of required resources is small.
基于分布式哈希表(DHT)的点对点网络中的范围查询仍然是一个有待解决的问题。传统的方法是使用保持顺序的散列函数来创建值索引,这些值索引放置并存储在相应的对等节点上,以支持范围查询。然而,这种方法的缺点是索引维护成本高。为了避免这个问题,可以使用一种可扩展的dht盲搜索方法——递归分区搜索(RPS)。但是,随着网络规模的增长,RPS仍然容易导致高网络开销。因此,本文提出了一种学习感知RPS (LARPS)来克服上述两种方法的缺点。大量实验表明,LARPS是一种可扩展且鲁棒的范围查询方法,特别是在以下情况下:查询范围大,请求资源遵循Zipf分布,所需资源数量少。
{"title":"Range Query Using Learning-Aware RPS in DHT-Based Peer-to-Peer Networks","authors":"Ze Deng, D. Feng, Ke Zhou, Zhan Shi, Chao Luo","doi":"10.1109/CCGRID.2009.25","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.25","url":null,"abstract":"Range query in Peer-to-Peer networks based on Distributed Hash Table (DHT) is still an open problem. The traditional way uses order-preserving hashing functions to create value indexes that are placed and stored on the corresponding peers to support range query. The way, however, suffers from high index maintenance costs. To avoid the issue, a scalable blind search method over DHTs - recursive partition search (RPS) can be used. But, RPS still easily incurs high network overhead as network size grows. Thus, in this paper, a learning-aware RPS (LARPS) is proposed to overcome the disadvantages of two approaches above mentioned. Extensive experiments show LARPS is a scalable and robust approach for range query, especially in the following cases: a) query range is wide, b) the requested resources follow Zipf distribution, and c) the number of required resources is small.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125156573","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Evaluating the Divisible Load Assumption in the Context of Economic Grid Scheduling with Deadline-Based QoS guarantees 基于最后期限的QoS保证下经济网格调度中可分负荷假设的评估
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.36
Wim Depoorter, R. Y. V. Bossche, K. Vanmechelen, J. Broeckhove
The ef¿cient scheduling of jobs is an essential part of any grid resource management system. At its core, it involves ¿nding a solution to a problem which is NP-complete by reduction to the knapsack problem. Consequently, this problem is often tackled by using heuristics to derive a more pragmatic solution. Other than the use of heuristics, simpli¿cations and abstractions of the workload model may also be employed to increase the tractability of the scheduling problem. A possible abstraction in this context is the use of Divisible Load Theory (DLT), in which it is assumed that an application consists of an arbitrarily divisible load (ADL). Many applications however, are composed of a number of atomic tasks and are only modularly divisible. In this paper we evaluate the consequences of the ADL assumption on the performance of economic scheduling approaches for grids, in the context of CPU-bound modularly divisible applications with hard deadlines. Our goal is to evaluate to what extent DLT can still serve as a useful workload abstraction for obtaining tractable scheduling algorithms in this setting. The focus of our evaluation is on the recently proposed tsfGrid heuristic for economic scheduling of grid workloads which operates under the assumptions of ADL. We demonstrate the effect of the ADL assumption on the actual instantiation of schedules and on the user value realized by the RMS. In addition we describe how the usage of a DLT heuristic in a high-level admission controller for a mechanism which does take into account the atomicity of individual tasks, can signi¿cantly reduce communication and computational overhead.
高效的作业调度是任何网格资源管理系统的重要组成部分。在其核心,它涉及到一个问题的解决方案,这个问题是np完全的,通过简化为背包问题。因此,这个问题通常是通过使用启发式来获得更实用的解决方案来解决的。除了使用启发式方法外,还可以使用工作负载模型的简化和抽象来增加调度问题的可跟踪性。在这种情况下,一个可能的抽象是使用可分负载理论(DLT),其中假设应用程序由任意可分负载(ADL)组成。然而,许多应用程序是由许多原子任务组成的,并且只能模块化地分割。在本文中,我们评估了ADL假设对网格经济调度方法性能的影响,在具有硬截止日期的cpu绑定模块化可分应用程序的背景下。我们的目标是评估在这种情况下,DLT在多大程度上仍然可以作为一种有用的工作负载抽象来获得可处理的调度算法。我们评估的重点是最近提出的tsfGrid启发式算法,用于在ADL假设下运行的网格工作负载的经济调度。我们论证了ADL假设对调度的实际实例化和RMS实现的用户价值的影响。此外,我们还描述了如何在高级准入控制器中使用DLT启发式,以实现考虑到单个任务原子性的机制,从而显着减少通信和计算开销。
{"title":"Evaluating the Divisible Load Assumption in the Context of Economic Grid Scheduling with Deadline-Based QoS guarantees","authors":"Wim Depoorter, R. Y. V. Bossche, K. Vanmechelen, J. Broeckhove","doi":"10.1109/CCGRID.2009.36","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.36","url":null,"abstract":"The ef¿cient scheduling of jobs is an essential part of any grid resource management system. At its core, it involves ¿nding a solution to a problem which is NP-complete by reduction to the knapsack problem. Consequently, this problem is often tackled by using heuristics to derive a more pragmatic solution. Other than the use of heuristics, simpli¿cations and abstractions of the workload model may also be employed to increase the tractability of the scheduling problem. A possible abstraction in this context is the use of Divisible Load Theory (DLT), in which it is assumed that an application consists of an arbitrarily divisible load (ADL). Many applications however, are composed of a number of atomic tasks and are only modularly divisible. In this paper we evaluate the consequences of the ADL assumption on the performance of economic scheduling approaches for grids, in the context of CPU-bound modularly divisible applications with hard deadlines. Our goal is to evaluate to what extent DLT can still serve as a useful workload abstraction for obtaining tractable scheduling algorithms in this setting. The focus of our evaluation is on the recently proposed tsfGrid heuristic for economic scheduling of grid workloads which operates under the assumptions of ADL. We demonstrate the effect of the ADL assumption on the actual instantiation of schedules and on the user value realized by the RMS. In addition we describe how the usage of a DLT heuristic in a high-level admission controller for a mechanism which does take into account the atomicity of individual tasks, can signi¿cantly reduce communication and computational overhead.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130208296","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
期刊
2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1