首页 > 最新文献

2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid最新文献

英文 中文
Runtime Estimations, Reputation and Elections for Top Performing Distributed Query Scheduling 分布式查询调度的运行时估计、声誉和选举
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.34
Rogério Luís de Carvalho Costa, P. Furtado
In the last few years, highly distributed, heterogeneous and dynamic environments have become usual contexts for scientific and business domains. In this work, we consider query scheduling over a grid-enabled distributed database, where the data may be partially or totally replicated into the component sites. Although there have been some previous proposals for query scheduling in distributed databases, they did not consider site reputation, which is important in autonomous and heterogeneous distributed systems. We propose a reputation-based election-inspired query scheduling strategy. Sites are autonomous concerning candidacy for answering queries, in which case they must report an expected response time commitment to those queries. A reputation system is used for ranking sites on their response time estimations. Commitment information and subsequent outcome allows the reputation-based election-inspired approach to improve the overall mean response time of the system. We compare it experimentally with other distributed schedulers to show that the use of reputation and elections improves performance in heterogeneous autonomous environments.
在过去的几年中,高度分布式、异构和动态的环境已经成为科学和商业领域的常用环境。在这项工作中,我们考虑在支持网格的分布式数据库上进行查询调度,其中数据可能部分或全部复制到组件站点中。虽然以前有一些关于分布式数据库查询调度的建议,但它们没有考虑站点声誉,而站点声誉在自治和异构分布式系统中是很重要的。我们提出了一种基于声誉的选举启发查询调度策略。站点在回答查询的候选性方面是自主的,在这种情况下,它们必须报告对这些查询的预期响应时间承诺。信誉系统用于根据响应时间估计对站点进行排名。承诺信息和随后的结果允许基于声誉的选举激励方法改善系统的总体平均响应时间。我们通过实验将其与其他分布式调度器进行比较,以表明在异构自治环境中使用声誉和选举可以提高性能。
{"title":"Runtime Estimations, Reputation and Elections for Top Performing Distributed Query Scheduling","authors":"Rogério Luís de Carvalho Costa, P. Furtado","doi":"10.1109/CCGRID.2009.34","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.34","url":null,"abstract":"In the last few years, highly distributed, heterogeneous and dynamic environments have become usual contexts for scientific and business domains. In this work, we consider query scheduling over a grid-enabled distributed database, where the data may be partially or totally replicated into the component sites. Although there have been some previous proposals for query scheduling in distributed databases, they did not consider site reputation, which is important in autonomous and heterogeneous distributed systems. We propose a reputation-based election-inspired query scheduling strategy. Sites are autonomous concerning candidacy for answering queries, in which case they must report an expected response time commitment to those queries. A reputation system is used for ranking sites on their response time estimations. Commitment information and subsequent outcome allows the reputation-based election-inspired approach to improve the overall mean response time of the system. We compare it experimentally with other distributed schedulers to show that the use of reputation and elections improves performance in heterogeneous autonomous environments.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128997330","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
Towards a Cluster Based Incentive Mechanism for P2P Networks 基于集群的P2P网络激励机制研究
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.92
Kan Zhang, N. Antonopoulos
Free riders in Peer-to-peer (P2P) networks are the nodes only consume services but provide little or nothing. They seriously degrade the fault-tolerance and scalability of the P2P networks. A Cluster-Based Incentive Mechanism (CBIM) is proposed in this paper to prevent free riding problem in P2P networks regardless of their topologies and service diversity. Nodes with asymmetric interests are organized in clusters that consist of service exchange rings. A node in a ring can receive a service from its predecessor by providing a requested service to its successor. Free riders can not complete their requested services since a ring will collapse once free riding is detected. We firstly identify five design requirements, namely, adaptability, service diversity, reward and penalty, altruism and performance. Second, we describe the cluster formation process and a graph theory based ring identification algorithm. Finally, we describe our coarse-grained probability-based free riding prevention algorithm. Through a set of simulations, we find that the CBIM is feasible and outperforms other incentive mechanisms.
点对点(P2P)网络中的搭便车者是只消费服务但提供很少或不提供服务的节点。它们严重降低了P2P网络的容错性和可扩展性。本文提出了一种基于集群的激励机制(CBIM)来防止P2P网络中的搭便车问题,无论其拓扑结构和服务多样性如何。具有不对称兴趣的节点被组织在由服务交换环组成的集群中。环中的节点可以通过向其后继者提供所请求的服务来接收来自其前继者的服务。搭便车者无法完成他们请求的服务,因为一旦发现搭便车,圆环将崩溃。我们首先确定了五个设计需求,即适应性、服务多样性、奖惩、利他性和绩效。其次,我们描述了簇的形成过程和基于图论的环识别算法。最后,我们描述了我们的基于概率的粗粒度搭便车预防算法。通过一组仿真,我们发现CBIM是可行的,并且优于其他激励机制。
{"title":"Towards a Cluster Based Incentive Mechanism for P2P Networks","authors":"Kan Zhang, N. Antonopoulos","doi":"10.1109/CCGRID.2009.92","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.92","url":null,"abstract":"Free riders in Peer-to-peer (P2P) networks are the nodes only consume services but provide little or nothing. They seriously degrade the fault-tolerance and scalability of the P2P networks. A Cluster-Based Incentive Mechanism (CBIM) is proposed in this paper to prevent free riding problem in P2P networks regardless of their topologies and service diversity. Nodes with asymmetric interests are organized in clusters that consist of service exchange rings. A node in a ring can receive a service from its predecessor by providing a requested service to its successor. Free riders can not complete their requested services since a ring will collapse once free riding is detected. We firstly identify five design requirements, namely, adaptability, service diversity, reward and penalty, altruism and performance. Second, we describe the cluster formation process and a graph theory based ring identification algorithm. Finally, we describe our coarse-grained probability-based free riding prevention algorithm. Through a set of simulations, we find that the CBIM is feasible and outperforms other incentive mechanisms.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"50 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124605647","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
Domain-Specific Groupware Environment for E-research on Chemistry 面向化学电子研究领域的群件环境
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.45
Dongmei Yue, Ruisheng Zhang, Chen Zhao, Ruipeng Wei, Lian Li
E-Research aims to facilitate collaboration across time and distance. Researchers need techniques and tools to support their collaborative work. Groupware is one technique that supports groups of people engaging in a common task over the network. Besides, it is also one of the most effective means to solve the collaboration problem. Existing groupware projects provide fixed functions such as messaging, conferen- cing, electronic meeting, document management, document collaboration and so on.  However, they put limited emphasis on scientists’ research work in their specific fields. This paper proposes a groupware environment, and tries to give a domain-specific group editor to facilitate researchers’ collaboration. The groupware implements a visual molecule group editor for chemists to co-edit molecular structures over network. And it has a plug-in extensible architecture intending to easily integrate other tools which is useful for chemists’ collaboration. The idea given in this paper could be a possible solution to facilitate chemists’ collaborative research work.
E-Research旨在促进跨越时间和距离的合作。研究人员需要技术和工具来支持他们的协作工作。群件是一种技术,它支持一组人通过网络参与共同的任务。此外,它也是解决协作问题的最有效手段之一。现有的群件项目提供固定的功能,如消息传递、会议、电子会议、文档管理、文档协作等。然而,他们对科学家在其特定领域的研究工作重视有限。本文提出了一个群件环境,并尝试提供一个特定领域的组编辑器,以方便研究人员的协作。群件实现了一个可视化的分子群编辑器,供化学家通过网络共同编辑分子结构。它有一个插件可扩展的架构,旨在轻松集成其他工具,这对化学家的协作很有用。本文提出的想法可能是促进化学家合作研究工作的一种可能的解决方案。
{"title":"Domain-Specific Groupware Environment for E-research on Chemistry","authors":"Dongmei Yue, Ruisheng Zhang, Chen Zhao, Ruipeng Wei, Lian Li","doi":"10.1109/CCGRID.2009.45","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.45","url":null,"abstract":"E-Research aims to facilitate collaboration across time and distance. Researchers need techniques and tools to support their collaborative work. Groupware is one technique that supports groups of people engaging in a common task over the network. Besides, it is also one of the most effective means to solve the collaboration problem. Existing groupware projects provide fixed functions such as messaging, conferen- cing, electronic meeting, document management, document collaboration and so on.  However, they put limited emphasis on scientists’ research work in their specific fields. This paper proposes a groupware environment, and tries to give a domain-specific group editor to facilitate researchers’ collaboration. The groupware implements a visual molecule group editor for chemists to co-edit molecular structures over network. And it has a plug-in extensible architecture intending to easily integrate other tools which is useful for chemists’ collaboration. The idea given in this paper could be a possible solution to facilitate chemists’ collaborative research work.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"105 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124762812","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Automating Malware Scanning Using Workflows 使用工作流自动化恶意软件扫描
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.90
D. Stirling, I. Welch, P. Komisarczuk, C. Seifert
Identifying websites hosting malicious code is a priority for helping protect consumers using the web and for the collection of malicious code for analysis by malware researchers. We have been running an InternetNZ sponsored study where homepages of almost all New Zealand Web servers are scanned on a regular basis by a set of client honeypots. This paper reflects upon our experience of running moderate scale scans over a period of several months manually and identifies some requirements for automation of such a system using workflow and related middleware.
识别托管恶意代码的网站是帮助保护使用网络的消费者和收集恶意代码供恶意软件研究人员分析的首要任务。我们一直在进行一项由新西兰互联网协会赞助的研究,在这项研究中,一组客户端蜜罐会定期扫描几乎所有新西兰网络服务器的主页。本文反映了我们在几个月的时间里手动运行中等规模扫描的经验,并确定了使用工作流和相关中间件实现这种系统自动化的一些需求。
{"title":"Automating Malware Scanning Using Workflows","authors":"D. Stirling, I. Welch, P. Komisarczuk, C. Seifert","doi":"10.1109/CCGRID.2009.90","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.90","url":null,"abstract":"Identifying websites hosting malicious code is a priority for helping protect consumers using the web and for the collection of malicious code for analysis by malware researchers. We have been running an InternetNZ sponsored study where homepages of almost all New Zealand Web servers are scanned on a regular basis by a set of client honeypots. This paper reflects upon our experience of running moderate scale scans over a period of several months manually and identifies some requirements for automation of such a system using workflow and related middleware.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132022949","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
EnVision: A Web-Based Tool for Scientific Visualization EnVision:一个基于网络的科学可视化工具
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.80
Gregory P. Johnson, S. Mock, Brandt M. Westing, Gregory S. Johnson
Scientific visualization is the process of transforming raw numeric data into a visual form, and is a key element of computational science. While many tools exist, they are unnecessarily difficult to use. This complexity increases time to insight and inhibits casual inquiry. The complexity derives from the need to support arbitrarily formatted data and many visualization algorithms. EnVision addresses both sources of complexity. Its design is predicated on two key insights. First, though the number of data file formats is unbounded, the structure of any one can be described using a small number of parameters. Second, the set of visualization algorithms applicable to a given type of data is small, and the subset used within a specific scientific discipline is smaller. EnVision utilizes domain-specific knowledge and user-directed semi-automation to dramatically simplify data importation and visualization algorithm selection. Its web-based interface facilitates access to remote hardware resources and provides a collaborative visualization environment.
科学可视化是将原始数字数据转换为可视化形式的过程,是计算科学的关键要素。虽然有许多工具存在,但它们使用起来并不困难。这种复杂性增加了洞察的时间,并抑制了随意的探究。复杂性来自于需要支持任意格式的数据和许多可视化算法。EnVision解决了复杂性的两个来源。它的设计基于两个关键的见解。首先,尽管数据文件格式的数量是无限的,但任何一种格式的结构都可以用少量参数来描述。其次,适用于给定类型数据的可视化算法集很小,在特定科学学科中使用的子集也较小。EnVision利用领域特定知识和用户导向的半自动化,大大简化了数据输入和可视化算法选择。其基于web的界面促进了对远程硬件资源的访问,并提供了一个协作的可视化环境。
{"title":"EnVision: A Web-Based Tool for Scientific Visualization","authors":"Gregory P. Johnson, S. Mock, Brandt M. Westing, Gregory S. Johnson","doi":"10.1109/CCGRID.2009.80","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.80","url":null,"abstract":"Scientific visualization is the process of transforming raw numeric data into a visual form, and is a key element of computational science. While many tools exist, they are unnecessarily difficult to use. This complexity increases time to insight and inhibits casual inquiry. The complexity derives from the need to support arbitrarily formatted data and many visualization algorithms. EnVision addresses both sources of complexity. Its design is predicated on two key insights. First, though the number of data file formats is unbounded, the structure of any one can be described using a small number of parameters. Second, the set of visualization algorithms applicable to a given type of data is small, and the subset used within a specific scientific discipline is smaller. EnVision utilizes domain-specific knowledge and user-directed semi-automation to dramatically simplify data importation and visualization algorithm selection. Its web-based interface facilitates access to remote hardware resources and provides a collaborative visualization environment.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"62 3-4","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131496677","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
Improving Parallel Write by Node-Level Request Scheduling 通过节点级请求调度改进并行写
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.71
Kazuki Ohta, Hiroya Matsuba, Y. Ishikawa
In a cluster of multiple processors or cpu-cores, many processes may run on each compute node. Each process tends to issue contiguous I/O requests for snapshot, checkpointing or so, however, if large number of processes enter the I/O phase at the same time, the requests from the same process may be interrupted by the requests of other processes. Then, the I/O nodes receive these requests as non-contiguous way. This interleaved access pattern causes performance degradation in parallel file systems. In order to overcome the problem, we have designed the Gather-Arrange-Scatter (GAS) I/O architecture, for optimizing the parallel write performance. The GAS is an architecture for capturing write operations, buffering them in the memory, and scheduling them to reduce I/O cost at I/O nodes. The scheduling is done per compute node, and the requests are sent to the remote disks in parallel. In this paper, after introducing the GAS architecture in detail, its efficiency and scalability are evaluated using the NAS Parallel Benchmark BTIO. GAS is 5.2%faster than ROMIO collective I/O on PVFS2 in BTIO with 16 nodes/64 processes, and 34.9% faster than MPI noncollective I/O in the same configuration.
在由多个处理器或cpu核心组成的集群中,每个计算节点上可能运行多个进程。每个进程倾向于发出连续的I/O请求,例如快照、检查点等,但是,如果大量进程同时进入I/O阶段,则同一进程的请求可能会被其他进程的请求中断。然后,I/O节点以不连续的方式接收这些请求。这种交错访问模式会导致并行文件系统的性能下降。为了克服这个问题,我们设计了收集-排列-分散(GAS) I/O架构,以优化并行写性能。GAS是一种架构,用于捕获写操作,将它们缓冲在内存中,并对它们进行调度,以减少I/O节点上的I/O成本。调度是在每个计算节点上完成的,请求被并行地发送到远程磁盘。本文在详细介绍GAS体系结构的基础上,利用NAS并行基准BTIO对其效率和可扩展性进行了评估。在16节点/64进程的BTIO中,GAS比PVFS2上的ROMIO集体I/O快5.2%,比相同配置下的MPI非集体I/O快34.9%。
{"title":"Improving Parallel Write by Node-Level Request Scheduling","authors":"Kazuki Ohta, Hiroya Matsuba, Y. Ishikawa","doi":"10.1109/CCGRID.2009.71","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.71","url":null,"abstract":"In a cluster of multiple processors or cpu-cores, many processes may run on each compute node. Each process tends to issue contiguous I/O requests for snapshot, checkpointing or so, however, if large number of processes enter the I/O phase at the same time, the requests from the same process may be interrupted by the requests of other processes. Then, the I/O nodes receive these requests as non-contiguous way. This interleaved access pattern causes performance degradation in parallel file systems. In order to overcome the problem, we have designed the Gather-Arrange-Scatter (GAS) I/O architecture, for optimizing the parallel write performance. The GAS is an architecture for capturing write operations, buffering them in the memory, and scheduling them to reduce I/O cost at I/O nodes. The scheduling is done per compute node, and the requests are sent to the remote disks in parallel. In this paper, after introducing the GAS architecture in detail, its efficiency and scalability are evaluated using the NAS Parallel Benchmark BTIO. GAS is 5.2%faster than ROMIO collective I/O on PVFS2 in BTIO with 16 nodes/64 processes, and 34.9% faster than MPI noncollective I/O in the same configuration.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"58 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124637169","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 12
Distributed Collaborative Visualization Using Light Field Rendering 使用光场渲染的分布式协同可视化
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.79
Asma Al-Saidi, N. J. Avis, I. Grimstead, O. Rana
Interactive distributed visualization is an emerging technology with numerous applications. However, many of the present approaches of interactive distributed visualization are based on the traditional polygonal processing graphics pipeline. Our research is centred on investigating an alternative method using Image-Based Rendering (IBR) which uses (multiple) images of the scene instead of a 3D geometrical representation. A key advantage to the use of IBR techniques is that the bandwidth required is independent of scene complexity and is therefore predictable given knowledge of the desired final image resolution. In this paper, we describe our IBR based interactive distributed visualization platform involving Light Field rendering and present results which indicate the scalability of our approach to accommodate multiple collaborative users. To our knowledge this is the first system to demonstrate deployment of interactive Light Field rendering to large numbers of distributed users.
交互式分布式可视化是一项新兴的技术,有着众多的应用。然而,目前许多交互式分布式可视化方法都是基于传统的多边形处理图形管道。我们的研究集中在研究一种使用基于图像的渲染(IBR)的替代方法,该方法使用场景的(多个)图像而不是3D几何表示。使用IBR技术的一个关键优势是所需的带宽与场景复杂性无关,因此在已知所需的最终图像分辨率的情况下是可预测的。在本文中,我们描述了基于IBR的交互式分布式可视化平台,包括光场渲染,并给出了结果,表明我们的方法具有可扩展性,可以容纳多个协作用户。据我们所知,这是第一个向大量分布式用户演示交互式光场渲染部署的系统。
{"title":"Distributed Collaborative Visualization Using Light Field Rendering","authors":"Asma Al-Saidi, N. J. Avis, I. Grimstead, O. Rana","doi":"10.1109/CCGRID.2009.79","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.79","url":null,"abstract":"Interactive distributed visualization is an emerging technology with numerous applications. However, many of the present approaches of interactive distributed visualization are based on the traditional polygonal processing graphics pipeline. Our research is centred on investigating an alternative method using Image-Based Rendering (IBR) which uses (multiple) images of the scene instead of a 3D geometrical representation. A key advantage to the use of IBR techniques is that the bandwidth required is independent of scene complexity and is therefore predictable given knowledge of the desired final image resolution. In this paper, we describe our IBR based interactive distributed visualization platform involving Light Field rendering and present results which indicate the scalability of our approach to accommodate multiple collaborative users. To our knowledge this is the first system to demonstrate deployment of interactive Light Field rendering to large numbers of distributed users.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124775648","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
A Hybrid Intelligent Method for Performance Modeling and Prediction of Workflow Activities in Grids 网格中工作流活动性能建模与预测的混合智能方法
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.58
Rubing Duan, F. Nadeem, Jie Wang, Yun Zhang, R. Prodan, T. Fahringer
Grid schedulers require individual activity performance predictions to map workflow activities on different Grid sites. The effectiveness of the scheduling systems is hampered by inaccurate predictions due to the inability of existing predictors to effectively model the dynamic and heterogeneous nature of Grid resources, or the wide range of problem sizes and runtime arguments. To address this deficiency, we propose a hybrid Bayesian-neural network approach to dynamically model and predict the execution time of activities in real workflow applications. Bayesian network is used for a high-level representation of activities performance probability distribution against different factors affecting the performance. The important attributes are dynamically selected by the Bayesian network and fed into a radial basis function neural network to make further predictions. Our approach is generic to any type of scientific applications, and flexible to import expert knowledge to further improve accuracies. Experimental results for activities from three realworld workflow applications are presented to show effectivenessof our approach.
网格调度器需要单独的活动性能预测来映射不同网格站点上的工作流活动。由于现有的预测器无法有效地对网格资源的动态性和异构性进行建模,或者由于问题大小和运行时参数的差异,导致不准确的预测妨碍了调度系统的有效性。为了解决这一缺陷,我们提出了一种混合贝叶斯神经网络方法来动态建模和预测实际工作流应用中活动的执行时间。贝叶斯网络用于对影响性能的不同因素的活动性能概率分布的高级表示。贝叶斯网络动态选择重要属性,并将其输入径向基函数神经网络进行进一步预测。我们的方法对任何类型的科学应用都是通用的,并且可以灵活地导入专家知识以进一步提高准确性。实验结果表明了该方法的有效性。
{"title":"A Hybrid Intelligent Method for Performance Modeling and Prediction of Workflow Activities in Grids","authors":"Rubing Duan, F. Nadeem, Jie Wang, Yun Zhang, R. Prodan, T. Fahringer","doi":"10.1109/CCGRID.2009.58","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.58","url":null,"abstract":"Grid schedulers require individual activity performance predictions to map workflow activities on different Grid sites. The effectiveness of the scheduling systems is hampered by inaccurate predictions due to the inability of existing predictors to effectively model the dynamic and heterogeneous nature of Grid resources, or the wide range of problem sizes and runtime arguments. To address this deficiency, we propose a hybrid Bayesian-neural network approach to dynamically model and predict the execution time of activities in real workflow applications. Bayesian network is used for a high-level representation of activities performance probability distribution against different factors affecting the performance. The important attributes are dynamically selected by the Bayesian network and fed into a radial basis function neural network to make further predictions. Our approach is generic to any type of scientific applications, and flexible to import expert knowledge to further improve accuracies. Experimental results for activities from three realworld workflow applications are presented to show effectivenessof our approach.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124849728","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 57
Memory-Mapped File Approach for On-Demand Data Co-allocation on Grids 网格上按需数据协同分配的内存映射文件方法
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.22
P. Chen, Jyh-Biau Chang, Yi-Chang Zhuang, C. Shieh, Tyng-Yeu Liang
Grid data sharing systems usually provide a data-intensive application with either a pre-staging mechanism or an on-demand access mechanism to access shared data. Pre-staging systems simultaneously download an entire shared file from multiple data sources even when only a tiny file fragment is required. Such systems consume unnecessary data transmission time and storage space. On-demand access systems, on the other hand, download only the required fragments from a single data source. Such systems unfortunately do not fully exploit available network bandwidth. This paper presents a data sharing system, designated as the On-Demand data Co-Allocation (ODCA). ODCA facilitates an unmodified legacy applications to transparently access shared data by using native I/O system calls. ODCA transfers only the necessary fragments on user demand, thereby reducing data transmission time, avoiding wasted network bandwidth and wasted storage space. Moreover, ODCA reduces data waiting time by downloading the file fragments from multiple data sources. Experimental results show ODCA successfully reduces turnaround time in data-intensive applications.
网格数据共享系统通常为数据密集型应用程序提供预登台机制或按需访问机制来访问共享数据。预分级系统同时从多个数据源下载整个共享文件,即使只需要很小的文件片段。这种系统消耗了不必要的数据传输时间和存储空间。另一方面,按需访问系统只从单个数据源下载所需的片段。不幸的是,这样的系统不能充分利用可用的网络带宽。本文提出了一种数据共享系统,称为按需数据协同分配(ODCA)。ODCA允许未经修改的遗留应用程序通过使用本机I/O系统调用透明地访问共享数据。ODCA只根据用户需要传输必要的分片,从而减少数据传输时间,避免浪费网络带宽和存储空间。此外,ODCA通过从多个数据源下载文件片段来减少数据等待时间。实验结果表明,ODCA成功地减少了数据密集型应用程序的周转时间。
{"title":"Memory-Mapped File Approach for On-Demand Data Co-allocation on Grids","authors":"P. Chen, Jyh-Biau Chang, Yi-Chang Zhuang, C. Shieh, Tyng-Yeu Liang","doi":"10.1109/CCGRID.2009.22","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.22","url":null,"abstract":"Grid data sharing systems usually provide a data-intensive application with either a pre-staging mechanism or an on-demand access mechanism to access shared data. Pre-staging systems simultaneously download an entire shared file from multiple data sources even when only a tiny file fragment is required. Such systems consume unnecessary data transmission time and storage space. On-demand access systems, on the other hand, download only the required fragments from a single data source. Such systems unfortunately do not fully exploit available network bandwidth. This paper presents a data sharing system, designated as the On-Demand data Co-Allocation (ODCA). ODCA facilitates an unmodified legacy applications to transparently access shared data by using native I/O system calls. ODCA transfers only the necessary fragments on user demand, thereby reducing data transmission time, avoiding wasted network bandwidth and wasted storage space. Moreover, ODCA reduces data waiting time by downloading the file fragments from multiple data sources. Experimental results show ODCA successfully reduces turnaround time in data-intensive applications.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131972267","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
An E-infrastructure to Support Collaborative Embryo Research 支持协同胚胎研究的电子基础设施
Pub Date : 2009-05-18 DOI: 10.1109/CCGRID.2009.78
A. Barker, Jano van Hemert, R. Baldock, M. Atkinson
Within the context of the EU Design Study Developmental Gene Expression Map, we identify a set of challenges when facilitating collaborative research on early human embryo development. These challenges bring forth requirements, for which we have identified solutions and technology. We summarise our solutions and demonstrate how they integrate to form an e-infrastructure to support collaborative research in this area of developmental biology.
在欧盟设计研究发育基因表达图谱的背景下,我们在促进早期人类胚胎发育的合作研究时发现了一系列挑战。这些挑战带来了需求,为此我们已经确定了解决方案和技术。我们总结了我们的解决方案,并展示了它们如何整合形成一个电子基础设施,以支持发育生物学这一领域的合作研究。
{"title":"An E-infrastructure to Support Collaborative Embryo Research","authors":"A. Barker, Jano van Hemert, R. Baldock, M. Atkinson","doi":"10.1109/CCGRID.2009.78","DOIUrl":"https://doi.org/10.1109/CCGRID.2009.78","url":null,"abstract":"Within the context of the EU Design Study Developmental Gene Expression Map, we identify a set of challenges when facilitating collaborative research on early human embryo development. These challenges bring forth requirements, for which we have identified solutions and technology. We summarise our solutions and demonstrate how they integrate to form an e-infrastructure to support collaborative research in this area of developmental biology.","PeriodicalId":118263,"journal":{"name":"2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127850928","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
期刊
2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1