首页 > 最新文献

2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing最新文献

英文 中文
SAGA BigJob: An Extensible and Interoperable Pilot-Job Abstraction for Distributed Applications and Systems SAGA BigJob:分布式应用和系统的可扩展和可互操作的试点工作抽象
André Luckow, Lukasz Lacinski, S. Jha
The uptake of distributed infrastructures by scientific applications has been limited by the availability of extensible, pervasive and simple-to-use abstractions which are required at multiple levels -- development, deployment and execution stages of scientific applications. The Pilot-Job abstraction has been shown to be an effective abstraction to address many requirements of scientific applications. Specifically, Pilot-Jobs support the decoupling of workload submission from resource assignment, this results in a flexible execution model, which in turn enables the distributed scale-out of applications on multiple and possibly heterogeneous resources. Most Pilot-Job implementations however, are tied to a specific infrastructure. In this paper, we describe the design and implementation of a SAGA-based Pilot-Job, which supports a wide range of application types, and is usable over a broad range of infrastructures, i.e., it is general-purpose and extensible, and as we will argue is also interoperable with Clouds. We discuss how the SAGA-based Pilot-Job is used for different application types and supports the concurrent usage across multiple heterogeneous distributed infrastructure, including concurrent usage across Clouds and traditional Grids/Clusters. Further, we show how Pilot-Jobs can help to support dynamic execution models and thus, introduce new opportunities for distributed applications. We also demonstrate for the first time that we are aware of, the use of multiple Pilot-Job implementations to solve the same problem, specifically, we use the SAGA-based Pilot-Job on high-end resources such as the TeraGrid and the native Condor Pilot-Job (Glide-in) on Condor resources. Importantly both are invoked via the same interface without changes at the development or deployment level, but only an execution (run-time) decision.
科学应用程序对分布式基础设施的吸收受到可扩展、普遍和易于使用的抽象的可用性的限制,这些抽象在多个层次(科学应用程序的开发、部署和执行阶段)都是必需的。试点工作抽象已被证明是一种有效的抽象,可以解决科学应用的许多需求。具体来说,Pilot-Jobs支持将工作负载提交与资源分配解耦,从而产生灵活的执行模型,从而支持应用程序在多个(可能是异构的)资源上的分布式扩展。然而,大多数试点作业的实现都与特定的基础设施相关联。在本文中,我们描述了基于saga的Pilot-Job的设计和实现,它支持广泛的应用程序类型,并且可以在广泛的基础设施上使用,也就是说,它是通用的和可扩展的,并且正如我们将讨论的那样,它还可以与云互操作。我们讨论了如何将基于saga的Pilot-Job用于不同的应用程序类型,以及如何支持跨多个异构分布式基础设施的并发使用,包括跨云和传统网格/集群的并发使用。此外,我们将展示Pilot-Jobs如何帮助支持动态执行模型,从而为分布式应用程序引入新的机会。我们还首次演示了使用多个Pilot-Job实现来解决相同的问题,具体来说,我们在高端资源(如TeraGrid)上使用基于saga的Pilot-Job,在Condor资源上使用本地Condor Pilot-Job(滑翔)。重要的是,两者都可以通过相同的接口调用,而无需在开发或部署级别进行更改,而只需执行(运行时)决策。
{"title":"SAGA BigJob: An Extensible and Interoperable Pilot-Job Abstraction for Distributed Applications and Systems","authors":"André Luckow, Lukasz Lacinski, S. Jha","doi":"10.1109/CCGRID.2010.91","DOIUrl":"https://doi.org/10.1109/CCGRID.2010.91","url":null,"abstract":"The uptake of distributed infrastructures by scientific applications has been limited by the availability of extensible, pervasive and simple-to-use abstractions which are required at multiple levels -- development, deployment and execution stages of scientific applications. The Pilot-Job abstraction has been shown to be an effective abstraction to address many requirements of scientific applications. Specifically, Pilot-Jobs support the decoupling of workload submission from resource assignment, this results in a flexible execution model, which in turn enables the distributed scale-out of applications on multiple and possibly heterogeneous resources. Most Pilot-Job implementations however, are tied to a specific infrastructure. In this paper, we describe the design and implementation of a SAGA-based Pilot-Job, which supports a wide range of application types, and is usable over a broad range of infrastructures, i.e., it is general-purpose and extensible, and as we will argue is also interoperable with Clouds. We discuss how the SAGA-based Pilot-Job is used for different application types and supports the concurrent usage across multiple heterogeneous distributed infrastructure, including concurrent usage across Clouds and traditional Grids/Clusters. Further, we show how Pilot-Jobs can help to support dynamic execution models and thus, introduce new opportunities for distributed applications. We also demonstrate for the first time that we are aware of, the use of multiple Pilot-Job implementations to solve the same problem, specifically, we use the SAGA-based Pilot-Job on high-end resources such as the TeraGrid and the native Condor Pilot-Job (Glide-in) on Condor resources. Importantly both are invoked via the same interface without changes at the development or deployment level, but only an execution (run-time) decision.","PeriodicalId":444485,"journal":{"name":"2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing","volume":"31 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-05-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123193505","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 88
A Fair Decentralized Scheduler for Bag-of-Tasks Applications on Desktop Grids 一个公平的分布式调度程序,用于桌面网格上的任务袋应用程序
Javier Celaya, L. Marchal
Desktop Grids have become very popular nowadays, with projects that include hundred of thousands computers. Desktop grid scheduling faces two challenges. First, the platform is volatile, since users may reclaim their computer at any time, which makes centralized schedulers inappropriate. Second, desktop grids are likely to be shared among several users, thus we must be particularly careful to ensure a fair sharing of the resources. In this paper, we propose a decentralized scheduler for bag-of-tasks applications on desktop grids, which ensures a fair and efficient use of the resources. It aims to provide a similar share of the platform to every application by minimizing their maximum stretch, using completely decentralized algorithms and protocols.
桌面网格现在已经变得非常流行,其项目包括数十万台计算机。桌面网格调度面临两个挑战。首先,该平台是不稳定的,因为用户可以随时回收他们的计算机,这使得集中调度程序不合适。其次,桌面网格可能在几个用户之间共享,因此我们必须特别小心,以确保资源的公平共享。在本文中,我们为桌面网格上的任务包应用程序提出了一个分散的调度程序,以确保资源的公平和有效利用。它的目标是通过使用完全分散的算法和协议,最大限度地减少应用程序的最大扩展,为每个应用程序提供类似的平台共享。
{"title":"A Fair Decentralized Scheduler for Bag-of-Tasks Applications on Desktop Grids","authors":"Javier Celaya, L. Marchal","doi":"10.1109/CCGRID.2010.13","DOIUrl":"https://doi.org/10.1109/CCGRID.2010.13","url":null,"abstract":"Desktop Grids have become very popular nowadays, with projects that include hundred of thousands computers. Desktop grid scheduling faces two challenges. First, the platform is volatile, since users may reclaim their computer at any time, which makes centralized schedulers inappropriate. Second, desktop grids are likely to be shared among several users, thus we must be particularly careful to ensure a fair sharing of the resources. In this paper, we propose a decentralized scheduler for bag-of-tasks applications on desktop grids, which ensures a fair and efficient use of the resources. It aims to provide a similar share of the platform to every application by minimizing their maximum stretch, using completely decentralized algorithms and protocols.","PeriodicalId":444485,"journal":{"name":"2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing","volume":"47 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-05-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122657640","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 26
Efficient Runtime Environment for Coupled Multi-physics Simulations: Dynamic Resource Allocation and Load-Balancing 耦合多物理场仿真的高效运行环境:动态资源分配和负载平衡
S. Ko, Nayong Kim, Joohyun Kim, A. Thota, S. Jha
Coupled Multi-Physics simulations, such as hybrid CFD-MD simulations, represent an increasingly important class of scientific applications. Often the physical problems of interest demand the use of high-end computers, such as TeraGrid resources, which are often accessible only via batch-queues. Batch-queue systems are not developed to natively support the coordinated scheduling of jobs – which in turn is required to support the concurrent execution required by coupled multi-physics simulations. In this paper we develop and demonstrate a novel approach to overcome the lack of native support for coordinated job submission requirement associated with coupled runs. We establish the performance advantages arising from our solution, which is a generalization of the Pilot-Job concept – which in of itself is not new, but is being applied to coupled simulations for the first time. Our solution not only overcomes the initial co-scheduling problem, but also provides a dynamic resource allocation mechanism. Support for such dynamic resources is critical for a load balancing mechanism, which we develop and demonstrate to be effective at reducing the total time-to-solution of the problem. We establish that the performance advantage of using Big Jobs is invariant with the size of the machine as well as the size of the physical model under investigation. The Pilot-Job abstraction is developed using SAGA, which provides an infrastructure agnostic implementation, and which can seamlessly execute and utilize distributed resources.
耦合多物理场模拟,如混合CFD-MD模拟,代表了越来越重要的科学应用类别。通常,感兴趣的物理问题需要使用高端计算机,例如TeraGrid资源,这些资源通常只能通过批处理队列访问。批处理队列系统本身并不是为了支持作业的协调调度而开发的——这反过来又需要支持耦合多物理场模拟所需的并发执行。在本文中,我们开发并演示了一种新的方法来克服缺乏与耦合运行相关的协调作业提交需求的本机支持。我们建立了从我们的解决方案中产生的性能优势,该解决方案是Pilot-Job概念的概括- Pilot-Job本身并不新鲜,但首次应用于耦合模拟。我们的解决方案不仅克服了最初的协同调度问题,而且提供了一种动态的资源分配机制。对这种动态资源的支持对于负载平衡机制至关重要,我们开发并演示了负载平衡机制在减少解决问题的总时间方面是有效的。我们确定,使用Big Jobs的性能优势与机器的大小以及所研究的物理模型的大小是不变的。Pilot-Job抽象是使用SAGA开发的,它提供了一个与基础设施无关的实现,并且可以无缝地执行和利用分布式资源。
{"title":"Efficient Runtime Environment for Coupled Multi-physics Simulations: Dynamic Resource Allocation and Load-Balancing","authors":"S. Ko, Nayong Kim, Joohyun Kim, A. Thota, S. Jha","doi":"10.1109/CCGRID.2010.107","DOIUrl":"https://doi.org/10.1109/CCGRID.2010.107","url":null,"abstract":"Coupled Multi-Physics simulations, such as hybrid CFD-MD simulations, represent an increasingly important class of scientific applications. Often the physical problems of interest demand the use of high-end computers, such as TeraGrid resources, which are often accessible only via batch-queues. Batch-queue systems are not developed to natively support the coordinated scheduling of jobs – which in turn is required to support the concurrent execution required by coupled multi-physics simulations. In this paper we develop and demonstrate a novel approach to overcome the lack of native support for coordinated job submission requirement associated with coupled runs. We establish the performance advantages arising from our solution, which is a generalization of the Pilot-Job concept – which in of itself is not new, but is being applied to coupled simulations for the first time. Our solution not only overcomes the initial co-scheduling problem, but also provides a dynamic resource allocation mechanism. Support for such dynamic resources is critical for a load balancing mechanism, which we develop and demonstrate to be effective at reducing the total time-to-solution of the problem. We establish that the performance advantage of using Big Jobs is invariant with the size of the machine as well as the size of the physical model under investigation. The Pilot-Job abstraction is developed using SAGA, which provides an infrastructure agnostic implementation, and which can seamlessly execute and utilize distributed resources.","PeriodicalId":444485,"journal":{"name":"2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing","volume":"43 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-05-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124977535","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 33
An Effective Architecture for Automated Appliance Management System Applying Ontology-Based Cloud Discovery 应用基于本体的云发现的自动化设备管理系统的有效架构
A. V. Dastjerdi, Sayed Gholam Hassan Tabatabaei, R. Buyya
Cloud computing is a computing paradigm which allows access of computing elements and storages on-demand over the Internet. Virtual Appliances, pre-configured, ready-to-run applications are emerging as a breakthrough technology to solve the complexities of service deployment on Cloud infrastructure. However, an automated approach to deploy required appliances on the most suitable Cloud infrastructure is neglected by previous works which is the focus of this work. In this paper, we propose an effective architecture using ontology-based discovery to provide QoS aware deployment of appliances on Cloud service providers. In addition, we test our approach on a case study and the result shows the efficiency and effectiveness of the proposed work.
云计算是一种计算范式,它允许在互联网上按需访问计算元素和存储。虚拟设备是一种预配置的、随时可运行的应用程序,它正在成为解决云基础设施上服务部署复杂性的突破性技术。然而,在最合适的云基础设施上部署所需设备的自动化方法被以前的工作所忽视,而这正是本文的重点。在本文中,我们提出了一种有效的架构,使用基于本体的发现来为云服务提供商的设备提供QoS感知部署。此外,我们在一个案例研究中测试了我们的方法,结果显示了所提出工作的效率和有效性。
{"title":"An Effective Architecture for Automated Appliance Management System Applying Ontology-Based Cloud Discovery","authors":"A. V. Dastjerdi, Sayed Gholam Hassan Tabatabaei, R. Buyya","doi":"10.1109/CCGRID.2010.87","DOIUrl":"https://doi.org/10.1109/CCGRID.2010.87","url":null,"abstract":"Cloud computing is a computing paradigm which allows access of computing elements and storages on-demand over the Internet. Virtual Appliances, pre-configured, ready-to-run applications are emerging as a breakthrough technology to solve the complexities of service deployment on Cloud infrastructure. However, an automated approach to deploy required appliances on the most suitable Cloud infrastructure is neglected by previous works which is the focus of this work. In this paper, we propose an effective architecture using ontology-based discovery to provide QoS aware deployment of appliances on Cloud service providers. In addition, we test our approach on a case study and the result shows the efficiency and effectiveness of the proposed work.","PeriodicalId":444485,"journal":{"name":"2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-05-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116813584","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 112
Dynamic Resource Pricing on Federated Clouds 联邦云的动态资源定价
Marian Mihailescu, Y. M. Teo
Current large distributed systems allow users to share and trade resources. In cloud computing, users purchase different types of resources from one or more resource providers using a fixed pricing scheme. Federated clouds, a topic of recent interest, allows different cloud providers to share resources for increased scalability and reliability. However, users and providers of cloud resources are rational and maximize their own interest when consuming and contributing shared resources. In this paper, we present a dyanmic pricing scheme suitable for rational users requests containing multiple resource types. Using simulations, we compare the efficiency of our proposed strategy-proof dynamic scheme with fixed pricing, and show that user welfare and the percentage of successful requests is increased by using dynamic pricing.
目前的大型分布式系统允许用户共享和交易资源。在云计算中,用户使用固定的定价方案从一个或多个资源提供商处购买不同类型的资源。联邦云是最近的一个热门话题,它允许不同的云提供商共享资源,以提高可伸缩性和可靠性。然而,云资源的用户和提供者在消费和贡献共享资源时都是理性的,会最大化自身的利益。本文提出了一种适用于包含多种资源类型的理性用户请求的动态定价方案。通过仿真,我们比较了所提出的无策略动态方案与固定定价方案的效率,并表明使用动态定价可以提高用户福利和成功请求的百分比。
{"title":"Dynamic Resource Pricing on Federated Clouds","authors":"Marian Mihailescu, Y. M. Teo","doi":"10.1109/CCGRID.2010.123","DOIUrl":"https://doi.org/10.1109/CCGRID.2010.123","url":null,"abstract":"Current large distributed systems allow users to share and trade resources. In cloud computing, users purchase different types of resources from one or more resource providers using a fixed pricing scheme. Federated clouds, a topic of recent interest, allows different cloud providers to share resources for increased scalability and reliability. However, users and providers of cloud resources are rational and maximize their own interest when consuming and contributing shared resources. In this paper, we present a dyanmic pricing scheme suitable for rational users requests containing multiple resource types. Using simulations, we compare the efficiency of our proposed strategy-proof dynamic scheme with fixed pricing, and show that user welfare and the percentage of successful requests is increased by using dynamic pricing.","PeriodicalId":444485,"journal":{"name":"2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-05-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130743104","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 214
In Search of Visualization Metaphors for PlanetLab 为PlanetLab寻找可视化隐喻
Andrew J. Zaliwski
Grids and clouds management and administration becomes a challenge as they become more complicated. This paper together with associated poster present ideas and solutions related to visualization of usage and performance data. The presented system can be used by system or network administrators as well as grid researchers to improve grid functionality or to test new concepts of grid organization.
网格和云的管理和管理随着它们变得越来越复杂而成为一项挑战。本文连同相关的海报展示了与使用和性能数据可视化相关的想法和解决方案。系统或网络管理员以及网格研究人员可以使用该系统来改进网格功能或测试网格组织的新概念。
{"title":"In Search of Visualization Metaphors for PlanetLab","authors":"Andrew J. Zaliwski","doi":"10.1109/CCGRID.2010.35","DOIUrl":"https://doi.org/10.1109/CCGRID.2010.35","url":null,"abstract":"Grids and clouds management and administration becomes a challenge as they become more complicated. This paper together with associated poster present ideas and solutions related to visualization of usage and performance data. The presented system can be used by system or network administrators as well as grid researchers to improve grid functionality or to test new concepts of grid organization.","PeriodicalId":444485,"journal":{"name":"2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing","volume":"57 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-05-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114066304","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
The Lightweight Approach to Use Grid Services with Grid Widgets on Grid WebOS 在网格WebOS上使用网格服务和网格小部件的轻量级方法
Yi-Lun Pan, Chang-Hsing Wu, Chia-Yen Liu, Hsi-En Yu, Weicheng Huang
To bridge the gap between computing grid environment and users, various Grid Widgets are developed by the Grid development team in the National Center for High-performance Computing (NCHC). These widgets are implemented to provide users with seamless and scalable access to Grid resources. Currently, this effort integrates the de facto Grid middleware, Web-based Operating System (WebOS), and automatic resource allocation mechanism to form a virtual computer in distributed computing environment. With the capability of automatic resource allocation and the feature of dynamic load prediction, the Resource Broker (RB) improves the performance of the dynamic scheduling over conventional scheduling policies. With this extremely lightweight and flexible approach to acquire Grid services, the barrier for users to access geographically distributed heterogeneous Grid resources is largely reduced. The Grid Widgets can also be customized and configured to meet the demands of the users.
为了弥合计算网格环境和用户之间的差距,国家高性能计算中心(NCHC)的网格开发团队开发了各种网格小部件。实现这些小部件是为了向用户提供对网格资源的无缝和可伸缩访问。目前,该工作集成了事实上的网格中间件、基于web的操作系统(WebOS)和自动资源分配机制,形成了分布式计算环境中的虚拟计算机。资源代理(resource Broker, RB)具有自动分配资源的能力和动态负荷预测的特性,比传统调度策略提高了动态调度的性能。通过这种极其轻量级和灵活的方法来获取网格服务,用户访问地理上分布的异构网格资源的障碍大大减少了。网格小部件还可以定制和配置,以满足用户的需求。
{"title":"The Lightweight Approach to Use Grid Services with Grid Widgets on Grid WebOS","authors":"Yi-Lun Pan, Chang-Hsing Wu, Chia-Yen Liu, Hsi-En Yu, Weicheng Huang","doi":"10.1109/CCGRID.2010.25","DOIUrl":"https://doi.org/10.1109/CCGRID.2010.25","url":null,"abstract":"To bridge the gap between computing grid environment and users, various Grid Widgets are developed by the Grid development team in the National Center for High-performance Computing (NCHC). These widgets are implemented to provide users with seamless and scalable access to Grid resources. Currently, this effort integrates the de facto Grid middleware, Web-based Operating System (WebOS), and automatic resource allocation mechanism to form a virtual computer in distributed computing environment. With the capability of automatic resource allocation and the feature of dynamic load prediction, the Resource Broker (RB) improves the performance of the dynamic scheduling over conventional scheduling policies. With this extremely lightweight and flexible approach to acquire Grid services, the barrier for users to access geographically distributed heterogeneous Grid resources is largely reduced. The Grid Widgets can also be customized and configured to meet the demands of the users.","PeriodicalId":444485,"journal":{"name":"2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-05-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121904228","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Multi-FFT Vectorization for the Cell Multicore Processor Cell多核处理器的多fft矢量化
J. Barhen, T. Humble, P. Mitra, M. Traweek
The emergence of streaming multicore processors with multi-SIMD architectures and ultra-low power operation combined with real-time compute and I/O reconfigurability opens unprecedented opportunities for executing sophisticated signal processing algorithms faster and within a much lower energy budget. Here, we present an unconventional FFT implementation scheme for the IBM Cell, named transverse vectorization. It is shown to outperform (both in terms of timing or GFLOP throughput) the fastest FFT results reported to date in the open literature.
具有多simd架构和超低功耗操作的流多核处理器的出现,结合了实时计算和I/O可重构性,为在更低的能源预算下更快地执行复杂的信号处理算法提供了前所未有的机会。在这里,我们为IBM Cell提出了一种非常规的FFT实现方案,称为横向矢量化。它被证明优于(在时序或GFLOP吞吐量方面)迄今为止在公开文献中报道的最快FFT结果。
{"title":"Multi-FFT Vectorization for the Cell Multicore Processor","authors":"J. Barhen, T. Humble, P. Mitra, M. Traweek","doi":"10.1109/CCGRID.2010.78","DOIUrl":"https://doi.org/10.1109/CCGRID.2010.78","url":null,"abstract":"The emergence of streaming multicore processors with multi-SIMD architectures and ultra-low power operation combined with real-time compute and I/O reconfigurability opens unprecedented opportunities for executing sophisticated signal processing algorithms faster and within a much lower energy budget. Here, we present an unconventional FFT implementation scheme for the IBM Cell, named transverse vectorization. It is shown to outperform (both in terms of timing or GFLOP throughput) the fastest FFT results reported to date in the open literature.","PeriodicalId":444485,"journal":{"name":"2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-05-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122303248","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Performance Analysis of Diffusion Tensor Imaging in an Academic Production Grid 学术生产网格中扩散张量成像性能分析
D. Krefting, R. Lützkendorf, Kathrin Peter, J. Bernarding
Analysis of diffusion weighted magnetic resonance images serves increasingly for non-invasive tracking of nerve fibers in the human brain, both in clinical diagnosis and basic research. Diffusion-tensor imaging (DTI) enables in-vivo research on the internal structure of the central nervous system, an estimation of the interconnection of functional areas and diagnosis of brain tumors and de-myelinating diseases. But modeling the local diffusion parameters is computationally expensive and on standard desktop computers runtimes of up to days are common. A workflow based grid implementation of the algorithm with slice-based parallelization has shown significant speedup. However, in production use, the implementation frequently delayed and even failed, discouraging the medical collaborators to take up the management of the data processing themselves. Therefore a comprehensive analysis of possible sources for errors and delays as well as their real impact in the respective infrastructure is vital to enable clinical researchers to fully exploit the benefits of the Healthgrid application. In this manuscript, we tested different implementations of the DTI analysis with respect to robustness and runtime. Based on the results, concrete application improvements as well as general suggestions for the layout and maintenance of Healthgrids are concluded.
磁共振弥散加权图像的分析在临床诊断和基础研究中越来越多地用于人脑神经纤维的无创跟踪。弥散张量成像(Diffusion-tensor imaging, DTI)可以在体内研究中枢神经系统的内部结构,估计功能区域的相互联系,以及诊断脑肿瘤和脱髓鞘疾病。但是,对局部扩散参数进行建模在计算上是昂贵的,在标准台式计算机上运行长达几天的时间是很常见的。基于工作流的网格实现和基于切片的并行化显示出显著的加速。然而,在生产使用中,实施经常延迟甚至失败,使医疗合作者不愿意自己承担数据处理的管理工作。因此,全面分析错误和延迟的可能来源,以及它们对各自基础设施的实际影响,对于临床研究人员充分利用Healthgrid应用程序的好处至关重要。在本文中,我们就鲁棒性和运行时测试了DTI分析的不同实现。在此基础上,提出了具体的应用改进方案,并对健康网的布局和维护提出了一般性建议。
{"title":"Performance Analysis of Diffusion Tensor Imaging in an Academic Production Grid","authors":"D. Krefting, R. Lützkendorf, Kathrin Peter, J. Bernarding","doi":"10.1109/CCGRID.2010.21","DOIUrl":"https://doi.org/10.1109/CCGRID.2010.21","url":null,"abstract":"Analysis of diffusion weighted magnetic resonance images serves increasingly for non-invasive tracking of nerve fibers in the human brain, both in clinical diagnosis and basic research. Diffusion-tensor imaging (DTI) enables in-vivo research on the internal structure of the central nervous system, an estimation of the interconnection of functional areas and diagnosis of brain tumors and de-myelinating diseases. But modeling the local diffusion parameters is computationally expensive and on standard desktop computers runtimes of up to days are common. A workflow based grid implementation of the algorithm with slice-based parallelization has shown significant speedup. However, in production use, the implementation frequently delayed and even failed, discouraging the medical collaborators to take up the management of the data processing themselves. Therefore a comprehensive analysis of possible sources for errors and delays as well as their real impact in the respective infrastructure is vital to enable clinical researchers to fully exploit the benefits of the Healthgrid application. In this manuscript, we tested different implementations of the DTI analysis with respect to robustness and runtime. Based on the results, concrete application improvements as well as general suggestions for the layout and maintenance of Healthgrids are concluded.","PeriodicalId":444485,"journal":{"name":"2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-05-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122733833","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
A Capabilities-Aware Programming Model for Asymmetric High-End Systems 非对称高端系统的能力感知编程模型
M. M. Rafique
In this research, we investigate and address the challenges of asymmetry in High-End Computing (HEC) systems comprising heterogeneous architectures with varying I/O and computation capacities. We focus on developing a flexible, scalable and easy-to-use programming model that automatically adapts to the capabilities of the system resources on largescale asymmetric clusters. Furthermore, we aim to develop innovative and efficient workload distribution techniques that bridge the asymmetry between system components. In particular, we intent to design tools and technologies that enable quick and efficient utilization of high-end asymmetric clusters in large-scale settings for modern scientific and enterprise computing.
在本研究中,我们调查并解决了高端计算(HEC)系统中不对称的挑战,该系统包括具有不同I/O和计算能力的异构架构。我们专注于开发一种灵活、可扩展且易于使用的编程模型,该模型可以自动适应大规模非对称集群上系统资源的能力。此外,我们的目标是开发创新和有效的工作负载分配技术,以弥合系统组件之间的不对称。特别是,我们打算设计工具和技术,以便在现代科学和企业计算的大规模设置中快速有效地利用高端非对称集群。
{"title":"A Capabilities-Aware Programming Model for Asymmetric High-End Systems","authors":"M. M. Rafique","doi":"10.1109/CCGRID.2010.131","DOIUrl":"https://doi.org/10.1109/CCGRID.2010.131","url":null,"abstract":"In this research, we investigate and address the challenges of asymmetry in High-End Computing (HEC) systems comprising heterogeneous architectures with varying I/O and computation capacities. We focus on developing a flexible, scalable and easy-to-use programming model that automatically adapts to the capabilities of the system resources on largescale asymmetric clusters. Furthermore, we aim to develop innovative and efficient workload distribution techniques that bridge the asymmetry between system components. In particular, we intent to design tools and technologies that enable quick and efficient utilization of high-end asymmetric clusters in large-scale settings for modern scientific and enterprise computing.","PeriodicalId":444485,"journal":{"name":"2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-05-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126469491","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1