DPX10: An Efficient X10 Framework for Dynamic Programming Applications

2015 44th International Conference on Parallel Processing Pub Date : 2015-09-01 DOI:10.1109/ICPP.2015.96

Chen Wang, Ce Yu, Ji-zhou Sun, X. Meng

{"title":"DPX10: An Efficient X10 Framework for Dynamic Programming Applications","authors":"Chen Wang, Ce Yu, Ji-zhou Sun, X. Meng","doi":"10.1109/ICPP.2015.96","DOIUrl":null,"url":null,"abstract":"X10 language and Asynchronous Partitioned Global Address Space (APGAS) model is an emerging mechanism for programming high-performance computers and commodity clusters. However, little work exists on distributed programming framework for dynamic programming (DP) problems based on X10 and APGAS model. In this paper we present DPX10, an efficient distributed X10 framework for DP applications. DPX10 enables developers to write highly efficient DP programs without much effort. A DPX10 program is specified by a directed acyclic graph (DAG) pattern and a compute method for the vertices. DPX10 provides eight commonly used DAG patterns and a simple API to create custom patterns. The system handles all the tiresome work of implementing parallelization including DAG distribution, vertices scheduling, and vertices communication. Moreover, a new recovery method for distributed arrays is developed to provide transparent fault tolerance. We describe the design of the framework and use four DP applications with up to a billion vertices on 120 cores to demonstrate its simplicity, efficiency, and scalability.","PeriodicalId":423007,"journal":{"name":"2015 44th International Conference on Parallel Processing","volume":"2 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2015-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2015 44th International Conference on Parallel Processing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICPP.2015.96","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 1

Abstract

X10 language and Asynchronous Partitioned Global Address Space (APGAS) model is an emerging mechanism for programming high-performance computers and commodity clusters. However, little work exists on distributed programming framework for dynamic programming (DP) problems based on X10 and APGAS model. In this paper we present DPX10, an efficient distributed X10 framework for DP applications. DPX10 enables developers to write highly efficient DP programs without much effort. A DPX10 program is specified by a directed acyclic graph (DAG) pattern and a compute method for the vertices. DPX10 provides eight commonly used DAG patterns and a simple API to create custom patterns. The system handles all the tiresome work of implementing parallelization including DAG distribution, vertices scheduling, and vertices communication. Moreover, a new recovery method for distributed arrays is developed to provide transparent fault tolerance. We describe the design of the framework and use four DP applications with up to a billion vertices on 120 cores to demonstrate its simplicity, efficiency, and scalability.

查看原文

微信好友朋友圈 QQ好友复制链接

本刊更多论文

DPX10:动态规划应用程序的高效X10框架

X10语言和异步分区全局地址空间(APGAS)模型是一种用于高性能计算机和商品集群编程的新兴机制。然而，基于X10和APGAS模型的动态规划问题的分布式规划框架研究却很少。在本文中，我们提出了DPX10，一个高效的用于DP应用的分布式X10框架。DPX10使开发人员能够轻松编写高效的DP程序。DPX10程序由有向无环图(DAG)模式和顶点的计算方法指定。DPX10提供了8种常用的DAG模式和一个用于创建自定义模式的简单API。该系统处理实现并行化的所有繁琐工作，包括DAG分发、顶点调度和顶点通信。在此基础上，提出了一种分布式阵列透明容错恢复方法。我们描述了框架的设计，并使用了四个DP应用程序，在120个内核上有多达10亿个顶点，以展示其简单性、效率和可扩展性。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文去求助

来源期刊

2015 44th International Conference on Parallel Processing

自引率

0.00%

发文量