首页 > 最新文献

2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW)最新文献

英文 中文
Welcome message 欢迎信息
J. Becker, E. Bozorgzadeh, João MP Cardoso, A. Dasu
The 17th Reconfigurable Architectures Workshop (RAW 2010) is being held in Atlanta, USA in April 2010. As usual, RAW is associated with the Annual International Parallel & Distributed Processing Symposium (IPDPS) and is sponsored by the IEEE Computer Society's Technical Committee on Parallel Processing. The workshop is one of the major meetings for researchers and practitioners to present ideas, results, and on-going research on both theoretical and practical advances in Reconfigurable Computing.
第十七届可重构架构研讨会(RAW 2010)于2010年4月在美国亚特兰大举行。与往常一样,RAW与年度国际并行和分布式处理研讨会(IPDPS)有关,并由IEEE计算机学会并行处理技术委员会赞助。该研讨会是研究人员和实践者就可重构计算的理论和实践进展提出想法、结果和正在进行的研究的主要会议之一。
{"title":"Welcome message","authors":"J. Becker, E. Bozorgzadeh, João MP Cardoso, A. Dasu","doi":"10.1109/IPDPSW.2010.5470681","DOIUrl":"https://doi.org/10.1109/IPDPSW.2010.5470681","url":null,"abstract":"The 17th Reconfigurable Architectures Workshop (RAW 2010) is being held in Atlanta, USA in April 2010. As usual, RAW is associated with the Annual International Parallel & Distributed Processing Symposium (IPDPS) and is sponsored by the IEEE Computer Society's Technical Committee on Parallel Processing. The workshop is one of the major meetings for researchers and practitioners to present ideas, results, and on-going research on both theoretical and practical advances in Reconfigurable Computing.","PeriodicalId":329280,"journal":{"name":"2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW)","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130820053","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A configurable-hardware document-similarity classifier to detect web attacks 一个可配置硬件文档相似分类器,用于检测web攻击
C. Ulmer, M. Gokhale
This paper describes our approach to adapting a text document similarity classifier based on the Term Frequency Inverse Document Frequency (TFIDF) metric [11] to reconfigurable hardware. The TFIDF classifier is used to detect web attacks in HTTP data. In our reconfigurable hardware approach, we design a streaming, real-time classifier by simplifying an existing sequential algorithm and manipulating the classifier's model to allow decision information to be represented compactly. We have developed a set of software tools to help automate the process of converting training data to synthesizable hardware and to provide a means of trading off between accuracy and resource utilization. The Xilinx Virtex 5-LX implementation requires two orders of magnitude less memory than the original algorithm. At 166MB/s (80X the software) the hardware implementation is able to achieve Gigabit network throughput at the same accuracy as the original algorithm.
本文描述了一种基于词频逆文档频率(TFIDF)度量[11]的文本文档相似分类器适应可重构硬件的方法。TFIDF分类器用于检测HTTP数据中的web攻击。在我们的可重构硬件方法中,我们通过简化现有的顺序算法和操作分类器模型来设计一个流,实时分类器,以允许决策信息被紧凑地表示。我们已经开发了一套软件工具,以帮助将训练数据转换为可合成硬件的过程自动化,并提供在准确性和资源利用率之间进行权衡的方法。Xilinx Virtex 5-LX实现所需的内存比原始算法少两个数量级。在166MB/s(软件的80倍)下,硬件实现能够以与原始算法相同的精度实现千兆网络吞吐量。
{"title":"A configurable-hardware document-similarity classifier to detect web attacks","authors":"C. Ulmer, M. Gokhale","doi":"10.1109/IPDPSW.2010.5470737","DOIUrl":"https://doi.org/10.1109/IPDPSW.2010.5470737","url":null,"abstract":"This paper describes our approach to adapting a text document similarity classifier based on the Term Frequency Inverse Document Frequency (TFIDF) metric [11] to reconfigurable hardware. The TFIDF classifier is used to detect web attacks in HTTP data. In our reconfigurable hardware approach, we design a streaming, real-time classifier by simplifying an existing sequential algorithm and manipulating the classifier's model to allow decision information to be represented compactly. We have developed a set of software tools to help automate the process of converting training data to synthesizable hardware and to provide a means of trading off between accuracy and resource utilization. The Xilinx Virtex 5-LX implementation requires two orders of magnitude less memory than the original algorithm. At 166MB/s (80X the software) the hardware implementation is able to achieve Gigabit network throughput at the same accuracy as the original algorithm.","PeriodicalId":329280,"journal":{"name":"2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW)","volume":"758 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-05-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132902547","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Application tuning through bottleneck-driven refactoring 通过瓶颈驱动的重构进行应用程序调优
Guojing Cong, I. Chung, H. Wen, D. Klepacki, H. Murata, Yasushi Negishi, T. Moriyama
To fully utilize the power of current high performance computing systems, high productivity to the end user is critical. It is a challenge to map an application to the target architecture efficiently. Tuning an application for high performance remains a daunting task, and frequently involves manual changes to the program. Recently refactoring techniques are proposed to rewrite or reorganize programs for various software engineering purposes. In our research we explore combining performance analysis with refactoring techniques for automated tuning that we expect to greatly improve the productivity of application deployment. We seek to build a system that can apply appropriate refactoring according to the bottleneck discovered. We demonstrate the effectiveness of this approach through the tuning of several scientific applications and kernels.
为了充分利用当前高性能计算系统的能力,对最终用户来说,高生产力是至关重要的。将应用程序有效地映射到目标体系结构是一项挑战。调优应用程序以获得高性能仍然是一项艰巨的任务,并且经常需要对程序进行手动更改。最近,重构技术被提出用于重写或重组各种软件工程目的的程序。在我们的研究中,我们探索了将性能分析与重构技术相结合,以实现自动调优,我们期望这将极大地提高应用程序部署的生产力。我们试图构建一个可以根据发现的瓶颈应用适当重构的系统。我们通过几个科学应用程序和内核的调优证明了这种方法的有效性。
{"title":"Application tuning through bottleneck-driven refactoring","authors":"Guojing Cong, I. Chung, H. Wen, D. Klepacki, H. Murata, Yasushi Negishi, T. Moriyama","doi":"10.1109/IPDPSW.2010.5470771","DOIUrl":"https://doi.org/10.1109/IPDPSW.2010.5470771","url":null,"abstract":"To fully utilize the power of current high performance computing systems, high productivity to the end user is critical. It is a challenge to map an application to the target architecture efficiently. Tuning an application for high performance remains a daunting task, and frequently involves manual changes to the program. Recently refactoring techniques are proposed to rewrite or reorganize programs for various software engineering purposes. In our research we explore combining performance analysis with refactoring techniques for automated tuning that we expect to greatly improve the productivity of application deployment. We seek to build a system that can apply appropriate refactoring according to the bottleneck discovered. We demonstrate the effectiveness of this approach through the tuning of several scientific applications and kernels.","PeriodicalId":329280,"journal":{"name":"2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW)","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-05-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115022580","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Advances in parallel and distributed computing models - APDCM 并行和分布式计算模型的进展- APDCM
O. Ibarra
The past twenty years have seen a flurry of activity in the arena of parallel and distributed computing. In recent years, novel parallel and distributed computational models have been proposed in the literature, reflecting advances in new computational devices and environments such as optical interconnects, programmable logic arrays, networks of workstations, radio communications, mobile computing, DNA computing, quantum computing, sensor networks etc. It is very encouraging to note that the advent of these new models has lead to significant advances in the resolution of various difficult problems of practical interest. The main goal of this workshop is to provide a timely forum for the exchange and dissemination of new ideas, techniques and research in the field of the parallel and distributed computational models. The workshop is meant to bring together researchers and practitioners interested in all aspects of parallel and distributed computing taken in an inclusive, rather than exclusive, sense. We are convinced that the workshop atmosphere will be conducive to open and mutually beneficial exchanges of ideas between the participants.
在过去的二十年里,并行和分布式计算领域出现了一系列的活动。近年来,文献中提出了新的并行和分布式计算模型,反映了新的计算设备和环境的进步,如光互连、可编程逻辑阵列、工作站网络、无线电通信、移动计算、DNA计算、量子计算、传感器网络等。令人十分鼓舞的是,这些新模式的出现已导致在解决实际关心的各种困难问题方面取得重大进展。本次研讨会的主要目标是为并行和分布式计算模型领域的新思想、新技术和新研究的交流和传播提供一个及时的论坛。研讨会旨在将对并行和分布式计算的各个方面感兴趣的研究人员和实践者聚集在一起,以包容而不是排斥的方式进行。我们相信,研讨会的气氛将有利于与会者之间开放和互利的思想交流。
{"title":"Advances in parallel and distributed computing models - APDCM","authors":"O. Ibarra","doi":"10.1109/IPDPSW.2010.5470826","DOIUrl":"https://doi.org/10.1109/IPDPSW.2010.5470826","url":null,"abstract":"The past twenty years have seen a flurry of activity in the arena of parallel and distributed computing. In recent years, novel parallel and distributed computational models have been proposed in the literature, reflecting advances in new computational devices and environments such as optical interconnects, programmable logic arrays, networks of workstations, radio communications, mobile computing, DNA computing, quantum computing, sensor networks etc. It is very encouraging to note that the advent of these new models has lead to significant advances in the resolution of various difficult problems of practical interest. The main goal of this workshop is to provide a timely forum for the exchange and dissemination of new ideas, techniques and research in the field of the parallel and distributed computational models. The workshop is meant to bring together researchers and practitioners interested in all aspects of parallel and distributed computing taken in an inclusive, rather than exclusive, sense. We are convinced that the workshop atmosphere will be conducive to open and mutually beneficial exchanges of ideas between the participants.","PeriodicalId":329280,"journal":{"name":"2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW)","volume":"58 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114647357","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Static macro data flow: Compiling global control into local control 静态宏数据流:将全局控制编译为局部控制
Pritish Jetley, L. Kalé
The expression of parallel codes through abstract, high-level specifications of global control and data flow can greatly simplify the task of creating large parallel programs. We discuss the challenges of compiling such global flows into the behavioral descriptions of individual component objects in an SPMD environment. We present our work in the context of Charisma, a language that describes global data and control flow through a simple script-like language. Inter-object interactions are realized through the production and consumption of data. The compiler infers communication patterns between objects and generates appropriate messaging code. We discuss the productivity and performance benefits of compiling such global specifications into local descriptions of control flow embodied by a language called Structured Dagger (SDAG).
通过抽象的、高层次的全局控制和数据流规范来表达并行代码,可以大大简化创建大型并行程序的任务。我们讨论了在SPMD环境中将这样的全局流编译成单个组件对象的行为描述所面临的挑战。我们在Charisma的背景下展示我们的工作,这是一种通过简单的脚本式语言描述全局数据和控制流的语言。对象间的交互是通过数据的生产和消费来实现的。编译器推断对象之间的通信模式并生成适当的消息传递代码。我们讨论了将这种全局规范编译成由称为结构化匕首(Structured Dagger, SDAG)的语言所体现的控制流的局部描述所带来的生产力和性能优势。
{"title":"Static macro data flow: Compiling global control into local control","authors":"Pritish Jetley, L. Kalé","doi":"10.1109/IPDPSW.2010.5470944","DOIUrl":"https://doi.org/10.1109/IPDPSW.2010.5470944","url":null,"abstract":"The expression of parallel codes through abstract, high-level specifications of global control and data flow can greatly simplify the task of creating large parallel programs. We discuss the challenges of compiling such global flows into the behavioral descriptions of individual component objects in an SPMD environment. We present our work in the context of Charisma, a language that describes global data and control flow through a simple script-like language. Inter-object interactions are realized through the production and consumption of data. The compiler infers communication patterns between objects and generates appropriate messaging code. We discuss the productivity and performance benefits of compiling such global specifications into local descriptions of control flow embodied by a language called Structured Dagger (SDAG).","PeriodicalId":329280,"journal":{"name":"2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW)","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125107899","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Scheduling instructions on hierarchical machines 分级机器上的调度指令
Florent Blachot, Guillaume Huard, Johnatan E. Pecero, Erik Saule, D. Trystram
The aim of this work is to study the problem of scheduling fine grain task graphs on hierarchical distributed systems with communication delay. We consider as a case study how to schedule the instructions on a processor that implements incomplete bypass ( ST200). We show first how this problem can be expressed as scheduling unitary tasks on a hierarchical architecture with heavy communications between clustered units. The proposed analysis is generic and can be extended to other challenging problems like scheduling in clusters of multi-cores. Our main result is an approximation algorithm based on list scheduling whose approximation ratio is the minimum of two expressions, the first one depends on the number of clusters while the second one depends on the communication delay. Experiments run on random graphs and on structured graphs demonstrate the effectiveness of the proposed approach.
本文的目的是研究具有通信延迟的分层分布式系统的细粒度任务图调度问题。我们考虑作为一个案例研究如何调度处理器上的指令,实现不完全旁路(ST200)。我们首先展示了如何将这个问题表示为在集群单元之间具有大量通信的分层体系结构上调度单一任务。所提出的分析是通用的,可以扩展到其他具有挑战性的问题,如多核集群中的调度。我们的主要成果是一种基于列表调度的近似算法,其近似比是两个表达式的最小值,第一个表达式取决于集群数量,第二个表达式取决于通信延迟。在随机图和结构化图上的实验证明了该方法的有效性。
{"title":"Scheduling instructions on hierarchical machines","authors":"Florent Blachot, Guillaume Huard, Johnatan E. Pecero, Erik Saule, D. Trystram","doi":"10.1109/IPDPSW.2010.5470711","DOIUrl":"https://doi.org/10.1109/IPDPSW.2010.5470711","url":null,"abstract":"The aim of this work is to study the problem of scheduling fine grain task graphs on hierarchical distributed systems with communication delay. We consider as a case study how to schedule the instructions on a processor that implements incomplete bypass ( ST200). We show first how this problem can be expressed as scheduling unitary tasks on a hierarchical architecture with heavy communications between clustered units. The proposed analysis is generic and can be extended to other challenging problems like scheduling in clusters of multi-cores. Our main result is an approximation algorithm based on list scheduling whose approximation ratio is the minimum of two expressions, the first one depends on the number of clusters while the second one depends on the communication delay. Experiments run on random graphs and on structured graphs demonstrate the effectiveness of the proposed approach.","PeriodicalId":329280,"journal":{"name":"2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW)","volume":"161 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125931045","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Energy-aware joint scheduling of tasks and messages in wireless sensor networks 无线传感器网络中任务和消息的能量感知联合调度
B. Fateh, G. Manimaran
We consider the problem of energy-aware joint scheduling of tasks and messages with real-time constraints in wireless networked embedded systems specifically wireless sensor networks. We use the mixed tree coloring approach in order to model the constraints and show that k-coloring of a mixed tree can be mapped to a non-conflicting schedule consisting of k time slots. Also, we propose to conduct testbed evaluation to quantify the performance of combined implementation of energy management techniques such as Dynamic Modulation Scaling (DMS) along with Dynamic Voltage Scaling (DVS).
研究了无线网络嵌入式系统特别是无线传感器网络中具有实时约束的任务和消息的能量感知联合调度问题。我们使用混合树着色方法对约束进行建模,并证明混合树的k-着色可以映射到由k个时隙组成的非冲突调度。此外,我们建议进行试验台评估,以量化能源管理技术(如动态调制缩放(DMS)和动态电压缩放(DVS))的组合实现的性能。
{"title":"Energy-aware joint scheduling of tasks and messages in wireless sensor networks","authors":"B. Fateh, G. Manimaran","doi":"10.1109/IPDPSW.2010.5470808","DOIUrl":"https://doi.org/10.1109/IPDPSW.2010.5470808","url":null,"abstract":"We consider the problem of energy-aware joint scheduling of tasks and messages with real-time constraints in wireless networked embedded systems specifically wireless sensor networks. We use the mixed tree coloring approach in order to model the constraints and show that k-coloring of a mixed tree can be mapped to a non-conflicting schedule consisting of k time slots. Also, we propose to conduct testbed evaluation to quantify the performance of combined implementation of energy management techniques such as Dynamic Modulation Scaling (DMS) along with Dynamic Voltage Scaling (DVS).","PeriodicalId":329280,"journal":{"name":"2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW)","volume":"115 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123752885","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Agent placement in wireless embedded systems: Memory space and energy optimizations 无线嵌入式系统中的代理放置:内存空间和能量优化
Nikos Tziritas, Thanasis Loukopoulos, S. Lalis, P. Lampsas
Embedded applications can be structured in terms of mobile agents that are flexibly installed on available nodes. In wireless systems, such nodes typically have limited battery and memory resources; therefore it is important to place agents judiciously. In this paper we tackle the problem of placing a newcomer agent in such a system. The problem has two main components. First, enough memory space must be found or created at some node to place the agent. Second, the placement should be energy efficient. We present heuristics for tackling these two goals in a stepwise fashion, as well as a branch and bound method for achieving both goals at the same time. Our algorithms are centralized assuming a single entry point through which agents are injected into the system, with adequate knowledge of the system state and enough resources to run the proposed algorithms. The algorithms are evaluated under different simulated scenarios, and the tradeoffs across the two metrics (space, energy) are identified.
嵌入式应用程序可以根据灵活地安装在可用节点上的移动代理来构建。在无线系统中,这样的节点通常只有有限的电池和内存资源;因此,明智地安排代理人是很重要的。在本文中,我们解决了在这样一个系统中放置新agent的问题。这个问题有两个主要组成部分。首先,必须在某个节点上找到或创建足够的内存空间来放置代理。其次,布局应该是节能的。我们提出了以逐步方式解决这两个目标的启发式方法,以及同时实现这两个目标的分支和定界方法。我们的算法是集中的,假设有一个单一的入口点,代理通过这个入口点被注入系统,并且有足够的系统状态知识和足够的资源来运行所提出的算法。在不同的模拟场景下对算法进行了评估,并确定了两个度量(空间,能量)之间的权衡。
{"title":"Agent placement in wireless embedded systems: Memory space and energy optimizations","authors":"Nikos Tziritas, Thanasis Loukopoulos, S. Lalis, P. Lampsas","doi":"10.1109/IPDPSW.2010.5470786","DOIUrl":"https://doi.org/10.1109/IPDPSW.2010.5470786","url":null,"abstract":"Embedded applications can be structured in terms of mobile agents that are flexibly installed on available nodes. In wireless systems, such nodes typically have limited battery and memory resources; therefore it is important to place agents judiciously. In this paper we tackle the problem of placing a newcomer agent in such a system. The problem has two main components. First, enough memory space must be found or created at some node to place the agent. Second, the placement should be energy efficient. We present heuristics for tackling these two goals in a stepwise fashion, as well as a branch and bound method for achieving both goals at the same time. Our algorithms are centralized assuming a single entry point through which agents are injected into the system, with adequate knowledge of the system state and enough resources to run the proposed algorithms. The algorithms are evaluated under different simulated scenarios, and the tradeoffs across the two metrics (space, energy) are identified.","PeriodicalId":329280,"journal":{"name":"2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125283710","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 17
Distributed tree decomposition of graphs and applications to verification 分布式树分解图和验证应用程序
S. Grumbach, Zhilin Wu
The tree decomposition of graphs is a fundamental algorithmic tool. It has been shown that difficult problems, such as some NP-complete ones, can be solved efficiently over classes of graphs of bounded tree-width. We consider in this paper the distributed construction of the tree decompositions of network topology graphs. We propose algorithms to distributively construct the tree-decomposition of respectively (i) planar networks of bounded diameter and (ii) networks of bounded degree and bounded tree-length. Both algorithms are very efficient, requiring only a constant number of messages sent over each link. We then use these algorithms to distributively verify properties of graphs expressible in Monadic Second Order Logic, MSO.
图的树分解是一个基本的算法工具。研究表明,在有界树宽度图的分类上,可以有效地求解一些困难的问题,例如一些np完全问题。本文考虑了网络拓扑图树分解的分布式构造。我们提出了分别对(i)有界直径平面网络和(ii)有界度和有界树长网络进行分布式树分解的算法。这两种算法都非常有效,只需要在每个链路上发送固定数量的消息。然后,我们使用这些算法来分布式验证可在一元二阶逻辑(MSO)中表示的图的性质。
{"title":"Distributed tree decomposition of graphs and applications to verification","authors":"S. Grumbach, Zhilin Wu","doi":"10.1109/IPDPSW.2010.5470828","DOIUrl":"https://doi.org/10.1109/IPDPSW.2010.5470828","url":null,"abstract":"The tree decomposition of graphs is a fundamental algorithmic tool. It has been shown that difficult problems, such as some NP-complete ones, can be solved efficiently over classes of graphs of bounded tree-width. We consider in this paper the distributed construction of the tree decompositions of network topology graphs. We propose algorithms to distributively construct the tree-decomposition of respectively (i) planar networks of bounded diameter and (ii) networks of bounded degree and bounded tree-length. Both algorithms are very efficient, requiring only a constant number of messages sent over each link. We then use these algorithms to distributively verify properties of graphs expressible in Monadic Second Order Logic, MSO.","PeriodicalId":329280,"journal":{"name":"2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125518938","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Improving MapReduce performance through data placement in heterogeneous Hadoop clusters 通过在异构Hadoop集群中放置数据来提高MapReduce的性能
Jiong Xie, Shu Yin, X. Ruan, Zhiyang Ding, Yun Tian, James Majors, A. Manzanares, X. Qin
MapReduce has become an important distributed processing model for large-scale data-intensive applications like data mining and web indexing. Hadoop-an open-source implementation of MapReduce is widely used for short jobs requiring low response time. The current Hadoop implementation assumes that computing nodes in a cluster are homogeneous in nature. Data locality has not been taken into account for launching speculative map tasks, because it is assumed that most maps are data-local. Unfortunately, both the homogeneity and data locality assumptions are not satisfied in virtualized data centers. We show that ignoring the data-locality issue in heterogeneous environments can noticeably reduce the MapReduce performance. In this paper, we address the problem of how to place data across nodes in a way that each node has a balanced data processing load. Given a dataintensive application running on a Hadoop MapReduce cluster, our data placement scheme adaptively balances the amount of data stored in each node to achieve improved data-processing performance. Experimental results on two real data-intensive applications show that our data placement strategy can always improve the MapReduce performance by rebalancing data across nodes before performing a data-intensive application in a heterogeneous Hadoop cluster.
MapReduce已经成为大规模数据密集型应用(如数据挖掘和web索引)的重要分布式处理模型。hadoop——MapReduce的开源实现,广泛用于需要低响应时间的短作业。当前的Hadoop实现假设集群中的计算节点本质上是同构的。在启动推测地图任务时没有考虑数据局部性,因为假设大多数地图都是数据局部性的。不幸的是,虚拟化数据中心不满足同质性和数据局部性假设。我们表明,在异构环境中忽略数据局部性问题会显著降低MapReduce的性能。在本文中,我们解决了如何以每个节点具有均衡数据处理负载的方式跨节点放置数据的问题。给定在Hadoop MapReduce集群上运行的数据密集型应用程序,我们的数据放置方案自适应地平衡存储在每个节点上的数据量,以实现改进的数据处理性能。在两个真实的数据密集型应用程序上的实验结果表明,我们的数据放置策略总是可以通过在异构Hadoop集群中执行数据密集型应用程序之前跨节点重新平衡数据来提高MapReduce性能。
{"title":"Improving MapReduce performance through data placement in heterogeneous Hadoop clusters","authors":"Jiong Xie, Shu Yin, X. Ruan, Zhiyang Ding, Yun Tian, James Majors, A. Manzanares, X. Qin","doi":"10.1109/IPDPSW.2010.5470880","DOIUrl":"https://doi.org/10.1109/IPDPSW.2010.5470880","url":null,"abstract":"MapReduce has become an important distributed processing model for large-scale data-intensive applications like data mining and web indexing. Hadoop-an open-source implementation of MapReduce is widely used for short jobs requiring low response time. The current Hadoop implementation assumes that computing nodes in a cluster are homogeneous in nature. Data locality has not been taken into account for launching speculative map tasks, because it is assumed that most maps are data-local. Unfortunately, both the homogeneity and data locality assumptions are not satisfied in virtualized data centers. We show that ignoring the data-locality issue in heterogeneous environments can noticeably reduce the MapReduce performance. In this paper, we address the problem of how to place data across nodes in a way that each node has a balanced data processing load. Given a dataintensive application running on a Hadoop MapReduce cluster, our data placement scheme adaptively balances the amount of data stored in each node to achieve improved data-processing performance. Experimental results on two real data-intensive applications show that our data placement strategy can always improve the MapReduce performance by rebalancing data across nodes before performing a data-intensive application in a heterogeneous Hadoop cluster.","PeriodicalId":329280,"journal":{"name":"2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW)","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125550125","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 420
期刊
2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1