首页 > 最新文献

21st International Symposium on High Performance Computing Systems and Applications (HPCS'07)最新文献

英文 中文
Utility of High Performance Computing Facilities for the Calculation of the Theoretical X-ray Absorption Spectra of Solids 固体理论x射线吸收光谱计算中高性能计算设备的应用
D. Shaw, M. Odelius, J. Tse
Two cases demonstrating the utility of high performance computing to calculate X-ray absorption spectra (XAS) of solids are discussed. The X-ray absorption spectra of high pressure ices II, VIII, and IX have been computed with the Car Parrinello plane wave pseudopotential method. XAS for the intermediate structures obtained from uniaxial compression of hexagonal graphite along the c-axis are also studied. Whenever possible, comparisons to available experimental results are made. The reliability of the computational methods for the calculations of the XAS for these structures is discussed.
讨论了用高性能计算计算固体x射线吸收光谱(XAS)的两个实例。用Car Parrinello平面波伪势法计算了高压冰II、VIII和IX的x射线吸收光谱。对六方石墨沿c轴单轴压缩得到的中间结构进行了XAS分析。只要有可能,就与现有的实验结果进行比较。讨论了这些结构的XAS计算方法的可靠性。
{"title":"Utility of High Performance Computing Facilities for the Calculation of the Theoretical X-ray Absorption Spectra of Solids","authors":"D. Shaw, M. Odelius, J. Tse","doi":"10.1109/HPCS.2007.33","DOIUrl":"https://doi.org/10.1109/HPCS.2007.33","url":null,"abstract":"Two cases demonstrating the utility of high performance computing to calculate X-ray absorption spectra (XAS) of solids are discussed. The X-ray absorption spectra of high pressure ices II, VIII, and IX have been computed with the Car Parrinello plane wave pseudopotential method. XAS for the intermediate structures obtained from uniaxial compression of hexagonal graphite along the c-axis are also studied. Whenever possible, comparisons to available experimental results are made. The reliability of the computational methods for the calculations of the XAS for these structures is discussed.","PeriodicalId":354520,"journal":{"name":"21st International Symposium on High Performance Computing Systems and Applications (HPCS'07)","volume":"71 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-05-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125212647","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Resource Assessment using Market Indices: Toward an Economic Grid Exchange Model 基于市场指数的资源评估:走向经济网格交换模型
Nicolas Dubé, M. Parizeau
This paper is revisiting computational Grid economy models with an innovative, unrestricted and purely market regulated approach where both the consumer and provider standpoints are considered. The paper starts by outlining the actual Grid model shortcomings in regards to sharing incentive, return on investment, resource usage efficiency and quality of service accountability. Subsequently, a replacement for the traditional utility function is presented in the form of an aggregation of statistical indices computed from previous transactions. While this sharing scheme is based on economic foundations, its intent is not to transform the Grid in an expensive capitalist system. Targeted goal is rather to stimulate sharing by assessing resources dynamically in some form of abstract grid unit fostering supercomputing democratization.
本文用一种创新的、不受限制的、完全由市场调控的方法重新审视了计算网格经济模型,同时考虑了消费者和供应商的立场。本文首先概述了网格模型在共享激励、投资回报、资源使用效率和服务质量责任方面的实际缺陷。随后,以从以前的事务计算的统计指数的汇总形式提出了传统效用函数的替代品。虽然这种共享方案是基于经济基础的,但其目的并不是要在昂贵的资本主义系统中改造电网。目标是通过以某种形式的抽象网格单元动态评估资源来促进共享,从而促进超级计算民主化。
{"title":"Resource Assessment using Market Indices: Toward an Economic Grid Exchange Model","authors":"Nicolas Dubé, M. Parizeau","doi":"10.1109/HPCS.2007.27","DOIUrl":"https://doi.org/10.1109/HPCS.2007.27","url":null,"abstract":"This paper is revisiting computational Grid economy models with an innovative, unrestricted and purely market regulated approach where both the consumer and provider standpoints are considered. The paper starts by outlining the actual Grid model shortcomings in regards to sharing incentive, return on investment, resource usage efficiency and quality of service accountability. Subsequently, a replacement for the traditional utility function is presented in the form of an aggregation of statistical indices computed from previous transactions. While this sharing scheme is based on economic foundations, its intent is not to transform the Grid in an expensive capitalist system. Targeted goal is rather to stimulate sharing by assessing resources dynamically in some form of abstract grid unit fostering supercomputing democratization.","PeriodicalId":354520,"journal":{"name":"21st International Symposium on High Performance Computing Systems and Applications (HPCS'07)","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-05-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116360772","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Design and Implementation of a Menu Based OSCAR Command Line Interface 基于菜单的OSCAR命令行界面的设计与实现
Wesley Bland, T. Naughton, Geoffroy R. Vallée, S. Scott
The open source cluster application resources (OSCAR) toolkit is used to build and maintain HPC clusters. The OSCAR cluster installer provides a graphical user interface (GUI) "wizard" that directs the user through the installation process. This GUI is useful for general usage, but in some instances a more basic interface is desirable. Therefore, a command line interface (CLI) has been developed for the OSCAR installer. Through the CLI, the OSCAR installer is better equipped to support scripting, which aids more advanced testing scenarios and helps in cluster replication. Additionally, the CLI is better suited for remote installations using OSCAR. While a graphical user interface simplifies installation for occasional users, frequent users and the OSCAR developers will find the CLI beneficial. For developers, the CLI will make testing easier because it may now be scripted for automated testing. Furthermore, because the CLI creates logs of user input, the user may create an exact duplicate of a previous installation, which could be used in later rebuilds or for diagnostic purposes when reporting issues to the developers. This paper provides an overview of the design and capabilities of the OSCAR CLI along with a brief discussion of possible future work.
开源集群应用程序资源(OSCAR)工具包用于构建和维护HPC集群。OSCAR集群安装程序提供图形用户界面(GUI)向导,指导用户完成安装过程。这个GUI对于一般用途是有用的,但是在某些情况下需要一个更基本的界面。因此,为OSCAR安装程序开发了命令行接口(CLI)。通过CLI, OSCAR安装程序可以更好地支持脚本,这有助于更高级的测试场景,并有助于集群复制。此外,CLI更适合使用OSCAR进行远程安装。虽然图形用户界面简化了偶尔使用的用户的安装,但经常使用的用户和OSCAR开发人员会发现CLI的好处。对于开发人员来说,CLI将使测试更容易,因为现在可以为自动化测试编写脚本。此外,由于CLI创建用户输入的日志,因此用户可以创建先前安装的精确副本,可以在以后的重新构建中使用,或者在向开发人员报告问题时用于诊断目的。本文概述了OSCAR CLI的设计和功能,并简要讨论了未来可能的工作。
{"title":"Design and Implementation of a Menu Based OSCAR Command Line Interface","authors":"Wesley Bland, T. Naughton, Geoffroy R. Vallée, S. Scott","doi":"10.1109/HPCS.2007.14","DOIUrl":"https://doi.org/10.1109/HPCS.2007.14","url":null,"abstract":"The open source cluster application resources (OSCAR) toolkit is used to build and maintain HPC clusters. The OSCAR cluster installer provides a graphical user interface (GUI) \"wizard\" that directs the user through the installation process. This GUI is useful for general usage, but in some instances a more basic interface is desirable. Therefore, a command line interface (CLI) has been developed for the OSCAR installer. Through the CLI, the OSCAR installer is better equipped to support scripting, which aids more advanced testing scenarios and helps in cluster replication. Additionally, the CLI is better suited for remote installations using OSCAR. While a graphical user interface simplifies installation for occasional users, frequent users and the OSCAR developers will find the CLI beneficial. For developers, the CLI will make testing easier because it may now be scripted for automated testing. Furthermore, because the CLI creates logs of user input, the user may create an exact duplicate of a previous installation, which could be used in later rebuilds or for diagnostic purposes when reporting issues to the developers. This paper provides an overview of the design and capabilities of the OSCAR CLI along with a brief discussion of possible future work.","PeriodicalId":354520,"journal":{"name":"21st International Symposium on High Performance Computing Systems and Applications (HPCS'07)","volume":"53 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-05-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122024430","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
Effect of Medium Dispersivity on the Viscous Fingering Instability in Porous Media 介质色散对多孔介质中粘性指入不稳定性的影响
Karim Ghesmat, J. Azaiez
Flow processes that involve the displacement of a viscous fluid by a less viscous one often lead to a hydrodynamic instability known as viscous fingering. In this study the viscous fingering instability for anisotropic dispersive flows will be addressed. In order to understand the physics of the flow displacement, the basic equations of conservation of mass and momentum are solved for a two-dimensional porous medium. The linear stability of the flow is analyzed first. The flow is then modeled numerically using a highly accurate spectral method based on the Hartley transformation. The streamfunction and concentration fields are tracked using an iteration process for two dimensional flows in every time-step. In this study, different types of anisotropic dispersions are considered and their effects on finger patterns are examined. We will present physical discussion of how medium dispersivity affects hydrodynamics and could result in interesting instability schemes.
涉及粘性较低的流体取代粘性较强的流体的流动过程通常会导致称为粘性指指的流体动力学不稳定性。本研究将讨论各向异性色散流动的粘性指指不稳定性。为了理解流体位移的物理性质,对二维多孔介质的质量守恒和动量守恒基本方程进行了求解。首先分析了流动的线性稳定性。然后使用基于哈特利变换的高精度谱方法对流进行数值模拟。采用迭代方法对二维流在每个时间步长的流函数和浓度场进行跟踪。在本研究中,考虑了不同类型的各向异性色散,并研究了它们对手指图案的影响。我们将提出介质色散如何影响流体力学的物理讨论,并可能导致有趣的不稳定性方案。
{"title":"Effect of Medium Dispersivity on the Viscous Fingering Instability in Porous Media","authors":"Karim Ghesmat, J. Azaiez","doi":"10.1109/HPCS.2007.16","DOIUrl":"https://doi.org/10.1109/HPCS.2007.16","url":null,"abstract":"Flow processes that involve the displacement of a viscous fluid by a less viscous one often lead to a hydrodynamic instability known as viscous fingering. In this study the viscous fingering instability for anisotropic dispersive flows will be addressed. In order to understand the physics of the flow displacement, the basic equations of conservation of mass and momentum are solved for a two-dimensional porous medium. The linear stability of the flow is analyzed first. The flow is then modeled numerically using a highly accurate spectral method based on the Hartley transformation. The streamfunction and concentration fields are tracked using an iteration process for two dimensional flows in every time-step. In this study, different types of anisotropic dispersions are considered and their effects on finger patterns are examined. We will present physical discussion of how medium dispersivity affects hydrodynamics and could result in interesting instability schemes.","PeriodicalId":354520,"journal":{"name":"21st International Symposium on High Performance Computing Systems and Applications (HPCS'07)","volume":"9 7","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-05-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114010519","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
High Performance RDMA-based Multi-port All-gather on Multi-rail QsNet II 基于多轨道QsNet的高性能rdma多端口全采集
Y. Qian, A. Afsahi
Scientific applications written in MPI use collective communications intensively. Efficient and scalable implementation of such collective operations is therefore crucial to the performance of MPI applications running on clusters. Quadrics QsNetII is a high-performance network that implements some collectives at its Elan user-level library. Its MPI implementation uses such primitives directly. Quadrics communication software supports point-to-point message striping over multi-rail QsNetII networks. However, multi-rail collectives, other than broadcast, are not supported. In this work, we propose, design and implement a number of RDMA- based multi-port algorithms for the all-gather operation over multi-rail QsNetII clusters directly at the Elan level. Our performance results indicate that the proposed multi-port all-gather Direct algorithm gains an improvement of up to 1.49 for 32 KB messages over the native Elan_gather() collective.
用MPI编写的科学应用程序大量使用了集体通信。因此,这种集体操作的高效和可伸缩实现对于在集群上运行的MPI应用程序的性能至关重要。ququrics QsNetII是一个高性能网络,它在其Elan用户级库中实现了一些集合。它的MPI实现直接使用这些原语。Quadrics通信软件支持多轨QsNetII网络上的点对点消息条带化。但是,除了广播之外,不支持多轨集体。在这项工作中,我们提出,设计和实现了许多基于RDMA的多端口算法,用于直接在Elan级别上对多轨道QsNetII集群进行全采集操作。我们的性能结果表明,与原生Elan_gather()集合相比,提议的多端口all-gather Direct算法在处理32 KB消息时获得了高达1.49的改进。
{"title":"High Performance RDMA-based Multi-port All-gather on Multi-rail QsNet II","authors":"Y. Qian, A. Afsahi","doi":"10.1109/HPCS.2007.19","DOIUrl":"https://doi.org/10.1109/HPCS.2007.19","url":null,"abstract":"Scientific applications written in MPI use collective communications intensively. Efficient and scalable implementation of such collective operations is therefore crucial to the performance of MPI applications running on clusters. Quadrics QsNetII is a high-performance network that implements some collectives at its Elan user-level library. Its MPI implementation uses such primitives directly. Quadrics communication software supports point-to-point message striping over multi-rail QsNetII networks. However, multi-rail collectives, other than broadcast, are not supported. In this work, we propose, design and implement a number of RDMA- based multi-port algorithms for the all-gather operation over multi-rail QsNetII clusters directly at the Elan level. Our performance results indicate that the proposed multi-port all-gather Direct algorithm gains an improvement of up to 1.49 for 32 KB messages over the native Elan_gather() collective.","PeriodicalId":354520,"journal":{"name":"21st International Symposium on High Performance Computing Systems and Applications (HPCS'07)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-05-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128705511","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
Semantically Enabling the Global Geodynamics Project: Incorporating Feature-Based Annotations via XML Pointer Language (XPointer) 语义上支持全球地球动力学项目:通过XML指针语言(XPointer)整合基于特征的注释
L. Lumb, J. Lederman, J. Freemantle, K. Aldridge
Earth science markup language (ESML) is efficient and effective in representing scientific data in an XML-based formalism. However, features of the data being represented are not accounted for in ESML. Such features might derive from events, identifications, or some other source. In order to account for features in an ESML context, they are considered from the perspective of annotation. Although it is possible to extend ESML to incorporate feature-based annotations internally, there are complicating factors identified that apply to ESML and most XML dialects. Rather than pursue the ESML-extension approach, an external representation for feature-based annotations via XML pointer language (XPointer) is developed. In previous work, it has been shown that it is possible to extract relationships from ESML-based representations, and capture the results in the resource description format (RDF). Application of this same requirement to XPointer-based annotations of ESML representations results in a revised semantic framework for the global geodynamics project (GGP).
地球科学标记语言(ESML)在以基于xml的形式表示科学数据方面是高效的。但是,在ESML中没有考虑所表示的数据的特性。这些特征可能来自事件、标识或其他来源。为了考虑ESML上下文中的特性,我们从注释的角度来考虑它们。虽然可以扩展ESML以在内部合并基于特性的注释,但是存在一些适用于ESML和大多数XML方言的复杂因素。我们没有采用XML扩展方法,而是通过XML指针语言(XPointer)开发了基于特性的注释的外部表示。在以前的工作中,已经证明可以从基于esb的表示中提取关系,并以资源描述格式(RDF)捕获结果。将相同的需求应用到基于xpointer的ESML表示注释中,会导致对全球地球动力学项目(GGP)的语义框架进行修订。
{"title":"Semantically Enabling the Global Geodynamics Project: Incorporating Feature-Based Annotations via XML Pointer Language (XPointer)","authors":"L. Lumb, J. Lederman, J. Freemantle, K. Aldridge","doi":"10.1109/HPCS.2007.29","DOIUrl":"https://doi.org/10.1109/HPCS.2007.29","url":null,"abstract":"Earth science markup language (ESML) is efficient and effective in representing scientific data in an XML-based formalism. However, features of the data being represented are not accounted for in ESML. Such features might derive from events, identifications, or some other source. In order to account for features in an ESML context, they are considered from the perspective of annotation. Although it is possible to extend ESML to incorporate feature-based annotations internally, there are complicating factors identified that apply to ESML and most XML dialects. Rather than pursue the ESML-extension approach, an external representation for feature-based annotations via XML pointer language (XPointer) is developed. In previous work, it has been shown that it is possible to extract relationships from ESML-based representations, and capture the results in the resource description format (RDF). Application of this same requirement to XPointer-based annotations of ESML representations results in a revised semantic framework for the global geodynamics project (GGP).","PeriodicalId":354520,"journal":{"name":"21st International Symposium on High Performance Computing Systems and Applications (HPCS'07)","volume":"231 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-05-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123262256","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Observations on greedy composite Newton methods 贪婪复合牛顿方法的观察
T. Ter, Matthew W. Donaldson, R. Spiteri
The only robust general-purpose numerical methods for approximating the solution to systems of nonlinear algebraic equations (NAEs) are based on Newton's method. Many variants of Newton's method exist in order to take advantage of problem structure; it is often computationally infeasible to solve a given problem without taking some advantage of this structure. It is generally impossible to know a priori which variant of Newton's method will be optimal for a given problem. In this paper, we describe an algorithm for automatically selecting a composite Newton method, i.e., a sequential combination of Newton variants, for solving NAEs. The algorithm is based on a greedy principle that updates the current state at regular intervals according to the best performing Newton variant. Preliminary results show that it is possible for composite Newton methods to outperform optimal classical implementations of Newton's method, i.e., ones that only use one Newton variant on a given problem.
求解非线性代数方程组的唯一鲁棒通用数值方法是基于牛顿法。为了利用问题结构的优势,存在许多牛顿方法的变体;如果不利用这种结构的一些优势,通常在计算上解决给定的问题是不可行的。通常不可能先验地知道牛顿方法的哪一种变体对给定问题是最优的。本文描述了一种自动选择复合牛顿法(即牛顿变量的顺序组合)求解NAEs的算法。该算法基于贪婪原则,根据性能最好的牛顿变体定期更新当前状态。初步结果表明,复合牛顿方法有可能优于牛顿方法的最优经典实现,即在给定问题上仅使用一个牛顿变体的实现。
{"title":"Observations on greedy composite Newton methods","authors":"T. Ter, Matthew W. Donaldson, R. Spiteri","doi":"10.1109/HPCS.2007.22","DOIUrl":"https://doi.org/10.1109/HPCS.2007.22","url":null,"abstract":"The only robust general-purpose numerical methods for approximating the solution to systems of nonlinear algebraic equations (NAEs) are based on Newton's method. Many variants of Newton's method exist in order to take advantage of problem structure; it is often computationally infeasible to solve a given problem without taking some advantage of this structure. It is generally impossible to know a priori which variant of Newton's method will be optimal for a given problem. In this paper, we describe an algorithm for automatically selecting a composite Newton method, i.e., a sequential combination of Newton variants, for solving NAEs. The algorithm is based on a greedy principle that updates the current state at regular intervals according to the best performing Newton variant. Preliminary results show that it is possible for composite Newton methods to outperform optimal classical implementations of Newton's method, i.e., ones that only use one Newton variant on a given problem.","PeriodicalId":354520,"journal":{"name":"21st International Symposium on High Performance Computing Systems and Applications (HPCS'07)","volume":"326 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-05-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132584596","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Towards a Decentralized Algorithm for Mapping Network and Computational Resources for Distributed Data-Flow Computations 一种分布式数据流计算的网络映射和计算资源的分散算法
S. Asaduzzaman, Muthucumaru Maheswaran
Several high-throughput distributed data-processing applications require multi-hop processing of streams of data. These applications include continual processing on data streams originating from a network of sensors, composing a multimedia stream through embedding several component streams originating from different locations, etc. These data-flow computing applications require multiple processing nodes interconnected according to the data-flow topology of the application, for on-stream processing of the data. Since the applications usually sustain for a long period, it is important to optimally map the component computations and communications on the nodes and links in the network, fulfilling the capacity constraints and optimizing some quality metric such as end-to-end latency. The mapping problem is unfortunately NP-complete and heuristics have been previously proposed to compute the approximate solution in a centralized way. However, because of the dynamicity of the network, it is practically impossible to aggregate the correct state of the whole network in a single node. In this paper, we present a distributed algorithm for optimal mapping of the components of the data flow applications. We propose several heuristics to minimize the message complexity of the algorithm while maintaining the quality of the solution.
一些高吞吐量的分布式数据处理应用需要对数据流进行多跳处理。这些应用包括对来自传感器网络的数据流进行连续处理,通过嵌入来自不同位置的多个组件流来组成多媒体流等。这些数据流计算应用程序需要根据应用程序的数据流拓扑相互连接多个处理节点,以便对数据进行流上处理。由于应用程序通常持续很长一段时间,因此在网络中的节点和链路上最佳地映射组件计算和通信,满足容量限制并优化一些质量度量(如端到端延迟)非常重要。不幸的是,映射问题是np完全的,以前已经提出了启发式方法以集中的方式计算近似解。然而,由于网络的动态性,将整个网络的正确状态聚合到单个节点上实际上是不可能的。本文提出了一种分布式的数据流应用组件的最优映射算法。我们提出了几种启发式方法来最小化算法的消息复杂性,同时保持解决方案的质量。
{"title":"Towards a Decentralized Algorithm for Mapping Network and Computational Resources for Distributed Data-Flow Computations","authors":"S. Asaduzzaman, Muthucumaru Maheswaran","doi":"10.1109/HPCS.2007.32","DOIUrl":"https://doi.org/10.1109/HPCS.2007.32","url":null,"abstract":"Several high-throughput distributed data-processing applications require multi-hop processing of streams of data. These applications include continual processing on data streams originating from a network of sensors, composing a multimedia stream through embedding several component streams originating from different locations, etc. These data-flow computing applications require multiple processing nodes interconnected according to the data-flow topology of the application, for on-stream processing of the data. Since the applications usually sustain for a long period, it is important to optimally map the component computations and communications on the nodes and links in the network, fulfilling the capacity constraints and optimizing some quality metric such as end-to-end latency. The mapping problem is unfortunately NP-complete and heuristics have been previously proposed to compute the approximate solution in a centralized way. However, because of the dynamicity of the network, it is practically impossible to aggregate the correct state of the whole network in a single node. In this paper, we present a distributed algorithm for optimal mapping of the components of the data flow applications. We propose several heuristics to minimize the message complexity of the algorithm while maintaining the quality of the solution.","PeriodicalId":354520,"journal":{"name":"21st International Symposium on High Performance Computing Systems and Applications (HPCS'07)","volume":"65 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130674785","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
期刊
21st International Symposium on High Performance Computing Systems and Applications (HPCS'07)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1