Workflow Critical Path: A data-oriented critical path metric for Holistic HPC Workflows

BenchCouncil Transactions on Benchmarks, Standards and Evaluations Pub Date : 2021-10-01 DOI:10.15760/etd.7369

Daniel D. Nguyen, K. Karavanic

{"title":"Workflow Critical Path: A data-oriented critical path metric for Holistic HPC Workflows","authors":"Daniel D. Nguyen, K. Karavanic","doi":"10.15760/etd.7369","DOIUrl":null,"url":null,"abstract":"............................................................................................................................... i List of Tables ...................................................................................................................... iv List of Figures ..................................................................................................................... v Chapter 1: Introduction ....................................................................................................... 1 1.1 Motivation ................................................................................................................. 3 1.2 Definitions ................................................................................................................. 5 1.3 Thesis Statement ....................................................................................................... 6 1.4 Contributions ............................................................................................................. 6 Chapter 2: Background ........................................................................................................ 9 2.1 Parallel Computing .................................................................................................... 9 2.2 Critical Path Analysis ................................................................................................ 9 2.3 High Performance Computing ................................................................................ 11 2.4 Holistic HPC Workflows ........................................................................................ 12 2.5 Instrumentation, Profiling, and Tracing .................................................................. 12 Chapter 3: Related Work ................................................................................................... 14 3.1 Workflow Management Systems ............................................................................ 14 3.2 Distributed Systems Tracing Tools ......................................................................... 17 3.3 HPC Performance Measurement Tools ................................................................... 20 3.4 Performance Analysis of Scientific Workflows ...................................................... 21 Chapter 4: Architecture ..................................................................................................... 22 4.1 Data State ................................................................................................................ 22 4.2 Crux UI .................................................................................................................... 24 4.3 Crux API ................................................................................................................. 24 4.4 Crux Database ......................................................................................................... 27 4.5 Crux Critical Path Algorithm .................................................................................. 29 4.6 Deployment in HPC clusters ................................................................................... 31 4.7 Instrumentation of HPC Applications ..................................................................... 33","PeriodicalId":100155,"journal":{"name":"BenchCouncil Transactions on Benchmarks, Standards and Evaluations","volume":"80 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"BenchCouncil Transactions on Benchmarks, Standards and Evaluations","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.15760/etd.7369","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 1

Abstract

............................................................................................................................... i List of Tables ...................................................................................................................... iv List of Figures ..................................................................................................................... v Chapter 1: Introduction ....................................................................................................... 1 1.1 Motivation ................................................................................................................. 3 1.2 Definitions ................................................................................................................. 5 1.3 Thesis Statement ....................................................................................................... 6 1.4 Contributions ............................................................................................................. 6 Chapter 2: Background ........................................................................................................ 9 2.1 Parallel Computing .................................................................................................... 9 2.2 Critical Path Analysis ................................................................................................ 9 2.3 High Performance Computing ................................................................................ 11 2.4 Holistic HPC Workflows ........................................................................................ 12 2.5 Instrumentation, Profiling, and Tracing .................................................................. 12 Chapter 3: Related Work ................................................................................................... 14 3.1 Workflow Management Systems ............................................................................ 14 3.2 Distributed Systems Tracing Tools ......................................................................... 17 3.3 HPC Performance Measurement Tools ................................................................... 20 3.4 Performance Analysis of Scientific Workflows ...................................................... 21 Chapter 4: Architecture ..................................................................................................... 22 4.1 Data State ................................................................................................................ 22 4.2 Crux UI .................................................................................................................... 24 4.3 Crux API ................................................................................................................. 24 4.4 Crux Database ......................................................................................................... 27 4.5 Crux Critical Path Algorithm .................................................................................. 29 4.6 Deployment in HPC clusters ................................................................................... 31 4.7 Instrumentation of HPC Applications ..................................................................... 33

查看原文

微信好友朋友圈 QQ好友复制链接

本刊更多论文

工作流关键路径:面向数据的整体HPC工作流关键路径度量

...............................................................................................................................我的表列表 ......................................................................................................................第四列数据 .....................................................................................................................第五章1:介绍 .......................................................................................................1 1.1动机 .................................................................................................................3 1.2定义 .................................................................................................................5 1.3论文声明 .......................................................................................................6 1.4贡献 .............................................................................................................6第二章:背景 ........................................................................................................9 2.1并行计算 ....................................................................................................9 2.2关键路径分析 ................................................................................................9 2.3高性能计算 ................................................................................11 2.4整体HPC工作流 ........................................................................................12个2.5仪器、分析和跟踪 ..................................................................12章3:相关工作 ...................................................................................................14个3.1工作流管理系统 ............................................................................14个3.2分布式系统跟踪工具 .........................................................................17 3.3 HPC性能测量工具 ...................................................................20 3.4科学工作流的性能分析 ......................................................第四章:体系结构 .....................................................................................................22 4.1数据状态 ................................................................................................................22 4.2关键用户界面 ....................................................................................................................24个4.3关键API .................................................................................................................24个4.4关键数据库 .........................................................................................................27 4.5关键关键路径算法 ..................................................................................29日4.6部署在HPC集群 ...................................................................................31日4.7 HPC应用程序的工具 .....................................................................33

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文去求助

来源期刊

BenchCouncil Transactions on Benchmarks, Standards and Evaluations

CiteScore

4.80

自引率

0.00%

发文量