Accurate Classification for HPC Applications Concerning Traffic Matrix Visual Patterns

R. Castro, Celio Trois, L. C. E. Bona, M. Martinello
{"title":"Accurate Classification for HPC Applications Concerning Traffic Matrix Visual Patterns","authors":"R. Castro, Celio Trois, L. C. E. Bona, M. Martinello","doi":"10.1109/NoF50125.2020.9249204","DOIUrl":null,"url":null,"abstract":"The evolution of computing and networking allowed multiple computers to be interconnected, aggregating their processing powers to form High-Performance Computing (HPC) architectures. Applications running in these computational environments process and communicate huge amounts of information, taking several hours or even days to complete their executions so, understanding their computation and communication demands is essential for management purposes. Moreover, although most of HPC applications are implemented with well-known algorithms that tend to follow a given pattern in computation and communication, the classical methods of traffic analysis have not been accurate to classify them. In this sense, we argue that observing and understanding the visual patterns in these applications' traffic matrices (TMs) can provide an accurate classification method. In this paper, we propose TReco, a framework that maintains a database with visual features extracted from these TMs and applies machine learning techniques to classify the HPC applications that are consuming the network, regardless of the number of computational nodes executing it. In our experiments, we reached accuracy rate over 99.75%.","PeriodicalId":405626,"journal":{"name":"2020 11th International Conference on Network of the Future (NoF)","volume":"32 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-10-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 11th International Conference on Network of the Future (NoF)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/NoF50125.2020.9249204","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

The evolution of computing and networking allowed multiple computers to be interconnected, aggregating their processing powers to form High-Performance Computing (HPC) architectures. Applications running in these computational environments process and communicate huge amounts of information, taking several hours or even days to complete their executions so, understanding their computation and communication demands is essential for management purposes. Moreover, although most of HPC applications are implemented with well-known algorithms that tend to follow a given pattern in computation and communication, the classical methods of traffic analysis have not been accurate to classify them. In this sense, we argue that observing and understanding the visual patterns in these applications' traffic matrices (TMs) can provide an accurate classification method. In this paper, we propose TReco, a framework that maintains a database with visual features extracted from these TMs and applies machine learning techniques to classify the HPC applications that are consuming the network, regardless of the number of computational nodes executing it. In our experiments, we reached accuracy rate over 99.75%.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于流量矩阵视觉模式的高性能计算应用的精确分类
计算和网络的发展允许多台计算机相互连接,聚合它们的处理能力以形成高性能计算(HPC)体系结构。在这些计算环境中运行的应用程序处理和通信大量的信息,需要几个小时甚至几天的时间来完成它们的执行,因此,了解它们的计算和通信需求对于管理目的至关重要。此外,尽管大多数HPC应用程序是用众所周知的算法实现的,这些算法倾向于遵循给定的计算和通信模式,但经典的流量分析方法并不能准确地对它们进行分类。从这个意义上说,我们认为观察和理解这些应用程序的流量矩阵(TMs)中的视觉模式可以提供一种准确的分类方法。在本文中,我们提出了TReco,这是一个框架,它维护一个数据库,其中包含从这些TMs中提取的视觉特征,并应用机器学习技术对消耗网络的HPC应用程序进行分类,而不管执行它的计算节点的数量。在我们的实验中,准确率达到了99.75%以上。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Dynamic task scheduling for fog nodes based on deadline constraints and task frequency for smart factories Experimental Performance Evaluation of Bluetooth5 for In-building Networks Accurate Classification for HPC Applications Concerning Traffic Matrix Visual Patterns A Heuristic Method for Controller Placement and Enhanced Availability between SDN Controllers Bounded Latency with Bridge-Local Stream Reservation and Strict Priority Queuing
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1