基于数据驱动方法的异构计算资源分配研究

Xirui Tang, Zeyu Wang, Xiaowei Cai, Honghua Su, Changsong Wei
{"title":"基于数据驱动方法的异构计算资源分配研究","authors":"Xirui Tang, Zeyu Wang, Xiaowei Cai, Honghua Su, Changsong Wei","doi":"arxiv-2408.05671","DOIUrl":null,"url":null,"abstract":"The rapid development of the mobile Internet and the Internet of Things is\nleading to a diversification of user devices and the emergence of new mobile\napplications on a regular basis. Such applications include those that are\ncomputationally intensive, such as pattern recognition, interactive gaming,\nvirtual reality, and augmented reality. However, the computing and energy\nresources available on the user's equipment are limited, which presents a\nchallenge in effectively supporting such demanding applications. In this work,\nwe propose a heterogeneous computing resource allocation model based on a\ndata-driven approach. The model first collects and analyzes historical workload\ndata at scale, extracts key features, and builds a detailed data set. Then, a\ndata-driven deep neural network is used to predict future resource\nrequirements. Based on the prediction results, the model adopts a dynamic\nadjustment and optimization resource allocation strategy. This strategy not\nonly fully considers the characteristics of different computing resources, but\nalso accurately matches the requirements of various tasks, and realizes dynamic\nand flexible resource allocation, thereby greatly improving the overall\nperformance and resource utilization of the system. Experimental results show\nthat the proposed method is significantly better than the traditional resource\nallocation method in a variety of scenarios, demonstrating its excellent\naccuracy and adaptability.","PeriodicalId":501309,"journal":{"name":"arXiv - CS - Computational Engineering, Finance, and Science","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-08-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Research on Heterogeneous Computation Resource Allocation based on Data-driven Method\",\"authors\":\"Xirui Tang, Zeyu Wang, Xiaowei Cai, Honghua Su, Changsong Wei\",\"doi\":\"arxiv-2408.05671\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The rapid development of the mobile Internet and the Internet of Things is\\nleading to a diversification of user devices and the emergence of new mobile\\napplications on a regular basis. Such applications include those that are\\ncomputationally intensive, such as pattern recognition, interactive gaming,\\nvirtual reality, and augmented reality. However, the computing and energy\\nresources available on the user's equipment are limited, which presents a\\nchallenge in effectively supporting such demanding applications. In this work,\\nwe propose a heterogeneous computing resource allocation model based on a\\ndata-driven approach. The model first collects and analyzes historical workload\\ndata at scale, extracts key features, and builds a detailed data set. Then, a\\ndata-driven deep neural network is used to predict future resource\\nrequirements. Based on the prediction results, the model adopts a dynamic\\nadjustment and optimization resource allocation strategy. This strategy not\\nonly fully considers the characteristics of different computing resources, but\\nalso accurately matches the requirements of various tasks, and realizes dynamic\\nand flexible resource allocation, thereby greatly improving the overall\\nperformance and resource utilization of the system. Experimental results show\\nthat the proposed method is significantly better than the traditional resource\\nallocation method in a variety of scenarios, demonstrating its excellent\\naccuracy and adaptability.\",\"PeriodicalId\":501309,\"journal\":{\"name\":\"arXiv - CS - Computational Engineering, Finance, and Science\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-08-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - CS - Computational Engineering, Finance, and Science\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2408.05671\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Computational Engineering, Finance, and Science","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2408.05671","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

移动互联网和物联网的快速发展导致用户设备的多样化和新移动应用的不断涌现。这些应用包括模式识别、互动游戏、虚拟现实和增强现实等计算密集型应用。然而,用户设备上可用的计算和能源资源有限,这给有效支持此类高要求应用带来了挑战。在这项工作中,我们提出了一种基于数据驱动方法的异构计算资源分配模型。该模型首先大规模收集和分析历史工作负载数据,提取关键特征,建立详细的数据集。然后,使用数据驱动的深度神经网络预测未来的资源需求。根据预测结果,模型采用动态调整和优化资源分配策略。该策略不仅充分考虑了不同计算资源的特点,而且准确匹配了各种任务的需求,实现了动态灵活的资源分配,从而大大提高了系统的整体性能和资源利用率。实验结果表明,所提出的方法在各种场景下都明显优于传统的资源分配方法,证明了其出色的准确性和适应性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Research on Heterogeneous Computation Resource Allocation based on Data-driven Method
The rapid development of the mobile Internet and the Internet of Things is leading to a diversification of user devices and the emergence of new mobile applications on a regular basis. Such applications include those that are computationally intensive, such as pattern recognition, interactive gaming, virtual reality, and augmented reality. However, the computing and energy resources available on the user's equipment are limited, which presents a challenge in effectively supporting such demanding applications. In this work, we propose a heterogeneous computing resource allocation model based on a data-driven approach. The model first collects and analyzes historical workload data at scale, extracts key features, and builds a detailed data set. Then, a data-driven deep neural network is used to predict future resource requirements. Based on the prediction results, the model adopts a dynamic adjustment and optimization resource allocation strategy. This strategy not only fully considers the characteristics of different computing resources, but also accurately matches the requirements of various tasks, and realizes dynamic and flexible resource allocation, thereby greatly improving the overall performance and resource utilization of the system. Experimental results show that the proposed method is significantly better than the traditional resource allocation method in a variety of scenarios, demonstrating its excellent accuracy and adaptability.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
A generalized non-hourglass updated Lagrangian formulation for SPH solid dynamics A Knowledge-Inspired Hierarchical Physics-Informed Neural Network for Pipeline Hydraulic Transient Simulation Uncertainty Analysis of Limit Cycle Oscillations in Nonlinear Dynamical Systems with the Fourier Generalized Polynomial Chaos Expansion Micropolar elastoplasticity using a fast Fourier transform-based solver A differentiable structural analysis framework for high-performance design optimization
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1