云中科学工作流的节能分区和调度方法

Khadija Bousselmi, Zaki Brahmi, M. Gammoudi
{"title":"云中科学工作流的节能分区和调度方法","authors":"Khadija Bousselmi, Zaki Brahmi, M. Gammoudi","doi":"10.1109/SCC.2016.26","DOIUrl":null,"url":null,"abstract":"Energy consumption is emerging as a new crucial issue of the Cloud Computing environments such as data centers. The problem of power consumption is more challenging especially in the context of scientific workflows deployment in the Cloud as they trigger intensive computational tasks and data manipulation steps which begets excessive data movement operations over communication networks. For instance, it was revealed that network devices consume up to one-third of the total energy consumption of Cloud data centers. In this paper, we propose an energy-aware approach for scientific workflows scheduling in the Cloud. In the first step, we propose a Workflow Partitioning for Energy Minimization (WPEM) algorithm that allows reducing the network energy consumption of the workflow and the total amount of data communication while achieving a high degree of parallelism. In the second step, we use the heuristic of Cat Swarm Optimization to schedule the generated partitions in order to minimize the workflow's overall energy consumption and execution time. We evaluated the proposed approach using three real cases of data intensive workflows and compare it with other algorithms from literature. The experimental results show that our proposal allows to reduce remarkably the network energy consumption of the tested workflows (up to 96% of network energy consumption saving for memory intensive workflows) and the overall energy consumption of the workflows while ensuring a reasonable execution time and using less Cloud resources.","PeriodicalId":115693,"journal":{"name":"2016 IEEE International Conference on Services Computing (SCC)","volume":"55 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2016-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"22","resultStr":"{\"title\":\"Energy Efficient Partitioning and Scheduling Approach for Scientific Workflows in the Cloud\",\"authors\":\"Khadija Bousselmi, Zaki Brahmi, M. Gammoudi\",\"doi\":\"10.1109/SCC.2016.26\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Energy consumption is emerging as a new crucial issue of the Cloud Computing environments such as data centers. The problem of power consumption is more challenging especially in the context of scientific workflows deployment in the Cloud as they trigger intensive computational tasks and data manipulation steps which begets excessive data movement operations over communication networks. For instance, it was revealed that network devices consume up to one-third of the total energy consumption of Cloud data centers. In this paper, we propose an energy-aware approach for scientific workflows scheduling in the Cloud. In the first step, we propose a Workflow Partitioning for Energy Minimization (WPEM) algorithm that allows reducing the network energy consumption of the workflow and the total amount of data communication while achieving a high degree of parallelism. In the second step, we use the heuristic of Cat Swarm Optimization to schedule the generated partitions in order to minimize the workflow's overall energy consumption and execution time. We evaluated the proposed approach using three real cases of data intensive workflows and compare it with other algorithms from literature. The experimental results show that our proposal allows to reduce remarkably the network energy consumption of the tested workflows (up to 96% of network energy consumption saving for memory intensive workflows) and the overall energy consumption of the workflows while ensuring a reasonable execution time and using less Cloud resources.\",\"PeriodicalId\":115693,\"journal\":{\"name\":\"2016 IEEE International Conference on Services Computing (SCC)\",\"volume\":\"55 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2016-06-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"22\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2016 IEEE International Conference on Services Computing (SCC)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/SCC.2016.26\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2016 IEEE International Conference on Services Computing (SCC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SCC.2016.26","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 22

摘要

能源消耗正在成为数据中心等云计算环境的一个新的关键问题。功耗问题更具挑战性,特别是在云中部署科学工作流的背景下,因为它们会触发密集的计算任务和数据操作步骤,从而在通信网络上产生过多的数据移动操作。例如,据透露,网络设备消耗了云数据中心总能耗的三分之一。在本文中,我们提出了一种在云中进行科学工作流调度的能量感知方法。首先,我们提出了一种工作流分区能量最小化(Workflow Partitioning for Energy Minimization, WPEM)算法,该算法在实现高并行度的同时,降低了工作流的网络能耗和数据通信总量。在第二步中,我们使用Cat群优化的启发式方法来调度生成的分区,以最小化工作流的总体能耗和执行时间。我们使用三个数据密集型工作流的真实案例评估了所提出的方法,并将其与文献中的其他算法进行了比较。实验结果表明,我们的方案在保证合理的执行时间和使用更少的云资源的同时,显著降低了被测工作流的网络能耗(内存密集型工作流的网络能耗节省高达96%)和工作流的整体能耗。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Energy Efficient Partitioning and Scheduling Approach for Scientific Workflows in the Cloud
Energy consumption is emerging as a new crucial issue of the Cloud Computing environments such as data centers. The problem of power consumption is more challenging especially in the context of scientific workflows deployment in the Cloud as they trigger intensive computational tasks and data manipulation steps which begets excessive data movement operations over communication networks. For instance, it was revealed that network devices consume up to one-third of the total energy consumption of Cloud data centers. In this paper, we propose an energy-aware approach for scientific workflows scheduling in the Cloud. In the first step, we propose a Workflow Partitioning for Energy Minimization (WPEM) algorithm that allows reducing the network energy consumption of the workflow and the total amount of data communication while achieving a high degree of parallelism. In the second step, we use the heuristic of Cat Swarm Optimization to schedule the generated partitions in order to minimize the workflow's overall energy consumption and execution time. We evaluated the proposed approach using three real cases of data intensive workflows and compare it with other algorithms from literature. The experimental results show that our proposal allows to reduce remarkably the network energy consumption of the tested workflows (up to 96% of network energy consumption saving for memory intensive workflows) and the overall energy consumption of the workflows while ensuring a reasonable execution time and using less Cloud resources.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Implementing the Required Degree of Multitenancy Isolation: A Case Study of Cloud-Hosted Bug Tracking System Complexity Reduction: Local Activity Ranking by Resource Entropy for QoS-Aware Cloud Scheduling An Elasticity-Aware Governance Platform for Cloud Service Delivery An Approach for Modeling and Ranking Node-Level Stragglers in Cloud Datacenters Dynamic Selection for Service Composition Based on Temporal and QoS Constraints
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1