首页 > 最新文献

2020 IEEE/ACM 13th International Conference on Utility and Cloud Computing (UCC)最新文献

英文 中文
Towards Timely, Resource-Efficient Analyses Through Spatially-Aware Constructs within Spark 通过Spark中的空间感知结构实现及时、资源高效的分析
Pub Date : 2020-12-01 DOI: 10.1109/UCC48980.2020.00024
Daniel Rammer, S. Pallickara, S. Pallickara
Across several domains there has been a substantial growth in data volumes. A majority of the generated data are geotagged. This data includes a wealth of information that can inform insights, planning, and decision-making. The proliferation of open-source analytical engines has democratized access to tools and processing frameworks to analyze data. However, several of the analytical engines do not include streamlined support for spatial data wrangling and processing. Here, we present our language-agnostic methodology for effective analyses over voluminous spatiotemporal datasets using Spark. In particular, we introduce support for spatial data processing within the foundational constructs underpinning development of Spark programs DataFrames, Datasets, and RDDs. Our empirical benchmarks demonstrate the suitability of our methodology; in contrast to alternative distribution spatial analytics frameworks, we achieve over 2x speed-up for spatial range queries. Our methodology also makes effective utilization of resources by reducing disk I/O by a factor of 18, network I/O by 5 orders of magnitude, and peak memory utilization by 58% for the same set of analytic tasks.
在多个领域,数据量都出现了大幅增长。大多数生成的数据都带有地理标记。这些数据包含丰富的信息,可以为洞察力、计划和决策提供信息。开源分析引擎的激增使分析数据的工具和处理框架的访问变得大众化。然而,一些分析引擎不包括对空间数据整理和处理的流线型支持。在这里,我们提出了使用Spark对大量时空数据集进行有效分析的语言不可知方法。特别地,我们在Spark程序dataframe、Datasets和rdd的基础结构中引入了对空间数据处理的支持。我们的经验基准证明了我们的方法的适用性;与其他分布空间分析框架相比,我们在空间范围查询方面实现了2倍以上的加速。对于同一组分析任务,我们的方法还通过将磁盘I/O减少18倍,将网络I/O减少5个数量级,并将峰值内存利用率减少58%,从而有效地利用资源。
{"title":"Towards Timely, Resource-Efficient Analyses Through Spatially-Aware Constructs within Spark","authors":"Daniel Rammer, S. Pallickara, S. Pallickara","doi":"10.1109/UCC48980.2020.00024","DOIUrl":"https://doi.org/10.1109/UCC48980.2020.00024","url":null,"abstract":"Across several domains there has been a substantial growth in data volumes. A majority of the generated data are geotagged. This data includes a wealth of information that can inform insights, planning, and decision-making. The proliferation of open-source analytical engines has democratized access to tools and processing frameworks to analyze data. However, several of the analytical engines do not include streamlined support for spatial data wrangling and processing. Here, we present our language-agnostic methodology for effective analyses over voluminous spatiotemporal datasets using Spark. In particular, we introduce support for spatial data processing within the foundational constructs underpinning development of Spark programs DataFrames, Datasets, and RDDs. Our empirical benchmarks demonstrate the suitability of our methodology; in contrast to alternative distribution spatial analytics frameworks, we achieve over 2x speed-up for spatial range queries. Our methodology also makes effective utilization of resources by reducing disk I/O by a factor of 18, network I/O by 5 orders of magnitude, and peak memory utilization by 58% for the same set of analytic tasks.","PeriodicalId":125849,"journal":{"name":"2020 IEEE/ACM 13th International Conference on Utility and Cloud Computing (UCC)","volume":"73 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122820068","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Misconfiguration Discovery with Principal Component Analysis for Cloud-Native Services 使用主成分分析发现云原生服务的错误配置
Pub Date : 2020-12-01 DOI: 10.1109/UCC48980.2020.00045
Alif Akbar Pranata, Olivier Barais, Johann Bourcier, L. Noirie
Cloud applications and services have significantly increased the importance of system and service configuration activities. These activities include updating (i) these services, (ii) their dependencies on third parties, (iii) their configurations, (iv) the configuration of the execution environment, (v) network configurations. The high frequency of updates results in significant configuration complexity that can lead to failures or performance drops. To mitigate these risks, service providers extensively rely on testing techniques, such as metamorphic testing, to detect these failures before moving to production. However, the development and maintenance of these tests are costly, especially the oracle, which must determine whether a system’s performance remains within acceptable boundaries. This paper explores the use of a learning method called Principal Component Analysis (PCA) to learn about acceptable performance metrics on cloudnative services and identify a metamorphic relationship between the nominal service behavior and the value of these metrics. We investigate the following research question: Is it possible to combine the metamorphic testing technique with learning methods on service monitoring data to detect error-prone reconfigurations before moving to production? We remove the developers’ burden to define a specific oracle in detecting these configuration issues. For validation, we applied this proposal on a distributed media streaming application whose authentication was managed by an external identity and access management services. This application illustrates both the heterogeneity of the technologies used to build this type of service and its large configuration space. Our proposal demonstrated the ability to identify error-prone reconfigurations using PCA.
云应用程序和服务显著提高了系统和服务配置活动的重要性。这些活动包括更新(i)这些服务,(ii)它们对第三方的依赖,(iii)它们的配置,(iv)执行环境的配置,(v)网络配置。频繁的更新会导致配置非常复杂,从而导致故障或性能下降。为了降低这些风险,服务提供商广泛依赖于测试技术,比如变形测试,在投入生产之前检测这些故障。然而,这些测试的开发和维护是昂贵的,特别是oracle,它必须确定系统的性能是否保持在可接受的范围内。本文探讨了一种称为主成分分析(PCA)的学习方法的使用,以了解云原生服务上可接受的性能指标,并确定名义服务行为与这些指标值之间的变形关系。我们调查了以下研究问题:是否有可能将变形测试技术与服务监控数据的学习方法结合起来,以便在投入生产之前检测容易出错的重新配置?我们消除了开发人员在检测这些配置问题时定义特定oracle的负担。为了验证,我们将此建议应用于分布式媒体流应用程序,该应用程序的身份验证由外部身份和访问管理服务管理。此应用程序说明了用于构建此类服务的技术的异构性及其巨大的配置空间。我们的建议展示了使用PCA识别容易出错的重新配置的能力。
{"title":"Misconfiguration Discovery with Principal Component Analysis for Cloud-Native Services","authors":"Alif Akbar Pranata, Olivier Barais, Johann Bourcier, L. Noirie","doi":"10.1109/UCC48980.2020.00045","DOIUrl":"https://doi.org/10.1109/UCC48980.2020.00045","url":null,"abstract":"Cloud applications and services have significantly increased the importance of system and service configuration activities. These activities include updating (i) these services, (ii) their dependencies on third parties, (iii) their configurations, (iv) the configuration of the execution environment, (v) network configurations. The high frequency of updates results in significant configuration complexity that can lead to failures or performance drops. To mitigate these risks, service providers extensively rely on testing techniques, such as metamorphic testing, to detect these failures before moving to production. However, the development and maintenance of these tests are costly, especially the oracle, which must determine whether a system’s performance remains within acceptable boundaries. This paper explores the use of a learning method called Principal Component Analysis (PCA) to learn about acceptable performance metrics on cloudnative services and identify a metamorphic relationship between the nominal service behavior and the value of these metrics. We investigate the following research question: Is it possible to combine the metamorphic testing technique with learning methods on service monitoring data to detect error-prone reconfigurations before moving to production? We remove the developers’ burden to define a specific oracle in detecting these configuration issues. For validation, we applied this proposal on a distributed media streaming application whose authentication was managed by an external identity and access management services. This application illustrates both the heterogeneity of the technologies used to build this type of service and its large configuration space. Our proposal demonstrated the ability to identify error-prone reconfigurations using PCA.","PeriodicalId":125849,"journal":{"name":"2020 IEEE/ACM 13th International Conference on Utility and Cloud Computing (UCC)","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131504344","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
DDoS detection and defense mechanism for SDN controllers with K-Means 基于K-Means的SDN控制器DDoS检测与防御机制
Pub Date : 2020-12-01 DOI: 10.1109/UCC48980.2020.00062
Jie Cui, Jing Zhang, Jiantao He, Hong Zhong, Yao Lu
Software-defined networks (SDNs) are key parts of the next generation networks owing to their high programmability and agility that traditional networks lack. However, the SDN controller is vulnerable to Distributed Denial-of-Service (DDoS) attacks. Once the SDN controller was unavailable due to the DDoS attack, all real-time services will be down immediately. Since the advantage of SDN is to process massive network data much faster, we need a real-time detecting algorithm to reduce the impact caused by the attack. To ensure the security of both the users and the SDN, we proposed a detection and defense mechanism against DDoS attacks in Software-defined networking (SDN) environments. The implementation of detection was based on the unbalance in the traffic distribution. The traffic unbalance can be detected by a clustering algorithm such as the K-Means algorithm. Furthermore, we used a Packet_IN message register to filter malicious packets and experimentally evaluated the performance of our scheme in terms of detection accuracy, defense effect, communication delay, and packet loss rate. The results show that our detection method is adaptable to defend against attacks of different scales and types and ensures the least possible decline in the quality of services.
软件定义网络(sdn)具有传统网络所缺乏的高度可编程性和敏捷性,是下一代网络的关键组成部分。但是,SDN控制器容易受到DDoS (Distributed Denial-of-Service)攻击。一旦SDN控制器因DDoS攻击而不可用,所有实时业务将立即中断。由于SDN的优势是处理海量网络数据的速度要快得多,因此我们需要一种实时检测算法来减少攻击造成的影响。为了保证用户和SDN网络的安全,我们提出了一种针对软件定义网络(SDN)环境下DDoS攻击的检测和防御机制。检测的实现是基于流量分布的不平衡。可以通过K-Means算法等聚类算法检测流量不均衡。此外,我们使用Packet_IN消息寄存器来过滤恶意数据包,并从检测精度、防御效果、通信延迟和丢包率等方面实验评估了我们的方案的性能。结果表明,我们的检测方法能够适应不同规模和类型的攻击,并保证服务质量的最小下降。
{"title":"DDoS detection and defense mechanism for SDN controllers with K-Means","authors":"Jie Cui, Jing Zhang, Jiantao He, Hong Zhong, Yao Lu","doi":"10.1109/UCC48980.2020.00062","DOIUrl":"https://doi.org/10.1109/UCC48980.2020.00062","url":null,"abstract":"Software-defined networks (SDNs) are key parts of the next generation networks owing to their high programmability and agility that traditional networks lack. However, the SDN controller is vulnerable to Distributed Denial-of-Service (DDoS) attacks. Once the SDN controller was unavailable due to the DDoS attack, all real-time services will be down immediately. Since the advantage of SDN is to process massive network data much faster, we need a real-time detecting algorithm to reduce the impact caused by the attack. To ensure the security of both the users and the SDN, we proposed a detection and defense mechanism against DDoS attacks in Software-defined networking (SDN) environments. The implementation of detection was based on the unbalance in the traffic distribution. The traffic unbalance can be detected by a clustering algorithm such as the K-Means algorithm. Furthermore, we used a Packet_IN message register to filter malicious packets and experimentally evaluated the performance of our scheme in terms of detection accuracy, defense effect, communication delay, and packet loss rate. The results show that our detection method is adaptable to defend against attacks of different scales and types and ensures the least possible decline in the quality of services.","PeriodicalId":125849,"journal":{"name":"2020 IEEE/ACM 13th International Conference on Utility and Cloud Computing (UCC)","volume":"27 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128530725","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Hathi: An MCDM-based Approach to Capacity Planning for Cloud-hosted DBMS Hathi:基于mcdm的云托管DBMS容量规划方法
Pub Date : 2020-12-01 DOI: 10.1109/UCC48980.2020.00033
Jörg Domaschka, Simon Volpert, Daniel Seybold
The evolution of distributed Database Management Systems (DBMSs) has led to heterogeneity in DBMS technologies. Particularly DBMSs applying a shared-nothing approach enable distributed operation and support fine-grained configurations of distribution characteristics such as replication degree and consistency. Overall, the operation of such DBMSs on IaaS clouds leads to a large configuration space involving different cloud providers, cloud resources and pricing models.The selection of a specific configuration impacts nonfunctional features such as performance, availability, consistency, but also costs of the deployment. In consequence, these need to be traded-off against each other and a suitable configuration needs to be found, satisfying technical and operational aspects. Yet, due to the strong interdependency between different non-functional features as well as the large number of DBMSs, configuration options, and cloud providers, a manual analysis and comparison is not possible.In this paper, we present Hathi, an evaluation-driven Multi Criteria Decision Making (MCDM) framework for planning of cloud-hosted distributed DBMS. By specifying DBMS configurations, workloads, and cloud offers, Hathi automatically performs experiments and evaluates their results. These are then matched against a list of user-defined preferences using an MCDM algorithm.Our evaluation shows that Hathi is able of performing largescale evaluation scenarios involving multiple DBMS in various cluster sizes, cloud providers, and cloud offers. Hathi can weight the resulting data and derives deployment recommendations with respect to throughput, latency, cost, consistency, availability, and stability.
分布式数据库管理系统(DBMS)的发展导致了DBMS技术的异质性。特别是应用无共享方法的dbms支持分布式操作,并支持细粒度的分布特征配置,如复制程度和一致性。总体而言,此类dbms在IaaS云上运行会导致涉及不同云提供商、云资源和定价模型的巨大配置空间。特定配置的选择会影响非功能特性,如性能、可用性、一致性,但也会影响部署成本。因此,这些需要相互权衡,需要找到合适的配置,以满足技术和操作方面的要求。然而,由于不同的非功能性特性以及大量的dbms、配置选项和云提供商之间存在很强的相互依赖性,因此不可能进行手动分析和比较。在本文中,我们提出了Hathi,一个评估驱动的多标准决策(MCDM)框架,用于规划云托管分布式DBMS。通过指定DBMS配置、工作负载和云服务,Hathi可以自动执行实验并评估结果。然后使用MCDM算法将这些参数与用户定义的首选项列表进行匹配。我们的评估表明,Hathi能够执行大规模评估场景,涉及不同集群规模、云提供商和云服务中的多个DBMS。Hathi可以对结果数据进行加权,并根据吞吐量、延迟、成本、一致性、可用性和稳定性得出部署建议。
{"title":"Hathi: An MCDM-based Approach to Capacity Planning for Cloud-hosted DBMS","authors":"Jörg Domaschka, Simon Volpert, Daniel Seybold","doi":"10.1109/UCC48980.2020.00033","DOIUrl":"https://doi.org/10.1109/UCC48980.2020.00033","url":null,"abstract":"The evolution of distributed Database Management Systems (DBMSs) has led to heterogeneity in DBMS technologies. Particularly DBMSs applying a shared-nothing approach enable distributed operation and support fine-grained configurations of distribution characteristics such as replication degree and consistency. Overall, the operation of such DBMSs on IaaS clouds leads to a large configuration space involving different cloud providers, cloud resources and pricing models.The selection of a specific configuration impacts nonfunctional features such as performance, availability, consistency, but also costs of the deployment. In consequence, these need to be traded-off against each other and a suitable configuration needs to be found, satisfying technical and operational aspects. Yet, due to the strong interdependency between different non-functional features as well as the large number of DBMSs, configuration options, and cloud providers, a manual analysis and comparison is not possible.In this paper, we present Hathi, an evaluation-driven Multi Criteria Decision Making (MCDM) framework for planning of cloud-hosted distributed DBMS. By specifying DBMS configurations, workloads, and cloud offers, Hathi automatically performs experiments and evaluates their results. These are then matched against a list of user-defined preferences using an MCDM algorithm.Our evaluation shows that Hathi is able of performing largescale evaluation scenarios involving multiple DBMS in various cluster sizes, cloud providers, and cloud offers. Hathi can weight the resulting data and derives deployment recommendations with respect to throughput, latency, cost, consistency, availability, and stability.","PeriodicalId":125849,"journal":{"name":"2020 IEEE/ACM 13th International Conference on Utility and Cloud Computing (UCC)","volume":"26 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123502152","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
An Approach Adopting Ethereum as a Wallet Domain Name System within the Economy of Things Context 在物联网背景下采用以太坊作为钱包域名系统的方法
Pub Date : 2020-12-01 DOI: 10.1109/UCC48980.2020.00036
Bruno Machado Agostinho, Fellipe Bratti Pasini, F. Gomes, A. R. Pinto, M. Dantas
The interest in blockchain technologies has been growing in the last years. Decentralization, scalability, and data integrity are characteristics that can solve problems in different application fields. However, some issues need to be addressed, aiming to facilitate using these systems. Every day the number of users increases, and the possibility of using multiple cryptocurrencies, with several wallets in each one, also brought an issue: How to manage all these addresses? This work proposes a novel architecture, named Wallet Domain Name System (WDNS), to handle several wallets and contracts in different blockchains. Using the Ethereum network to develop a DNS approach, the WDNS uses smart contracts to store and resolve domains and enable multiple subdomains that are managed by the users. Our work provides an open and free data architecture where any person and system can connect and consume. The initial tests showed an average transaction time of almost 15 seconds and a price of 3.30 USD plus 0.0012 USD per character for the domain requests. Also, the tests showed a fixed cost of 0.71 USD plus 1 USD per each synchronized instruction. Comparing the proposed domain price and the average renewal prices for internet domains makes it possible to ensure our proposal’s feasibility.
在过去的几年里,人们对区块链技术的兴趣一直在增长。去中心化、可扩展性和数据完整性是可以解决不同应用领域问题的特征。然而,为了方便使用这些系统,还需要解决一些问题。用户数量每天都在增加,使用多种加密货币的可能性,每种货币都有几个钱包,这也带来了一个问题:如何管理所有这些地址?这项工作提出了一种名为钱包域名系统(WDNS)的新架构,用于处理不同区块链中的多个钱包和合同。WDNS使用以太坊网络开发DNS方法,使用智能合约来存储和解析域,并启用由用户管理的多个子域。我们的工作提供了一个开放和免费的数据架构,任何人和系统都可以连接和使用。最初的测试显示,平均交易时间几乎为15秒,域名请求的价格为3.30美元加上每个字符0.0012美元。此外,测试显示固定成本为0.71美元,每条同步指令加1美元。将建议的域名价格与互联网域名的平均续费价格进行比较,可以确保建议的可行性。
{"title":"An Approach Adopting Ethereum as a Wallet Domain Name System within the Economy of Things Context","authors":"Bruno Machado Agostinho, Fellipe Bratti Pasini, F. Gomes, A. R. Pinto, M. Dantas","doi":"10.1109/UCC48980.2020.00036","DOIUrl":"https://doi.org/10.1109/UCC48980.2020.00036","url":null,"abstract":"The interest in blockchain technologies has been growing in the last years. Decentralization, scalability, and data integrity are characteristics that can solve problems in different application fields. However, some issues need to be addressed, aiming to facilitate using these systems. Every day the number of users increases, and the possibility of using multiple cryptocurrencies, with several wallets in each one, also brought an issue: How to manage all these addresses? This work proposes a novel architecture, named Wallet Domain Name System (WDNS), to handle several wallets and contracts in different blockchains. Using the Ethereum network to develop a DNS approach, the WDNS uses smart contracts to store and resolve domains and enable multiple subdomains that are managed by the users. Our work provides an open and free data architecture where any person and system can connect and consume. The initial tests showed an average transaction time of almost 15 seconds and a price of 3.30 USD plus 0.0012 USD per character for the domain requests. Also, the tests showed a fixed cost of 0.71 USD plus 1 USD per each synchronized instruction. Comparing the proposed domain price and the average renewal prices for internet domains makes it possible to ensure our proposal’s feasibility.","PeriodicalId":125849,"journal":{"name":"2020 IEEE/ACM 13th International Conference on Utility and Cloud Computing (UCC)","volume":"8 Suppl 5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121508270","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Cloud Energy Micro-Moment Data Classification: A Platform Study 云能量微矩数据分类:平台研究
Pub Date : 2020-10-16 DOI: 10.1109/UCC48980.2020.00066
A. Alsalemi, Ayman Al-Kababji, Yassine Himeur, F. Bensaali, A. Amira
Energy efficiency is a crucial factor in the wellbeing of our planet. In parallel, Machine Learning (ML) plays an instrumental role in automating our lives and creating convenient workflows for enhancing behavior. So, analyzing energy behavior can help understand weak points and lay the path towards better interventions. Moving towards higher performance, cloud platforms can assist researchers in conducting classification trials that need high computational power. Under the larger umbrella of the Consumer Engagement Towards Energy Saving Behavior by means of Exploiting Micro Moments and Mobile Recommendation Systems (EM)3 framework, we aim to influence consumers’ behavioral change via improving their power consumption consciousness. In this paper, common cloud artificial intelligence platforms are benchmarked and compared for micromoment classification. Amazon Web Services, Google Cloud Platform, Google Colab, and Microsoft Azure Machine Learning are employed on simulated and real energy consumption datasets. The KNN, DNN, and SVM classifiers have been employed. Superb performance has been observed in the selected cloud platforms, showing relatively close performance. Yet, the nature of some algorithms limits the training performance.
能源效率对我们这个星球的福祉至关重要。与此同时,机器学习(ML)在自动化我们的生活和创建方便的工作流程以增强行为方面发挥着重要作用。因此,分析能源行为可以帮助了解弱点,并为更好的干预铺平道路。向更高的性能发展,云平台可以帮助研究人员进行需要高计算能力的分类试验。在利用微朋友圈和移动推荐系统(EM)3框架的消费者参与节能行为的大保护伞下,我们的目标是通过提高消费者的能耗意识来影响消费者的行为改变。本文对常用的云人工智能平台进行了微瞬间分类的基准测试和比较。亚马逊网络服务、谷歌云平台、谷歌Colab和微软Azure机器学习被用于模拟和真实的能源消耗数据集。采用了KNN、DNN和SVM分类器。所选云平台的性能非常好,性能比较接近。然而,一些算法的性质限制了训练性能。
{"title":"Cloud Energy Micro-Moment Data Classification: A Platform Study","authors":"A. Alsalemi, Ayman Al-Kababji, Yassine Himeur, F. Bensaali, A. Amira","doi":"10.1109/UCC48980.2020.00066","DOIUrl":"https://doi.org/10.1109/UCC48980.2020.00066","url":null,"abstract":"Energy efficiency is a crucial factor in the wellbeing of our planet. In parallel, Machine Learning (ML) plays an instrumental role in automating our lives and creating convenient workflows for enhancing behavior. So, analyzing energy behavior can help understand weak points and lay the path towards better interventions. Moving towards higher performance, cloud platforms can assist researchers in conducting classification trials that need high computational power. Under the larger umbrella of the Consumer Engagement Towards Energy Saving Behavior by means of Exploiting Micro Moments and Mobile Recommendation Systems (EM)3 framework, we aim to influence consumers’ behavioral change via improving their power consumption consciousness. In this paper, common cloud artificial intelligence platforms are benchmarked and compared for micromoment classification. Amazon Web Services, Google Cloud Platform, Google Colab, and Microsoft Azure Machine Learning are employed on simulated and real energy consumption datasets. The KNN, DNN, and SVM classifiers have been employed. Superb performance has been observed in the selected cloud platforms, showing relatively close performance. Yet, the nature of some algorithms limits the training performance.","PeriodicalId":125849,"journal":{"name":"2020 IEEE/ACM 13th International Conference on Utility and Cloud Computing (UCC)","volume":"35 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125463195","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 12
High-Performance Mining of COVID-19 Open Research Datasets for Text Classification and Insights in Cloud Computing Environments 基于云计算环境下文本分类和洞察的COVID-19开放研究数据集的高性能挖掘
Pub Date : 2020-09-16 DOI: 10.1109/UCC48980.2020.00048
Jie Zhao, M. A. Rodriguez, R. Buyya
The COVID-19 global pandemic is an unprecedented health crisis. Many researchers around the world have produced an extensive collection of literature since the outbreak. Analysing this information to extract knowledge and provide meaningful insights in a timely manner requires a considerable amount of computational power. Cloud platforms are designed to provide this computational power in an on-demand and elastic manner. Specifically, hybrid clouds, composed of private and public data centers, are particularly well suited to deploy computationally intensive workloads in a cost-efficient, yet scalable manner. In this paper, we developed a system utilising the Aneka Platform as a Service middleware with parallel processing and multi-cloud capability to accelerate the data process pipeline and article categorising process using machine learning on a hybrid cloud. The results are then persisted for further referencing, searching and visualising. The performance evaluation shows that the system can help with reducing processing time and achieving linear scalability. Beyond COVID-19, the application might be used directly in broader scholarly article indexing and analysing.
2019冠状病毒病全球大流行是一场前所未有的健康危机。自疫情爆发以来,世界各地的许多研究人员已经收集了大量文献。分析这些信息以提取知识并及时提供有意义的见解需要相当大的计算能力。云平台旨在以按需和弹性的方式提供这种计算能力。具体来说,由私有和公共数据中心组成的混合云特别适合以经济高效且可扩展的方式部署计算密集型工作负载。在本文中,我们开发了一个系统,利用Aneka平台作为一个具有并行处理和多云功能的服务中间件,在混合云上使用机器学习来加速数据处理管道和文章分类过程。然后将结果持久化以供进一步参考、搜索和可视化。性能评估表明,该系统有助于减少处理时间和实现线性可扩展性。除了COVID-19,该应用程序还可以直接用于更广泛的学术文章索引和分析。
{"title":"High-Performance Mining of COVID-19 Open Research Datasets for Text Classification and Insights in Cloud Computing Environments","authors":"Jie Zhao, M. A. Rodriguez, R. Buyya","doi":"10.1109/UCC48980.2020.00048","DOIUrl":"https://doi.org/10.1109/UCC48980.2020.00048","url":null,"abstract":"The COVID-19 global pandemic is an unprecedented health crisis. Many researchers around the world have produced an extensive collection of literature since the outbreak. Analysing this information to extract knowledge and provide meaningful insights in a timely manner requires a considerable amount of computational power. Cloud platforms are designed to provide this computational power in an on-demand and elastic manner. Specifically, hybrid clouds, composed of private and public data centers, are particularly well suited to deploy computationally intensive workloads in a cost-efficient, yet scalable manner. In this paper, we developed a system utilising the Aneka Platform as a Service middleware with parallel processing and multi-cloud capability to accelerate the data process pipeline and article categorising process using machine learning on a hybrid cloud. The results are then persisted for further referencing, searching and visualising. The performance evaluation shows that the system can help with reducing processing time and achieving linear scalability. Beyond COVID-19, the application might be used directly in broader scholarly article indexing and analysing.","PeriodicalId":125849,"journal":{"name":"2020 IEEE/ACM 13th International Conference on Utility and Cloud Computing (UCC)","volume":"134 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124657137","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
WattsApp: Power-Aware Container Scheduling WattsApp:功率感知容器调度
Pub Date : 2020-05-30 DOI: 10.1109/UCC48980.2020.00027
H. Mehta, P. Harvey, O. Rana, R. Buyya, B. Varghese
Containers are popular for deploying workloads. However, there are limited software-based methods (hardware- based methods are expensive) for obtaining the power consumed by containers to facilitate power-aware container scheduling. This paper presents WattsApp, a tool underpinned by a six step software-based method for power-aware container scheduling to minimize power cap violations on a server. The proposed method relies on a neural network-based power estimation model and a power capped container scheduling technique. Experimental studies are pursued in a lab-based environment on 10 benchmarks on Intel and ARM processors. The results highlight that power estimation has negligible overheads - nearly 90% of all data samples can be estimated with less than a 10% error, and the Mean Absolute Percentage Error (MAPE) is less than 6%. The power-aware scheduling of WattsApp is more effective than Intel’s Running Power Average Limit (RAPL) based power capping as it does not degrade the performance of all running containers.
容器在部署工作负载方面很流行。然而,基于软件的方法有限(基于硬件的方法很昂贵),无法获得容器所消耗的功率,从而促进对功率敏感的容器调度。本文介绍了WattsApp,这是一个基于六步软件的工具,用于功率感知容器调度,以最大限度地减少服务器上的功率上限。该方法基于基于神经网络的功率估计模型和功率上限容器调度技术。实验研究是在基于实验室的环境中对英特尔和ARM处理器的10个基准进行的。结果表明,功率估计的开销可以忽略不计——几乎90%的数据样本可以以小于10%的误差进行估计,平均绝对百分比误差(MAPE)小于6%。WattsApp的功率感知调度比英特尔基于运行功率平均限制(RAPL)的功率上限更有效,因为它不会降低所有运行容器的性能。
{"title":"WattsApp: Power-Aware Container Scheduling","authors":"H. Mehta, P. Harvey, O. Rana, R. Buyya, B. Varghese","doi":"10.1109/UCC48980.2020.00027","DOIUrl":"https://doi.org/10.1109/UCC48980.2020.00027","url":null,"abstract":"Containers are popular for deploying workloads. However, there are limited software-based methods (hardware- based methods are expensive) for obtaining the power consumed by containers to facilitate power-aware container scheduling. This paper presents WattsApp, a tool underpinned by a six step software-based method for power-aware container scheduling to minimize power cap violations on a server. The proposed method relies on a neural network-based power estimation model and a power capped container scheduling technique. Experimental studies are pursued in a lab-based environment on 10 benchmarks on Intel and ARM processors. The results highlight that power estimation has negligible overheads - nearly 90% of all data samples can be estimated with less than a 10% error, and the Mean Absolute Percentage Error (MAPE) is less than 6%. The power-aware scheduling of WattsApp is more effective than Intel’s Running Power Average Limit (RAPL) based power capping as it does not degrade the performance of all running containers.","PeriodicalId":125849,"journal":{"name":"2020 IEEE/ACM 13th International Conference on Utility and Cloud Computing (UCC)","volume":"139 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131424442","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Workshop Program Committees 工作坊计划委员会
Wahabou Abdou, Ana Roxin, B. Yenke, J. Toutouh, F. Ababsa
Program Committee K. Pasupa, King Mongkut's Institute of Technology Ladkrabang, Thailand X. Chen, Nanjing University of Posts and Communications, China X. Yang, Sichuan University, China W. Lei, University of Jinan, China A. Paul, Kyungpook National University, South Korea W. Wu, Sichuan University, China Y. Fang, Northwest A&F University, China J. Wu, Xidian University, China F. Frati, Università degli Studi di Milano, Italy L. Arnone, STMicroelectronics, Italy M. Sacco, ITIA-CNR, Italy G. Gianini, EBTIC/Khalifa University of Science and Technology, UAE Bin Ye, Queen's University Belfast, United Kingdom
项目委员会K. Pasupa,蒙古国王理工学院,泰国Ladkrabang,陈翔,南京邮电大学,中国杨翔,四川大学,中国雷伟,济南大学,中国A. Paul,庆北大学,韩国吴伟,四川大学,中国方勇,西北农林科技大学,中国吴杰,西安电子科技大学,中国F. Frati,意大利米兰理工大学,L. Arnone,意法半导体,意大利M. Sacco, ITIA-CNR,意大利G. Gianini, EBTIC/哈利法科技大学,阿联酋Bin Ye,英国贝尔法斯特女王大学
{"title":"Workshop Program Committees","authors":"Wahabou Abdou, Ana Roxin, B. Yenke, J. Toutouh, F. Ababsa","doi":"10.1109/icdmw.2009.7","DOIUrl":"https://doi.org/10.1109/icdmw.2009.7","url":null,"abstract":"Program Committee K. Pasupa, King Mongkut's Institute of Technology Ladkrabang, Thailand X. Chen, Nanjing University of Posts and Communications, China X. Yang, Sichuan University, China W. Lei, University of Jinan, China A. Paul, Kyungpook National University, South Korea W. Wu, Sichuan University, China Y. Fang, Northwest A&F University, China J. Wu, Xidian University, China F. Frati, Università degli Studi di Milano, Italy L. Arnone, STMicroelectronics, Italy M. Sacco, ITIA-CNR, Italy G. Gianini, EBTIC/Khalifa University of Science and Technology, UAE Bin Ye, Queen's University Belfast, United Kingdom","PeriodicalId":125849,"journal":{"name":"2020 IEEE/ACM 13th International Conference on Utility and Cloud Computing (UCC)","volume":"162 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123258423","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Steering Committee 指导委员会
Pub Date : 2018-12-01 DOI: 10.1109/icspcs.2018.8631775
M. Fateh
{"title":"Steering Committee","authors":"M. Fateh","doi":"10.1109/icspcs.2018.8631775","DOIUrl":"https://doi.org/10.1109/icspcs.2018.8631775","url":null,"abstract":"","PeriodicalId":125849,"journal":{"name":"2020 IEEE/ACM 13th International Conference on Utility and Cloud Computing (UCC)","volume":"149 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114157655","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
2020 IEEE/ACM 13th International Conference on Utility and Cloud Computing (UCC)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1