首页 > 最新文献

2015 IEEE/ACM 8th International Conference on Utility and Cloud Computing (UCC)最新文献

英文 中文
Cloud Orchestration Features: Are Tools Fit for Purpose? 云编排功能:工具适合用途吗?
Dani Baur, Daniel Seybold, F. Griesinger, Athanasios Tsitsipas, Christopher B. Hauser, Jörg Domaschka
Even though the cloud era has begun almost one decade ago, many problems of the first hour are still around. Vendor lock-in and poor tool support hinder users from taking full advantage of main cloud features: dynamic and scale. This has given rise to tools that target the seamless management and orchestration of cloud applications. All these tools promise similar capabilities and are barely distinguishable what makes it hard to select the right tool. In this paper, we objectively investigate required and desired features of such tools and give a definition of them. We then select three open-source tools (Brooklyn, Cloudify, Stratos) and compare them according to the features they support using our experience gained from deploying and operating a standard three-tier application. This exercise leads to a fine-grained feature list that enables the comparison of such tools based on objective criteria as well as a rating of three popular cloud orchestration tools. In addition, it leads to the insight that the tools are on the right track, but that further development and particularly research is necessary to satisfy all demands.
尽管云时代在近10年前就开始了,但最初的许多问题仍然存在。厂商锁定和糟糕的工具支持阻碍了用户充分利用云的主要特性:动态和可扩展性。这就产生了针对云应用程序的无缝管理和编排的工具。所有这些工具都承诺类似的功能,并且几乎没有区别,这使得选择正确的工具变得困难。在本文中,我们客观地研究了这些工具所需要的和期望的特性,并给出了它们的定义。然后,我们选择了三个开源工具(Brooklyn, Cloudify, Stratos),并使用我们从部署和操作标准三层应用程序中获得的经验,根据它们支持的功能对它们进行比较。这个练习产生了一个细粒度的功能列表,可以根据客观标准对这些工具进行比较,并对三种流行的云编排工具进行评级。此外,它还使我们认识到这些工具正处于正确的轨道上,但是需要进一步的开发,特别是研究来满足所有的需求。
{"title":"Cloud Orchestration Features: Are Tools Fit for Purpose?","authors":"Dani Baur, Daniel Seybold, F. Griesinger, Athanasios Tsitsipas, Christopher B. Hauser, Jörg Domaschka","doi":"10.1109/UCC.2015.25","DOIUrl":"https://doi.org/10.1109/UCC.2015.25","url":null,"abstract":"Even though the cloud era has begun almost one decade ago, many problems of the first hour are still around. Vendor lock-in and poor tool support hinder users from taking full advantage of main cloud features: dynamic and scale. This has given rise to tools that target the seamless management and orchestration of cloud applications. All these tools promise similar capabilities and are barely distinguishable what makes it hard to select the right tool. In this paper, we objectively investigate required and desired features of such tools and give a definition of them. We then select three open-source tools (Brooklyn, Cloudify, Stratos) and compare them according to the features they support using our experience gained from deploying and operating a standard three-tier application. This exercise leads to a fine-grained feature list that enables the comparison of such tools based on objective criteria as well as a rating of three popular cloud orchestration tools. In addition, it leads to the insight that the tools are on the right track, but that further development and particularly research is necessary to satisfy all demands.","PeriodicalId":381279,"journal":{"name":"2015 IEEE/ACM 8th International Conference on Utility and Cloud Computing (UCC)","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125788303","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 33
Efficient Update of Encrypted Files for Cloud Storage 高效更新加密文件的云存储
Youssef El Houti, Andrea Miele
We propose a method for file encryption based on AES-CTR suitable for cloud storage. Our method allows efficient updates of encrypted files by minimizing the amount of data that need to be re-encrypted. It achieves significantly better performance than full re-encryption for file updates. In addition our method addresses several security issues that traditional schemes used in the domain of disk encryption incur especially if used in the cloud. Efficient and secure update of encrypted files is relevant for applications using cloud storage or secure remote storage, which are becoming more and more common.
提出了一种适合云存储的基于AES-CTR的文件加密方法。我们的方法允许通过最小化需要重新加密的数据量来有效地更新加密文件。它比文件更新的完全重新加密实现了明显更好的性能。此外,我们的方法还解决了磁盘加密领域中使用的传统方案所产生的几个安全问题,特别是在云中使用时。对于使用云存储或安全远程存储的应用程序来说,加密文件的高效和安全更新是非常重要的,而云存储和安全远程存储正变得越来越普遍。
{"title":"Efficient Update of Encrypted Files for Cloud Storage","authors":"Youssef El Houti, Andrea Miele","doi":"10.1109/UCC.2015.100","DOIUrl":"https://doi.org/10.1109/UCC.2015.100","url":null,"abstract":"We propose a method for file encryption based on AES-CTR suitable for cloud storage. Our method allows efficient updates of encrypted files by minimizing the amount of data that need to be re-encrypted. It achieves significantly better performance than full re-encryption for file updates. In addition our method addresses several security issues that traditional schemes used in the domain of disk encryption incur especially if used in the cloud. Efficient and secure update of encrypted files is relevant for applications using cloud storage or secure remote storage, which are becoming more and more common.","PeriodicalId":381279,"journal":{"name":"2015 IEEE/ACM 8th International Conference on Utility and Cloud Computing (UCC)","volume":"53 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126363225","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Public-Private Cloud Federation Challenges 公有-私有云联盟挑战
Boris Parák, D. Wallom, S. Licehammer, Z. Šustr
This paper provides a brief introduction into emerging user requirements and expectations in the context of large cloud-based infrastructures. Observed cloud usage patterns are used to demonstrate the need for large federated cloud infrastructures, in particular cloud federations bridging the gap between private cloud infrastructures and large commercial public cloud providers. The paper proposes the use of open standards as the best possible way to achieve a working user-friendly large-scale cloud federation and discusses the challenges in assembling and managing such a federation whilst focusing on the differences between private-private and public-private cloud federations in key areas of virtual machine management and authentication, authorization, and identity management.
本文简要介绍了大型基于云的基础设施背景下出现的用户需求和期望。观察到的云使用模式用于演示对大型联合云基础设施的需求,特别是云联合弥合了私有云基础设施和大型商业公共云提供商之间的差距。本文建议使用开放标准作为实现工作友好的大规模云联盟的最佳方式,并讨论了组装和管理这种联盟的挑战,同时重点讨论了私有-私有和公有-私有云联盟在虚拟机管理、身份验证、授权和身份管理等关键领域的差异。
{"title":"Public-Private Cloud Federation Challenges","authors":"Boris Parák, D. Wallom, S. Licehammer, Z. Šustr","doi":"10.1109/UCC.2015.91","DOIUrl":"https://doi.org/10.1109/UCC.2015.91","url":null,"abstract":"This paper provides a brief introduction into emerging user requirements and expectations in the context of large cloud-based infrastructures. Observed cloud usage patterns are used to demonstrate the need for large federated cloud infrastructures, in particular cloud federations bridging the gap between private cloud infrastructures and large commercial public cloud providers. The paper proposes the use of open standards as the best possible way to achieve a working user-friendly large-scale cloud federation and discusses the challenges in assembling and managing such a federation whilst focusing on the differences between private-private and public-private cloud federations in key areas of virtual machine management and authentication, authorization, and identity management.","PeriodicalId":381279,"journal":{"name":"2015 IEEE/ACM 8th International Conference on Utility and Cloud Computing (UCC)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132297019","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Adaptive Performance Isolation Middleware for Multi-tenant SaaS 用于多租户SaaS的自适应性能隔离中间件
Stefan Walraven, Wouter De Borger, B. V. Brabant, B. Lagaisse, D. Landuyt, W. Joosen
SaaS providers typically adopt a multi-tenant architecture to leverage economies of scale. By maximizing the sharing of resources among multiple customer organizations, called tenants, operational costs are reduced. However, this high degree of resource sharing complicates performance isolation between tenants: different tenants have different requirements regarding performance and ensuring compliance with these co-existing and competing performance constraints within a shared application remains a challenge. This paper presents an adaptive middleware that enables SaaS providers to efficiently enforce different and competing performance constraints in multi-tenant SaaS applications. It can manage a combination of performance constraints in terms of latency, throughput and deadlines at a fine-grained level, and enables rapid response on changing circumstances, while preserving the resource usage efficiency of application-level multi-tenancy. We focus on service-oriented applications that asynchronously process small units of work, as supported by many cloud platforms via queues or simple workflows (e.g. Google App Engine, Amazon AWS). We have implemented a prototype on top of a private cloud platform, based on OpenStack and JBoss. The evaluation shows the effectiveness and flexibility of our solution in the context of an industry-relevant SaaS application, with minimal performance overhead.
SaaS提供商通常采用多租户架构来利用规模经济。通过在多个客户组织(称为租户)之间最大限度地共享资源,可以降低运营成本。然而,这种高度的资源共享使租户之间的性能隔离变得复杂:不同的租户对性能有不同的要求,确保在共享应用程序中遵守这些共存和竞争的性能约束仍然是一个挑战。本文提出了一种自适应中间件,使SaaS提供商能够在多租户SaaS应用程序中有效地执行不同的竞争性性能约束。它可以在细粒度级别上管理延迟、吞吐量和截止日期方面的性能约束组合,并支持对不断变化的环境进行快速响应,同时保持应用程序级多租户的资源使用效率。我们专注于异步处理小工作单元的面向服务的应用程序,正如许多云平台通过队列或简单工作流(例如b谷歌App Engine, Amazon AWS)所支持的那样。我们已经在私有云平台上实现了一个原型,基于OpenStack和JBoss。评估显示了我们的解决方案在与行业相关的SaaS应用程序上下文中的有效性和灵活性,并且性能开销最小。
{"title":"Adaptive Performance Isolation Middleware for Multi-tenant SaaS","authors":"Stefan Walraven, Wouter De Borger, B. V. Brabant, B. Lagaisse, D. Landuyt, W. Joosen","doi":"10.1109/UCC.2015.27","DOIUrl":"https://doi.org/10.1109/UCC.2015.27","url":null,"abstract":"SaaS providers typically adopt a multi-tenant architecture to leverage economies of scale. By maximizing the sharing of resources among multiple customer organizations, called tenants, operational costs are reduced. However, this high degree of resource sharing complicates performance isolation between tenants: different tenants have different requirements regarding performance and ensuring compliance with these co-existing and competing performance constraints within a shared application remains a challenge. This paper presents an adaptive middleware that enables SaaS providers to efficiently enforce different and competing performance constraints in multi-tenant SaaS applications. It can manage a combination of performance constraints in terms of latency, throughput and deadlines at a fine-grained level, and enables rapid response on changing circumstances, while preserving the resource usage efficiency of application-level multi-tenancy. We focus on service-oriented applications that asynchronously process small units of work, as supported by many cloud platforms via queues or simple workflows (e.g. Google App Engine, Amazon AWS). We have implemented a prototype on top of a private cloud platform, based on OpenStack and JBoss. The evaluation shows the effectiveness and flexibility of our solution in the context of an industry-relevant SaaS application, with minimal performance overhead.","PeriodicalId":381279,"journal":{"name":"2015 IEEE/ACM 8th International Conference on Utility and Cloud Computing (UCC)","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127778016","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 16
Middleware for Customizable Multi-staged Dynamic Upgrades of Multi-tenant SaaS Applications 用于多租户SaaS应用程序的可定制多阶段动态升级的中间件
Fatih Gey, D. Landuyt, W. Joosen
Multi-tenant Software as a Service (SaaS) is the cloud computing delivery model that maximizes resource sharing up to the level of a single application instance servicing many customer organizations (tenants) at once. Due to this scale of delivery, a SaaS offering, once successful, becomes difficult to upgrade and evolve without affecting service continuity and tenant businesses profoundly. However, not all tenants are equal, and to some organizations such disruptions are more costly than to others. To account for such tenant-specific requirements, middleware for upgrading SaaS applications should support tenant-specific enactment of upgrades that allow for a customizable schedule and type of enactment in accordance to the tenant SLA. In this paper, we present our design and implementation of a SaaS middleware that enables run-time adaptation by means of a gradual tenant-by-tenant activation of upgrades. The adaptation mechanism is multi-staged, i.e. supports configuration based on the inputs of the tenant administrator and other stakeholders, and is maximally automated. We have validated the middleware in an OSGi-based prototype implementation and evaluated this prototype, showing negligible performance overhead of the middleware and yet clearly showcasing service continuity improvements in realistic upgrade scenarios.
多租户软件即服务(SaaS)是一种云计算交付模型,它将资源共享最大化到单个应用程序实例的级别,可以同时为多个客户组织(租户)提供服务。由于这种交付规模,SaaS产品一旦成功,就很难在不深刻影响服务连续性和租户业务的情况下进行升级和发展。然而,并不是所有的租户都是平等的,对于一些组织来说,这种中断的代价比其他组织要高。为了满足这种特定于租户的需求,用于升级SaaS应用程序的中间件应该支持特定于租户的升级实施,从而允许根据租户SLA定制时间表和实施类型。在本文中,我们介绍了SaaS中间件的设计和实现,该中间件通过逐个租户的逐步激活升级来实现运行时适应。适应机制是多阶段的,即支持基于租户管理员和其他涉众输入的配置,并且最大程度地实现自动化。我们已经在一个基于osgi的原型实现中验证了中间件,并对这个原型进行了评估,结果显示中间件的性能开销可以忽略不计,并且在实际升级场景中清楚地展示了服务连续性的改进。
{"title":"Middleware for Customizable Multi-staged Dynamic Upgrades of Multi-tenant SaaS Applications","authors":"Fatih Gey, D. Landuyt, W. Joosen","doi":"10.1109/UCC.2015.26","DOIUrl":"https://doi.org/10.1109/UCC.2015.26","url":null,"abstract":"Multi-tenant Software as a Service (SaaS) is the cloud computing delivery model that maximizes resource sharing up to the level of a single application instance servicing many customer organizations (tenants) at once. Due to this scale of delivery, a SaaS offering, once successful, becomes difficult to upgrade and evolve without affecting service continuity and tenant businesses profoundly. However, not all tenants are equal, and to some organizations such disruptions are more costly than to others. To account for such tenant-specific requirements, middleware for upgrading SaaS applications should support tenant-specific enactment of upgrades that allow for a customizable schedule and type of enactment in accordance to the tenant SLA. In this paper, we present our design and implementation of a SaaS middleware that enables run-time adaptation by means of a gradual tenant-by-tenant activation of upgrades. The adaptation mechanism is multi-staged, i.e. supports configuration based on the inputs of the tenant administrator and other stakeholders, and is maximally automated. We have validated the middleware in an OSGi-based prototype implementation and evaluated this prototype, showing negligible performance overhead of the middleware and yet clearly showcasing service continuity improvements in realistic upgrade scenarios.","PeriodicalId":381279,"journal":{"name":"2015 IEEE/ACM 8th International Conference on Utility and Cloud Computing (UCC)","volume":"37 5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132936206","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
CYCLONE Unified Deployment and Management of Federated, Multi-cloud Applications 旋风统一部署和管理联邦,多云应用程序
Mathias Slawik, Begüm Ilke Zilci, Y. Demchenko, José-Ignacio Aznar-Baranda, R. Branchat, C. Loomis, O. Lodygensky, Christophe Blanchet
Various Cloud layers have to work in concert in order to manage and deploy complex multi-cloud applications, executing sophisticated workflows for Cloud resource deployment, activation, adjustment, interaction, and monitoring. While there are ample solutions for managing individual Cloud aspects (e.g. network controllers, deployment tools, and application security software), there are no well-integrated suites for managing an entire multi cloud environment with multiple providers and deployment models. This paper presents the CYCLONE architecture that integrates a number of existing solutions to create an open, unified, holistic Cloud management platform for multicloud applications, tailored to the needs of research organizations and SMEs. It discusses major challenges in providing a network and security infrastructure for the Intercloud and concludes with the demonstration how the architecture is implemented in a real life bioinformatics use case.
为了管理和部署复杂的多云应用程序,执行用于云资源部署、激活、调整、交互和监视的复杂工作流,各种云层必须协同工作。虽然有足够的解决方案来管理单个云方面(例如网络控制器、部署工具和应用程序安全软件),但没有一个集成良好的套件来管理具有多个提供商和部署模型的整个多云环境。本文介绍了CYCLONE架构,它集成了许多现有的解决方案,为多云应用程序创建了一个开放、统一、整体的云管理平台,以满足研究机构和中小企业的需求。它讨论了为Intercloud提供网络和安全基础设施的主要挑战,并在最后演示了如何在现实生活中的生物信息学用例中实现该体系结构。
{"title":"CYCLONE Unified Deployment and Management of Federated, Multi-cloud Applications","authors":"Mathias Slawik, Begüm Ilke Zilci, Y. Demchenko, José-Ignacio Aznar-Baranda, R. Branchat, C. Loomis, O. Lodygensky, Christophe Blanchet","doi":"10.1109/UCC.2015.81","DOIUrl":"https://doi.org/10.1109/UCC.2015.81","url":null,"abstract":"Various Cloud layers have to work in concert in order to manage and deploy complex multi-cloud applications, executing sophisticated workflows for Cloud resource deployment, activation, adjustment, interaction, and monitoring. While there are ample solutions for managing individual Cloud aspects (e.g. network controllers, deployment tools, and application security software), there are no well-integrated suites for managing an entire multi cloud environment with multiple providers and deployment models. This paper presents the CYCLONE architecture that integrates a number of existing solutions to create an open, unified, holistic Cloud management platform for multicloud applications, tailored to the needs of research organizations and SMEs. It discusses major challenges in providing a network and security infrastructure for the Intercloud and concludes with the demonstration how the architecture is implemented in a real life bioinformatics use case.","PeriodicalId":381279,"journal":{"name":"2015 IEEE/ACM 8th International Conference on Utility and Cloud Computing (UCC)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124463578","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 12
Enabling Big Data Analytics in the Hybrid Cloud Using Iterative MapReduce 使用迭代MapReduce实现混合云中的大数据分析
Francisco J. Clemente-Castelló, Bogdan Nicolae, K. Katrinis, M. M. Rafique, R. Mayo, J. C. Fernández, Daniela Loreti
The cloud computing model has seen tremendous commercial success through its materialization via two prominent models to date, namely public and private cloud. Recently, a third model combining the former two service models as on-/off-premise resources has been receiving significant market traction: hybrid cloud. While state of art techniques that address workload performance prediction and efficient workload execution over hybrid cloud setups exist, how to address data-intensive workloads - including Big Data Analytics - in similar environments is nascent. This paper addresses this gap by taking on the challenge of bursting over hybrid clouds for the benefit of accelerating iterative MapReduce applications. We first specify the challenges associated with data locality and data movement in such setups. Subsequently, we propose a novel technique to address the locality issue, without requiring changes to the MapReduce framework or the underlying storage layer. In addition, we contribute with a performance prediction methodology that combines modeling with micro-benchmarks to estimate completion time for iterative MapReduce applications, which enables users to estimate cost-to-solution before committing extra resources from public clouds. We show through experimentation in a dual-Openstack hybrid cloud setup that our solutions manage to bring substantial improvement at predictable cost-control for two real-life iterative MapReduce applications: large-scale machine learning and text analysis.
迄今为止,云计算模型通过公共云和私有云这两个突出的模型实现,取得了巨大的商业成功。最近,第三种结合了前两种服务模式作为内部/外部资源的模式已经获得了巨大的市场吸引力:混合云。虽然在混合云设置上解决工作负载性能预测和高效工作负载执行的最新技术已经存在,但如何在类似的环境中解决数据密集型工作负载(包括大数据分析)仍处于萌芽阶段。为了加速迭代MapReduce应用程序,本文通过挑战混合云来解决这一差距。我们首先指定在这种设置中与数据位置和数据移动相关的挑战。随后,我们提出了一种新的技术来解决局域性问题,而不需要改变MapReduce框架或底层存储层。此外,我们还提供了一种性能预测方法,该方法将建模与微基准相结合,以估计迭代MapReduce应用程序的完成时间,这使用户能够在从公共云提交额外资源之前估计解决方案的成本。我们通过双openstack混合云设置的实验表明,我们的解决方案在可预测的成本控制方面为两个现实生活中的迭代MapReduce应用程序带来了实质性的改进:大规模机器学习和文本分析。
{"title":"Enabling Big Data Analytics in the Hybrid Cloud Using Iterative MapReduce","authors":"Francisco J. Clemente-Castelló, Bogdan Nicolae, K. Katrinis, M. M. Rafique, R. Mayo, J. C. Fernández, Daniela Loreti","doi":"10.1109/UCC.2015.47","DOIUrl":"https://doi.org/10.1109/UCC.2015.47","url":null,"abstract":"The cloud computing model has seen tremendous commercial success through its materialization via two prominent models to date, namely public and private cloud. Recently, a third model combining the former two service models as on-/off-premise resources has been receiving significant market traction: hybrid cloud. While state of art techniques that address workload performance prediction and efficient workload execution over hybrid cloud setups exist, how to address data-intensive workloads - including Big Data Analytics - in similar environments is nascent. This paper addresses this gap by taking on the challenge of bursting over hybrid clouds for the benefit of accelerating iterative MapReduce applications. We first specify the challenges associated with data locality and data movement in such setups. Subsequently, we propose a novel technique to address the locality issue, without requiring changes to the MapReduce framework or the underlying storage layer. In addition, we contribute with a performance prediction methodology that combines modeling with micro-benchmarks to estimate completion time for iterative MapReduce applications, which enables users to estimate cost-to-solution before committing extra resources from public clouds. We show through experimentation in a dual-Openstack hybrid cloud setup that our solutions manage to bring substantial improvement at predictable cost-control for two real-life iterative MapReduce applications: large-scale machine learning and text analysis.","PeriodicalId":381279,"journal":{"name":"2015 IEEE/ACM 8th International Conference on Utility and Cloud Computing (UCC)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132323658","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 25
Agent-Based Modelling as a Service on Amazon EC2: Opportunities and Challenges Amazon EC2上基于代理的建模即服务:机遇与挑战
M. Kiran, Kabiru M. Maiyama, Haroon Mir, Bashir Mohammed, Ashraf Al-Ou'n
Modelling and Simulation is heavily influenced by availability of computational power and resources, to successfully complete simulation tasks. In this paper, we investigate deploying the FLAME framework, the only supercomputing framework that automatically produces parallelisable code on different parallel hardware architectures, on cloud infrastructures. The framework focuses on agent-based modelling (ABM) technique which has presented various challenges in the high-performance computing fields and how these reflect in Cloud environments. Computationally these simulations are extremely complex to program with interconnected software, using massive amount of computational power and architectural challenges. High-performance computing grids have provided solutions to some of these issues, but are still not capable enough to solve most of the issues faced by the modelers. This paper discusses the computational problems of executing these simulations and open challenges. Presenting ABM-as-a-service with a possible framework on how this can be implemented with a platform as a service backend. Computational problems such as memory, processing and time are discussed highlighting the issues for enabling these services for non-computing scientists.
为了成功地完成仿真任务,建模和仿真在很大程度上受到计算能力和资源可用性的影响。在本文中,我们研究了在云基础设施上部署FLAME框架,这是唯一一个在不同并行硬件架构上自动生成可并行代码的超级计算框架。该框架侧重于基于代理的建模(ABM)技术,该技术在高性能计算领域提出了各种挑战,以及这些挑战如何在云环境中反映出来。在计算上,这些模拟用互联软件编程是极其复杂的,使用大量的计算能力和架构挑战。高性能计算网格已经为其中的一些问题提供了解决方案,但仍然不足以解决建模者面临的大多数问题。本文讨论了执行这些模拟的计算问题和开放的挑战。呈现abm即服务,并提供一个可能的框架,说明如何使用平台作为服务后端来实现它。讨论了诸如内存、处理和时间等计算问题,突出了为非计算科学家提供这些服务的问题。
{"title":"Agent-Based Modelling as a Service on Amazon EC2: Opportunities and Challenges","authors":"M. Kiran, Kabiru M. Maiyama, Haroon Mir, Bashir Mohammed, Ashraf Al-Ou'n","doi":"10.1109/UCC.2015.42","DOIUrl":"https://doi.org/10.1109/UCC.2015.42","url":null,"abstract":"Modelling and Simulation is heavily influenced by availability of computational power and resources, to successfully complete simulation tasks. In this paper, we investigate deploying the FLAME framework, the only supercomputing framework that automatically produces parallelisable code on different parallel hardware architectures, on cloud infrastructures. The framework focuses on agent-based modelling (ABM) technique which has presented various challenges in the high-performance computing fields and how these reflect in Cloud environments. Computationally these simulations are extremely complex to program with interconnected software, using massive amount of computational power and architectural challenges. High-performance computing grids have provided solutions to some of these issues, but are still not capable enough to solve most of the issues faced by the modelers. This paper discusses the computational problems of executing these simulations and open challenges. Presenting ABM-as-a-service with a possible framework on how this can be implemented with a platform as a service backend. Computational problems such as memory, processing and time are discussed highlighting the issues for enabling these services for non-computing scientists.","PeriodicalId":381279,"journal":{"name":"2015 IEEE/ACM 8th International Conference on Utility and Cloud Computing (UCC)","volume":"50 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130331025","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Enhancing the Usability and Utilization of Accelerated Architectures via Docker 通过Docker增强加速架构的可用性和利用率
Nicholas Haydel, S. Gesing, I. Taylor, G. Madey, Abdul Dakkak, Simon Garcia De Gonzalo, Wen-mei W. Hwu
Accelerated architectures such as GPUs (Graphics Processing Units) and MICs (Many Integrated Cores) have been proven to increase the performance of many algorithms compared to their CPU counterparts and are widely available in local, campus-wide and national infrastructures, however, their utilization is not following the same pace as their deployment. Reasons for the underutilization lay partly on the software side with proprietary and complex interfaces for development and usage. A common API providing an extra layer to abstract the differences and specific characteristics of those architectures would deliver a far more portable interface for application developers. This cloud challenge proposal presents such an API that addresses these issues using a container-based approach. The resulting environment provides Docker-based containers for deploying accelerator libraries, such as CUDA Toolkit, OpenCL and OpenACC, onto a wide variety of different platforms and operating systems. By leveraging the container approach, we can overlay accelerator libraries onto the host without needing to be concerned about the intricacies of underlying operating system of the host. Docker therefore provides the advantage of being easily applicable on diverse architectures, virtualizing the necessary environment and including libraries as well as applications in a standardized way. The novelty of our approach is the extra layer for utilization and device discovery in this layer improving the usability and uniform development of accelerated methods with direct access to resources.
加速架构,如gpu(图形处理单元)和mic(多集成核心)已经被证明可以提高许多算法的性能,并且在本地,校园范围和国家基础设施中广泛使用,然而,它们的利用率并不像它们的部署一样快。未充分利用的原因部分在于软件方面,具有专有的和复杂的开发和使用接口。一个通用的API提供了一个额外的层来抽象这些体系结构的差异和特定特征,这将为应用程序开发人员提供一个更加可移植的接口。这个云挑战提案提供了这样一个API,它使用基于容器的方法来解决这些问题。由此产生的环境提供了基于docker的容器,用于在各种不同的平台和操作系统上部署加速库,如CUDA Toolkit、OpenCL和OpenACC。通过利用容器方法,我们可以将加速器库覆盖到主机上,而无需担心主机底层操作系统的复杂性。因此,Docker提供了易于应用于各种架构的优势,虚拟化必要的环境,并以标准化的方式包括库和应用程序。我们方法的新颖之处在于,在这一层中增加了用于利用和设备发现的额外层,提高了直接访问资源的加速方法的可用性和统一开发。
{"title":"Enhancing the Usability and Utilization of Accelerated Architectures via Docker","authors":"Nicholas Haydel, S. Gesing, I. Taylor, G. Madey, Abdul Dakkak, Simon Garcia De Gonzalo, Wen-mei W. Hwu","doi":"10.1109/UCC.2015.57","DOIUrl":"https://doi.org/10.1109/UCC.2015.57","url":null,"abstract":"Accelerated architectures such as GPUs (Graphics Processing Units) and MICs (Many Integrated Cores) have been proven to increase the performance of many algorithms compared to their CPU counterparts and are widely available in local, campus-wide and national infrastructures, however, their utilization is not following the same pace as their deployment. Reasons for the underutilization lay partly on the software side with proprietary and complex interfaces for development and usage. A common API providing an extra layer to abstract the differences and specific characteristics of those architectures would deliver a far more portable interface for application developers. This cloud challenge proposal presents such an API that addresses these issues using a container-based approach. The resulting environment provides Docker-based containers for deploying accelerator libraries, such as CUDA Toolkit, OpenCL and OpenACC, onto a wide variety of different platforms and operating systems. By leveraging the container approach, we can overlay accelerator libraries onto the host without needing to be concerned about the intricacies of underlying operating system of the host. Docker therefore provides the advantage of being easily applicable on diverse architectures, virtualizing the necessary environment and including libraries as well as applications in a standardized way. The novelty of our approach is the extra layer for utilization and device discovery in this layer improving the usability and uniform development of accelerated methods with direct access to resources.","PeriodicalId":381279,"journal":{"name":"2015 IEEE/ACM 8th International Conference on Utility and Cloud Computing (UCC)","volume":"29 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130421586","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
When IT Meets Telco: RAN as a Service 当IT遇到电信:RAN即服务
A. Outtagarts, L. Roullet, Bruno Mongazon-Cazavet, G. Aravinthan
Network virtualization functions (NFV) and software-defined networking (SDN) are changing the landscape of the telecommunications industry, particularly infrastructure and network systems of Telco operators with the introduction of cloud computing, paradigms of virtualization and software approaches. In this paper, we describe a demonstrator which shows how IT technologies reduce the time of deployment of a wireless infrastructure. In less than 60s, a wireless LTE network is available for connecting Smartphone's. In this demo, the eNodeB, virtualized using docker containers, is orchestrated by OpenStack heat.
网络虚拟化功能(NFV)和软件定义网络(SDN)正在改变电信行业的格局,特别是随着云计算、虚拟化范例和软件方法的引入,电信运营商的基础设施和网络系统。在本文中,我们描述了一个演示,它展示了IT技术如何减少无线基础设施的部署时间。不到60年代,就可以使用无线LTE网络连接智能手机。在本演示中,使用docker容器虚拟化的eNodeB由OpenStack heat编排。
{"title":"When IT Meets Telco: RAN as a Service","authors":"A. Outtagarts, L. Roullet, Bruno Mongazon-Cazavet, G. Aravinthan","doi":"10.1109/UCC.2015.75","DOIUrl":"https://doi.org/10.1109/UCC.2015.75","url":null,"abstract":"Network virtualization functions (NFV) and software-defined networking (SDN) are changing the landscape of the telecommunications industry, particularly infrastructure and network systems of Telco operators with the introduction of cloud computing, paradigms of virtualization and software approaches. In this paper, we describe a demonstrator which shows how IT technologies reduce the time of deployment of a wireless infrastructure. In less than 60s, a wireless LTE network is available for connecting Smartphone's. In this demo, the eNodeB, virtualized using docker containers, is orchestrated by OpenStack heat.","PeriodicalId":381279,"journal":{"name":"2015 IEEE/ACM 8th International Conference on Utility and Cloud Computing (UCC)","volume":"115 3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116641412","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
期刊
2015 IEEE/ACM 8th International Conference on Utility and Cloud Computing (UCC)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1