首页 > 最新文献

2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing最新文献

英文 中文
Cowic: A Column-Wise Independent Compression for Log Stream Analysis cocoic:用于日志流分析的列独立压缩
Hao Lin, Jingyu Zhou, Bin Yao, M. Guo, Jie Li
Nowadays massive log streams are generated from many Internet and cloud services. Storing log streams consumes a large amount of disk space and incurs high cost. Traditional compression methods can be applied to reduce storage cost, but are inefficient for log analysis, because fetching relevant log entries from compressed data often requires retrieval and decompression of large blocks of data. We propose a column-wise compression approach for well-formatted log streams, where each log entry can be independently compressed or decompressed for analysis. Specifically, we separate a log entry into several columns and compress each column with different models. We have implemented our approach as a library and integrated it into two applications, a log search system and a log joining system. Experimental results show that our compression scheme outperforms traditional compression methods for decompression times and has a competitive compression ratio. For log search, our approach achieves better query times than using traditional compression algorithms for both in-core and out-of-core cases. For joining log streams, our approach achieves the same join quality with only 30% memory of uncompressed streams.
如今,大量的日志流是由许多互联网和云服务产生的。存储日志流占用磁盘空间大,成本高。传统的压缩方法可以降低存储成本,但对于日志分析来说效率低下,因为从压缩数据中获取相关的日志条目通常需要检索和解压缩大块数据。我们为格式良好的日志流提出了一种按列压缩方法,其中每个日志条目可以独立地压缩或解压缩以进行分析。具体来说,我们将一个日志条目分成几个列,并用不同的模型压缩每个列。我们已经将我们的方法实现为一个图书馆,并将其集成到两个应用程序中,一个日志搜索系统和一个日志连接系统。实验结果表明,我们的压缩方案在压缩次数上优于传统的压缩方法,压缩比具有竞争力。对于日志搜索,无论在核内还是核外情况下,我们的方法都比使用传统压缩算法获得了更好的查询时间。对于连接日志流,我们的方法只需要30%未压缩流的内存就可以实现相同的连接质量。
{"title":"Cowic: A Column-Wise Independent Compression for Log Stream Analysis","authors":"Hao Lin, Jingyu Zhou, Bin Yao, M. Guo, Jie Li","doi":"10.1109/CCGrid.2015.45","DOIUrl":"https://doi.org/10.1109/CCGrid.2015.45","url":null,"abstract":"Nowadays massive log streams are generated from many Internet and cloud services. Storing log streams consumes a large amount of disk space and incurs high cost. Traditional compression methods can be applied to reduce storage cost, but are inefficient for log analysis, because fetching relevant log entries from compressed data often requires retrieval and decompression of large blocks of data. We propose a column-wise compression approach for well-formatted log streams, where each log entry can be independently compressed or decompressed for analysis. Specifically, we separate a log entry into several columns and compress each column with different models. We have implemented our approach as a library and integrated it into two applications, a log search system and a log joining system. Experimental results show that our compression scheme outperforms traditional compression methods for decompression times and has a competitive compression ratio. For log search, our approach achieves better query times than using traditional compression algorithms for both in-core and out-of-core cases. For joining log streams, our approach achieves the same join quality with only 30% memory of uncompressed streams.","PeriodicalId":6664,"journal":{"name":"2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing","volume":"26 1","pages":"21-30"},"PeriodicalIF":0.0,"publicationDate":"2015-05-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89419407","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 17
DualVisor: Redundant Hypervisor Execution for Achieving Hardware Error Resilience in Datacenters DualVisor:在数据中心实现硬件错误恢复的冗余管理程序执行
Xin Xu, H. H. Huang
Virtualization technology as the foundation of cloud computing provides many benefits in cost, security, and management, but all of them rely on the reliability of the underlying virtualization software - the hypervisor (or virtual machine monitor). Cloud data centers are built upon 10Ks to 100Ks commodity servers. Hardware errors in these large scale computer systems are not rare events. When hardware errors occur during the hypervisor execution, they may cause failures or data corruptions in co-located VMs, undermining the whole system reliability. In this paper, we propose DualVisor, that uses a software redundancy based fault tolerance technique to protect the hypervisor from hardware errors. DualVisor replicates hypervisor executions and data structures for error detection and recovery. In this work, we first study the need for a hardware error-resilient hypervisor. Then, we discuss the design considerations in detail. We implement a prototype in the hypervisor to demonstrate the feasibility and evaluate the performance overhead. Our preliminary results show that the performance overhead of DualVisor is fairly small (less than 6%) for tested applications.
虚拟化技术作为云计算的基础,在成本、安全性和管理方面提供了许多好处,但所有这些都依赖于底层虚拟化软件——管理程序(或虚拟机监视器)的可靠性。云数据中心建立在10k到100k的商用服务器上。这些大型计算机系统中的硬件错误并不罕见。当虚拟化环境在执行过程中出现硬件错误时,可能会导致虚拟机故障或数据损坏,从而降低整个系统的可靠性。在本文中,我们提出了DualVisor,它使用基于软件冗余的容错技术来保护管理程序免受硬件错误的影响。DualVisor复制管理程序执行和数据结构,用于错误检测和恢复。在这项工作中,我们首先研究了对硬件容错管理程序的需求。然后,详细讨论了设计注意事项。我们在管理程序中实现了一个原型,以演示可行性并评估性能开销。我们的初步结果表明,对于测试的应用程序,DualVisor的性能开销相当小(小于6%)。
{"title":"DualVisor: Redundant Hypervisor Execution for Achieving Hardware Error Resilience in Datacenters","authors":"Xin Xu, H. H. Huang","doi":"10.1109/CCGrid.2015.30","DOIUrl":"https://doi.org/10.1109/CCGrid.2015.30","url":null,"abstract":"Virtualization technology as the foundation of cloud computing provides many benefits in cost, security, and management, but all of them rely on the reliability of the underlying virtualization software - the hypervisor (or virtual machine monitor). Cloud data centers are built upon 10Ks to 100Ks commodity servers. Hardware errors in these large scale computer systems are not rare events. When hardware errors occur during the hypervisor execution, they may cause failures or data corruptions in co-located VMs, undermining the whole system reliability. In this paper, we propose DualVisor, that uses a software redundancy based fault tolerance technique to protect the hypervisor from hardware errors. DualVisor replicates hypervisor executions and data structures for error detection and recovery. In this work, we first study the need for a hardware error-resilient hypervisor. Then, we discuss the design considerations in detail. We implement a prototype in the hypervisor to demonstrate the feasibility and evaluate the performance overhead. Our preliminary results show that the performance overhead of DualVisor is fairly small (less than 6%) for tested applications.","PeriodicalId":6664,"journal":{"name":"2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing","volume":"16 1","pages":"485-494"},"PeriodicalIF":0.0,"publicationDate":"2015-05-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87555920","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
HPC-ABDS High Performance Computing Enhanced Apache Big Data Stack 高性能计算增强Apache大数据栈
Pub Date : 2015-05-04 DOI: 10.1109/CCGrid.2015.122
G. Fox, J. Qiu, Supun Kamburugamuve, S. Jha, André Luckow
We review the High Performance Computing Enhanced Apache Big Data Stack HPC-ABDS and summarize the capabilities in 21 identified architecture layers. These cover Message and Data Protocols, Distributed Coordination, Security & Privacy, Monitoring, Infrastructure Management, DevOps, Interoperability, File Systems, Cluster & Resource management, Data Transport, File management, NoSQL, SQL (NewSQL), Extraction Tools, Object-relational mapping, In-memory caching and databases, Inter-process Communication, Batch Programming model and Runtime, Stream Processing, High-level Programming, Application Hosting and PaaS, Libraries and Applications, Workflow and Orchestration. We summarize status of these layers focusing on issues of importance for data analytics. We highlight areas where HPC and ABDS have good opportunities for integration.
我们回顾了高性能计算增强Apache大数据堆栈HPC-ABDS,并总结了21个确定的架构层的功能。这些内容包括消息和数据协议、分布式协调、安全和隐私、监控、基础设施管理、DevOps、互操作性、文件系统、集群和资源管理、数据传输、文件管理、NoSQL、SQL (NewSQL)、提取工具、对象关系映射、内存缓存和数据库、进程间通信、批处理编程模型和运行时、流处理、高级编程、应用程序托管和PaaS、库和应用程序、工作流和编排。我们总结了这些层的现状,重点关注数据分析的重要问题。我们强调了HPC和ABDS有很好的整合机会的领域。
{"title":"HPC-ABDS High Performance Computing Enhanced Apache Big Data Stack","authors":"G. Fox, J. Qiu, Supun Kamburugamuve, S. Jha, André Luckow","doi":"10.1109/CCGrid.2015.122","DOIUrl":"https://doi.org/10.1109/CCGrid.2015.122","url":null,"abstract":"We review the High Performance Computing Enhanced Apache Big Data Stack HPC-ABDS and summarize the capabilities in 21 identified architecture layers. These cover Message and Data Protocols, Distributed Coordination, Security & Privacy, Monitoring, Infrastructure Management, DevOps, Interoperability, File Systems, Cluster & Resource management, Data Transport, File management, NoSQL, SQL (NewSQL), Extraction Tools, Object-relational mapping, In-memory caching and databases, Inter-process Communication, Batch Programming model and Runtime, Stream Processing, High-level Programming, Application Hosting and PaaS, Libraries and Applications, Workflow and Orchestration. We summarize status of these layers focusing on issues of importance for data analytics. We highlight areas where HPC and ABDS have good opportunities for integration.","PeriodicalId":6664,"journal":{"name":"2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing","volume":"27 1 1","pages":"1057-1066"},"PeriodicalIF":0.0,"publicationDate":"2015-05-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75150524","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 43
Boosting GPU Performance by Profiling-Based L1 Data Cache Bypassing 通过基于分析的L1数据缓存绕过来提高GPU性能
Y. Huangfu, Wei Zhang
Cache memories have been introduced in recent generations of Graphics Processing Units (GPUs) to benefit general-purpose computing on GPUs (GPGPUs). In this work, we analyze the memory access patterns of GPGPU applications and propose a cost-effective profiling-based method to identify the data accesses that should bypass the L1 data cache to improve performance. The evaluation indicates that the proposed L1 cache bypassing can improve the GPU performance by 13.8% on average.
在最近几代图形处理单元(gpu)中引入了缓存存储器,以便在gpu (gpgpu)上进行通用计算。在这项工作中,我们分析了GPGPU应用程序的内存访问模式,并提出了一种经济有效的基于分析的方法来识别应该绕过L1数据缓存以提高性能的数据访问。评估结果表明,所提出的L1缓存绕过可以使GPU性能平均提高13.8%。
{"title":"Boosting GPU Performance by Profiling-Based L1 Data Cache Bypassing","authors":"Y. Huangfu, Wei Zhang","doi":"10.1109/CCGrid.2015.67","DOIUrl":"https://doi.org/10.1109/CCGrid.2015.67","url":null,"abstract":"Cache memories have been introduced in recent generations of Graphics Processing Units (GPUs) to benefit general-purpose computing on GPUs (GPGPUs). In this work, we analyze the memory access patterns of GPGPU applications and propose a cost-effective profiling-based method to identify the data accesses that should bypass the L1 data cache to improve performance. The evaluation indicates that the proposed L1 cache bypassing can improve the GPU performance by 13.8% on average.","PeriodicalId":6664,"journal":{"name":"2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing","volume":"9 1","pages":"1119-1122"},"PeriodicalIF":0.0,"publicationDate":"2015-05-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73890974","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
A Reliable Distributed Convolutional Neural Network for Biology Image Segmentation 一种可靠的分布式卷积神经网络用于生物图像分割
Pub Date : 2015-05-04 DOI: 10.1109/CCGrid.2015.108
Xiuxia Zhang, Guangming Tan, Mingyu Chen
Many modern advanced biology experiments are carried on by Electron Microscope(EM) image analysis. Segmentation is one of the most important and complex steps in the process of image analysis. Previous ISBI contest results and related research show that Convolution Neural Network(CNN)has high classification accuracy in EM image segmentation. Besides it eliminates the pain of extracting complex features which's indispensable for traditional classification algorithms. However CNN's extremely time-consuming and fault vulnerability due to long time execution prevent it from being widely used in practice. In this paper, we try to address these problems by providing reliable high performance CNN framework for medial image segmentation. Our CNN has light weighted user level checkpoint, which costs seconds when doing one checkpoint and restart. On the fact of lacking in platform diversity in current parallel CNN framework, our CNN system tries to make it general by providing distributed cross-platform parallelism implementation. Currently we have integrated Theano's GPU implementation in our CNNsystem, and we explore parallelism potential on multi-core CPUs and many-core Intel Phi by testing performance of main kernel functions of CNN. In the future, we will integrate implementation son other two platforms into our CNN framework.
现代许多高级生物学实验都是通过电子显微镜(EM)图像分析进行的。分割是图像分析过程中最重要也是最复杂的步骤之一。以往的ISBI竞赛结果和相关研究表明,卷积神经网络(CNN)在EM图像分割中具有较高的分类准确率。此外,它还消除了传统分类算法所不可缺少的提取复杂特征的痛苦。然而,CNN的耗时和长时间执行导致的故障脆弱性使其无法在实践中得到广泛应用。在本文中,我们试图通过为媒体图像分割提供可靠的高性能CNN框架来解决这些问题。我们的CNN有轻量级的用户级检查点,执行一个检查点并重新启动需要几秒钟的时间。针对当前并行CNN框架缺乏平台多样性的问题,我们的CNN系统试图通过提供分布式跨平台并行实现来使其通用性。目前,我们已经将Theano的GPU实现集成到我们的CNN系统中,并通过测试CNN主要内核函数的性能来探索多核cpu和多核Intel Phi上的并行化潜力。未来,我们将把其他两个平台的实现集成到我们的CNN框架中。
{"title":"A Reliable Distributed Convolutional Neural Network for Biology Image Segmentation","authors":"Xiuxia Zhang, Guangming Tan, Mingyu Chen","doi":"10.1109/CCGrid.2015.108","DOIUrl":"https://doi.org/10.1109/CCGrid.2015.108","url":null,"abstract":"Many modern advanced biology experiments are carried on by Electron Microscope(EM) image analysis. Segmentation is one of the most important and complex steps in the process of image analysis. Previous ISBI contest results and related research show that Convolution Neural Network(CNN)has high classification accuracy in EM image segmentation. Besides it eliminates the pain of extracting complex features which's indispensable for traditional classification algorithms. However CNN's extremely time-consuming and fault vulnerability due to long time execution prevent it from being widely used in practice. In this paper, we try to address these problems by providing reliable high performance CNN framework for medial image segmentation. Our CNN has light weighted user level checkpoint, which costs seconds when doing one checkpoint and restart. On the fact of lacking in platform diversity in current parallel CNN framework, our CNN system tries to make it general by providing distributed cross-platform parallelism implementation. Currently we have integrated Theano's GPU implementation in our CNNsystem, and we explore parallelism potential on multi-core CPUs and many-core Intel Phi by testing performance of main kernel functions of CNN. In the future, we will integrate implementation son other two platforms into our CNN framework.","PeriodicalId":6664,"journal":{"name":"2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing","volume":"55 1","pages":"777-780"},"PeriodicalIF":0.0,"publicationDate":"2015-05-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80429155","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
A Virtual Machine Placement Taxonomy 虚拟机放置分类法
Fabio Lopez Pires, B. Barán
Cloud computing data enters dynamically provide millions of virtual machines (VMs) in actual cloud markets. In this context, Virtual Machine Placement (VMP) is one of the most challenging problems in cloud infrastructure management, considering the large number of possible optimization criteria and different formulations that could be studied. VMP literature include relevant research topics such as energy efficiency, Service Level Agreement (SLA), Quality of Service (QoS), cloud service pricing schemes and carbon dioxide emissions, all of them with high economical and ecological impact. This work classifies an extensive up-to-date survey of the most relevant VMP literature proposing a novel taxonomy in order to identify research opportunities and define a general vision on this research area.
云计算数据中心在实际的云市场中动态地提供数以百万计的虚拟机(vm)。在这种情况下,考虑到大量可能的优化标准和可以研究的不同公式,虚拟机放置(VMP)是云基础设施管理中最具挑战性的问题之一。VMP文献包括能源效率、服务水平协议(SLA)、服务质量(QoS)、云服务定价方案和二氧化碳排放等相关研究课题,它们都具有很高的经济和生态影响。这项工作对最相关的VMP文献进行了广泛的最新调查,提出了一种新的分类法,以确定研究机会并定义这一研究领域的总体愿景。
{"title":"A Virtual Machine Placement Taxonomy","authors":"Fabio Lopez Pires, B. Barán","doi":"10.1109/CCGrid.2015.15","DOIUrl":"https://doi.org/10.1109/CCGrid.2015.15","url":null,"abstract":"Cloud computing data enters dynamically provide millions of virtual machines (VMs) in actual cloud markets. In this context, Virtual Machine Placement (VMP) is one of the most challenging problems in cloud infrastructure management, considering the large number of possible optimization criteria and different formulations that could be studied. VMP literature include relevant research topics such as energy efficiency, Service Level Agreement (SLA), Quality of Service (QoS), cloud service pricing schemes and carbon dioxide emissions, all of them with high economical and ecological impact. This work classifies an extensive up-to-date survey of the most relevant VMP literature proposing a novel taxonomy in order to identify research opportunities and define a general vision on this research area.","PeriodicalId":6664,"journal":{"name":"2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing","volume":"40 1","pages":"159-168"},"PeriodicalIF":0.0,"publicationDate":"2015-05-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76158062","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 92
CloudSimSDN: Modeling and Simulation of Software-Defined Cloud Data Centers CloudSimSDN:软件定义云数据中心的建模和仿真
Jungmin Son, A. V. Dastjerdi, R. Calheiros, Xiaohui Ji, Young Yoon, R. Buyya
Software-Defined Networking not only addresses the shortcoming of traditional network technologies in dealing with frequent and immediate changes in cloud data centers but also made network resource management open and innovation-friendly. To further accelerate the innovation pace, accessible and easy-to-learn testbeds are required which estimate and measure the performance of network and host capacity provisioning approaches simultaneously within a data center. This is a challenging task and is often costly if accomplished in a physical environment. Thus, a lightweight and scalable simulation environment is necessary to evaluate the network allocation capacity policies while avoiding such a complicated and expensive facility. This paper introduces CloudSimSDN, a simulation framework for SDN-enabled cloud environments based on CloudSim. This paper develops and presents the overall architecture and features of the framework and provides several use cases. Moreover, we empirically validate the accuracy and effectiveness of CloudSimSDN through a number of simulations of a cloud-based three-tier web application.
软件定义网络不仅解决了传统网络技术在应对云数据中心频繁、即时变化方面的不足,而且使网络资源管理具有开放性和创新性。为了进一步加快创新步伐,需要可访问且易于学习的测试平台,以在数据中心内同时评估和测量网络和主机容量供应方法的性能。这是一项具有挑战性的任务,如果在物理环境中完成,通常代价高昂。因此,需要一个轻量级和可扩展的模拟环境来评估网络分配容量策略,同时避免使用如此复杂和昂贵的设施。本文介绍了基于CloudSim的支持sdn的云环境仿真框架CloudSimSDN。本文开发并展示了该框架的总体架构和功能,并提供了几个用例。此外,我们通过对基于云的三层web应用程序的大量模拟,经验验证了CloudSimSDN的准确性和有效性。
{"title":"CloudSimSDN: Modeling and Simulation of Software-Defined Cloud Data Centers","authors":"Jungmin Son, A. V. Dastjerdi, R. Calheiros, Xiaohui Ji, Young Yoon, R. Buyya","doi":"10.1109/CCGrid.2015.87","DOIUrl":"https://doi.org/10.1109/CCGrid.2015.87","url":null,"abstract":"Software-Defined Networking not only addresses the shortcoming of traditional network technologies in dealing with frequent and immediate changes in cloud data centers but also made network resource management open and innovation-friendly. To further accelerate the innovation pace, accessible and easy-to-learn testbeds are required which estimate and measure the performance of network and host capacity provisioning approaches simultaneously within a data center. This is a challenging task and is often costly if accomplished in a physical environment. Thus, a lightweight and scalable simulation environment is necessary to evaluate the network allocation capacity policies while avoiding such a complicated and expensive facility. This paper introduces CloudSimSDN, a simulation framework for SDN-enabled cloud environments based on CloudSim. This paper develops and presents the overall architecture and features of the framework and provides several use cases. Moreover, we empirically validate the accuracy and effectiveness of CloudSimSDN through a number of simulations of a cloud-based three-tier web application.","PeriodicalId":6664,"journal":{"name":"2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing","volume":"25 1","pages":"475-484"},"PeriodicalIF":0.0,"publicationDate":"2015-05-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76311009","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 111
Dependable Horizontal Scaling Based on Probabilistic Model Checking 基于概率模型检验的可靠水平尺度
A. Naskos, Emmanouela Stachtiari, A. Gounaris, P. Katsaros, Dimitrios Tsoumakos, I. Konstantinou, S. Sioutas
The focus of this work is the on-demand resource provisioning in cloud computing, which is commonly referredto as cloud elasticity. Although a lot of effort has been invested in developing systems and mechanisms that enable elasticity, the elasticity decision policies tend to be designed without quantifying or guaranteeing the quality of their operation. We present an approach towards the development of more formalized and dependable elasticity policies. We make two distinct contributions. First, we propose an extensible approach to enforcing elasticity through the dynamic instantiation and online quantitative verification of Markov Decision Processes(MDP) using probabilistic model checking. Second, various concrete elasticity models and elasticity policies are studied. We evaluate the decision policies using traces from a realNoSQL database cluster under constantly evolving externalload. We reason about the behaviour of different modelling and elasticity policy options and we show that our proposal can improve upon the state-of-the-art in significantly decreasing under-provisioning while avoiding over-provisioning.
这项工作的重点是云计算中的按需资源供应,这通常被称为云弹性。尽管在开发支持弹性的系统和机制方面投入了大量精力,但弹性决策策略的设计往往没有量化或保证其操作的质量。我们提出了一种开发更形式化和可靠的弹性策略的方法。我们有两个不同的贡献。首先,我们提出了一种可扩展的方法,通过使用概率模型检查的马尔可夫决策过程(MDP)的动态实例化和在线定量验证来增强弹性。其次,研究了各种混凝土弹性模型和弹性策略。在不断变化的外部负载下,我们使用来自realNoSQL数据库集群的跟踪来评估决策策略。我们对不同建模和弹性策略选项的行为进行了推理,并表明我们的建议可以在显著减少供应不足的同时避免供应过剩。
{"title":"Dependable Horizontal Scaling Based on Probabilistic Model Checking","authors":"A. Naskos, Emmanouela Stachtiari, A. Gounaris, P. Katsaros, Dimitrios Tsoumakos, I. Konstantinou, S. Sioutas","doi":"10.1109/CCGrid.2015.91","DOIUrl":"https://doi.org/10.1109/CCGrid.2015.91","url":null,"abstract":"The focus of this work is the on-demand resource provisioning in cloud computing, which is commonly referredto as cloud elasticity. Although a lot of effort has been invested in developing systems and mechanisms that enable elasticity, the elasticity decision policies tend to be designed without quantifying or guaranteeing the quality of their operation. We present an approach towards the development of more formalized and dependable elasticity policies. We make two distinct contributions. First, we propose an extensible approach to enforcing elasticity through the dynamic instantiation and online quantitative verification of Markov Decision Processes(MDP) using probabilistic model checking. Second, various concrete elasticity models and elasticity policies are studied. We evaluate the decision policies using traces from a realNoSQL database cluster under constantly evolving externalload. We reason about the behaviour of different modelling and elasticity policy options and we show that our proposal can improve upon the state-of-the-art in significantly decreasing under-provisioning while avoiding over-provisioning.","PeriodicalId":6664,"journal":{"name":"2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing","volume":"21 1","pages":"31-40"},"PeriodicalIF":0.0,"publicationDate":"2015-05-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80782389","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 55
Security-Oriented Cloud Platform for SOA-Based SCADA 面向安全的soa SCADA云平台
T. Baker, M. Mackay, A. Shaheed, Bandar Aldawsari
During the last 10 years, experts in critical infrastructure security have been increasingly directing their focus and attention to the security of control structures such as Supervisory Control and Data Acquisition (SCADA) systems in the light of the move toward Internet-connected architectures. However, this more open architecture has resulted in an increasing level of risk being faced by these systems, especially as they became offered as services and utilised via Service Oriented Architectures (SOA). For example, the SOA-based SCADA architecture proposed by the AESOP project concentrated on facilitating the integration of SCADA systems with distributed services on the application layer of a cloud network. However, whilst each service specified various security goals, such as authorisation and authentication, the current AESOP model does not attempt to encompass all the necessary security requirements and features of the integrated services. This paper presents a concept for an innovative integrated cloud platform to reinforce the integrity and security of SOA-based SCADA systems that will apply in the context of Critical Infrastructures to identify the core requirements, components and features of these types of system. The paper uses the SmartGrid to highlight the applicability and importance of the proposed platform in a real world scenario.
在过去的10年里,随着互联网连接架构的发展,关键基础设施安全专家越来越多地将注意力集中在监控和数据采集(SCADA)系统等控制结构的安全性上。然而,这种更加开放的体系结构导致这些系统面临的风险越来越大,特别是当它们作为服务提供并通过面向服务的体系结构(Service Oriented Architectures, SOA)使用时。例如,AESOP项目提出的基于soa的SCADA体系结构侧重于促进SCADA系统与云网络应用层上的分布式服务的集成。然而,虽然每个服务指定了各种安全目标,例如授权和身份验证,但当前的AESOP模型并没有尝试包含集成服务的所有必要的安全需求和特性。本文提出了一个创新的集成云平台的概念,以加强基于soa的SCADA系统的完整性和安全性,该系统将应用于关键基础设施的背景下,以确定这些类型系统的核心需求、组件和特征。本文使用智能电网来强调所提出的平台在现实世界场景中的适用性和重要性。
{"title":"Security-Oriented Cloud Platform for SOA-Based SCADA","authors":"T. Baker, M. Mackay, A. Shaheed, Bandar Aldawsari","doi":"10.1109/CCGrid.2015.37","DOIUrl":"https://doi.org/10.1109/CCGrid.2015.37","url":null,"abstract":"During the last 10 years, experts in critical infrastructure security have been increasingly directing their focus and attention to the security of control structures such as Supervisory Control and Data Acquisition (SCADA) systems in the light of the move toward Internet-connected architectures. However, this more open architecture has resulted in an increasing level of risk being faced by these systems, especially as they became offered as services and utilised via Service Oriented Architectures (SOA). For example, the SOA-based SCADA architecture proposed by the AESOP project concentrated on facilitating the integration of SCADA systems with distributed services on the application layer of a cloud network. However, whilst each service specified various security goals, such as authorisation and authentication, the current AESOP model does not attempt to encompass all the necessary security requirements and features of the integrated services. This paper presents a concept for an innovative integrated cloud platform to reinforce the integrity and security of SOA-based SCADA systems that will apply in the context of Critical Infrastructures to identify the core requirements, components and features of these types of system. The paper uses the SmartGrid to highlight the applicability and importance of the proposed platform in a real world scenario.","PeriodicalId":6664,"journal":{"name":"2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing","volume":"1 1","pages":"961-970"},"PeriodicalIF":0.0,"publicationDate":"2015-05-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80827887","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 35
SIRF-1: Enhancing Reliability of Single Flash SSD through Internal Mirroring for Mission-Critical Mobile Applications SIRF-1:通过内部镜像增强关键移动应用中单个Flash SSD的可靠性
Michael S. MacFadden, Richard Shelby, T. Xie
Flash memory based solid state drives (SSD) are increasingly common in portable and mobile computing devices such as laptops, mobile phones, and tablets. Due to space, weight, and power constraints, portable devices are often restricted to a single storage device, which makes them susceptible to data loss from internal errors. On the other hand, mission-critical mobile applications like wireless healthcare always demand a high level of data reliability. This is mainly because data sampled from mobile and dynamic environments are most likely irreproducible. An effective approach to improving storage and data reliability is the RAID (redundant arrays of inexpensive disks) organization. However, the multiple disks required to implement RAID make it incompatible with the aforementioned restrictions of many portable devices. In this paper, we propose a SIRF (single internally redundant flash) architecture that leverages the internal hierarchical structure and parallelism of SSDs to provide redundancy similar to RAID in a single drive configuration. The initial effort focuses on implementing SIRF-1 (mirroring), which is the corollary to its RAID-1 counterpart. In SIRF-1, data is mirrored across SSD channels to optimally exploit parallelism for both read and write operations. Simulation results show that for read-dominant workloads SIRF-1 significantly outperforms a non-mirrored SSD by up to 39.5% in terms of mean response time. For write-intensive workloads, SIRF-1 pays a performance penalty no more than 5.5%.
基于闪存的固态硬盘(SSD)在便携式和移动计算设备(如笔记本电脑、移动电话和平板电脑)中越来越普遍。由于空间、重量和功率的限制,便携式设备通常仅限于单个存储设备,这使得它们容易因内部错误而丢失数据。另一方面,像无线医疗保健这样的关键任务移动应用程序总是需要高水平的数据可靠性。这主要是因为从移动和动态环境中采样的数据很可能是不可复制的。提高存储和数据可靠性的一种有效方法是RAID(廉价磁盘的冗余阵列)组织。然而,实现RAID所需的多个磁盘使其与前面提到的许多便携式设备的限制不兼容。在本文中,我们提出了一种SIRF(单个内部冗余闪存)架构,它利用ssd的内部分层结构和并行性,在单个驱动器配置中提供类似于RAID的冗余。最初的工作重点是实现SIRF-1(镜像),这是其对应的RAID-1的必然结果。在SIRF-1中,数据在SSD通道上镜像,以最佳地利用读和写操作的并行性。仿真结果表明,对于以读为主的工作负载,SIRF-1在平均响应时间方面明显优于非镜像SSD,最高可达39.5%。对于写密集型工作负载,SIRF-1的性能损失不超过5.5%。
{"title":"SIRF-1: Enhancing Reliability of Single Flash SSD through Internal Mirroring for Mission-Critical Mobile Applications","authors":"Michael S. MacFadden, Richard Shelby, T. Xie","doi":"10.1109/CCGrid.2015.28","DOIUrl":"https://doi.org/10.1109/CCGrid.2015.28","url":null,"abstract":"Flash memory based solid state drives (SSD) are increasingly common in portable and mobile computing devices such as laptops, mobile phones, and tablets. Due to space, weight, and power constraints, portable devices are often restricted to a single storage device, which makes them susceptible to data loss from internal errors. On the other hand, mission-critical mobile applications like wireless healthcare always demand a high level of data reliability. This is mainly because data sampled from mobile and dynamic environments are most likely irreproducible. An effective approach to improving storage and data reliability is the RAID (redundant arrays of inexpensive disks) organization. However, the multiple disks required to implement RAID make it incompatible with the aforementioned restrictions of many portable devices. In this paper, we propose a SIRF (single internally redundant flash) architecture that leverages the internal hierarchical structure and parallelism of SSDs to provide redundancy similar to RAID in a single drive configuration. The initial effort focuses on implementing SIRF-1 (mirroring), which is the corollary to its RAID-1 counterpart. In SIRF-1, data is mirrored across SSD channels to optimally exploit parallelism for both read and write operations. Simulation results show that for read-dominant workloads SIRF-1 significantly outperforms a non-mirrored SSD by up to 39.5% in terms of mean response time. For write-intensive workloads, SIRF-1 pays a performance penalty no more than 5.5%.","PeriodicalId":6664,"journal":{"name":"2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing","volume":"87 1","pages":"343-351"},"PeriodicalIF":0.0,"publicationDate":"2015-05-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"84122547","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
期刊
2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1