{"title":"System Level Benchmarking of Public Clouds","authors":"S. Ahuja","doi":"10.4018/ijcac.309933","DOIUrl":null,"url":null,"abstract":"It is important for cloud users to be able to evaluate and compare different cloud services to achieve high performance and maximize cost savings. To that end, this research benchmarked Amazon web services elastic compute cloud and Rackspace cloud infrastructure and compared the results for the two public cloud providers. The intent of the study was to determine how these selected providers perform with regards to system parameter usage and hence three system-level benchmarks: STREAM, IOR, and NPB-EP were run on different configurations to provide an insight to the cloud users in selection of provider on VM clusters of 1,2,4,6, and 8 nodes. The clusters were created with similar virtual machines from both providers. The benchmarks examined bandwidth, I/O and CPU performance. A comparison of results for the two providers is presented graphically and T-test applied to determine if differences are significant. Observations were taken at multiple times at different time periods on weekdays and weekends to examine variance of cloud performance.","PeriodicalId":442336,"journal":{"name":"Int. J. Cloud Appl. Comput.","volume":"32 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-04-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Int. J. Cloud Appl. Comput.","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.4018/ijcac.309933","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
It is important for cloud users to be able to evaluate and compare different cloud services to achieve high performance and maximize cost savings. To that end, this research benchmarked Amazon web services elastic compute cloud and Rackspace cloud infrastructure and compared the results for the two public cloud providers. The intent of the study was to determine how these selected providers perform with regards to system parameter usage and hence three system-level benchmarks: STREAM, IOR, and NPB-EP were run on different configurations to provide an insight to the cloud users in selection of provider on VM clusters of 1,2,4,6, and 8 nodes. The clusters were created with similar virtual machines from both providers. The benchmarks examined bandwidth, I/O and CPU performance. A comparison of results for the two providers is presented graphically and T-test applied to determine if differences are significant. Observations were taken at multiple times at different time periods on weekdays and weekends to examine variance of cloud performance.
对于云用户来说,能够评估和比较不同的云服务以实现高性能和最大限度地节省成本是非常重要的。为此,本研究对Amazon web services弹性计算云和Rackspace云基础设施进行了基准测试,并比较了这两个公共云提供商的结果。该研究的目的是确定这些选定的提供商在系统参数使用方面的表现,因此三个系统级基准:STREAM、IOR和NPB-EP在不同的配置上运行,以便为云用户在1、2、4、6和8个节点的VM集群上选择提供商提供洞察。集群是用来自两个提供商的类似虚拟机创建的。基准测试测试了带宽、I/O和CPU性能。两个提供者的比较结果以图形形式呈现,并应用t检验来确定差异是否显著。在工作日和周末的不同时间段进行多次观测,以检验云性能的差异。