首页 > 最新文献

Int. J. Grid Util. Comput.最新文献

英文 中文
A configurable and executable model of Spark Streaming on Apache YARN Spark Streaming在Apache YARN上的可配置和可执行模型
Pub Date : 2020-02-03 DOI: 10.1504/ijguc.2020.10026548
Jia-Chun Lin, Ming-Chang Lee, Ingrid Chieh Yu, E. Johnsen
Streams of data are produced today at an unprecedented scale. Efficient and stable processing of these streams requires a careful interplay between the parameters of the streaming application and of the underlying stream processing framework. Today, finding these parameters happens by trial and error on the complex, deployed framework. This paper shows that high-level models can help to determine these parameters by predicting and comparing the performance of streaming applications running on stream processing frameworks with different configurations. To demonstrate this approach, this paper considers Spark Streaming, a widely used framework to leverage data streams on the fly and provide real-time stream processing. Technically, we develop a configurable and executable model to simulate both the streaming applications and the underlying Spark stream processing framework. Furthermore, we model the deployment of Spark Streaming on Apache YARN, which is a popular open-source distributed software framework for big data processing. We show that the developed model provides a satisfactory accuracy for predicting performance by means of empirical validation.
今天,数据流以前所未有的规模产生。高效和稳定地处理这些流需要在流应用程序和底层流处理框架的参数之间进行仔细的相互作用。如今,要找到这些参数,需要在复杂的已部署框架上反复试验。本文表明,高级模型可以通过预测和比较在不同配置的流处理框架上运行的流应用程序的性能来帮助确定这些参数。为了演示这种方法,本文考虑了Spark Streaming,这是一个广泛使用的框架,用于动态利用数据流并提供实时流处理。在技术上,我们开发了一个可配置和可执行的模型来模拟流应用程序和底层Spark流处理框架。此外,我们还对Spark Streaming在Apache YARN上的部署进行了建模,Apache YARN是一个流行的大数据处理开源分布式软件框架。通过实证验证,表明所建立的模型具有较好的预测精度。
{"title":"A configurable and executable model of Spark Streaming on Apache YARN","authors":"Jia-Chun Lin, Ming-Chang Lee, Ingrid Chieh Yu, E. Johnsen","doi":"10.1504/ijguc.2020.10026548","DOIUrl":"https://doi.org/10.1504/ijguc.2020.10026548","url":null,"abstract":"Streams of data are produced today at an unprecedented scale. Efficient and stable processing of these streams requires a careful interplay between the parameters of the streaming application and of the underlying stream processing framework. Today, finding these parameters happens by trial and error on the complex, deployed framework. This paper shows that high-level models can help to determine these parameters by predicting and comparing the performance of streaming applications running on stream processing frameworks with different configurations. To demonstrate this approach, this paper considers Spark Streaming, a widely used framework to leverage data streams on the fly and provide real-time stream processing. Technically, we develop a configurable and executable model to simulate both the streaming applications and the underlying Spark stream processing framework. Furthermore, we model the deployment of Spark Streaming on Apache YARN, which is a popular open-source distributed software framework for big data processing. We show that the developed model provides a satisfactory accuracy for predicting performance by means of empirical validation.","PeriodicalId":375871,"journal":{"name":"Int. J. Grid Util. Comput.","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2020-02-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131148395","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
Preferential charging for government authorised emergency electric vehicles 政府批准的应急电动车辆优惠收费
Pub Date : 2020-02-03 DOI: 10.1504/ijguc.2020.10026557
R. Yaqub, F. A. Shifa, M. F. Butt
The proliferation of Electric Vehicles (EVs) is exponential. However, the power grid is not able to provide simultaneous charging of several EVs due to limited power production capabilities and old distribution infrastructure. Scheduled charging is one of the most advocated solutions. However, it is not viable for emergency vehicles. This paper proposes to provide priority charging service for government authorised emergency EVs. For enablement of this proposal, a complete solution that includes architecture, as well as the protocols suite is suggested. To realise such a service, the paper suggests a major functional entity called a Priority Charging Server, i.e. a database server where authorised emergency EVs' IDs are registered, and their record is maintained. The paper also proposes modifications in the IEC15118 and IEC 61850 protocol suites. These protocols provide communication between vehicle and grid. The solution also inculcates roaming as well as non-roaming scenarios, i.e. a priority charging request may be originated by an authorised emergency EV from a Home Utility Network, as well as Visiting Utility Network. The paper is concluded with a MATLAB-based proof-of-concept simulation.
电动汽车(ev)的增长呈指数级增长。然而,由于有限的电力生产能力和旧的配电基础设施,电网无法同时为几辆电动汽车充电。定期充电是最受推崇的解决方案之一。然而,它不适用于紧急车辆。建议对政府授权的应急电动汽车提供优先充电服务。为了实现这个提议,建议提供一个完整的解决方案,包括体系结构和协议套件。为了实现这种服务,本文建议建立一个称为优先充电服务器的主要功能实体,即一个数据库服务器,用于注册授权的应急电动汽车的id,并维护其记录。本文还提出了对IEC15118和iec61850协议组的修改。这些协议提供了车辆和电网之间的通信。该解决方案还包括漫游和非漫游场景,即可由家庭公用事业网络和访问公用事业网络的授权紧急电动汽车发起优先收费请求。最后以matlab为基础进行了概念验证仿真。
{"title":"Preferential charging for government authorised emergency electric vehicles","authors":"R. Yaqub, F. A. Shifa, M. F. Butt","doi":"10.1504/ijguc.2020.10026557","DOIUrl":"https://doi.org/10.1504/ijguc.2020.10026557","url":null,"abstract":"The proliferation of Electric Vehicles (EVs) is exponential. However, the power grid is not able to provide simultaneous charging of several EVs due to limited power production capabilities and old distribution infrastructure. Scheduled charging is one of the most advocated solutions. However, it is not viable for emergency vehicles. This paper proposes to provide priority charging service for government authorised emergency EVs. For enablement of this proposal, a complete solution that includes architecture, as well as the protocols suite is suggested. To realise such a service, the paper suggests a major functional entity called a Priority Charging Server, i.e. a database server where authorised emergency EVs' IDs are registered, and their record is maintained. The paper also proposes modifications in the IEC15118 and IEC 61850 protocol suites. These protocols provide communication between vehicle and grid. The solution also inculcates roaming as well as non-roaming scenarios, i.e. a priority charging request may be originated by an authorised emergency EV from a Home Utility Network, as well as Visiting Utility Network. The paper is concluded with a MATLAB-based proof-of-concept simulation.","PeriodicalId":375871,"journal":{"name":"Int. J. Grid Util. Comput.","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2020-02-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131296245","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A spatial access method approach to continuous k-nearest neighbour processing for location-based services 基于位置服务的连续k近邻处理的空间访问方法
Pub Date : 2020-02-03 DOI: 10.1504/ijguc.2020.10026555
W. Osborn
In this paper, two strategies for handling continuous k-nearest neighbour queries for location-based services are proposed. CKNN1 and CKNN2 utilise a validity (i.e., safe) region approach for minimising the number of query requests that need to be send to the server. They also use a two-dimensional spatial access method for both validity region selection and in-structure searching. The latter feature ensures that new searches for a validity region are not required to begin from the root. An evaluation and comparison of both strategies is performed against repeated nearest neighbour search. Both random and exponentially distributed point sets are utilised. Results show that both approaches achieve significant performance gains, especially with respect to reducing the number of queries that must be sent from the client to the server.
本文提出了两种处理基于位置服务的连续k近邻查询的策略。CKNN1和CKNN2利用有效性(即安全)区域方法来最小化需要发送到服务器的查询请求的数量。采用二维空间访问方法进行有效区域选择和结构内搜索。后一个特性确保对有效性区域的新搜索不需要从根开始。针对重复的最近邻搜索,对两种策略进行了评估和比较。随机和指数分布的点集都被使用。结果表明,这两种方法都获得了显著的性能提升,特别是在减少必须从客户机发送到服务器的查询数量方面。
{"title":"A spatial access method approach to continuous k-nearest neighbour processing for location-based services","authors":"W. Osborn","doi":"10.1504/ijguc.2020.10026555","DOIUrl":"https://doi.org/10.1504/ijguc.2020.10026555","url":null,"abstract":"In this paper, two strategies for handling continuous k-nearest neighbour queries for location-based services are proposed. CKNN1 and CKNN2 utilise a validity (i.e., safe) region approach for minimising the number of query requests that need to be send to the server. They also use a two-dimensional spatial access method for both validity region selection and in-structure searching. The latter feature ensures that new searches for a validity region are not required to begin from the root. An evaluation and comparison of both strategies is performed against repeated nearest neighbour search. Both random and exponentially distributed point sets are utilised. Results show that both approaches achieve significant performance gains, especially with respect to reducing the number of queries that must be sent from the client to the server.","PeriodicalId":375871,"journal":{"name":"Int. J. Grid Util. Comput.","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2020-02-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122119742","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Models for hyper-converged cloud computing infrastructures planning 超融合云计算基础设施规划模型
Pub Date : 2020-02-03 DOI: 10.1504/ijguc.2020.10026550
Carlos Melo, J. Dantas, P. Maciel, Danilo Oliveira, J. Araujo, Rúbens de Souza Matos Júnior, Iure Fé
The Data Centre concept has evolved, mainly due to the need to reduce expenses with the required physical space to store, provide and maintain large computational infrastructures. The Software-Defined Data Centre (SDDC) is a result of this evolution. Through SDDC, any service can be hosted by virtualising more reliable and easier-to-keep hardware resources. Nowadays, many services and resources can be provided in a single rack, or even a single machine, with similar availability, considering the deployment costs of silo-based environments. One of the ways to apply the SDDC into a data centre is through hyper-convergence. Among the main contributions of this paper are the behavioural models developed for availability and capacity-oriented availability evaluation of silo-based, converged and hyper-converged cloud computing infrastructures. The obtained results may help stakeholders to select between converged and hyper-converged environments, due to their similar availability but with the particularity of having lower deployment costs.
数据中心的概念已经演变,主要是因为需要利用存储、提供和维护大型计算基础设施所需的物理空间来减少开支。软件定义数据中心(SDDC)就是这种演变的结果。通过SDDC,任何服务都可以通过虚拟化更可靠、更易于维护的硬件资源来托管。如今,考虑到基于竖井的环境的部署成本,许多服务和资源可以在单个机架甚至单个机器中提供,并且具有类似的可用性。将SDDC应用到数据中心的方法之一是通过超融合。本文的主要贡献之一是为基于竖井、融合和超融合的云计算基础设施的可用性和面向容量的可用性评估开发的行为模型。获得的结果可以帮助涉众在融合和超融合环境之间进行选择,因为它们的可用性相似,但具有部署成本较低的特殊性。
{"title":"Models for hyper-converged cloud computing infrastructures planning","authors":"Carlos Melo, J. Dantas, P. Maciel, Danilo Oliveira, J. Araujo, Rúbens de Souza Matos Júnior, Iure Fé","doi":"10.1504/ijguc.2020.10026550","DOIUrl":"https://doi.org/10.1504/ijguc.2020.10026550","url":null,"abstract":"The Data Centre concept has evolved, mainly due to the need to reduce expenses with the required physical space to store, provide and maintain large computational infrastructures. The Software-Defined Data Centre (SDDC) is a result of this evolution. Through SDDC, any service can be hosted by virtualising more reliable and easier-to-keep hardware resources. Nowadays, many services and resources can be provided in a single rack, or even a single machine, with similar availability, considering the deployment costs of silo-based environments. One of the ways to apply the SDDC into a data centre is through hyper-convergence. Among the main contributions of this paper are the behavioural models developed for availability and capacity-oriented availability evaluation of silo-based, converged and hyper-converged cloud computing infrastructures. The obtained results may help stakeholders to select between converged and hyper-converged environments, due to their similar availability but with the particularity of having lower deployment costs.","PeriodicalId":375871,"journal":{"name":"Int. J. Grid Util. Comput.","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2020-02-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127853063","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Cognitive workload management on globally interoperable network of clouds 基于全局互操作云网络的认知工作负载管理
Pub Date : 2019-08-09 DOI: 10.1504/IJGUC.2019.10023104
G. Morana, Rao V. Mikkilineni, Surendra Keshan
A new computing paradigm using Distributed Intelligent Managed Elements (DIME) and DIME Network Architecture (DNA) is used to demonstrate globally interoperable public and private cloud network deploying cloud agnostic workloads. The workloads are cognitive and able to adjust autonomously their structure and maintain desired quality-of-service (QoS). DNA is designed to provide a control architecture for workload self-management of non-functional requirements to address rapid fluctuations either in workload demand or fluctuations in available resources. Using DNA, a transaction intensive three-tier workload is migrated from a physical server to a virtual machine hosted in a public cloud without interrupting the service transactions. After migration, cloud agnostic inter-cloud and intra-cloud auto-scaling, auto- failover and live migration are demonstrated again, without disrupting the user experience or losing transactions.
一种使用分布式智能管理元素(DIME)和DIME网络架构(DNA)的新计算范式被用来演示部署与云无关工作负载的全球可互操作的公共和私有云网络。工作负载是认知的,能够自主调整其结构并保持所需的服务质量(QoS)。DNA旨在为非功能需求的工作负载自我管理提供控制体系结构,以处理工作负载需求或可用资源的快速波动。使用DNA,可以将事务密集型三层工作负载从物理服务器迁移到托管在公共云中的虚拟机,而不会中断服务事务。迁移后,将再次演示与云无关的云间和云内自动扩展、自动故障转移和实时迁移,而不会中断用户体验或丢失事务。
{"title":"Cognitive workload management on globally interoperable network of clouds","authors":"G. Morana, Rao V. Mikkilineni, Surendra Keshan","doi":"10.1504/IJGUC.2019.10023104","DOIUrl":"https://doi.org/10.1504/IJGUC.2019.10023104","url":null,"abstract":"A new computing paradigm using Distributed Intelligent Managed Elements (DIME) and DIME Network Architecture (DNA) is used to demonstrate globally interoperable public and private cloud network deploying cloud agnostic workloads. The workloads are cognitive and able to adjust autonomously their structure and maintain desired quality-of-service (QoS). DNA is designed to provide a control architecture for workload self-management of non-functional requirements to address rapid fluctuations either in workload demand or fluctuations in available resources. Using DNA, a transaction intensive three-tier workload is migrated from a physical server to a virtual machine hosted in a public cloud without interrupting the service transactions. After migration, cloud agnostic inter-cloud and intra-cloud auto-scaling, auto- failover and live migration are demonstrated again, without disrupting the user experience or losing transactions.","PeriodicalId":375871,"journal":{"name":"Int. J. Grid Util. Comput.","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2019-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115398922","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Data analysis of CSI 800 industry index by using factor analysis model 运用因子分析模型对沪深800工业指数进行数据分析
Pub Date : 2019-08-09 DOI: 10.1504/IJGUC.2019.10023115
Chunfen Xu
This paper studies the linkages among the industries based on CSI 800 industry index, which provides mass complicated data for industry research. Factor analysis, a useful data analysis tool, allows researchers to investigate concepts that are not easily measured directly by collapsing a large number of variables into a few interpretable underlying factors. Firstly, data of ten industries in the period from September 2009 to March 2017 is collected from CSI 800 Index and correlational analyses are conducted. Secondly, this paper establishes an appropriate evaluation system, and then uses factor analysis to do dimension reduction. Finally, some characteristics and trends in various industries are obtained.
本文基于沪深800行业指数对行业间的关联进行了研究,为行业研究提供了大量复杂的数据。因子分析是一种有用的数据分析工具,它允许研究人员通过将大量变量分解为几个可解释的潜在因素来调查不容易直接测量的概念。首先,收集2009年9月至2017年3月沪深800指数中10个行业的数据,并进行相关性分析。其次,建立合适的评价体系,运用因子分析法进行降维。最后,得出了各行业的一些特点和趋势。
{"title":"Data analysis of CSI 800 industry index by using factor analysis model","authors":"Chunfen Xu","doi":"10.1504/IJGUC.2019.10023115","DOIUrl":"https://doi.org/10.1504/IJGUC.2019.10023115","url":null,"abstract":"This paper studies the linkages among the industries based on CSI 800 industry index, which provides mass complicated data for industry research. Factor analysis, a useful data analysis tool, allows researchers to investigate concepts that are not easily measured directly by collapsing a large number of variables into a few interpretable underlying factors. Firstly, data of ten industries in the period from September 2009 to March 2017 is collected from CSI 800 Index and correlational analyses are conducted. Secondly, this paper establishes an appropriate evaluation system, and then uses factor analysis to do dimension reduction. Finally, some characteristics and trends in various industries are obtained.","PeriodicalId":375871,"journal":{"name":"Int. J. Grid Util. Comput.","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2019-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131391268","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Towards to virtual infrastructure allocation on multiple IaaS providers with survivability and reliability requirements 面向多个IaaS提供商的虚拟基础设施分配,具有生存性和可靠性需求
Pub Date : 2019-08-09 DOI: 10.1504/IJGUC.2019.10023134
A. S. Raugust, W. J. Loch, Felipe Rodrigo de Souza, M. A. Pillon, C. Miers, G. Koslovski
The diversity of services, prices, and geographical footprints has turned the clouds into a complex and heterogeneous environment. Moreover, the survivability and reliability aspects are often disregarded by tenants, eventually resulting in heavy losses due to unavailability of services that are hosted on Virtual Infrastructures (VIs). We present an alternative to improve Vis' survivability and reliability, which considers the use of replicas and the spreading of virtual resources atop providers, regions, and zones. We formulate the VI allocation with survivability and reliability requirements as a mixed integer program, and three strategies to solve the formulation are proposed. First, the binary constraints are relaxed to obtain a Linear Program (LP), and the LP solution is given as input for the simulated annealing technique. Then, two GPU-accelerated algorithms are proposed to speed up the allocation of large-scale scenarios. Simulation with different reliability requests indicate an increasing in survivability without inflating costs.
服务、价格和地理足迹的多样性使云成为一个复杂和异构的环境。此外,租户经常忽略生存性和可靠性方面的问题,最终导致虚拟基础设施(Virtual infrastructure, VIs)上托管的服务不可用,从而造成重大损失。我们提出了一种改进Vis的生存能力和可靠性的替代方案,它考虑了副本的使用和虚拟资源在提供者、区域和区域之上的传播。我们将具有生存能力和可靠性要求的VI分配表述为一个混合整数规划,并提出了三种求解策略。首先,将二元约束放宽,得到线性规划,并给出线性规划的解作为模拟退火技术的输入。然后,提出了两种gpu加速算法来加快大规模场景的分配速度。对不同可靠性要求的仿真表明,在不增加成本的情况下,生存性得到了提高。
{"title":"Towards to virtual infrastructure allocation on multiple IaaS providers with survivability and reliability requirements","authors":"A. S. Raugust, W. J. Loch, Felipe Rodrigo de Souza, M. A. Pillon, C. Miers, G. Koslovski","doi":"10.1504/IJGUC.2019.10023134","DOIUrl":"https://doi.org/10.1504/IJGUC.2019.10023134","url":null,"abstract":"The diversity of services, prices, and geographical footprints has turned the clouds into a complex and heterogeneous environment. Moreover, the survivability and reliability aspects are often disregarded by tenants, eventually resulting in heavy losses due to unavailability of services that are hosted on Virtual Infrastructures (VIs). We present an alternative to improve Vis' survivability and reliability, which considers the use of replicas and the spreading of virtual resources atop providers, regions, and zones. We formulate the VI allocation with survivability and reliability requirements as a mixed integer program, and three strategies to solve the formulation are proposed. First, the binary constraints are relaxed to obtain a Linear Program (LP), and the LP solution is given as input for the simulated annealing technique. Then, two GPU-accelerated algorithms are proposed to speed up the allocation of large-scale scenarios. Simulation with different reliability requests indicate an increasing in survivability without inflating costs.","PeriodicalId":375871,"journal":{"name":"Int. J. Grid Util. Comput.","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2019-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125602057","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Resource auto-scaling for SQL-like queries in the cloud based on parallel reinforcement learning 基于并行强化学习的云中类sql查询的资源自动伸缩
Pub Date : 2019-08-09 DOI: 10.1504/IJGUC.2019.102748
Mohamed Mehdi Kandi, Shaoyi Yin, A. Hameurlain
Cloud computing is a technology that provides on-demand services in which the number of assigned resources can be automatically adjusted. A key challenge is how to choose the right number of resources so that the overall monetary cost is minimised. This problem, known as auto-scaling, was addressed in some existing works but most of them are dedicated to web applications. In these applications, it is assumed that the queries are atomic and each of them uses a single resource for a short period of time. However, this assumption cannot be considered for database applications. A query, in this case, contains many dependent and long tasks so several resources are required. We propose in this work an auto-scaling method based on reinforcement learning. The method is coupled with placement-scheduling. In the experimental section, we show the advantage of coupling the auto-scaling to the placement-scheduling by comparing our work to an existing auto-scaling method.
云计算是一种提供按需服务的技术,其中分配的资源数量可以自动调整。一个关键的挑战是如何选择正确数量的资源,从而使总体货币成本最小化。这个被称为自动缩放的问题已经在一些现有的作品中得到了解决,但大多数都是针对web应用程序的。在这些应用程序中,假设查询是原子的,并且每个查询在短时间内使用单个资源。但是,对于数据库应用程序不能考虑这种假设。在这种情况下,查询包含许多依赖的长任务,因此需要多个资源。我们在这项工作中提出了一种基于强化学习的自动缩放方法。该方法与安置调度相结合。在实验部分,通过将我们的工作与现有的自动缩放方法进行比较,我们展示了将自动缩放与放置调度相结合的优势。
{"title":"Resource auto-scaling for SQL-like queries in the cloud based on parallel reinforcement learning","authors":"Mohamed Mehdi Kandi, Shaoyi Yin, A. Hameurlain","doi":"10.1504/IJGUC.2019.102748","DOIUrl":"https://doi.org/10.1504/IJGUC.2019.102748","url":null,"abstract":"Cloud computing is a technology that provides on-demand services in which the number of assigned resources can be automatically adjusted. A key challenge is how to choose the right number of resources so that the overall monetary cost is minimised. This problem, known as auto-scaling, was addressed in some existing works but most of them are dedicated to web applications. In these applications, it is assumed that the queries are atomic and each of them uses a single resource for a short period of time. However, this assumption cannot be considered for database applications. A query, in this case, contains many dependent and long tasks so several resources are required. We propose in this work an auto-scaling method based on reinforcement learning. The method is coupled with placement-scheduling. In the experimental section, we show the advantage of coupling the auto-scaling to the placement-scheduling by comparing our work to an existing auto-scaling method.","PeriodicalId":375871,"journal":{"name":"Int. J. Grid Util. Comput.","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2019-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116577931","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
A cloud-based approach to dynamically manage service contracts for local public transportation 一种基于云的方法来动态管理本地公共交通的服务合同
Pub Date : 2019-08-09 DOI: 10.1504/IJGUC.2020.10021245
A. Longo, M. Zappatore, Mario Alessandro Bochicchio
Public contracts regulate how public services are managed by the stakeholders. However, the current technological trend is creating a significant bias between the pace at which service data are produced and that at which contracts change. This increased availability of service data can be exploited in public procurement processes by fostering novel approaches to manage contracts, making them more dynamic and improving the Quality of Service (QoS) delivered to customers. In this paper, a cloud-based approach for assessing the QoS in Local Transportation Services (LTSs) in Apulia Region (Southern Italy) is proposed. Service Level Agreements (SLAs) between providers and the Regional Authority, as well as the minimal guaranteed QoS levels between providers and passengers, are modelled as contracts enacted via a cloud-based system, which gathers data from sensors and passengers. In this way, changes in contract conditions for improving the perceived and delivered QoS can be fastened and facilitated based on data. In order to validate the pilot case, a set of quality indicators and service levels grounded in European and Italian regulatory frameworks has been considered.
公共合同规范了利益相关者如何管理公共服务。然而,目前的技术趋势在服务数据产生的速度和合同变化的速度之间造成了明显的偏差。通过培养管理合同的新方法,使合同更具动态性,并提高向客户提供的服务质量(QoS),可以在公共采购过程中利用服务数据可用性的增加。本文提出了一种基于云的方法来评估阿普利亚地区(意大利南部)的本地运输服务(LTSs)的QoS。供应商和地区当局之间的服务水平协议(sla),以及供应商和乘客之间的最低保证QoS水平,都是通过基于云的系统制定的合同模型,该系统从传感器和乘客那里收集数据。通过这种方式,可以根据数据确定和促进合同条件的变化,以改善感知和交付的QoS。为了验证试点案例,考虑了一套基于欧洲和意大利监管框架的质量指标和服务水平。
{"title":"A cloud-based approach to dynamically manage service contracts for local public transportation","authors":"A. Longo, M. Zappatore, Mario Alessandro Bochicchio","doi":"10.1504/IJGUC.2020.10021245","DOIUrl":"https://doi.org/10.1504/IJGUC.2020.10021245","url":null,"abstract":"Public contracts regulate how public services are managed by the stakeholders. However, the current technological trend is creating a significant bias between the pace at which service data are produced and that at which contracts change. This increased availability of service data can be exploited in public procurement processes by fostering novel approaches to manage contracts, making them more dynamic and improving the Quality of Service (QoS) delivered to customers. In this paper, a cloud-based approach for assessing the QoS in Local Transportation Services (LTSs) in Apulia Region (Southern Italy) is proposed. Service Level Agreements (SLAs) between providers and the Regional Authority, as well as the minimal guaranteed QoS levels between providers and passengers, are modelled as contracts enacted via a cloud-based system, which gathers data from sensors and passengers. In this way, changes in contract conditions for improving the perceived and delivered QoS can be fastened and facilitated based on data. In order to validate the pilot case, a set of quality indicators and service levels grounded in European and Italian regulatory frameworks has been considered.","PeriodicalId":375871,"journal":{"name":"Int. J. Grid Util. Comput.","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2019-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121221448","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Improving the MXFT scheduling algorithm for a cloud computing context 改进云计算环境下的MXFT调度算法
Pub Date : 2019-08-09 DOI: 10.1504/IJGUC.2019.10023108
Paul Moggridge, N. Helian, Yi Sun, M. Lilley, V. Veneziano, Martin Eaves
In this paper, the Max-Min Fast Track (MXFT) scheduling algorithm is improved and compared against a selection of popular algorithms. The improved versions of MXFT are called Min-Min Max-Min Fast Track (MMMXFT) and Clustering Min-Min Max-Min Fast Track (CMMMXFT). The key difference is using Min-Min for the fast track. Experimentation revealed that despite Min-Min's characteristic of prioritising small tasks at the expense of overall makespan, the overall makespan was not adversely affected and the benefits of prioritising small tasks were identified in MMMXFT. Experiments were conducted by using a simulator with the exception of one real-world experiment. The real-world experiment identified challenges faced by algorithms which rely on accurate execution time prediction.
本文对最大-最小快速通道调度算法进行了改进,并与一些常用算法进行了比较。MXFT的改进版本被称为Min-Min Max-Min Fast Track (MMMXFT)和Clustering Min-Min Max-Min Fast Track (CMMMXFT)。关键的区别是使用Min-Min快速通道。实验表明,尽管Min-Min以牺牲总体完工时间为代价优先考虑小任务的特点,但总体完工时间并没有受到不利影响,并且在MMMXFT中确定了优先考虑小任务的好处。除一次真实实验外,其余实验均使用模拟器进行。现实世界的实验表明,依赖于准确的执行时间预测的算法所面临的挑战。
{"title":"Improving the MXFT scheduling algorithm for a cloud computing context","authors":"Paul Moggridge, N. Helian, Yi Sun, M. Lilley, V. Veneziano, Martin Eaves","doi":"10.1504/IJGUC.2019.10023108","DOIUrl":"https://doi.org/10.1504/IJGUC.2019.10023108","url":null,"abstract":"In this paper, the Max-Min Fast Track (MXFT) scheduling algorithm is improved and compared against a selection of popular algorithms. The improved versions of MXFT are called Min-Min Max-Min Fast Track (MMMXFT) and Clustering Min-Min Max-Min Fast Track (CMMMXFT). The key difference is using Min-Min for the fast track. Experimentation revealed that despite Min-Min's characteristic of prioritising small tasks at the expense of overall makespan, the overall makespan was not adversely affected and the benefits of prioritising small tasks were identified in MMMXFT. Experiments were conducted by using a simulator with the exception of one real-world experiment. The real-world experiment identified challenges faced by algorithms which rely on accurate execution time prediction.","PeriodicalId":375871,"journal":{"name":"Int. J. Grid Util. Comput.","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2019-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123111184","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Int. J. Grid Util. Comput.
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1