MRASS: Dynamic Task Scheduling enabled High Multi-cluster Resource Availability in JointCloud

Abstract

As the new paradigm of JointCloud Computing matures, enterprises are trying to build multiple Kubernetes clusters on different clouds to deploy tasks, with the advantages of disaster backup, low latency, and avoidance of single vendor lock-in, etc. Tasks in a JointCloud environment, always have highly diversified resource demands on CPU, memory, disk, and network. However, the mismatch between these tasks and heterogeneous clusters can easily cause many resource fragments, resulting in low resource availability. Therefore, the task scheduling strategy is the key to solving the above problem. The existing task schedule strategies for multi-clusters are always aiming at clusters’ load balancing instead of increasing the resource availability. In this paper, we propose a dynamic task scheduling framework with the design of multi-cluster resource high-availability schedule strategy (MRASS) based on historical task resource consumption. MRASS conducts a cooperation model between multiple clusters and tasks, and proposes an indicator of resource availability, which is used to optimize the proportion of remaining resources of the cluster to keep approaching the proportion of resource requirements of future tasks, thereby execute more tasks within limited resources. Extensive numerical results confirm that the strategy has stable performance and performs well with different initial cluster resource setting, task resource type and task number. Compared with the existing algorithm, MRASS can place up to 20% more tasks, and the success rate of first placement of tasks can reach over 98%.