Early Prediction of the Cost of HPC Application Execution in the Cloud

Abstract

Even if clouds are not fit for high-end HPC applications, they could be profitably used to bring the power of economic and scalable parallel computing to the masses. But this requires both simple development environments, able to exploit cloud scalability, and the capability to easily predict the cost of HPC application runs. This paper presents a framework built on the top of a cloud aware programming platform (mOSAIC) for the development of bag-of-tasks scientific applications. The framework integrates a cloud-based simulation environment able to predict the behavior of the developed applications. Simulations enable the developer to predict at an early development stage performance and cloud resource usage, and so the infrastructure lease cost on a public cloud. The paper sketches the framework organization and discusses the approach followed for application development. Moreover, some validation tests of prediction results are presented.