Towards a High Level Programming Paradigm to Deploy e-Science Applications with Dynamic Workflows on Large Scale Distributed Systems

Abstract

This papers targeted scientists and programmers who need to easily develop and run e-science applications on large scale distributed systems. We present a rich programming paradigm and environment used to develop and deploy high performance applications (HPC) on large scale distributed and heterogeneous platforms. We particularly target iterative e-science applications where (i) convergence conditions and number of jobs are not known in advance, (ii) jobs are created on the fly and (iii) jobs could be persistent. We propose two programming paradigms so as to provide intuitive statements enabling an easy writing of HPC e-science applications. Non-expert developers (scientific researchers) can use them to guarantee fast development and efficient deployment of their applications.