Public Datasets for Cloud Computing: A Comprehensive Survey

Abstract

Publicly available datasets are vital to researchers because they permit the testing of new algorithms under a variety of conditions and ensure the verifiability and reproducibility of scientific experiments. In cloud computing research, there is a particular dependence on obtaining load traces and network traces from real cloud computing clusters, which are used for designing energy efficiency prediction, workload analysis, and anomaly detection solutions. To address the current lack of a comprehensive overview and thorough analysis of cloud computing datasets and to gain insight into their current status and future trends, in this paper, we provide a comprehensive survey of existing publicly cloud computing datasets. Firstly, we utilize a systematic mapping approach to analyze 968 scientific papers from 6 scientific databases, resulting in the retrieval of 42 datasets related to cloud computing. Secondly, we categorize these datasets based on 11 characteristics to assist researchers in quickly finding datasets suitable for their specific needs. Thirdly, we provide detailed descriptions of each dataset to assist researchers in gaining a clearer understanding of their characteristics. Fourthly, we select 12 mainstream datasets and conduct a comprehensive analysis and comparison of their characteristics. Finally, we discuss the weaknesses of existing datasets, identify challenges, provide recommendations for long-term dataset maintenance and updates, and outline directions for the future creation of new cloud computing datasets. Related resources are available at: https://github.com/ACAT-SCUT/Awesome-CloudComputing-Datasets.