Comparison of Ensemble Learning Method: Random Forest, Support Vector Machine, AdaBoost for Classification Human Development Index (HDI)

Abstract

Classification in supervised learning is a way to find patterns in data base that the classes are already known. In the classification of machine learning, there is a term called ensemble classifier. The workings of the ensemble classifier aimed to improve model accuracy and optimize classification performance. This study aims to analyze the comparison of algorithms that work with ensemble learning , including Random Forest, Support Vector Machine (SVM), and AdaBoost. The data used is the Human Development Index ( HDI ) of districts/cities in Indonesia . O ther variables that are strongly related to human development are GRDP per capita, gross enrollment rate, n et enrollment rate, labor force participation rate, unemployment rate, poverty rate, poverty depth, poverty severity, and average consumption per capita. The reason for using HDI is that apart from being an important macroeconomic variable in describing the condition of human resources in Indonesia, HDI already has a n obvious classification according to the Badan Pusat Statistik (BPS) so that supervised learning can be applied . Comparison of model evaluation using accuracy, specificity, sensitivity, and kappa statistics . The analysis flow starts with data preprocessing , resampling and cross - validation , then modeling using the Random Forest, Support Vector Machine (SVM), and AdaBoost algorithm . T he final stage is the model evaluation by comparing the best models in the classification s of districts/ cities according to HDI. The results showed that the Random Forest model had the best performance compared to the Support Vector Machine (SVM) and AdaBoost models with an accuracy value of 85,23%, spe c ifi c it y of 71,63% , sensitivit y of 95,05% , and kappa coefficient of 0,7698 . From this research, the an ensemble classifier can be developed to help classify scores on the Human Development Index in Indonesia. Keywords: AdaBoost, Random Forest, Support Vector Machine , Ensemble Learning, Human Development Index