Analysis of Imputation Methods of Small and Unbalanced Datasets in Classifications using Naïve Bayes and Particle Swarm Optimization

Abstract

The classification method in data mining requires a good learning process to get optimal accuracy. This can be done if the dataset used is ideal, balanced, and has a lot of records, but in reality, it is difficult to get such a dataset. The imputation method is one way to fill in missing values, in a dataset that is not ideal. A large number of missing values can reduce the number of records in the learning process and affect accuracy. This research aims to analyze the effects of zero and mean imputation methods on classification accuracy in small datasets using the Naïve Bayes classifier (NBC) and NBC which have been optimized with Particle Swarm Optimization (PSO). Tests were carried out on five types of datasets originating from the UCI database, where one of the datasets did not require an imputation method because it did not have a missing value. Based on the results of the PSO testing proven to be able to improve the accuracy of the NBC classification on all datasets. While the imputation method can improve classification accuracy up to 4.33% in Biomarker datasets.