A Novel Scheme For Feature Selection Using Filter Approach

Abstract

This paper proposes a wrapper based scheme for feature selection in unsupervised data sets. This scheme first ranks features in a dataset as per their Laplacian scores. Subsequently, subsets of features are selected considering feature's rank. Each selected feature subset is then tested for classification accuracy. In order to achieve reasonable satisfactory results, feature subsets are iteratively tested for accuracy as well as cardinality using incremental approach. Four real benchmark datasets namely colon, leukaemia-l, lung-discrete & warpPIE10 have been used for the experiments in this paper. Accuracy above 80% and number of features reduced to less than 20% of the total number of features in each dataset justify the potential of the proposed scheme to be applied to other large datasets as well.