Feature selection based on partition clustering

Abstract

Feature selection plays an important role in data mining, machine learning and pattern recognition, especially for large scale data with high dimensions. Many selection techniques have been proposed during past years. Their general purposes are to exploit certain metric to measure the relevance or irrelevance between different features of data for certain task, and then select fewer features without deteriorating discriminative capability. Each technique, however, has not absolutely better performance than others' for all kinds of data, due to the data characterized by incorrectness, incompleteness, inconsistency, and diversity. Based on this fact, this paper put forward to a new scheme based on partition clustering for feature selection, which is a special preprocessing procedure and independent of selection techniques. Experimental results carried out on UCI data sets show that the performance achieved by our proposed scheme is better than selection techniques without using this scheme in most cases.