Learning similarity measures from data with fuzzy sets and particle swarms

Abstract

Gauging the similarity among objects is a fairly common and important task that underpins many popular machine learning endeavours such as classification or clustering. Uncertainty representation mechanisms, such as rough set theory, or information processing paradigms like granular computing also lean upon well-defined similarity measures to better model the objects in the universe of discourse. In this informationladen world, the responsibility of designing these crucial granular constructs is shifting from domain experts to intelligent systems that automatically learn from data. An approach that hybridizes particle swarm optimization with elements from rough set theory has been recently proposed [1] to build these similarity measures from scratch. However, this scheme still remains fairly sensitive to the values of the similarity thresholds both in the input attribute space and the decision space. In this paper, we tackle this limitation by employing fuzzy sets to categorize the domain of both similarity thresholds. The efficacy of the proposed methodology is illustrated with the K-nearest neighbor classifier. Empirical results over several well-known repositories confirm that this approach preserves the classification accuracy while reducing the number of system parameters and enhancing its interpretability.