Instance Selection Techniques for Multiple Instance Classification

Abstract

As the amount of data increases, fully supervised learning methods relying on dense annotations often become impractical, and are substituted by weakly supervised methods, that exploit data with a variable content in respect to size and semantics. In such schemes the volume of irrelevant information might be critically high impacting negatively the modeling performance and increasing considerably the memory and computational cost. Data reduction or selection are necessary to mitigate these effects. In this paper we propose and compare three different instance selection techniques for the Multiple Instance Learning (MIL) paradigm. The techniques are assessed for the problem of image classification using features from standard benchmark MIL datasets, as well as recently proposed features based on tensor decomposition. As implementation paradigm we exploit the widely accepted JC2MIL algorithm that performs joint clustering and classification. Two of the proposed instance selection techniques are based on Shannon entropy in image and feature space respectively, while one technique is based on a clustering evaluation metric, the silhouette score, that is introduced internally in the iterative joint clustering and classification algorithm. The enrichment of the MIL framework with the instance selection step showed to outperform the original algorithm providing state-of-the-art results in the vast majority of the performed experiments.