A Hybrid Approach Based on SVM and Bernoulli Mixture Model for Binary Vectors Classification

Abstract

In the last decades, the development of generative/discriminative approaches for classifying different kinds of data has attracted scholars’ attention. Considering the strengths and weaknesses of both approaches, several hybrid learning approaches which combined the desirable properties of both have been developed. Our goal in this paper is to combine Support Vector Machines (SVMs), as a powerful classification tool, and Bernoulli mixture model in order to classify binary data. We propose using Bernoulli mixture model for generating probabilistic kernels for SVM based on information divergence. These kernels make intelligent use of unlabeled binary data to achieve good data discrimination. We demonstrate the merits of the proposed hybrid learning approach for the problem of classifying binary and texture images.