Image retrieval based on saliency for urban image contents

Abstract

With the increase of image datasets size and of descriptors complexity in Content-Based Image Retrieval (CBIR) and Computer Vision, it is essential to find a way to limit the amount of manipulated data, while keeping its quality. Instead of treating the entire image, the selection of regions which hold the essence of information is a relevant option to reach this goal. As the visual saliency aims at highlighting the areas of the image which are the most important for a given task, in this paper we propose to exploit visual saliency maps to prune the most salient image features. A novel visual saliency approach based on the local distribution analysis of the edges orientation, particularly dedicated to structured contents, such as street view images of urban environments, is proposed. It is evaluated for CBIR according to three criteria: quality of retrieval, volume of manipulated features and computation time. The proposal can be exploited into various applications involving large sets of local visual features; here it is experimented within two applications: cross-domain image retrieval and image-based vehicle localisation.