lifeXplore at the Lifelog Search Challenge 2019

Abstract

First held in Yokohama, Japan in 2018, the Lifelogging Search Challenge (LSC) is an interactive lifelogging content retrieval competition, where international teams are faced with the task of finding specific moments within a large collection of multimodal lifelogging data. As one of the successfully participating LSC2018 teams (2nd place), we present our improved lifeXplore system for the second iteration of this challenge. Based on diveXplore, an interactive video retrieval system that has been developed for the annual Video Browser Showdown, the lifeXplore system similarly operates on shot-segmented video data, while maintaining browseable feature maps and offering customizable similarity search, yet also introducing additional features such as metadata filtering and interactive day inspection. Alongside several smaller functionality and usability improvements, the LSC2019 version of the system in particular includes combinable filters, geolocation-based filtering and automatic feature map browsing in order to improve a user's searching and browsing experience.