Semantic mobiletiles: A tool for movie content understanding on mobile phones

Abstract

Web-accessible video sites are currently some of the most visited on the mobile Web. It is expected that the number of these sites will continue to grow and that customers will want more powerful exploration tools. Recently, we described an innovative content-based tool for video browsing called MobileTiles. In this paper we describe Semantic MobileTiles, an improved version of MobileTiles based on semantically meaningful key frame selection. We propose a method of approximation of semantically compressed versions of short movies. We found that a good approximation can be achieved if pairs of key frames from each shot boundary are used to represent a sequence of shots. Semantic MobileTiles provides a novel abstraction/understanding tool that enables users to get the main idea of a short movie at a glance. Our algorithm is both effective and computationally simple.