Music tracking in audio streams from movies

Abstract

This paper presents a robust and computationally efficient method for tracking music in audio streams from movies. The audio stream is first mid-term processed with a fixed length moving window and four features are extracted per window. Each feature is fed as input to a simple classifier which produces a soft output for the binary problem of music vs. all other types of audio. The soft outputs are then combined to yield a measure of confidence quantifying whether the segment corresponds to music or not. At a final step, thresholding is applied to filter out segments where the confidence measure is low. The proposed approach has been tested with audio streams from various movies and its performance was measured both on a mid-term segment basis as well as on an event detection basis. Reported results demonstrate that the method exhibits high performance even when music is mixed with other types of audio in the stream.