Sound event detection using class activation maps

Abstract

In this paper, we present the system for sound event detection in domestic environments as defined in the DCASE 2021 challenge Task 4. The task aims to provide audio event localization timestamps in addition to event class probabilities. We aim to explore the usage of class activation maps, known from image processing, in such sound event detection systems. We propose two systems. The first system is a convolutional neural network trained for sound event classification using only weakly labeled and unlabeled data. The strong labels are obtained using class activation mapping, which is a popular technique, especially in image processing. In the second proposed system, we modified the baseline system, provided by the DCASE organizers, in which we added the class activation mapping as a part of the attention mechanism. The experimental results show that the class activation maps enable improvement of the system performance in comparison with the baseline.