A lightweight video anomaly detection model with weak supervision and adaptive instance selection

Abstract

Video anomaly detection is to determine whether there are any abnormal events, behaviors or objects in a given video, which enables effective and intelligent public safety management. As video anomaly labeling is both time-consuming and expensive, most existing works employ unsupervised or weakly supervised learning methods. This paper focuses on weakly supervised video anomaly detection, in which the training videos are labeled whether or not they contain any anomalies, but lack information about the specific frames and quantities of anomalies. However, the uncertainty of weakly labeled data and the large model size prevent existing methods from wide deployment in real scenarios, especially the resource-limit situations such as edge-computing. In this paper, we develop a lightweight video anomaly detection model. On the one hand, we propose an adaptive instance selection strategy, which is based on the model’s current status to select confident instances, thereby mitigating the uncertainty of weakly labeled data and subsequently promoting the model’s performance. On the other hand, we design a lightweight multi-level temporal correlation attention module and an hourglass-shaped fully connected layer to construct the model, which can reduce the model parameters to only 0.56% of the existing methods (e.g. RTFM). Extensive experiments on three public datasets UCF-Crime, ShanghaiTech and XD-Violence show that our model performs better than or equally to the existing lightweight methods, while with a significantly reduced number of model parameters. Furthermore, by integrating the improved module designed in this paper with the VadCLIP method proposed by Wu et al., we achieve the state-of-the-art performance of non-lightweight models on the UCF-Crime and XD-Violence datasets.