Novel Activities Detection Algorithm in Extended Videos

Abstract

Due to participation in TRECVID ActEV[1] competition, we conduct research on temporal activity recognition. In this paper, we propose a system for activity detection and localize detected activities temporally in extended videos. Our system firstly detects objects in video frames. Secondly, we use position information of detected object, as input to the object tracking model, which can obtain motion information of multiple objects in consecutive frames. Lastly, we input consecutive video frames containing only detected objects into 3D Convolutional Neural Network to achieve features, and 3D CNN is followed by a recurrent neural network for accurately localizing the detected activity.