Contextual anomaly detection for multivariate time series data

Abstract

Abstract With the advancement of sensing technologies, sensor data collected over time have become more useful for detecting anomalies in underlying processes and systems. Sensor data are often affected by contextual variables, such as equipment settings, and can have different patterns, even in normal states depending on the contextual variables. Motivated by this problem, we propose a contextual anomaly detection method for multivariate time series data. We first build a prediction model using training data consisting of only normal observations, and then perform anomaly detection based on the prediction errors for future observations. The prediction model is based on a long short-term memory (LSTM) network that can flexibly model complex relationships between variables as well as temporal correlations between successive time points using the high expressive power of deep recurrent neural networks. In particular, to incorporate the contextual information while ensuring that it does not propagate over time but affects the response data only at specific target time points, we extend the standard LSTM by adding a layer for the contextual variables separately for each time step. The performance of the proposed method was verified with several open-source datasets and a real dataset from a global tire company.