Hybrid Model Featuring CNN and LSTM Architecture for Human Activity Recognition on Smartphone Sensor Data

Abstract

The traditional methods of recognizing human activities involve typical machine learning (ML) algorithms which uses heuristic engineered features. Human activities are dynamic in nature and are encoded with a sequence of actions. ML methods are able to perform activity recognition tasks but may not exploit the temporal correlations of the input data. Therefore, in this paper, we proposed and showed the effectiveness of employing a new combination of deep learning (DL) methods for human activity recognition (HAR). DL methods are capable of extracting discriminative features automatically from the raw sensor data. Specifically, in this paper, we proposed a hybrid architecture which features a combination of Convolutional neural networks (CNN) and Long short-term Memory (LSTM) networks for HAR task. The model is tested on UCI HAR dataset which is a benchmark dataset and comprises of accelerometer and gyroscope data obtained from a smartphone. Our experimental results showed that our proposed method outperformed the recent results which used pure LSTM and bidirectional LSTM networks on the same dataset.