Generating Virtual Head-Mounted Gyroscope Signals From Video Data

Abstract

Human activity recognition (HAR) using the deep learning method has caught the attention of researchers thanks to its automatic feature extraction and accurate prediction capabilities. However, for applications based on a wearable sensor, such as an inertial measurement unit (IMU), the process of collecting and hand-labeling large amounts of data is complicated and labor-intensive, meaning that there is a limited amount of data available for model training. Therefore, there is a need to propose and develop data augmentation approaches to generate high quality data for the growth of HAR research. We propose a head-mounted virtual gyroscope signal generator to alleviate the problems caused by the lack of data in head movement-related applications. Unlike previous work, our system only generates head-motion related gyroscope data, minimizing system complexity. We trained a deep-learning model in a head motion-based application with different generated sensor data ratios, and show the viability of our proposed data generation method.