Monitoring System for Persons With Alzheimer's Disease via Video-Object Tracking

Abstract

This article presents a framework for a food intake monitoring system intended for use with persons with Alzheimer's disease and other dementias. Alzheimer's disease has a significant impact on the individual's ability to perform their daily activities including eating. Providing assistance with feeding is a major challenge for caregivers, including a significant time commitment. We present a vision-based system that tracks moving objects, such as the hand, using a combined optical flow and skin region detection algorithms. Skin detection is implemented using two different methods. Hue, saturation, and value (HSV) color space, which is on separation of the illuminance component from chrominance one as the first method and skin color information is extracted from subject's face detected using Viola-Johns algorithm for the second method. Once face and other moving skin regions are detected, bounding boxes are created and used to track all moving regions over the video frames, recognizing eating behavior or the lack of it. Based on experimental results the proposed method using optical flow and skin regions segmentation using HSV color detects the hand to mouth eating motion with 92.12% accuracy. The optical flow and skin region segmentation based on face color information achieves a higher accuracy of 94.29%.