Depth Assisted Palm Region Extraction Using the Kinect v2 Sensor

Abstract

This paper evaluates the feasibility of using the fusion of multispectral data from a Kinect v2 sensor as a way to extract the palm region of hand in an unconstrained environment. The depth data was used to both track the hand and extract palm regions. This extracted palm region was then used to extract the palm region in the RGB and Near Infrared data. One of the underlying goals was to maintain real time performance and as such relatively simple techniques such as using a sliding window were used. The lower boundary of the usable frames extracted was 50%, while in the case when the user is positioned directly in front of the sensor with hands extended outward from the body, the percentage of usable frames reached 75%.