Noncontact Neonatal Respiration Rate Estimation Using Machine Vision

Abstract

Using video data of neonates admitted to the neonatal intensive care unit (NICU) we developed and compared the performance of various techniques for noncontact respiration rate (RR) estimation. Data were collected from an overhead colour and depth (RGB-D) camera, while gold standard physiologic data were captured from the hospital's patient monitor. We developed a deep learning algorithm for automatic detection of the face and chest area of the neonate. We then use this algorithm to identify time periods with low patient motion and to locate regions of interest for RR estimation. We produce a respiration signal by quantifying the chest movement using the raw RGB video, motion-magnified RGB video, and depth video. We compare this to a respiration signal derived from the changes in the green channel of the face. We were able to estimate RR from motion-magnified video and depth video, achieving a mean absolute error of less than 3.5 BPM for 69% and 67% of the time for each stream, respectively. We achieve this result without the need for skin segmentation and can apply our technique to fully clothed neonatal patients. We show that similar performance can be achieved using the depth and colour stream using this technique.