Prospective Validation and Usability Evaluation of a Mobile Diagnostic App for Obstructive Sleep Apnea.

Abstract

Background/Objectives: Obstructive sleep apnea (OSA) classification relies on polysomnography (PSG) results. Current guidelines recommend the development of clinical prediction algorithms in screening prior to PSG. A recent intuitive and user-friendly tool (OSABayes), based on a Bayesian network model using six clinical variables, has been proposed to quantify the probability of OSA. Our aims are (1) to validate OSABayes prospectively, (2) to build a smartphone app based on the proposed model, and (3) to evaluate app usability. Methods: We prospectively included adult patients suspected of OSA, without suspicion of other sleep disorders, who underwent level I or III diagnostic PSG. Apnea-hypopnea index (AHI) and OSABayes probabilities were obtained and compared using the area under the ROC curve (AUC [95%CI]) for OSA diagnosis (AHI ≥ 5/h) and higher severity levels (AHI ≥ 15/h) prediction. We built the OSABayes app on 'App Inventor 2', and the usability was assessed with a cognitive walkthrough method and a general evaluation. Results: 216 subjects were included in the validation cohort, performing PSG levels I (34%) and III (66%). OSABayes presented an AUC of 83.6% [77.3-90.0%] for OSA diagnosis and 76.3% [69.9-82.7%] for moderate/severe OSA prediction, showing good response for both types of PSG. The OSABayes smartphone application allows one to calculate the probability of having OSA and consult information about OSA and the tool. In the usability evaluation, 96% of the proposed tasks were carried out. Conclusions: These results show the good discrimination power of OSABayes and validate its applicability in identifying patients with a high pre-test probability of OSA. The tool is available as an online form and as a smartphone app, allowing a quick and accessible calculation of OSA probability.