Pedro Amorim, Daniela Ferreira-Santos, Marta Drummond, Pedro Pereira Rodrigues
{"title":"阻塞性睡眠呼吸暂停移动诊断应用程序的前瞻性验证和可用性评估。","authors":"Pedro Amorim, Daniela Ferreira-Santos, Marta Drummond, Pedro Pereira Rodrigues","doi":"10.3390/diagnostics14222519","DOIUrl":null,"url":null,"abstract":"<p><p><b>Background/Objectives</b>: Obstructive sleep apnea (OSA) classification relies on polysomnography (PSG) results. Current guidelines recommend the development of clinical prediction algorithms in screening prior to PSG. A recent intuitive and user-friendly tool (OSABayes), based on a Bayesian network model using six clinical variables, has been proposed to quantify the probability of OSA. Our aims are (1) to validate OSABayes prospectively, (2) to build a smartphone app based on the proposed model, and (3) to evaluate app usability. <b>Methods</b>: We prospectively included adult patients suspected of OSA, without suspicion of other sleep disorders, who underwent level I or III diagnostic PSG. Apnea-hypopnea index (AHI) and OSABayes probabilities were obtained and compared using the area under the ROC curve (AUC [95%CI]) for OSA diagnosis (AHI ≥ 5/h) and higher severity levels (AHI ≥ 15/h) prediction. We built the OSABayes app on 'App Inventor 2', and the usability was assessed with a cognitive walkthrough method and a general evaluation. <b>Results</b>: 216 subjects were included in the validation cohort, performing PSG levels I (34%) and III (66%). OSABayes presented an AUC of 83.6% [77.3-90.0%] for OSA diagnosis and 76.3% [69.9-82.7%] for moderate/severe OSA prediction, showing good response for both types of PSG. The OSABayes smartphone application allows one to calculate the probability of having OSA and consult information about OSA and the tool. In the usability evaluation, 96% of the proposed tasks were carried out. <b>Conclusions</b>: These results show the good discrimination power of OSABayes and validate its applicability in identifying patients with a high pre-test probability of OSA. The tool is available as an online form and as a smartphone app, allowing a quick and accessible calculation of OSA probability.</p>","PeriodicalId":11225,"journal":{"name":"Diagnostics","volume":"14 22","pages":""},"PeriodicalIF":3.0000,"publicationDate":"2024-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11592544/pdf/","citationCount":"0","resultStr":"{\"title\":\"Prospective Validation and Usability Evaluation of a Mobile Diagnostic App for Obstructive Sleep Apnea.\",\"authors\":\"Pedro Amorim, Daniela Ferreira-Santos, Marta Drummond, Pedro Pereira Rodrigues\",\"doi\":\"10.3390/diagnostics14222519\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p><b>Background/Objectives</b>: Obstructive sleep apnea (OSA) classification relies on polysomnography (PSG) results. Current guidelines recommend the development of clinical prediction algorithms in screening prior to PSG. A recent intuitive and user-friendly tool (OSABayes), based on a Bayesian network model using six clinical variables, has been proposed to quantify the probability of OSA. Our aims are (1) to validate OSABayes prospectively, (2) to build a smartphone app based on the proposed model, and (3) to evaluate app usability. <b>Methods</b>: We prospectively included adult patients suspected of OSA, without suspicion of other sleep disorders, who underwent level I or III diagnostic PSG. Apnea-hypopnea index (AHI) and OSABayes probabilities were obtained and compared using the area under the ROC curve (AUC [95%CI]) for OSA diagnosis (AHI ≥ 5/h) and higher severity levels (AHI ≥ 15/h) prediction. We built the OSABayes app on 'App Inventor 2', and the usability was assessed with a cognitive walkthrough method and a general evaluation. <b>Results</b>: 216 subjects were included in the validation cohort, performing PSG levels I (34%) and III (66%). OSABayes presented an AUC of 83.6% [77.3-90.0%] for OSA diagnosis and 76.3% [69.9-82.7%] for moderate/severe OSA prediction, showing good response for both types of PSG. The OSABayes smartphone application allows one to calculate the probability of having OSA and consult information about OSA and the tool. In the usability evaluation, 96% of the proposed tasks were carried out. <b>Conclusions</b>: These results show the good discrimination power of OSABayes and validate its applicability in identifying patients with a high pre-test probability of OSA. The tool is available as an online form and as a smartphone app, allowing a quick and accessible calculation of OSA probability.</p>\",\"PeriodicalId\":11225,\"journal\":{\"name\":\"Diagnostics\",\"volume\":\"14 22\",\"pages\":\"\"},\"PeriodicalIF\":3.0000,\"publicationDate\":\"2024-11-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11592544/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Diagnostics\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.3390/diagnostics14222519\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MEDICINE, GENERAL & INTERNAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Diagnostics","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.3390/diagnostics14222519","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MEDICINE, GENERAL & INTERNAL","Score":null,"Total":0}
引用次数: 0
摘要
背景/目的:阻塞性睡眠呼吸暂停(OSA)分类依赖于多导睡眠图(PSG)结果。现行指南建议在 PSG 之前开发筛查临床预测算法。最近有人提出了一种直观且用户友好的工具(OSABayes),该工具基于使用六个临床变量的贝叶斯网络模型,用于量化 OSA 的概率。我们的目标是:(1)对 OSABayes 进行前瞻性验证;(2)基于所提出的模型开发一款智能手机应用程序;(3)评估应用程序的可用性。方法:我们前瞻性地纳入了疑似 OSA 的成年患者,这些患者未怀疑有其他睡眠障碍,并接受了 I 级或 III 级 PSG 诊断。我们获得了呼吸暂停-低通气指数(AHI)和 OSABayes 概率,并使用 ROC 曲线下面积(AUC [95%CI])对 OSA 诊断(AHI ≥ 5/h)和更高严重程度(AHI ≥ 15/h)预测进行了比较。我们在 "App Inventor 2 "上开发了 OSABayes 应用程序,并通过认知演练法和一般评估对其可用性进行了评估。结果:216 名受试者参加了验证队列,他们的 PSG 水平分别为 I 级(34%)和 III 级(66%)。OSABayes 对 OSA 诊断的 AUC 为 83.6% [77.3-90.0%],对中度/重度 OSA 预测的 AUC 为 76.3% [69.9-82.7%],显示出对两种 PSG 的良好反应。OSABayes智能手机应用程序允许人们计算患OSA的概率,并查询有关OSA和该工具的信息。在可用性评估中,96% 的建议任务都得到了执行。结论这些结果表明 OSABayes 具有良好的辨别能力,并验证了其在识别 OSA 检测前概率较高的患者方面的适用性。该工具可作为在线表格和智能手机应用程序使用,可快速方便地计算 OSA 概率。
Prospective Validation and Usability Evaluation of a Mobile Diagnostic App for Obstructive Sleep Apnea.
Background/Objectives: Obstructive sleep apnea (OSA) classification relies on polysomnography (PSG) results. Current guidelines recommend the development of clinical prediction algorithms in screening prior to PSG. A recent intuitive and user-friendly tool (OSABayes), based on a Bayesian network model using six clinical variables, has been proposed to quantify the probability of OSA. Our aims are (1) to validate OSABayes prospectively, (2) to build a smartphone app based on the proposed model, and (3) to evaluate app usability. Methods: We prospectively included adult patients suspected of OSA, without suspicion of other sleep disorders, who underwent level I or III diagnostic PSG. Apnea-hypopnea index (AHI) and OSABayes probabilities were obtained and compared using the area under the ROC curve (AUC [95%CI]) for OSA diagnosis (AHI ≥ 5/h) and higher severity levels (AHI ≥ 15/h) prediction. We built the OSABayes app on 'App Inventor 2', and the usability was assessed with a cognitive walkthrough method and a general evaluation. Results: 216 subjects were included in the validation cohort, performing PSG levels I (34%) and III (66%). OSABayes presented an AUC of 83.6% [77.3-90.0%] for OSA diagnosis and 76.3% [69.9-82.7%] for moderate/severe OSA prediction, showing good response for both types of PSG. The OSABayes smartphone application allows one to calculate the probability of having OSA and consult information about OSA and the tool. In the usability evaluation, 96% of the proposed tasks were carried out. Conclusions: These results show the good discrimination power of OSABayes and validate its applicability in identifying patients with a high pre-test probability of OSA. The tool is available as an online form and as a smartphone app, allowing a quick and accessible calculation of OSA probability.
DiagnosticsBiochemistry, Genetics and Molecular Biology-Clinical Biochemistry
CiteScore
4.70
自引率
8.30%
发文量
2699
审稿时长
19.64 days
期刊介绍:
Diagnostics (ISSN 2075-4418) is an international scholarly open access journal on medical diagnostics. It publishes original research articles, reviews, communications and short notes on the research and development of medical diagnostics. There is no restriction on the length of the papers. Our aim is to encourage scientists to publish their experimental and theoretical research in as much detail as possible. Full experimental and/or methodological details must be provided for research articles.