首页 > 最新文献

PLOS digital health最新文献

英文 中文
Diagnosing skin neglected tropical diseases with the aid of digital health tools: A scoping review. 借助数字医疗工具诊断被忽视的热带皮肤病:范围综述。
Pub Date : 2024-10-07 eCollection Date: 2024-10-01 DOI: 10.1371/journal.pdig.0000629
Ewelina Julia Barnowska, Anil Fastenau, Srilekha Penna, Ann-Kristin Bonkass, Sophie Stuetzle, Ricky Janssen

Delays in diagnosis and detection of skin neglected tropical diseases (NTDs) pose obstacles to prompt treatment, which is crucial in preventing disability. Recent developments in digital health have given rise to approaches that could increase access to diagnosis in resource-poor areas affected by skin NTDs. This scoping review provides an overview of current digital health approaches that aim to aid in the diagnosis of skin NTDs and provides an insight into the diverse functionalities of current digital health tools, their feasibility, usability, and the current gaps in research around these digital health approaches. This scoping review included a comprehensive literature search on PubMed, EMBASE and SCOPUS, following the PRISMA guidelines. Eleven studies were included in the review and were analysed using a descriptive thematic approach. Most digital tools were found to be mobile-phone based, such as mobile Health (mHealth) apps, store-and-forward tele-dermatology, and Short Messaging Service (SMS) text-messaging. Other digital approaches were based on computer software, such as tele-dermatopathology, computer-based telemedicine, and real-time tele-dermatology. Digital health tools commonly facilitated provider-provider interactions, which helped support diagnoses of skin NTDs at the community level. Articles which focused on end-user user experience reported that users appreciated the usefulness and convenience of these digital tools. However, the results emphasized the existing lack of data regarding the diagnostic precision of these tools, and highlighted various hurdles to their effective implementation, including insufficient infrastructure, data security issues and low adherence to the routine use of digital health tools. Digital health tools can help ascertain diagnosis of skin NTDs through remote review or consultations with patients, and support health providers in the diagnostic process. However, further research is required to address the data security issues associated with digital health tools. Developers should consider adapting digital health tools to diverse socio-cultural and technical environments, where skin NTDs are endemic. Researchers are encouraged to assess the diagnostic accuracy of digital health tools and conduct further qualitative studies to inform end-user experience. Overall, future studies should consider expanding the geographical and disease scope of research on digital health tools which aid the diagnosis of skin NTDs.

被忽视的热带皮肤病(NTDs)诊断和检测的延误阻碍了及时治疗,而及时治疗对于预防残疾至关重要。数字医疗领域的最新发展催生了一些方法,这些方法可以增加受皮肤性病影响的资源匮乏地区获得诊断的机会。本范围界定综述概述了当前旨在帮助诊断皮肤性病的数字医疗方法,并深入探讨了当前数字医疗工具的各种功能、其可行性、可用性以及围绕这些数字医疗方法的研究目前存在的差距。本次范围界定综述按照 PRISMA 指南在 PubMed、EMBASE 和 SCOPUS 上进行了全面的文献检索。11 项研究被纳入综述,并采用描述性主题方法进行了分析。研究发现,大多数数字化工具都是基于手机的,如移动医疗(mHealth)应用程序、存储转发式远程皮肤病学和短信服务(SMS)。其他数字化方法以计算机软件为基础,如远程皮肤病学、基于计算机的远程医疗和实时远程皮肤病学。数字医疗工具通常促进了医疗服务提供者与医疗服务提供者之间的互动,有助于支持社区层面的皮肤性病诊断。关注最终用户体验的文章称,用户对这些数字工具的实用性和便利性表示赞赏。然而,研究结果强调,目前缺乏有关这些工具诊断精确性的数据,并突出强调了有效实施这些工具的各种障碍,包括基础设施不足、数据安全问题以及对常规使用数字医疗工具的依从性较低。数字医疗工具可以通过远程复查或与患者会诊帮助确定皮肤非传染性疾病的诊断,并在诊断过程中为医疗服务提供者提供支持。不过,还需要进一步研究解决与数字医疗工具相关的数据安全问题。开发人员应考虑使数字医疗工具适应皮肤性病流行的不同社会文化和技术环境。鼓励研究人员评估数字健康工具的诊断准确性,并开展进一步的定性研究,以了解最终用户的体验。总之,未来的研究应考虑扩大有助于诊断皮肤性病的数字医疗工具研究的地域和疾病范围。
{"title":"Diagnosing skin neglected tropical diseases with the aid of digital health tools: A scoping review.","authors":"Ewelina Julia Barnowska, Anil Fastenau, Srilekha Penna, Ann-Kristin Bonkass, Sophie Stuetzle, Ricky Janssen","doi":"10.1371/journal.pdig.0000629","DOIUrl":"https://doi.org/10.1371/journal.pdig.0000629","url":null,"abstract":"<p><p>Delays in diagnosis and detection of skin neglected tropical diseases (NTDs) pose obstacles to prompt treatment, which is crucial in preventing disability. Recent developments in digital health have given rise to approaches that could increase access to diagnosis in resource-poor areas affected by skin NTDs. This scoping review provides an overview of current digital health approaches that aim to aid in the diagnosis of skin NTDs and provides an insight into the diverse functionalities of current digital health tools, their feasibility, usability, and the current gaps in research around these digital health approaches. This scoping review included a comprehensive literature search on PubMed, EMBASE and SCOPUS, following the PRISMA guidelines. Eleven studies were included in the review and were analysed using a descriptive thematic approach. Most digital tools were found to be mobile-phone based, such as mobile Health (mHealth) apps, store-and-forward tele-dermatology, and Short Messaging Service (SMS) text-messaging. Other digital approaches were based on computer software, such as tele-dermatopathology, computer-based telemedicine, and real-time tele-dermatology. Digital health tools commonly facilitated provider-provider interactions, which helped support diagnoses of skin NTDs at the community level. Articles which focused on end-user user experience reported that users appreciated the usefulness and convenience of these digital tools. However, the results emphasized the existing lack of data regarding the diagnostic precision of these tools, and highlighted various hurdles to their effective implementation, including insufficient infrastructure, data security issues and low adherence to the routine use of digital health tools. Digital health tools can help ascertain diagnosis of skin NTDs through remote review or consultations with patients, and support health providers in the diagnostic process. However, further research is required to address the data security issues associated with digital health tools. Developers should consider adapting digital health tools to diverse socio-cultural and technical environments, where skin NTDs are endemic. Researchers are encouraged to assess the diagnostic accuracy of digital health tools and conduct further qualitative studies to inform end-user experience. Overall, future studies should consider expanding the geographical and disease scope of research on digital health tools which aid the diagnosis of skin NTDs.</p>","PeriodicalId":74465,"journal":{"name":"PLOS digital health","volume":"3 10","pages":"e0000629"},"PeriodicalIF":0.0,"publicationDate":"2024-10-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11458012/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142395808","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Identifying older adults at risk for dementia based on smartphone data obtained during a wayfinding task in the real world. 根据在现实世界中完成寻路任务时获得的智能手机数据,识别有痴呆风险的老年人。
Pub Date : 2024-10-03 eCollection Date: 2024-10-01 DOI: 10.1371/journal.pdig.0000613
Jonas Marquardt, Priyanka Mohan, Myra Spiliopoulou, Wenzel Glanz, Michaela Butryn, Esther Kuehn, Stefanie Schreiber, Anne Maass, Nadine Diersch

Alzheimer's disease (AD), as the most common form of dementia and leading cause for disability and death in old age, represents a major burden to healthcare systems worldwide. For the development of disease-modifying interventions and treatments, the detection of cognitive changes at the earliest disease stages is crucial. Recent advancements in mobile consumer technologies provide new opportunities to collect multi-dimensional data in real-life settings to identify and monitor at-risk individuals. Based on evidence showing that deficits in spatial navigation are a common hallmark of dementia, we assessed whether a memory clinic sample of patients with subjective cognitive decline (SCD) who still scored normally on neuropsychological assessments show differences in smartphone-assisted wayfinding behavior compared with cognitively healthy older and younger adults. Guided by a mobile application, participants had to find locations along a short route on the medical campus of the Magdeburg university. We show that performance measures that were extracted from GPS and user input data distinguish between the groups. In particular, the number of orientation stops was predictive of the SCD status in older participants. Our data suggest that subtle cognitive changes in patients with SCD, whose risk to develop dementia in the future is elevated, can be inferred from smartphone data, collected during a brief wayfinding task in the real world.

阿尔茨海默病(AD)是最常见的痴呆症,也是导致老年残疾和死亡的主要原因,给全世界的医疗系统带来了沉重负担。为了开发改变疾病的干预措施和治疗方法,在疾病的早期阶段检测认知变化至关重要。移动消费技术的最新进展为在现实生活中收集多维数据以识别和监测高危人群提供了新的机会。有证据表明,空间导航能力的缺陷是痴呆症的常见特征,基于这一证据,我们评估了记忆门诊样本中主观认知能力下降(SCD)但神经心理评估得分仍然正常的患者与认知健康的老年人和年轻人相比,在智能手机辅助下的寻路行为是否存在差异。在手机应用程序的引导下,参与者必须沿着马格德堡大学医学园区内的一条短路线寻找地点。我们的研究表明,从全球定位系统和用户输入数据中提取的性能指标能够区分不同的组别。特别是,定向停留的次数可以预测老年参与者的 SCD 状态。我们的数据表明,从智能手机数据中可以推断出 SCD 患者的细微认知变化,这些患者未来患痴呆症的风险较高。
{"title":"Identifying older adults at risk for dementia based on smartphone data obtained during a wayfinding task in the real world.","authors":"Jonas Marquardt, Priyanka Mohan, Myra Spiliopoulou, Wenzel Glanz, Michaela Butryn, Esther Kuehn, Stefanie Schreiber, Anne Maass, Nadine Diersch","doi":"10.1371/journal.pdig.0000613","DOIUrl":"10.1371/journal.pdig.0000613","url":null,"abstract":"<p><p>Alzheimer's disease (AD), as the most common form of dementia and leading cause for disability and death in old age, represents a major burden to healthcare systems worldwide. For the development of disease-modifying interventions and treatments, the detection of cognitive changes at the earliest disease stages is crucial. Recent advancements in mobile consumer technologies provide new opportunities to collect multi-dimensional data in real-life settings to identify and monitor at-risk individuals. Based on evidence showing that deficits in spatial navigation are a common hallmark of dementia, we assessed whether a memory clinic sample of patients with subjective cognitive decline (SCD) who still scored normally on neuropsychological assessments show differences in smartphone-assisted wayfinding behavior compared with cognitively healthy older and younger adults. Guided by a mobile application, participants had to find locations along a short route on the medical campus of the Magdeburg university. We show that performance measures that were extracted from GPS and user input data distinguish between the groups. In particular, the number of orientation stops was predictive of the SCD status in older participants. Our data suggest that subtle cognitive changes in patients with SCD, whose risk to develop dementia in the future is elevated, can be inferred from smartphone data, collected during a brief wayfinding task in the real world.</p>","PeriodicalId":74465,"journal":{"name":"PLOS digital health","volume":"3 10","pages":"e0000613"},"PeriodicalIF":0.0,"publicationDate":"2024-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11449328/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142373736","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Socioeconomic and demographic patterning of family uptake of a paediatric electronic patient portal innovation. 儿科电子患者门户网站创新的社会经济和人口结构模式。
Pub Date : 2024-10-03 eCollection Date: 2024-10-01 DOI: 10.1371/journal.pdig.0000496
Ameenat Lola Solebo, Lisanne Horvat-Gitsels, Christine Twomey, Siegfried Karl Wagner, Jugnoo S Rahi

Patient portals allowing access to electronic health care records and services can inform and empower but may widen existing sociodemographic inequities. We aimed to describe associations between activation of a paediatric patient portal and patient race/ethnicity, socioeconomic status and markers of previous engagement with health care. A retrospective single site cross-sectional study was undertaken to examine patient portal adoption amongst families of children receiving care for chronic or complex disorders within the United Kingdom. Descriptive and multivariable regression analysis was undertaken to describe associations between predictors (Race/Ethnicity, age, socio-economic deprivation status based on family residence, and previous non-attendance to outpatient consultations) and outcome. A sample of 3687 children, representative of the diverse 'real world' patient population, was identified. Of these 37% (1364) were from a White British background, 71% (2631) had English as the primary family spoken language (PSL), 14% (532) lived in areas of high deprivation, and 17% (643) had high (>33%) rates of non-attendance. The families of 73% (2682) had activated the portal. In adjusted analyses, English as a PSL (adjusted odds ratio [aOR] 1.58, 95% confidence interval 1.29-1.95) and multi-morbidity (aOR 1.26, 1.22-1.30) was positively associated with portal activation, whilst families from British Black African backgrounds (aOR 0.68, 0.50-0.93), and those with high rates of non-attendance (aOR 0.48, 0.40-0.58) were less likely to use the portal. Family race/ethnicity and previous low engagement with health care services are potentially key drivers of widening inequity in access to health care following the implementation of patient portals, a digital health innovation intended to inform and empower. Health care providers should be aware that innovative human-driven engagement approaches, targeted towards previously underserved communities, are needed to ensure equitable access to high quality patient-centred care.

患者门户网站允许访问电子医疗记录和服务,可以提供信息和增强能力,但也可能扩大现有的社会人口不平等。我们旨在描述儿科患者门户网站的激活与患者的种族/民族、社会经济地位和以往参与医疗保健的标志物之间的关联。我们开展了一项回顾性单点横断面研究,以考察英国接受慢性或复杂疾病治疗的儿童家庭采用患者门户网站的情况。研究人员通过描述性和多变量回归分析来描述预测因素(种族/民族、年龄、基于家庭居住地的社会经济贫困状况以及以前未参加门诊咨询的情况)与结果之间的关联。研究确定了 3687 名儿童样本,这些样本代表了 "现实世界 "中的不同患者群体。其中,37%(1364 名)的儿童来自英国白人背景,71%(2631 名)的儿童以英语为主要家庭口语(PSL),14%(532 名)的儿童居住在高度贫困地区,17%(643 名)的儿童未就诊率较高(>33%)。73%(2682 人)的家庭启动了门户网站。在调整后的分析中,英语作为PSL(调整后的几率比[aOR]1.58,95%置信区间1.29-1.95)和多病(aOR 1.26,1.22-1.30)与门户网站的激活呈正相关,而来自英国黑非洲背景的家庭(aOR 0.68,0.50-0.93)和未到会率高的家庭(aOR 0.48,0.40-0.58)使用门户网站的可能性较低。患者门户网站是一项旨在提供信息和增强能力的数字医疗创新,其实施后,家庭种族/民族和以前很少参与医疗服务可能是导致医疗服务不平等扩大的主要原因。医疗服务提供者应该意识到,需要针对以前服务不足的社区采取以人为本的创新参与方法,以确保公平地获得以患者为中心的高质量医疗服务。
{"title":"Socioeconomic and demographic patterning of family uptake of a paediatric electronic patient portal innovation.","authors":"Ameenat Lola Solebo, Lisanne Horvat-Gitsels, Christine Twomey, Siegfried Karl Wagner, Jugnoo S Rahi","doi":"10.1371/journal.pdig.0000496","DOIUrl":"10.1371/journal.pdig.0000496","url":null,"abstract":"<p><p>Patient portals allowing access to electronic health care records and services can inform and empower but may widen existing sociodemographic inequities. We aimed to describe associations between activation of a paediatric patient portal and patient race/ethnicity, socioeconomic status and markers of previous engagement with health care. A retrospective single site cross-sectional study was undertaken to examine patient portal adoption amongst families of children receiving care for chronic or complex disorders within the United Kingdom. Descriptive and multivariable regression analysis was undertaken to describe associations between predictors (Race/Ethnicity, age, socio-economic deprivation status based on family residence, and previous non-attendance to outpatient consultations) and outcome. A sample of 3687 children, representative of the diverse 'real world' patient population, was identified. Of these 37% (1364) were from a White British background, 71% (2631) had English as the primary family spoken language (PSL), 14% (532) lived in areas of high deprivation, and 17% (643) had high (>33%) rates of non-attendance. The families of 73% (2682) had activated the portal. In adjusted analyses, English as a PSL (adjusted odds ratio [aOR] 1.58, 95% confidence interval 1.29-1.95) and multi-morbidity (aOR 1.26, 1.22-1.30) was positively associated with portal activation, whilst families from British Black African backgrounds (aOR 0.68, 0.50-0.93), and those with high rates of non-attendance (aOR 0.48, 0.40-0.58) were less likely to use the portal. Family race/ethnicity and previous low engagement with health care services are potentially key drivers of widening inequity in access to health care following the implementation of patient portals, a digital health innovation intended to inform and empower. Health care providers should be aware that innovative human-driven engagement approaches, targeted towards previously underserved communities, are needed to ensure equitable access to high quality patient-centred care.</p>","PeriodicalId":74465,"journal":{"name":"PLOS digital health","volume":"3 10","pages":"e0000496"},"PeriodicalIF":0.0,"publicationDate":"2024-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11449342/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142373737","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Automated image transcription for perinatal blood pressure monitoring using mobile health technology. 利用移动医疗技术进行围产期血压监测的自动图像转录。
Pub Date : 2024-10-02 eCollection Date: 2024-10-01 DOI: 10.1371/journal.pdig.0000588
Nasim Katebi, Whitney Bremer, Tony Nguyen, Daniel Phan, Jamila Jeff, Kirkland Armstrong, Paula Phabian-Millbrook, Marissa Platner, Kimberly Carroll, Banafsheh Shoai, Peter Rohloff, Sheree L Boulet, Cheryl G Franklin, Gari D Clifford

This paper introduces a novel approach to address the challenges associated with transferring blood pressure (BP) data obtained from oscillometric devices used in self-measured BP monitoring systems to integrate this data into medical health records or a proxy database accessible by clinicians, particularly in low literacy populations. To this end, we developed an automated image transcription technique to effectively transcribe readings from BP devices, ultimately enhancing the accessibility and usability of BP data for monitoring and managing BP during pregnancy and the postpartum period, particularly in low-resource settings and low-literate populations. In the designed study, the photos of the BP devices were captured as part of perinatal mobile health (mHealth) monitoring programs, conducted in four studies across two countries. The Guatemala Set 1 and Guatemala Set 2 datasets include the data captured by a cohort of 49 lay midwives from 1697 and 584 pregnant women carrying singletons in the second and third trimesters in rural Guatemala during routine screening. Additionally, we designed an mHealth system in Georgia for postpartum women to monitor and report their BP at home with 23 and 49 African American participants contributing to the Georgia I3 and Georgia IMPROVE projects, respectively. We developed a deep learning-based model which operates in two steps: LCD localization using the You Only Look Once (YOLO) object detection model and digit recognition using a convolutional neural network-based model capable of recognizing multiple digits. We applied color correction and thresholding techniques to minimize the impact of reflection and artifacts. Three experiments were conducted based on the devices used for training the digit recognition model. Overall, our results demonstrate that the device-specific model with transfer learning and the device independent model outperformed the device-specific model without transfer learning. The mean absolute error (MAE) of image transcription on held-out test datasets using the device-independent digit recognition were 1.2 and 0.8 mmHg for systolic and diastolic BP in the Georgia IMPROVE and 0.9 and 0.5 mmHg in Guatemala Set 2 datasets. The MAE, far below the FDA recommendation of 5 mmHg, makes the proposed automatic image transcription model suitable for general use when used with appropriate low-error BP devices.

本文介绍了一种新颖的方法,用于解决与传输从自测血压监测系统中使用的示波测量设备获得的血压(BP)数据相关的挑战,将这些数据整合到医疗健康记录或临床医生可访问的代理数据库中,尤其是在文化水平较低的人群中。为此,我们开发了一种自动图像转录技术,以有效地转录血压设备的读数,最终提高血压数据的可获取性和可用性,用于监测和管理孕期和产后血压,尤其是在资源匮乏的环境和低文化水平人群中。在设计的研究中,血压设备的照片是围产期移动医疗(mHealth)监测计划的一部分,在两个国家的四项研究中进行。危地马拉第一套和第二套数据集包括由 49 名非专业助产士组成的队列在危地马拉农村地区对 1697 名孕妇和 584 名怀有单胎的孕妇进行例行筛查时采集的数据。此外,我们还在佐治亚州设计了一个移动医疗系统,让产后妇女在家监测和报告血压,分别有 23 名和 49 名非洲裔美国人参加了佐治亚州 I3 和佐治亚州 IMPROVE 项目。我们开发了一个基于深度学习的模型,该模型分两步运行:使用 "只看一遍"(YOLO)对象检测模型进行 LCD 定位,并使用基于卷积神经网络、能够识别多个数字的模型进行数字识别。我们采用了色彩校正和阈值技术,以尽量减少反射和伪影的影响。我们根据用于训练数字识别模型的设备进行了三次实验。总体而言,我们的结果表明,带有迁移学习的特定设备模型和独立于设备的模型优于不带迁移学习的特定设备模型。在佐治亚 IMPROVE 和危地马拉 Set 2 数据集中,使用独立于设备的数字识别技术对保持不变的测试数据集进行图像转录的平均绝对误差(MAE)分别为 1.2 和 0.8 mmHg(收缩压和舒张压)和 0.9 和 0.5 mmHg(舒张压和收缩压)。MAE 远远低于美国食品及药物管理局建议的 5 mmHg,因此建议的自动图像转录模型在与适当的低误差血压设备一起使用时适合普遍使用。
{"title":"Automated image transcription for perinatal blood pressure monitoring using mobile health technology.","authors":"Nasim Katebi, Whitney Bremer, Tony Nguyen, Daniel Phan, Jamila Jeff, Kirkland Armstrong, Paula Phabian-Millbrook, Marissa Platner, Kimberly Carroll, Banafsheh Shoai, Peter Rohloff, Sheree L Boulet, Cheryl G Franklin, Gari D Clifford","doi":"10.1371/journal.pdig.0000588","DOIUrl":"10.1371/journal.pdig.0000588","url":null,"abstract":"<p><p>This paper introduces a novel approach to address the challenges associated with transferring blood pressure (BP) data obtained from oscillometric devices used in self-measured BP monitoring systems to integrate this data into medical health records or a proxy database accessible by clinicians, particularly in low literacy populations. To this end, we developed an automated image transcription technique to effectively transcribe readings from BP devices, ultimately enhancing the accessibility and usability of BP data for monitoring and managing BP during pregnancy and the postpartum period, particularly in low-resource settings and low-literate populations. In the designed study, the photos of the BP devices were captured as part of perinatal mobile health (mHealth) monitoring programs, conducted in four studies across two countries. The Guatemala Set 1 and Guatemala Set 2 datasets include the data captured by a cohort of 49 lay midwives from 1697 and 584 pregnant women carrying singletons in the second and third trimesters in rural Guatemala during routine screening. Additionally, we designed an mHealth system in Georgia for postpartum women to monitor and report their BP at home with 23 and 49 African American participants contributing to the Georgia I3 and Georgia IMPROVE projects, respectively. We developed a deep learning-based model which operates in two steps: LCD localization using the You Only Look Once (YOLO) object detection model and digit recognition using a convolutional neural network-based model capable of recognizing multiple digits. We applied color correction and thresholding techniques to minimize the impact of reflection and artifacts. Three experiments were conducted based on the devices used for training the digit recognition model. Overall, our results demonstrate that the device-specific model with transfer learning and the device independent model outperformed the device-specific model without transfer learning. The mean absolute error (MAE) of image transcription on held-out test datasets using the device-independent digit recognition were 1.2 and 0.8 mmHg for systolic and diastolic BP in the Georgia IMPROVE and 0.9 and 0.5 mmHg in Guatemala Set 2 datasets. The MAE, far below the FDA recommendation of 5 mmHg, makes the proposed automatic image transcription model suitable for general use when used with appropriate low-error BP devices.</p>","PeriodicalId":74465,"journal":{"name":"PLOS digital health","volume":"3 10","pages":"e0000588"},"PeriodicalIF":0.0,"publicationDate":"2024-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11446426/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142367759","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Assessing generalizability of an AI-based visual test for cervical cancer screening. 评估基于人工智能的宫颈癌筛查视觉测试的通用性。
Pub Date : 2024-10-02 eCollection Date: 2024-10-01 DOI: 10.1371/journal.pdig.0000364
Syed Rakin Ahmed, Didem Egemen, Brian Befano, Ana Cecilia Rodriguez, Jose Jeronimo, Kanan Desai, Carolina Teran, Karla Alfaro, Joel Fokom-Domgue, Kittipat Charoenkwan, Chemtai Mungo, Rebecca Luckett, Rakiya Saidu, Taina Raiol, Ana Ribeiro, Julia C Gage, Silvia de Sanjose, Jayashree Kalpathy-Cramer, Mark Schiffman

A number of challenges hinder artificial intelligence (AI) models from effective clinical translation. Foremost among these challenges is the lack of generalizability, which is defined as the ability of a model to perform well on datasets that have different characteristics from the training data. We recently investigated the development of an AI pipeline on digital images of the cervix, utilizing a multi-heterogeneous dataset of 9,462 women (17,013 images) and a multi-stage model selection and optimization approach, to generate a diagnostic classifier able to classify images of the cervix into "normal", "indeterminate" and "precancer/cancer" (denoted as "precancer+") categories. In this work, we investigate the performance of this multiclass classifier on external data not utilized in training and internal validation, to assess the generalizability of the classifier when moving to new settings. We assessed both the classification performance and repeatability of our classifier model across the two axes of heterogeneity present in our dataset: image capture device and geography, utilizing both out-of-the-box inference and retraining with external data. Our results demonstrate that device-level heterogeneity affects our model performance more than geography-level heterogeneity. Classification performance of our model is strong on images from a new geography without retraining, while incremental retraining with inclusion of images from a new device progressively improves classification performance on that device up to a point of saturation. Repeatability of our model is relatively unaffected by data heterogeneity and remains strong throughout. Our work supports the need for optimized retraining approaches that address data heterogeneity (e.g., when moving to a new device) to facilitate effective use of AI models in new settings.

许多挑战阻碍了人工智能(AI)模型有效地进行临床转化。其中最主要的挑战是缺乏通用性,通用性是指模型在与训练数据具有不同特征的数据集上表现良好的能力。我们最近研究了在宫颈数字图像上开发人工智能流水线的问题,利用由 9,462 名妇女(17,013 张图像)组成的多异构数据集和多阶段模型选择与优化方法,生成了一个诊断分类器,能够将宫颈图像分为 "正常"、"不确定 "和 "癌前/癌"(表示为 "癌前+")类别。在这项工作中,我们研究了这一多类分类器在未用于训练和内部验证的外部数据上的性能,以评估分类器在转移到新环境时的通用性。我们利用开箱即用的推理和外部数据的再训练,评估了分类器模型在数据集的两个异质性轴(图像捕捉设备和地理位置)上的分类性能和可重复性。我们的结果表明,设备层面的异质性对模型性能的影响要大于地理层面的异质性。在不进行再训练的情况下,我们的模型对来自新地理位置的图像的分类性能很强,而通过加入来自新设备的图像进行增量再训练,可以逐步提高该设备的分类性能,直至达到饱和点。我们的模型的可重复性相对来说不受数据异质性的影响,在整个过程中保持强劲。我们的工作支持了对优化的再训练方法的需求,这种方法可以解决数据异质性问题(例如,在转移到新设备时),从而促进人工智能模型在新环境中的有效使用。
{"title":"Assessing generalizability of an AI-based visual test for cervical cancer screening.","authors":"Syed Rakin Ahmed, Didem Egemen, Brian Befano, Ana Cecilia Rodriguez, Jose Jeronimo, Kanan Desai, Carolina Teran, Karla Alfaro, Joel Fokom-Domgue, Kittipat Charoenkwan, Chemtai Mungo, Rebecca Luckett, Rakiya Saidu, Taina Raiol, Ana Ribeiro, Julia C Gage, Silvia de Sanjose, Jayashree Kalpathy-Cramer, Mark Schiffman","doi":"10.1371/journal.pdig.0000364","DOIUrl":"10.1371/journal.pdig.0000364","url":null,"abstract":"<p><p>A number of challenges hinder artificial intelligence (AI) models from effective clinical translation. Foremost among these challenges is the lack of generalizability, which is defined as the ability of a model to perform well on datasets that have different characteristics from the training data. We recently investigated the development of an AI pipeline on digital images of the cervix, utilizing a multi-heterogeneous dataset of 9,462 women (17,013 images) and a multi-stage model selection and optimization approach, to generate a diagnostic classifier able to classify images of the cervix into \"normal\", \"indeterminate\" and \"precancer/cancer\" (denoted as \"precancer+\") categories. In this work, we investigate the performance of this multiclass classifier on external data not utilized in training and internal validation, to assess the generalizability of the classifier when moving to new settings. We assessed both the classification performance and repeatability of our classifier model across the two axes of heterogeneity present in our dataset: image capture device and geography, utilizing both out-of-the-box inference and retraining with external data. Our results demonstrate that device-level heterogeneity affects our model performance more than geography-level heterogeneity. Classification performance of our model is strong on images from a new geography without retraining, while incremental retraining with inclusion of images from a new device progressively improves classification performance on that device up to a point of saturation. Repeatability of our model is relatively unaffected by data heterogeneity and remains strong throughout. Our work supports the need for optimized retraining approaches that address data heterogeneity (e.g., when moving to a new device) to facilitate effective use of AI models in new settings.</p>","PeriodicalId":74465,"journal":{"name":"PLOS digital health","volume":"3 10","pages":"e0000364"},"PeriodicalIF":0.0,"publicationDate":"2024-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11446437/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142367758","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Development and validation of a deep learning model for detecting signs of tuberculosis on chest radiographs among US-bound immigrants and refugees. 开发和验证深度学习模型,用于检测前往美国的移民和难民胸片上的肺结核迹象。
Pub Date : 2024-09-30 eCollection Date: 2024-09-01 DOI: 10.1371/journal.pdig.0000612
Scott H Lee, Shannon Fox, Raheem Smith, Kimberly A Skrobarcek, Harold Keyserling, Christina R Phares, Deborah Lee, Drew L Posey

Immigrants and refugees seeking admission to the United States must first undergo an overseas medical exam, overseen by the US Centers for Disease Control and Prevention (CDC), during which all persons ≥15 years old receive a chest x-ray to look for signs of tuberculosis. Although individual screening sites often implement quality control (QC) programs to ensure radiographs are interpreted correctly, the CDC does not currently have a method for conducting similar QC reviews at scale. We obtained digitized chest radiographs collected as part of the overseas immigration medical exam. Using radiographs from applicants 15 years old and older, we trained deep learning models to perform three tasks: identifying abnormal radiographs; identifying abnormal radiographs suggestive of tuberculosis; and identifying the specific findings (e.g., cavities or infiltrates) in abnormal radiographs. We then evaluated the models on both internal and external testing datasets, focusing on two classes of performance metrics: individual-level metrics, like sensitivity and specificity, and sample-level metrics, like accuracy in predicting the prevalence of abnormal radiographs. A total of 152,012 images (one image per applicant; mean applicant age 39 years) were used for model training. On our internal test dataset, our models performed well both in identifying abnormalities suggestive of TB (area under the curve [AUC] of 0.97; 95% confidence interval [CI]: 0.95, 0.98) and in estimating sample-level counts of the same (-2% absolute percentage error; 95% CIC: -8%, 6%). On the external test datasets, our models performed similarly well in identifying both generic abnormalities (AUCs ranging from 0.89 to 0.92) and those suggestive of TB (AUCs from 0.94 to 0.99). This performance was consistent across metrics, including those based on thresholded class predictions, like sensitivity, specificity, and F1 score. Strong performance relative to high-quality radiological reference standards across a variety of datasets suggests our models may make reliable tools for supporting chest radiography QC activities at CDC.

寻求进入美国的移民和难民必须首先接受由美国疾病控制和预防中心(CDC)监督的海外体检,在体检过程中,所有年龄≥15 岁的人都要接受胸部 X 光检查,以寻找结核病的迹象。虽然个别筛查点通常会实施质量控制(QC)计划,以确保正确解读X光片,但美国疾病预防控制中心目前还没有类似的大规模质量控制审查方法。我们获得了作为海外移民体检一部分的数字化胸部 X 光片。使用 15 岁及以上申请人的 X 光片,我们训练了深度学习模型来完成三项任务:识别异常 X 光片;识别提示肺结核的异常 X 光片;识别异常 X 光片中的特定发现(如龋齿或浸润)。然后,我们在内部和外部测试数据集上对模型进行了评估,重点关注两类性能指标:个体级指标(如灵敏度和特异性)和样本级指标(如预测异常射线照片患病率的准确性)。模型训练共使用了 152 012 张图像(每位申请人一张图像;申请人平均年龄 39 岁)。在内部测试数据集上,我们的模型在识别提示肺结核的异常方面表现良好(曲线下面积 [AUC] 为 0.97;95% 置信区间 [CI]:0.95, 0.98):0.95,0.98)和估计样本水平的相同计数(绝对百分比误差-2%;95% 置信区间 [CIC]:-8%,6%)。在外部测试数据集上,我们的模型在识别一般异常(AUC 在 0.89 到 0.92 之间)和提示肺结核的异常(AUC 在 0.94 到 0.99 之间)方面表现相似。这种性能在各种指标上都是一致的,包括那些基于阈值分类预测的指标,如灵敏度、特异性和 F1 分数。与各种数据集的高质量放射参考标准相比,我们的模型具有很强的性能,这表明我们的模型是支持疾病预防控制中心胸部放射质量控制活动的可靠工具。
{"title":"Development and validation of a deep learning model for detecting signs of tuberculosis on chest radiographs among US-bound immigrants and refugees.","authors":"Scott H Lee, Shannon Fox, Raheem Smith, Kimberly A Skrobarcek, Harold Keyserling, Christina R Phares, Deborah Lee, Drew L Posey","doi":"10.1371/journal.pdig.0000612","DOIUrl":"10.1371/journal.pdig.0000612","url":null,"abstract":"<p><p>Immigrants and refugees seeking admission to the United States must first undergo an overseas medical exam, overseen by the US Centers for Disease Control and Prevention (CDC), during which all persons ≥15 years old receive a chest x-ray to look for signs of tuberculosis. Although individual screening sites often implement quality control (QC) programs to ensure radiographs are interpreted correctly, the CDC does not currently have a method for conducting similar QC reviews at scale. We obtained digitized chest radiographs collected as part of the overseas immigration medical exam. Using radiographs from applicants 15 years old and older, we trained deep learning models to perform three tasks: identifying abnormal radiographs; identifying abnormal radiographs suggestive of tuberculosis; and identifying the specific findings (e.g., cavities or infiltrates) in abnormal radiographs. We then evaluated the models on both internal and external testing datasets, focusing on two classes of performance metrics: individual-level metrics, like sensitivity and specificity, and sample-level metrics, like accuracy in predicting the prevalence of abnormal radiographs. A total of 152,012 images (one image per applicant; mean applicant age 39 years) were used for model training. On our internal test dataset, our models performed well both in identifying abnormalities suggestive of TB (area under the curve [AUC] of 0.97; 95% confidence interval [CI]: 0.95, 0.98) and in estimating sample-level counts of the same (-2% absolute percentage error; 95% CIC: -8%, 6%). On the external test datasets, our models performed similarly well in identifying both generic abnormalities (AUCs ranging from 0.89 to 0.92) and those suggestive of TB (AUCs from 0.94 to 0.99). This performance was consistent across metrics, including those based on thresholded class predictions, like sensitivity, specificity, and F1 score. Strong performance relative to high-quality radiological reference standards across a variety of datasets suggests our models may make reliable tools for supporting chest radiography QC activities at CDC.</p>","PeriodicalId":74465,"journal":{"name":"PLOS digital health","volume":"3 9","pages":"e0000612"},"PeriodicalIF":0.0,"publicationDate":"2024-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11441656/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142333978","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The high price of equity in pulse oximetry: A cost evaluation and need for interim solutions. 脉搏氧饱和度的高昂公平代价:成本评估和临时解决方案的必要性。
Pub Date : 2024-09-30 eCollection Date: 2024-09-01 DOI: 10.1371/journal.pdig.0000372
Katelyn Dempsey, Joao Matos, Timothy McMahon, Mary Lindsay, James E Tcheng, An-Kwok Ian Wong

Disparities in pulse oximetry accuracy, disproportionately affecting patients of color, have been associated with serious clinical outcomes. Although many have called for pulse oximetry hardware replacement, the cost associated with this replacement is not known. The objective of this study was to estimate the cost of replacing all current pulse oximetry hardware throughout a hospital system via a single-center survey in 2023 at an academic medical center (Duke University) with three hospitals. The main outcome was the cost of total hardware replacement as identified by current day prices for hardware. New and used prices for 3,542/4,136 (85.6%) across three hospitals for pulse oximetry devices were found. The average cost to replace current pulse oximetry hardware is $6,834.61 per bed. Replacement and integration costs are estimated at $14.2-17.4 million for the entire medical system. Extrapolating these costs to 5,564 hospitals in the United States results in an estimated cost of $8.72 billion. "Simply replacing" current pulse oximetry hardware to address disparities may not be simple, cheap, or timely. Solutions for addressing pulse oximetry accuracy disparities leveraging current technology may be necessary, and might also be better. Trial Registration: Pro00113724, exempt.

脉搏血氧仪准确性的差异对有色人种患者的影响尤为严重,并与严重的临床后果相关。尽管许多人呼吁更换脉搏血氧仪硬件,但与更换相关的成本尚不清楚。本研究的目的是通过单中心调查,估算 2023 年在一家拥有三家医院的学术医疗中心(杜克大学)更换整个医院系统所有现有脉搏血氧仪硬件的成本。主要结果是根据硬件的当前价格确定的全部硬件更换成本。调查发现,三家医院共有 3,542/4,136 台(85.6%)脉搏血氧仪设备的新旧价格。更换当前脉搏血氧仪硬件的平均成本为每床 6,834.61 美元。整个医疗系统的更换和集成成本估计为 1,420 万至 1,740 万美元。将这些成本推算到美国的 5,564 家医院,估计成本为 87.2 亿美元。"简单地更换 "当前的脉搏血氧仪硬件来解决差异问题可能并不简单、廉价或及时。利用现有技术解决脉搏血氧仪准确性差异的解决方案可能是必要的,也可能是更好的。试验注册:Pro00113724, 豁免。
{"title":"The high price of equity in pulse oximetry: A cost evaluation and need for interim solutions.","authors":"Katelyn Dempsey, Joao Matos, Timothy McMahon, Mary Lindsay, James E Tcheng, An-Kwok Ian Wong","doi":"10.1371/journal.pdig.0000372","DOIUrl":"10.1371/journal.pdig.0000372","url":null,"abstract":"<p><p>Disparities in pulse oximetry accuracy, disproportionately affecting patients of color, have been associated with serious clinical outcomes. Although many have called for pulse oximetry hardware replacement, the cost associated with this replacement is not known. The objective of this study was to estimate the cost of replacing all current pulse oximetry hardware throughout a hospital system via a single-center survey in 2023 at an academic medical center (Duke University) with three hospitals. The main outcome was the cost of total hardware replacement as identified by current day prices for hardware. New and used prices for 3,542/4,136 (85.6%) across three hospitals for pulse oximetry devices were found. The average cost to replace current pulse oximetry hardware is $6,834.61 per bed. Replacement and integration costs are estimated at $14.2-17.4 million for the entire medical system. Extrapolating these costs to 5,564 hospitals in the United States results in an estimated cost of $8.72 billion. \"Simply replacing\" current pulse oximetry hardware to address disparities may not be simple, cheap, or timely. Solutions for addressing pulse oximetry accuracy disparities leveraging current technology may be necessary, and might also be better. Trial Registration: Pro00113724, exempt.</p>","PeriodicalId":74465,"journal":{"name":"PLOS digital health","volume":"3 9","pages":"e0000372"},"PeriodicalIF":0.0,"publicationDate":"2024-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11441667/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142333980","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Trust as moral currency: Perspectives of health researchers in sub-Saharan Africa on strategies to promote equitable data sharing. 信任是道德货币:撒哈拉以南非洲卫生研究人员对促进公平数据共享战略的看法。
Pub Date : 2024-09-27 eCollection Date: 2024-09-01 DOI: 10.1371/journal.pdig.0000551
Qunita Brown, Jyothi Chabilall, Nezerith Cengiz, Keymanthri Moodley

Groundbreaking data-sharing techniques and quick access to stored research data from the African continent are highly beneficial to create diverse unbiased datasets to inform digital health technologies and artificial intelligence in healthcare. Yet health researchers in sub-Saharan Africa (SSA) experience individual and collective challenges that render them cautious and even hesitant to share data despite acknowledging the public health benefits of sharing. This qualitative study reports on the perspectives of health researchers regarding strategies to mitigate these challenges. In-depth interviews were conducted via Microsoft Teams with 16 researchers from 16 different countries across SSA between July 2022 and April 2023. Purposive and snowball sampling techniques were used to invite participants via email. Recorded interviews were transcribed, cleaned, coded and managed through Atlas.ti.22. Thematic Analysis was used to analyse the data. Three recurrent themes and several subthemes emerged around strategies to improve governance of data sharing. The main themes identified were (1) Strategies for change at a policy level: guideline development, (2) Strengthening data governance to improve data quality and (3) Reciprocity: towards equitable data sharing. Building trust is central to the promotion of data sharing amongst researchers on the African continent and with global partners. This can be achieved by enhancing research integrity and strengthening micro and macro level governance. Substantial resources are required from funders and governments to enhance data governance practices, to improve data literacy and to enhance data quality. High quality data from Africa will afford diversity to global data sets, reducing bias in algorithms built for artificial intelligence technologies in healthcare. Engagement with multiple stakeholders including researchers and research communities is necessary to establish an equitable data sharing approach based on reciprocity and mutual benefit.

开创性的数据共享技术和对非洲大陆存储研究数据的快速访问非常有利于创建多样化、无偏见的数据集,为数字医疗技术和人工智能在医疗保健领域的应用提供依据。然而,撒哈拉以南非洲地区(SSA)的卫生研究人员却面临着个人和集体的挑战,这使他们对共享数据持谨慎甚至犹豫态度,尽管他们承认共享数据对公共卫生有益。这项定性研究报告了卫生研究人员对缓解这些挑战的策略的看法。在 2022 年 7 月至 2023 年 4 月期间,通过 Microsoft Teams 对来自撒哈拉以南非洲地区 16 个不同国家的 16 名研究人员进行了深入访谈。研究采用了有目的抽样和滚雪球抽样技术,通过电子邮件邀请参与者。访谈记录通过 Atlas.ti.22 进行转录、清理、编码和管理。采用主题分析法对数据进行分析。围绕改进数据共享管理的战略,出现了三个重复出现的主题和几个次主题。确定的主要主题是:(1) 政策层面的变革战略:制定准则;(2) 加强数据管理以提高数据质量;(3) 互惠:实现公平的数据共享。建立信任是促进非洲大陆研究人员之间以及与全球合作伙伴共享数据的核心。要做到这一点,就必须提高研究的诚信度,加强微观和宏观管理。资助者和政府需要提供大量资源,以加强数据管理实践、提高数据素养和数据质量。来自非洲的高质量数据将为全球数据集提供多样性,减少医疗保健领域人工智能技术算法的偏差。有必要与包括研究人员和研究团体在内的多个利益相关方合作,在互惠互利的基础上建立公平的数据共享方法。
{"title":"Trust as moral currency: Perspectives of health researchers in sub-Saharan Africa on strategies to promote equitable data sharing.","authors":"Qunita Brown, Jyothi Chabilall, Nezerith Cengiz, Keymanthri Moodley","doi":"10.1371/journal.pdig.0000551","DOIUrl":"10.1371/journal.pdig.0000551","url":null,"abstract":"<p><p>Groundbreaking data-sharing techniques and quick access to stored research data from the African continent are highly beneficial to create diverse unbiased datasets to inform digital health technologies and artificial intelligence in healthcare. Yet health researchers in sub-Saharan Africa (SSA) experience individual and collective challenges that render them cautious and even hesitant to share data despite acknowledging the public health benefits of sharing. This qualitative study reports on the perspectives of health researchers regarding strategies to mitigate these challenges. In-depth interviews were conducted via Microsoft Teams with 16 researchers from 16 different countries across SSA between July 2022 and April 2023. Purposive and snowball sampling techniques were used to invite participants via email. Recorded interviews were transcribed, cleaned, coded and managed through Atlas.ti.22. Thematic Analysis was used to analyse the data. Three recurrent themes and several subthemes emerged around strategies to improve governance of data sharing. The main themes identified were (1) Strategies for change at a policy level: guideline development, (2) Strengthening data governance to improve data quality and (3) Reciprocity: towards equitable data sharing. Building trust is central to the promotion of data sharing amongst researchers on the African continent and with global partners. This can be achieved by enhancing research integrity and strengthening micro and macro level governance. Substantial resources are required from funders and governments to enhance data governance practices, to improve data literacy and to enhance data quality. High quality data from Africa will afford diversity to global data sets, reducing bias in algorithms built for artificial intelligence technologies in healthcare. Engagement with multiple stakeholders including researchers and research communities is necessary to establish an equitable data sharing approach based on reciprocity and mutual benefit.</p>","PeriodicalId":74465,"journal":{"name":"PLOS digital health","volume":"3 9","pages":"e0000551"},"PeriodicalIF":0.0,"publicationDate":"2024-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11432837/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142333981","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Aspiring to clinical significance: Insights from developing and evaluating a machine learning model to predict emergency department return visit admissions. 追求临床意义:开发和评估预测急诊科回访入院情况的机器学习模型的启示。
Pub Date : 2024-09-27 eCollection Date: 2024-09-01 DOI: 10.1371/journal.pdig.0000606
Yiye Zhang, Yufang Huang, Anthony Rosen, Lynn G Jiang, Matthew McCarty, Arindam RoyChoudhury, Jin Ho Han, Adam Wright, Jessica S Ancker, Peter Ad Steel

Return visit admissions (RVA), which are instances where patients discharged from the emergency department (ED) rapidly return and require hospital admission, have been associated with quality issues and adverse outcomes. We developed and validated a machine learning model to predict 72-hour RVA using electronic health records (EHR) data. Study data were extracted from EHR data in 2019 from three urban EDs. The development and independent validation datasets included 62,154 patients from two EDs and 73,453 patients from one ED, respectively. Multiple machine learning algorithms were evaluated, including deep significance clustering (DICE), regularized logistic regression (LR), Gradient Boosting Decision Tree, and XGBoost. These machine learning models were also compared against an existing clinical risk score. To support clinical actionability, clinician investigators conducted manual chart reviews of the cases identified by the model. Chart reviews categorized predicted cases across index ED discharge diagnosis and RVA root cause classifications. The best-performing model achieved an AUC of 0.87 in the development site (test set) and 0.75 in the independent validation set. The model, which combined DICE and LR, boosted predictive performance while providing well-defined features. The model was relatively robust to sensitivity analyses regarding performance across age, race, and by varying predictor availability but less robust across diagnostic groups. Clinician examination demonstrated discrete model performance characteristics within clinical subtypes of RVA. This machine learning model demonstrated a strong predictive performance for 72- RVA. Despite the limited clinical actionability potentially due to model complexity, the rarity of the outcome, and variable relevance, the clinical examination offered guidance on further variable inclusion for enhanced predictive accuracy and actionability.

回访入院(RVA)是指从急诊科(ED)出院的患者迅速返回并需要入院治疗的情况,它与质量问题和不良后果有关。我们利用电子病历(EHR)数据开发并验证了一种机器学习模型,用于预测 72 小时内的 RVA。研究数据提取自三个城市急诊室 2019 年的电子病历数据。开发数据集和独立验证数据集分别包括两个急诊室的 62154 名患者和一个急诊室的 73453 名患者。评估了多种机器学习算法,包括深度意义聚类(DICE)、正则化逻辑回归(LR)、梯度提升决策树(Gradient Boosting Decision Tree)和 XGBoost。这些机器学习模型还与现有的临床风险评分进行了比较。为了支持临床可操作性,临床研究人员对模型确定的病例进行了人工病历审查。病历审查根据索引 ED 出院诊断和 RVA 根源分类对预测病例进行了分类。表现最好的模型在开发现场(测试集)的 AUC 为 0.87,在独立验证集的 AUC 为 0.75。该模型结合了 DICE 和 LR,提高了预测性能,同时提供了定义明确的特征。该模型在不同年龄、种族以及不同预测因子可用性的敏感性分析中表现相对稳健,但在不同诊断组别中的稳健性较差。临床医生的检查结果表明,模型在 RVA 临床亚型中具有离散的性能特征。该机器学习模型对 72- RVA 具有很强的预测性能。尽管由于模型的复杂性、结果的罕见性和变量的相关性,临床可操作性有限,但临床检查为进一步纳入变量以提高预测准确性和可操作性提供了指导。
{"title":"Aspiring to clinical significance: Insights from developing and evaluating a machine learning model to predict emergency department return visit admissions.","authors":"Yiye Zhang, Yufang Huang, Anthony Rosen, Lynn G Jiang, Matthew McCarty, Arindam RoyChoudhury, Jin Ho Han, Adam Wright, Jessica S Ancker, Peter Ad Steel","doi":"10.1371/journal.pdig.0000606","DOIUrl":"10.1371/journal.pdig.0000606","url":null,"abstract":"<p><p>Return visit admissions (RVA), which are instances where patients discharged from the emergency department (ED) rapidly return and require hospital admission, have been associated with quality issues and adverse outcomes. We developed and validated a machine learning model to predict 72-hour RVA using electronic health records (EHR) data. Study data were extracted from EHR data in 2019 from three urban EDs. The development and independent validation datasets included 62,154 patients from two EDs and 73,453 patients from one ED, respectively. Multiple machine learning algorithms were evaluated, including deep significance clustering (DICE), regularized logistic regression (LR), Gradient Boosting Decision Tree, and XGBoost. These machine learning models were also compared against an existing clinical risk score. To support clinical actionability, clinician investigators conducted manual chart reviews of the cases identified by the model. Chart reviews categorized predicted cases across index ED discharge diagnosis and RVA root cause classifications. The best-performing model achieved an AUC of 0.87 in the development site (test set) and 0.75 in the independent validation set. The model, which combined DICE and LR, boosted predictive performance while providing well-defined features. The model was relatively robust to sensitivity analyses regarding performance across age, race, and by varying predictor availability but less robust across diagnostic groups. Clinician examination demonstrated discrete model performance characteristics within clinical subtypes of RVA. This machine learning model demonstrated a strong predictive performance for 72- RVA. Despite the limited clinical actionability potentially due to model complexity, the rarity of the outcome, and variable relevance, the clinical examination offered guidance on further variable inclusion for enhanced predictive accuracy and actionability.</p>","PeriodicalId":74465,"journal":{"name":"PLOS digital health","volume":"3 9","pages":"e0000606"},"PeriodicalIF":0.0,"publicationDate":"2024-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11432862/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142333976","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Digital health and equitable access to care. 数字健康与公平获得医疗服务。
Pub Date : 2024-09-25 eCollection Date: 2024-09-01 DOI: 10.1371/journal.pdig.0000573
James Shaw, Ibukun-Oluwa Omolade Abejirinde, Payal Agarwal, Simone Shahid, Danielle Martin

Research on digital health equity has developed in important ways especially since the onset of the COVID-19 pandemic, with a series of clear recommendations now established for policy and practice. However, research and policy addressing the health system dimensions of digital health equity is needed to examine the appropriate roles of digital technologies in enabling access to care. We use a highly cited framework by Levesque et al on patient-centered access to care and the World Health Organization's framework on digitally enabled health systems to generate insights into the ways that digital solutions can support access to needed health care for structurally marginalized communities. Specifically, we mapped the frameworks to identify where applications of digital health do and do not support access to care, documenting which dimensions of access are under-addressed by digital health. Our analysis suggests that digital health has disproportionately focused on downstream enablers of access to care, which are low-yield when equity is the goal. We identify important opportunities for policy makers, funders and other stakeholders to attend more to digital solutions that support upstream enablement of peoples' abilities to understand, perceive, and seek out care. These areas are an important focal point for digital interventions and have the potential to be more equity-enhancing than downstream interventions at the time that care is accessed. Overall, we highlight the importance of taking a health system perspective when considering the roles of digital technologies in enhancing or inhibiting equitable access to needed health care.

特别是自 COVID-19 大流行以来,有关数字医疗公平的研究取得了重要发展,目前已为政策和实践提出了一系列明确的建议。然而,还需要针对数字医疗公平的卫生系统层面开展研究和制定政策,以考察数字技术在促进医疗服务获取方面的适当作用。我们利用 Levesque 等人提出的以患者为中心的医疗服务框架和世界卫生组织提出的数字化医疗系统框架,深入探讨数字化解决方案如何支持结构边缘化社区获得所需的医疗服务。具体来说,我们对这两个框架进行了映射,以确定数字医疗在哪些方面得到了应用,在哪些方面没有得到应用,并记录了数字医疗在哪些方面的应用不足。我们的分析表明,数字医疗过度关注获取医疗服务的下游推动因素,而在以公平为目标的情况下,这些因素的收益较低。我们发现,政策制定者、资助者和其他利益相关者有重要机会更多地关注支持上游的数字解决方案,以提高人们理解、感知和寻求医疗服务的能力。这些领域是数字化干预措施的重要焦点,与获取医疗服务时的下游干预措施相比,有可能更能促进公平。总之,我们强调,在考虑数字技术在促进或抑制公平获得所需医疗服务方面的作用时,从医疗系统的角度出发非常重要。
{"title":"Digital health and equitable access to care.","authors":"James Shaw, Ibukun-Oluwa Omolade Abejirinde, Payal Agarwal, Simone Shahid, Danielle Martin","doi":"10.1371/journal.pdig.0000573","DOIUrl":"https://doi.org/10.1371/journal.pdig.0000573","url":null,"abstract":"<p><p>Research on digital health equity has developed in important ways especially since the onset of the COVID-19 pandemic, with a series of clear recommendations now established for policy and practice. However, research and policy addressing the health system dimensions of digital health equity is needed to examine the appropriate roles of digital technologies in enabling access to care. We use a highly cited framework by Levesque et al on patient-centered access to care and the World Health Organization's framework on digitally enabled health systems to generate insights into the ways that digital solutions can support access to needed health care for structurally marginalized communities. Specifically, we mapped the frameworks to identify where applications of digital health do and do not support access to care, documenting which dimensions of access are under-addressed by digital health. Our analysis suggests that digital health has disproportionately focused on downstream enablers of access to care, which are low-yield when equity is the goal. We identify important opportunities for policy makers, funders and other stakeholders to attend more to digital solutions that support upstream enablement of peoples' abilities to understand, perceive, and seek out care. These areas are an important focal point for digital interventions and have the potential to be more equity-enhancing than downstream interventions at the time that care is accessed. Overall, we highlight the importance of taking a health system perspective when considering the roles of digital technologies in enhancing or inhibiting equitable access to needed health care.</p>","PeriodicalId":74465,"journal":{"name":"PLOS digital health","volume":"3 9","pages":"e0000573"},"PeriodicalIF":0.0,"publicationDate":"2024-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11423990/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142333979","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
PLOS digital health
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1