首页 > 最新文献

JAMIA Open最新文献

英文 中文
Exploring the impact of missingness on racial disparities in predictive performance of a machine learning model for emergency department triage 探索遗漏对急诊科分诊机器学习模型预测性能种族差异的影响
IF 2.1 Q2 Medicine Pub Date : 2023-10-04 DOI: 10.1093/jamiaopen/ooad107
Stephanie Teeple, Aria G. Smith, Matthew F. Toerper, Scott Levin, Scott Halpern, Oluwakemi Badaki‐Makun, J. Hinson
To investigate how missing data in the patient problem list may impact racial disparities in the predictive performance of a machine learning (ML) model for emergency department (ED) triage. Racial disparities may exist in the missingness of EHR data (eg, systematic differences in access, testing, and/or treatment) that can impact model predictions across racialized patient groups. We use an ML model that predicts patients’ risk for adverse events to produce triage-level recommendations, patterned after a clinical decision support tool deployed at multiple EDs. We compared the model’s predictive performance on sets of observed (problem list data at the point of triage) versus manipulated (updated to the more complete problem list at the end of the encounter) test data. These differences were compared between Black and non-Hispanic White patient groups using multiple performance measures relevant to health equity. There were modest, but significant, changes in predictive performance comparing the observed to manipulated models across both Black and non-Hispanic White patient groups; c-statistic improvement ranged between 0.027 and 0.058. The manipulation produced no between-group differences in c-statistic by race. However, there were small between-group differences in other performance measures, with greater change for non-Hispanic White patients. Problem list missingness impacted model performance for both patient groups, with marginal differences detected by race. Further exploration is needed to examine how missingness may contribute to racial disparities in clinical model predictions across settings. The novel manipulation method demonstrated may aid future research.
目的:研究患者问题清单中的缺失数据如何影响急诊科(ED)分诊机器学习(ML)模型预测性能中的种族差异。 电子病历数据的缺失可能存在种族差异(例如,就诊、检测和/或治疗方面的系统性差异),这会影响模型对不同种族患者群体的预测。我们使用了一个预测患者不良事件风险的 ML 模型,以多个急诊室部署的临床决策支持工具为蓝本,提出分诊建议。我们比较了该模型在观察数据集(分诊时的问题列表数据)和操作数据集(就诊结束时更新为更完整的问题列表)上的预测性能。使用与健康公平相关的多种绩效指标,比较了黑人和非西班牙裔白人患者群体之间的差异。 在黑人和非西班牙裔白人患者群体中,将观察到的模型与操作模型进行比较,预测性能发生了适度但显著的变化;c 统计量的提高幅度在 0.027 和 0.058 之间。操纵模型在不同种族的 c 统计量上没有组间差异。但是,在其他绩效指标方面,组间差异较小,非西班牙裔白人患者的变化更大。 问题列表缺失对两组患者的模型性能都有影响,种族间的差异微乎其微。 我们还需要进一步研究遗漏是如何导致不同环境下临床模型预测的种族差异的。所展示的新颖操作方法可能有助于未来的研究。
{"title":"Exploring the impact of missingness on racial disparities in predictive performance of a machine learning model for emergency department triage","authors":"Stephanie Teeple, Aria G. Smith, Matthew F. Toerper, Scott Levin, Scott Halpern, Oluwakemi Badaki‐Makun, J. Hinson","doi":"10.1093/jamiaopen/ooad107","DOIUrl":"https://doi.org/10.1093/jamiaopen/ooad107","url":null,"abstract":"To investigate how missing data in the patient problem list may impact racial disparities in the predictive performance of a machine learning (ML) model for emergency department (ED) triage. Racial disparities may exist in the missingness of EHR data (eg, systematic differences in access, testing, and/or treatment) that can impact model predictions across racialized patient groups. We use an ML model that predicts patients’ risk for adverse events to produce triage-level recommendations, patterned after a clinical decision support tool deployed at multiple EDs. We compared the model’s predictive performance on sets of observed (problem list data at the point of triage) versus manipulated (updated to the more complete problem list at the end of the encounter) test data. These differences were compared between Black and non-Hispanic White patient groups using multiple performance measures relevant to health equity. There were modest, but significant, changes in predictive performance comparing the observed to manipulated models across both Black and non-Hispanic White patient groups; c-statistic improvement ranged between 0.027 and 0.058. The manipulation produced no between-group differences in c-statistic by race. However, there were small between-group differences in other performance measures, with greater change for non-Hispanic White patients. Problem list missingness impacted model performance for both patient groups, with marginal differences detected by race. Further exploration is needed to examine how missingness may contribute to racial disparities in clinical model predictions across settings. The novel manipulation method demonstrated may aid future research.","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2023-10-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139323583","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using natural language processing to identify the status of homelessness and housing instability among serious illness patients from clinical notes in an integrated healthcare system. 在综合医疗系统中,使用自然语言处理从临床笔记中识别严重疾病患者的无家可归和住房不稳定状况。
IF 2.1 Q2 Medicine Pub Date : 2023-09-22 eCollection Date: 2023-10-01 DOI: 10.1093/jamiaopen/ooad082
Fagen Xie, Susan Wang, Lori Viveros, Allegra Rich, Huong Q Nguyen, Ariadna Padilla, Lindsey Lyons, Claudia L Nau

Background: Efficiently identifying the social risks of patients with serious illnesses (SIs) is the critical first step in providing patient-centered and value-driven care for this medically vulnerable population.

Objective: To apply and further hone an existing natural language process (NLP) algorithm that identifies patients who are homeless/at risk of homeless to a SI population.

Methods: Patients diagnosed with SI between 2019 and 2020 were identified using an adapted list of diagnosis codes from the Center for Advance Palliative Care from the Kaiser Permanente Southern California electronic health record. Clinical notes associated with medical encounters within 6 months before and after the diagnosis date were processed by a previously developed NLP algorithm to identify patients who were homeless/at risk of homelessness. To improve the generalizability to the SI population, the algorithm was refined by multiple iterations of chart review and adjudication. The updated algorithm was then applied to the SI population.

Results: Among 206 993 patients with a SI diagnosis, 1737 (0.84%) were identified as homeless/at risk of homelessness. These patients were more likely to be male (51.1%), age among 45-64 years (44.7%), and have one or more emergency visit (65.8%) within a year of their diagnosis date. Validation of the updated algorithm yielded a sensitivity of 100.0% and a positive predictive value of 93.8%.

Conclusions: The improved NLP algorithm effectively identified patients with SI who were homeless/at risk of homelessness and can be used to target interventions for this vulnerable group.

背景:有效识别严重疾病患者的社会风险是为这一医学弱势群体提供以患者为中心和价值驱动的护理的关键第一步。目的:应用并进一步完善现有的自然语言过程(NLP)算法,将无家可归/有无家可归风险的患者识别为SI人群。方法:使用来自南加州凯撒永久电子健康记录的高级姑息治疗中心的诊断代码改编列表,确定2019年至2020年间诊断为SI的患者。诊断日期前后6个月内与就诊相关的临床记录由先前开发的NLP算法处理,以识别无家可归/有无家可归风险的患者。为了提高对SI总体的可推广性,该算法通过图表审查和裁决的多次迭代进行了改进。然后将更新后的算法应用于SI群体。结果:在206993名被诊断为SI的患者中,1737人(0.84%)被确定为无家可归/有无家可归风险。这些患者更有可能是男性(51.1%),年龄在45-64岁之间(44.7%),并且在诊断日期后一年内有一次或多次急诊就诊(65.8%)。更新算法的验证产生了100.0%的灵敏度和93.8%的阳性预测值。结论:改进的NLP算法有效地识别了无家可归/有无家可归风险的SI患者,可用于针对这一弱势群体的干预措施。
{"title":"Using natural language processing to identify the status of homelessness and housing instability among serious illness patients from clinical notes in an integrated healthcare system.","authors":"Fagen Xie,&nbsp;Susan Wang,&nbsp;Lori Viveros,&nbsp;Allegra Rich,&nbsp;Huong Q Nguyen,&nbsp;Ariadna Padilla,&nbsp;Lindsey Lyons,&nbsp;Claudia L Nau","doi":"10.1093/jamiaopen/ooad082","DOIUrl":"https://doi.org/10.1093/jamiaopen/ooad082","url":null,"abstract":"<p><strong>Background: </strong>Efficiently identifying the social risks of patients with serious illnesses (SIs) is the critical first step in providing patient-centered and value-driven care for this medically vulnerable population.</p><p><strong>Objective: </strong>To apply and further hone an existing natural language process (NLP) algorithm that identifies patients who are homeless/at risk of homeless to a SI population.</p><p><strong>Methods: </strong>Patients diagnosed with SI between 2019 and 2020 were identified using an adapted list of diagnosis codes from the Center for Advance Palliative Care from the Kaiser Permanente Southern California electronic health record. Clinical notes associated with medical encounters within 6 months before and after the diagnosis date were processed by a previously developed NLP algorithm to identify patients who were homeless/at risk of homelessness. To improve the generalizability to the SI population, the algorithm was refined by multiple iterations of chart review and adjudication. The updated algorithm was then applied to the SI population.</p><p><strong>Results: </strong>Among 206 993 patients with a SI diagnosis, 1737 (0.84%) were identified as homeless/at risk of homelessness. These patients were more likely to be male (51.1%), age among 45-64 years (44.7%), and have one or more emergency visit (65.8%) within a year of their diagnosis date. Validation of the updated algorithm yielded a sensitivity of 100.0% and a positive predictive value of 93.8%.</p><p><strong>Conclusions: </strong>The improved NLP algorithm effectively identified patients with SI who were homeless/at risk of homelessness and can be used to target interventions for this vulnerable group.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2023-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10517738/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41151029","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Optimizing usability of a mobile health intervention for Spanish-speaking Latinx people with HIV through user-centered design: a post-implementation study. 通过以用户为中心的设计优化西班牙语拉丁裔艾滋病毒感染者移动健康干预的可用性:实施后研究。
IF 2.1 Q2 Medicine Pub Date : 2023-09-19 eCollection Date: 2023-10-01 DOI: 10.1093/jamiaopen/ooad083
Kristen Petros De Guex, Tabor E Flickinger, Lisa Mayevsky, Hannah Zaveri, Michael Goncalves, Helen Reed, Lazaro Pesina, Rebecca Dillingham

Objective: Latinx people comprise 30% of all new human immunodeficiency virus (HIV) infections in the United States and face many challenges to accessing and engaging with HIV care. To bridge these gaps in care, a Spanish-language mobile health (mHealth) intervention known as ConexionesPositivas (CP) was adapted from an established English-language platform called PositiveLinks (PL) to help improve engagement in care and reduce viral nonsuppression among its users. We aimed to determine how CP can address the challenges that Latinx people with HIV (PWH) in the United States face.

Materials and methods: We conducted a post-implementation study of the CP mHealth platform, guided by principles of user-centered design. We enrolled 20 Spanish-speaking CP users in the study, who completed the previously validated System Usability Scale (SUS) and semistructured interviews. Interviews were transcribed and translated for analysis. We performed thematic coding of interview transcripts in Dedoose.

Results: The SUS composite score was 75, which is within the range of good usability. Four categories of themes were identified in the interviews: client context, strengths of CP, barriers to use and dislikes, and suggestions to improve CP. Positive impacts included encouraging self-monitoring of medication adherence, mood and stress, connection to professional care, and development of a support system for PWH.

Discussion: While CP is an effective and easy-to-use application, participants expressed a desire for improved personalization and interactivity, which will guide further iteration.

Conclusion: This study highlights the importance of tailoring mHealth interventions to improve equity of access, especially for populations with limited English proficiency.

目标:在美国,拉丁裔占所有新发人类免疫缺陷病毒(HIV)感染者的30%,在获得和参与HIV护理方面面临许多挑战。为了弥补这些护理差距,一种名为ConexionesPositivas(CP)的西班牙语移动健康(mHealth)干预措施改编自一个名为PositiveLinks(PL)的既定英语平台,以帮助提高护理参与度,减少用户中的病毒非抑制。我们旨在确定CP如何应对美国拉丁裔艾滋病毒感染者(PWH)面临的挑战。材料和方法:我们在以用户为中心的设计原则的指导下,对CP-mHealth平台进行了实施后研究。我们在研究中招募了20名讲西班牙语的CP用户,他们完成了之前验证的系统可用性量表(SUS)和半结构化访谈。访谈被转录和翻译以供分析。我们在Dedoose中对访谈记录进行了主题编码。结果:SUS综合得分为75,在良好的可用性范围内。访谈中确定了四类主题:客户背景、CP的优势、使用障碍和厌恶以及改善CP的建议。积极影响包括鼓励自我监测药物依从性、情绪和压力、与专业护理的联系以及开发PWH支持系统。讨论:虽然CP是一种有效且易于使用的应用程序,参与者表达了对改进个性化和交互性的渴望,这将指导进一步的迭代。结论:本研究强调了量身定制mHealth干预措施以提高获取公平性的重要性,尤其是对于英语水平有限的人群。
{"title":"Optimizing usability of a mobile health intervention for Spanish-speaking Latinx people with HIV through user-centered design: a post-implementation study.","authors":"Kristen Petros De Guex, Tabor E Flickinger, Lisa Mayevsky, Hannah Zaveri, Michael Goncalves, Helen Reed, Lazaro Pesina, Rebecca Dillingham","doi":"10.1093/jamiaopen/ooad083","DOIUrl":"10.1093/jamiaopen/ooad083","url":null,"abstract":"<p><strong>Objective: </strong>Latinx people comprise 30% of all new human immunodeficiency virus (HIV) infections in the United States and face many challenges to accessing and engaging with HIV care. To bridge these gaps in care, a Spanish-language mobile health (mHealth) intervention known as ConexionesPositivas (CP) was adapted from an established English-language platform called PositiveLinks (PL) to help improve engagement in care and reduce viral nonsuppression among its users. We aimed to determine how CP can address the challenges that Latinx people with HIV (PWH) in the United States face.</p><p><strong>Materials and methods: </strong>We conducted a post-implementation study of the CP mHealth platform, guided by principles of user-centered design. We enrolled 20 Spanish-speaking CP users in the study, who completed the previously validated System Usability Scale (SUS) and semistructured interviews. Interviews were transcribed and translated for analysis. We performed thematic coding of interview transcripts in Dedoose.</p><p><strong>Results: </strong>The SUS composite score was 75, which is within the range of good usability. Four categories of themes were identified in the interviews: client context, strengths of CP, barriers to use and dislikes, and suggestions to improve CP. Positive impacts included encouraging self-monitoring of medication adherence, mood and stress, connection to professional care, and development of a support system for PWH.</p><p><strong>Discussion: </strong>While CP is an effective and easy-to-use application, participants expressed a desire for improved personalization and interactivity, which will guide further iteration.</p><p><strong>Conclusion: </strong>This study highlights the importance of tailoring mHealth interventions to improve equity of access, especially for populations with limited English proficiency.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2023-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10508965/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41172420","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Artificial neural network approaches to identify maternal and infant risk and asset factors using Peridata.Net: a WI-MIOS study. 使用Peridata.Net识别母婴风险和资产因素的人工神经网络方法:WI-MIOS研究。
IF 2.1 Q2 Medicine Pub Date : 2023-09-14 eCollection Date: 2023-10-01 DOI: 10.1093/jamiaopen/ooad080
Jeana M Holt, AkkeNeel Talsma, Teresa S Johnson, Timothy Ehlinger

Objective: To analyze PeriData.Net, a clinical registry with linked maternal-infant hospital data of Milwaukee County residents, to demonstrate a predictive analytic approach to perinatal infant risk assessment.

Materials and methods: Using unsupervised learning, we identified infant birth clusters with similar multivariate health indicator patterns, measured using perinatal variables from 2008 to 2019 from n = 43 969 clinical registry records in Milwaukee County, WI, followed by supervised learning risk-propagation modeling to identify key maternal factors. To understand the relationship between socioeconomic status (SES) and birth outcome cluster assignment, we recoded zip codes in Peridata.Net according to SES level.

Results: Three self-organizing map clusters describe infant birth outcome patterns that are similar in the multivariate space. Birth outcome clusters showed higher hazard birth outcome patterns in cluster 3 than clusters 1 and 2. Cluster 3 was associated with lower Apgar scores at 1 and 5 min after birth, shorter infant length, and premature birth. Prediction profiles of birth clusters indicate the most sensitivity to pregnancy weight loss and prenatal visits. Majority of infants assigned to cluster 3 were in the 2 lowest SES levels.

Discussion: Using an extensive perinatal clinical registry, we found that the strongest predictive performance, when considering cluster membership using supervised learning, was achieved by incorporating social and behavioral risk factors. There were inequalities in infant birth outcomes based on SES.

Conclusion: Identifying infant risk hazard profiles can contribute to knowledge discovery and guide future research directions. Additionally, presenting the results to community members can build consensus for community-identified health and risk indicator prioritization for intervention development.

目的:分析PeriData.Net,一个具有密尔沃基县居民母婴医院相关数据的临床注册中心,以证明一种围产期婴儿风险评估的预测分析方法。材料和方法:使用无监督学习,我们确定了具有相似多变量健康指标模式的婴儿出生集群,使用2008年至2019年的围产期变量从n = 43 威斯康星州密尔沃基县969份临床登记记录,随后进行监督学习风险传播建模,以确定关键的母体因素。为了了解社会经济地位(SES)和出生结果聚类分配之间的关系,我们根据SES水平在Peridata.Net中重新编码了邮政编码。结果:三个自组织映射聚类描述了在多元空间中相似的婴儿出生结果模式。出生结果聚类在聚类3中显示出比聚类1和聚类2更高的危险出生结果模式。聚类3与1和5的Apgar评分较低有关 出生后分钟,婴儿身长较短,早产。出生集群的预测概况表明,对妊娠体重减轻和产前检查最敏感。被分配到第3组的大多数婴儿处于2个最低的SES水平。讨论:通过广泛的围产期临床登记,我们发现,当使用监督学习考虑集群成员时,通过结合社会和行为风险因素,可以获得最强的预测性能。基于SES的婴儿出生结果存在不平等现象。结论:识别婴儿风险危险状况有助于知识发现和指导未来的研究方向。此外,将结果提交给社区成员可以为社区确定的干预发展的健康和风险指标优先级建立共识。
{"title":"Artificial neural network approaches to identify maternal and infant risk and asset factors using Peridata.Net: a WI-MIOS study.","authors":"Jeana M Holt,&nbsp;AkkeNeel Talsma,&nbsp;Teresa S Johnson,&nbsp;Timothy Ehlinger","doi":"10.1093/jamiaopen/ooad080","DOIUrl":"10.1093/jamiaopen/ooad080","url":null,"abstract":"<p><strong>Objective: </strong>To analyze PeriData.Net, a clinical registry with linked maternal-infant hospital data of Milwaukee County residents, to demonstrate a predictive analytic approach to perinatal infant risk assessment.</p><p><strong>Materials and methods: </strong>Using unsupervised learning, we identified infant birth clusters with similar multivariate health indicator patterns, measured using perinatal variables from 2008 to 2019 from <i>n</i> = 43 969 clinical registry records in Milwaukee County, WI, followed by supervised learning risk-propagation modeling to identify key maternal factors. To understand the relationship between socioeconomic status (SES) and birth outcome cluster assignment, we recoded zip codes in Peridata.Net according to SES level.</p><p><strong>Results: </strong>Three self-organizing map clusters describe infant birth outcome patterns that are similar in the multivariate space. Birth outcome clusters showed higher hazard birth outcome patterns in cluster 3 than clusters 1 and 2. Cluster 3 was associated with lower Apgar scores at 1 and 5 min after birth, shorter infant length, and premature birth. Prediction profiles of birth clusters indicate the most sensitivity to pregnancy weight loss and prenatal visits. Majority of infants assigned to cluster 3 were in the 2 lowest SES levels.</p><p><strong>Discussion: </strong>Using an extensive perinatal clinical registry, we found that the strongest predictive performance, when considering cluster membership using supervised learning, was achieved by incorporating social and behavioral risk factors. There were inequalities in infant birth outcomes based on SES.</p><p><strong>Conclusion: </strong>Identifying infant risk hazard profiles can contribute to knowledge discovery and guide future research directions. Additionally, presenting the results to community members can build consensus for community-identified health and risk indicator prioritization for intervention development.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2023-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/97/3c/ooad080.PMC10500218.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10286996","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Enhanced phenotypes for identifying opioid overdose in emergency department visit electronic health record data 在急诊科访问电子健康记录数据中识别阿片类药物过量的增强表型
Q2 Medicine Pub Date : 2023-09-11 DOI: 10.1093/jamiaopen/ooad081
Ralph Ward, Jihad S Obeid, Lindsey Jennings, Elizabeth Szwast, William Garrett Hayes, Royal Pipaliya, Cameron Bailey, Skylar Faul, Brianna Polyak, George Hamilton Baker, Jenna L McCauley, Leslie A Lenert
Abstract Background Accurate identification of opioid overdose (OOD) cases in electronic healthcare record (EHR) data is an important element in surveillance, empirical research, and clinical intervention. We sought to improve existing OOD electronic phenotypes by incorporating new data types beyond diagnostic codes and by applying several statistical and machine learning methods. Materials and Methods We developed an EHR dataset of emergency department visits involving OOD cases or patients considered at risk for an OOD and ascertained true OOD status through manual chart reviews. We developed and validated prediction models using Random Forest, Extreme Gradient Boost, and Elastic Net models that incorporated 717 features involving primary and second diagnoses, chief complaints, medications prescribed, vital signs, laboratory results, and procedural codes. We also developed models limited to single data types. Results A total of 1718 records involving 1485 patients were manually reviewed; 541 (36.4%) patients had one or more OOD. Prediction performance was similar for all models; sensitivity varied from 94% to 97%; and area under the receiver operating characteristic curve (AUC) was 98% for all methods. The primary diagnosis and chief complaint were the most important contributors to AUC performance; primary diagnoses and medication class contributed most to sensitivity; chief complaint, primary diagnosis, and vital signs were most important for specificity. Models limited to decision support data types available in real time demonstrated robust prediction performance. Conclusions Substantial prediction performance improvements were demonstrated for identifying OODs in EHR data. Our e-phenotypes could be applied in surveillance, retrospective empirical applications, or clinical decision support systems.
背景在电子医疗记录(EHR)数据中准确识别阿片类药物过量(OOD)病例是监测、实证研究和临床干预的重要组成部分。我们试图通过结合诊断代码之外的新数据类型以及应用几种统计和机器学习方法来改善现有的OOD电子表型。材料和方法我们建立了一个EHR数据集,包括急诊就诊的OOD病例或被认为有OOD风险的患者,并通过手工图表审查确定了真正的OOD状态。我们使用随机森林、极端梯度增强和弹性网模型开发并验证了预测模型,这些模型纳入了717个特征,包括初诊和二次诊断、主诉、处方药物、生命体征、实验室结果和程序代码。我们还开发了仅限于单一数据类型的模型。结果共手工审核病历1718份,患者1485例;541例(36.4%)患者有一种或多种OOD。所有模型的预测性能相似;灵敏度从94%到97%不等;所有方法的受试者工作特征曲线下面积(AUC)均为98%。初诊和主诉是影响AUC表现的最重要因素;初步诊断和用药类别对敏感性影响最大;主诉、初诊和生命体征对特异性最重要。仅限于实时可用的决策支持数据类型的模型显示了稳健的预测性能。结论在EHR数据中识别OODs的预测性能有了实质性的提高。我们的e表型可以应用于监测,回顾性经验应用,或临床决策支持系统。
{"title":"Enhanced phenotypes for identifying opioid overdose in emergency department visit electronic health record data","authors":"Ralph Ward, Jihad S Obeid, Lindsey Jennings, Elizabeth Szwast, William Garrett Hayes, Royal Pipaliya, Cameron Bailey, Skylar Faul, Brianna Polyak, George Hamilton Baker, Jenna L McCauley, Leslie A Lenert","doi":"10.1093/jamiaopen/ooad081","DOIUrl":"https://doi.org/10.1093/jamiaopen/ooad081","url":null,"abstract":"Abstract Background Accurate identification of opioid overdose (OOD) cases in electronic healthcare record (EHR) data is an important element in surveillance, empirical research, and clinical intervention. We sought to improve existing OOD electronic phenotypes by incorporating new data types beyond diagnostic codes and by applying several statistical and machine learning methods. Materials and Methods We developed an EHR dataset of emergency department visits involving OOD cases or patients considered at risk for an OOD and ascertained true OOD status through manual chart reviews. We developed and validated prediction models using Random Forest, Extreme Gradient Boost, and Elastic Net models that incorporated 717 features involving primary and second diagnoses, chief complaints, medications prescribed, vital signs, laboratory results, and procedural codes. We also developed models limited to single data types. Results A total of 1718 records involving 1485 patients were manually reviewed; 541 (36.4%) patients had one or more OOD. Prediction performance was similar for all models; sensitivity varied from 94% to 97%; and area under the receiver operating characteristic curve (AUC) was 98% for all methods. The primary diagnosis and chief complaint were the most important contributors to AUC performance; primary diagnoses and medication class contributed most to sensitivity; chief complaint, primary diagnosis, and vital signs were most important for specificity. Models limited to decision support data types available in real time demonstrated robust prediction performance. Conclusions Substantial prediction performance improvements were demonstrated for identifying OODs in EHR data. Our e-phenotypes could be applied in surveillance, retrospective empirical applications, or clinical decision support systems.","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136070908","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A chatbot for hypertension self-management support: user-centered design, development, and usability testing. 用于高血压自我管理支持的聊天机器人:以用户为中心的设计、开发和可用性测试。
IF 2.1 Q2 Medicine Pub Date : 2023-09-08 eCollection Date: 2023-10-01 DOI: 10.1093/jamiaopen/ooad073
Ashley C Griffin, Saif Khairat, Stacy C Bailey, Arlene E Chung

Objectives: Health-related chatbots have demonstrated early promise for improving self-management behaviors but have seldomly been utilized for hypertension. This research focused on the design, development, and usability evaluation of a chatbot for hypertension self-management, called "Medicagent."

Materials and methods: A user-centered design process was used to iteratively design and develop a text-based chatbot using Google Cloud's Dialogflow natural language understanding platform. Then, usability testing sessions were conducted among patients with hypertension. Each session was comprised of: (1) background questionnaires, (2) 10 representative tasks within Medicagent, (3) System Usability Scale (SUS) questionnaire, and (4) a brief semi-structured interview. Sessions were video and audio recorded using Zoom. Qualitative and quantitative analyses were used to assess effectiveness, efficiency, and satisfaction of the chatbot.

Results: Participants (n = 10) completed nearly all tasks (98%, 98/100) and spent an average of 18 min (SD = 10 min) interacting with Medicagent. Only 11 (8.6%) utterances were not successfully mapped to an intent. Medicagent achieved a mean SUS score of 78.8/100, which demonstrated acceptable usability. Several participants had difficulties navigating the conversational interface without menu and back buttons, felt additional information would be useful for redirection when utterances were not recognized, and desired a health professional persona within the chatbot.

Discussion: The text-based chatbot was viewed favorably for assisting with blood pressure and medication-related tasks and had good usability.

Conclusion: Flexibility of interaction styles, handling unrecognized utterances gracefully, and having a credible persona were highlighted as design components that may further enrich the user experience of chatbots for hypertension self-management.

目的:与健康相关的聊天机器人已经证明了改善自我管理行为的早期前景,但很少用于高血压。这项研究的重点是用于高血压自我管理的聊天机器人“Medicagent”的设计、开发和可用性评估。材料和方法:使用谷歌云的Dialogflow自然语言理解平台,使用以用户为中心的设计过程迭代设计和开发基于文本的聊天机器人。然后,在高血压患者中进行可用性测试。每个环节包括:(1)背景问卷,(2)Medicagent内的10项代表性任务,(3)系统可用性量表(SUS)问卷,以及(4)简短的半结构化访谈。会话是使用Zoom录制的视频和音频。定性和定量分析用于评估聊天机器人的有效性、效率和满意度。结果:参与者(n = 10) 完成了几乎所有的任务(98%,98/100),平均花费了18分钟(SD = 10 min)与Medicagent交互。只有11个(8.6%)话语没有成功地映射到意图。Medicagent的平均SUS得分为78.8/100,这表明其可用性是可以接受的。一些参与者在没有菜单和后退按钮的情况下很难导航对话界面,他们认为当话语无法识别时,额外的信息将有助于重定向,并希望在聊天机器人中有一个健康专业人士的角色。讨论:基于文本的聊天机器人在协助血压和药物相关任务方面受到好评,并且具有良好的可用性。结论:互动风格的灵活性、优雅地处理未被识别的话语以及拥有可信的个性被强调为设计组件,这些组件可能会进一步丰富聊天机器人的高血压自我管理用户体验。
{"title":"A chatbot for hypertension self-management support: user-centered design, development, and usability testing.","authors":"Ashley C Griffin, Saif Khairat, Stacy C Bailey, Arlene E Chung","doi":"10.1093/jamiaopen/ooad073","DOIUrl":"10.1093/jamiaopen/ooad073","url":null,"abstract":"<p><strong>Objectives: </strong>Health-related chatbots have demonstrated early promise for improving self-management behaviors but have seldomly been utilized for hypertension. This research focused on the design, development, and usability evaluation of a chatbot for hypertension self-management, called \"Medicagent.\"</p><p><strong>Materials and methods: </strong>A user-centered design process was used to iteratively design and develop a text-based chatbot using Google Cloud's Dialogflow natural language understanding platform. Then, usability testing sessions were conducted among patients with hypertension. Each session was comprised of: (1) background questionnaires, (2) 10 representative tasks within Medicagent, (3) System Usability Scale (SUS) questionnaire, and (4) a brief semi-structured interview. Sessions were video and audio recorded using Zoom. Qualitative and quantitative analyses were used to assess effectiveness, efficiency, and satisfaction of the chatbot.</p><p><strong>Results: </strong>Participants (<i>n</i> = 10) completed nearly all tasks (98%, 98/100) and spent an average of 18 min (SD = 10 min) interacting with Medicagent. Only 11 (8.6%) utterances were not successfully mapped to an intent. Medicagent achieved a mean SUS score of 78.8/100, which demonstrated acceptable usability. Several participants had difficulties navigating the conversational interface without menu and back buttons, felt additional information would be useful for redirection when utterances were not recognized, and desired a health professional persona within the chatbot.</p><p><strong>Discussion: </strong>The text-based chatbot was viewed favorably for assisting with blood pressure and medication-related tasks and had good usability.</p><p><strong>Conclusion: </strong>Flexibility of interaction styles, handling unrecognized utterances gracefully, and having a credible persona were highlighted as design components that may further enrich the user experience of chatbots for hypertension self-management.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2023-09-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10491950/pdf/ooad073.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10570803","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Patient portal interventions: a scoping review of functionality, automation used, and therapeutic elements of patient portal interventions. 患者门静脉干预:对患者门静脉干预的功能、使用的自动化和治疗要素的范围审查。
IF 2.1 Q2 Medicine Pub Date : 2023-08-31 eCollection Date: 2023-10-01 DOI: 10.1093/jamiaopen/ooad077
Kelly T Gleason, Danielle S Powell, Aleksandra Wec, Xingyuan Zou, Mary Jo Gamper, Danielle Peereboom, Jennifer L Wolff
Abstract Objectives We sought to understand the objectives, targeted populations, therapeutic elements, and delivery characteristics of patient portal interventions. Materials and Methods Following Arksey and O-Malley’s methodological framework, we conducted a scoping review of manuscripts published through June 2022 by hand and systematically searching PubMed, PSYCHInfo, Embase, and Web of Science. The search yielded 5403 manuscripts; 248 were selected for full-text review; 81 met the eligibility criteria for examining outcomes of a patient portal intervention. Results The 81 articles described: trials involving comparison groups (n = 37; 45.7%), quality improvement initiatives (n = 15; 18.5%), pilot studies (n = 7; 8.6%), and single-arm studies (n = 22; 27.2%). Studies were conducted in primary care (n = 33, 40.7%), specialty outpatient (n = 24, 29.6%), or inpatient settings (n = 4, 4.9%)—or they were deployed system wide (n = 9, 11.1%). Interventions targeted specific health conditions (n = 35, 43.2%), promoted preventive services (n = 19, 23.5%), or addressed communication (n = 19, 23.4%); few specifically sought to improve the patient experience (n = 3, 3.7%). About half of the studies (n = 40, 49.4%) relied on human involvement, and about half involved personalized (vs exclusively standardized) elements (n = 42, 51.8%). Interventions commonly collected patient-reported information (n = 36, 44.4%), provided education (n = 35, 43.2%), or deployed preventive service reminders (n = 14, 17.3%). Discussion This scoping review finds that most patient portal interventions have delivered education or facilitated collection of patient-reported information. Few interventions have involved pragmatic designs or been deployed system wide. Conclusion The patient portal is an important tool in real-world efforts to more effectively support patients, but interventions to date rely largely on evidence from consented participants rather than pragmatically implemented systems-level initiatives.
目的:我们试图了解患者门户干预的目的、目标人群、治疗要素和提供特征。材料和方法:根据Arksey和O-Malley的方法论框架,我们对截至2022年6月出版的手稿进行了范围界定审查,并系统搜索PubMed、PSYCHInfo、Embase和Web of Science。搜索得到5403份手稿;选择248个进行全文审查;81符合检查患者门脉介入治疗结果的资格标准。结果:所描述的81篇文章:涉及对照组的试验(n = 37;45.7%),质量改进举措(n = 15;18.5%),试点研究(n = 7.8.6%)和单臂研究(n = 22;27.2%) = 33,40.7%),专科门诊(n = 24,29.6%),或住院设置(n = 4.9%)-或者在全系统范围内部署(n = 9,11.1%)。针对特定健康状况的干预措施(n = 35.43.2%),促进预防性服务(n = 19,23.5%),或寻址通信(n = 19.23.4%);很少有人专门寻求改善患者体验(n = 3.7%) = 40.49.4%)依赖于人类的参与,大约一半涉及个性化(相对于完全标准化)元素(n = 干预措施通常收集患者报告的信息(n = 36.44.4%),提供教育(n = 35,43.2%),或部署预防性服务提醒(n = 14,17.3%)。讨论:这项范围界定审查发现,大多数患者门户干预措施都提供了教育或促进了患者报告信息的收集。很少有干预措施涉及务实的设计或在全系统范围内部署。结论:患者门户网站是现实世界中更有效地支持患者的重要工具,但迄今为止的干预措施主要依赖于同意参与者的证据,而不是实际实施的系统级举措。
{"title":"Patient portal interventions: a scoping review of functionality, automation used, and therapeutic elements of patient portal interventions.","authors":"Kelly T Gleason,&nbsp;Danielle S Powell,&nbsp;Aleksandra Wec,&nbsp;Xingyuan Zou,&nbsp;Mary Jo Gamper,&nbsp;Danielle Peereboom,&nbsp;Jennifer L Wolff","doi":"10.1093/jamiaopen/ooad077","DOIUrl":"10.1093/jamiaopen/ooad077","url":null,"abstract":"Abstract Objectives We sought to understand the objectives, targeted populations, therapeutic elements, and delivery characteristics of patient portal interventions. Materials and Methods Following Arksey and O-Malley’s methodological framework, we conducted a scoping review of manuscripts published through June 2022 by hand and systematically searching PubMed, PSYCHInfo, Embase, and Web of Science. The search yielded 5403 manuscripts; 248 were selected for full-text review; 81 met the eligibility criteria for examining outcomes of a patient portal intervention. Results The 81 articles described: trials involving comparison groups (n = 37; 45.7%), quality improvement initiatives (n = 15; 18.5%), pilot studies (n = 7; 8.6%), and single-arm studies (n = 22; 27.2%). Studies were conducted in primary care (n = 33, 40.7%), specialty outpatient (n = 24, 29.6%), or inpatient settings (n = 4, 4.9%)—or they were deployed system wide (n = 9, 11.1%). Interventions targeted specific health conditions (n = 35, 43.2%), promoted preventive services (n = 19, 23.5%), or addressed communication (n = 19, 23.4%); few specifically sought to improve the patient experience (n = 3, 3.7%). About half of the studies (n = 40, 49.4%) relied on human involvement, and about half involved personalized (vs exclusively standardized) elements (n = 42, 51.8%). Interventions commonly collected patient-reported information (n = 36, 44.4%), provided education (n = 35, 43.2%), or deployed preventive service reminders (n = 14, 17.3%). Discussion This scoping review finds that most patient portal interventions have delivered education or facilitated collection of patient-reported information. Few interventions have involved pragmatic designs or been deployed system wide. Conclusion The patient portal is an important tool in real-world efforts to more effectively support patients, but interventions to date rely largely on evidence from consented participants rather than pragmatically implemented systems-level initiatives.","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2023-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/a9/a9/ooad077.PMC10469545.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10208248","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Determining prescriptions in electronic healthcare record data: methods for development of standardized, reproducible drug codelists. 电子医疗记录数据中处方的确定:标准化、可复制药物代码表的开发方法。
IF 2.1 Q2 Medicine Pub Date : 2023-08-29 eCollection Date: 2023-10-01 DOI: 10.1093/jamiaopen/ooad078
Emily L Graul, Philip W Stone, Georgie M Massen, Sara Hatam, Alexander Adamson, Spiros Denaxas, Nicholas S Peters, Jennifer K Quint

Objective: To develop a standardizable, reproducible method for creating drug codelists that incorporates clinical expertise and is adaptable to other studies and databases.

Materials and methods: We developed methods to generate drug codelists and tested this using the Clinical Practice Research Datalink (CPRD) Aurum database, accounting for missing data in the database. We generated codelists for: (1) cardiovascular disease and (2) inhaled Chronic Obstructive Pulmonary Disease (COPD) therapies, applying them to a sample cohort of 335 931 COPD patients. We compared searching all drug dictionary variables (A) against searching only (B) chemical or (C) ontological variables.

Results: In Search A, we identified 165 150 patients prescribed cardiovascular drugs (49.2% of cohort), and 317 963 prescribed COPD inhalers (94.7% of cohort). Evaluating output per search strategy, Search C missed numerous prescriptions, including vasodilator anti-hypertensives (A and B:19 696 prescriptions; C:1145) and SAMA inhalers (A and B:35 310; C:564).

Discussion: We recommend the full search (A) for comprehensiveness. There are special considerations when generating adaptable and generalizable drug codelists, including fluctuating status, cohort-specific drug indications, underlying hierarchical ontology, and statistical analyses.

Conclusions: Methods must have end-to-end clinical input, and be standardizable, reproducible, and understandable to all researchers across data contexts.

目的:开发一种可标准化、可重复的方法来创建药物代码表,该方法结合了临床专业知识,并适用于其他研究和数据库。材料和方法:我们开发了生成药物代码表的方法,并使用临床实践研究数据链接(CPRD)Aurum数据库对此进行了测试,以解释数据库中缺失的数据。我们生成了以下疾病的代码表:(1)心血管疾病和(2)吸入性慢性阻塞性肺病(COPD)治疗,并将其应用于335931名COPD患者的样本队列。我们比较了搜索所有药物字典变量(A)和仅搜索(B)化学或(C)本体变量。结果:在搜索A中,我们确定了165150名服用心血管药物的患者(占队列的49.2%)和317963名服用COPD吸入器的患者(约占队列的94.7%)。根据搜索策略评估输出,search C遗漏了许多处方,包括血管舒张剂抗高血压药(A和B:19696张处方;C:1145张)和SAMA吸入器(A和B:35310张;C:564张)。讨论:我们建议全面搜索(A)以获得全面性。在生成可适应性和可推广的药物代码表时,需要特别考虑,包括波动状态、队列特异性药物适应症、潜在的层次本体和统计分析。结论:方法必须有端到端的临床输入,并且在数据环境中对所有研究人员来说都是标准化的、可重复的和可理解的。
{"title":"Determining prescriptions in electronic healthcare record data: methods for development of standardized, reproducible drug codelists.","authors":"Emily L Graul, Philip W Stone, Georgie M Massen, Sara Hatam, Alexander Adamson, Spiros Denaxas, Nicholas S Peters, Jennifer K Quint","doi":"10.1093/jamiaopen/ooad078","DOIUrl":"10.1093/jamiaopen/ooad078","url":null,"abstract":"<p><strong>Objective: </strong>To develop a standardizable, reproducible method for creating drug codelists that incorporates clinical expertise and is adaptable to other studies and databases.</p><p><strong>Materials and methods: </strong>We developed methods to generate drug codelists and tested this using the Clinical Practice Research Datalink (CPRD) Aurum database, accounting for missing data in the database. We generated codelists for: (1) cardiovascular disease and (2) inhaled Chronic Obstructive Pulmonary Disease (COPD) therapies, applying them to a sample cohort of 335 931 COPD patients. We compared searching all drug dictionary variables (A) against searching only (B) chemical or (C) ontological variables.</p><p><strong>Results: </strong>In Search A, we identified 165 150 patients prescribed cardiovascular drugs (49.2% of cohort), and 317 963 prescribed COPD inhalers (94.7% of cohort). Evaluating output per search strategy, Search C missed numerous prescriptions, including vasodilator anti-hypertensives (A and B:19 696 prescriptions; C:1145) and SAMA inhalers (A and B:35 310; C:564).</p><p><strong>Discussion: </strong>We recommend the full search (A) for comprehensiveness. There are special considerations when generating adaptable and generalizable drug codelists, including fluctuating status, cohort-specific drug indications, underlying hierarchical ontology, and statistical analyses.</p><p><strong>Conclusions: </strong>Methods must have end-to-end clinical input, and be standardizable, reproducible, and understandable to all researchers across data contexts.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2023-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/d2/17/ooad078.PMC10463548.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10127493","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Establishing a clinical informatics umbilical cord: lessons learned in launching infrastructure to support dyadic mother/infant primary care. 建立临床信息学脐带:启动基础设施以支持二元母婴初级保健的经验教训。
IF 2.1 Q2 Medicine Pub Date : 2023-08-18 eCollection Date: 2023-10-01 DOI: 10.1093/jamiaopen/ooad065
Seuli Bose-Brill, Rachel D'Amico, Adam Bartley, Robert Ashmead, Paola Flores-Beamon, Shadia Jallaq, Kevin Li, Shengyi Mao, Shannon Gillespie, Naleef Fareed, Kartik K Venkatesh, Norah L Crossnohere, Jody Davis, Alicia C Bunger, Allison Lorenz

The Multimodal Maternal Infant Perinatal Outpatient Delivery System (MOMI PODS) was developed to facilitate the pregnancy to postpartum primary care transition, particularly for individuals at risk for severe maternal morbidity, via a unique multidisciplinary model of mother/infant dyadic primary care. Specialized clinical informatics platforms are critical to ensuring the feasibility and scalability of MOMI PODS and a smooth perinatal transition into longitudinal postpartum primary care. In this manuscript, we describe the MOMI PODS transition and management clinical informatics platforms developed to facilitate MOMI PODS referrals, scheduling, evidence-based multidisciplinary care, and program evaluation. We discuss opportunities and lessons learned associated with our applied methods, as advances in clinical informatics have considerable potential to enhance the quality and evaluation of innovative maternal health programs like MOMI PODS.

开发多模式母婴围产期门诊分娩系统(MOMI PODS)是为了通过独特的母婴二元初级保健多学科模式,促进从怀孕到产后的初级保健过渡,特别是对有严重孕产妇发病风险的个人。专业的临床信息学平台对于确保MOMI PODS的可行性和可扩展性以及顺利过渡到纵向产后初级保健至关重要。在这份手稿中,我们描述了MOMI PODS过渡和管理临床信息学平台,该平台旨在促进MOMI PODS转诊、日程安排、循证多学科护理和项目评估。我们讨论了与我们的应用方法相关的机会和经验教训,因为临床信息学的进步在提高MOMI PODS等创新孕产妇健康计划的质量和评估方面具有相当大的潜力。
{"title":"Establishing a clinical informatics umbilical cord: lessons learned in launching infrastructure to support dyadic mother/infant primary care.","authors":"Seuli Bose-Brill, Rachel D'Amico, Adam Bartley, Robert Ashmead, Paola Flores-Beamon, Shadia Jallaq, Kevin Li, Shengyi Mao, Shannon Gillespie, Naleef Fareed, Kartik K Venkatesh, Norah L Crossnohere, Jody Davis, Alicia C Bunger, Allison Lorenz","doi":"10.1093/jamiaopen/ooad065","DOIUrl":"10.1093/jamiaopen/ooad065","url":null,"abstract":"<p><p>The Multimodal Maternal Infant Perinatal Outpatient Delivery System (MOMI PODS) was developed to facilitate the pregnancy to postpartum primary care transition, particularly for individuals at risk for severe maternal morbidity, via a unique multidisciplinary model of mother/infant dyadic primary care. Specialized clinical informatics platforms are critical to ensuring the feasibility and scalability of MOMI PODS and a smooth perinatal transition into longitudinal postpartum primary care. In this manuscript, we describe the MOMI PODS transition and management clinical informatics platforms developed to facilitate MOMI PODS referrals, scheduling, evidence-based multidisciplinary care, and program evaluation. We discuss opportunities and lessons learned associated with our applied methods, as advances in clinical informatics have considerable potential to enhance the quality and evaluation of innovative maternal health programs like MOMI PODS.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2023-08-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10438959/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10051098","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluating the predictive ability of natural language processing in identifying tertiary/quaternary cases in prioritization workflows for interhospital transfer. 评估自然语言处理在医院间转移优先工作流程中识别三级/四级病例的预测能力。
IF 2.1 Q2 Medicine Pub Date : 2023-08-17 eCollection Date: 2023-10-01 DOI: 10.1093/jamiaopen/ooad069
Timothy Lee, Paul J Lukac, Sitaram Vangala, Kamran Kowsari, Vu Vu, Spencer Fogelman, Michael A Pfeffer, Douglas S Bell

Objectives: Tertiary and quaternary (TQ) care refers to complex cases requiring highly specialized health services. Our study aimed to compare the ability of a natural language processing (NLP) model to an existing human workflow in predictively identifying TQ cases for transfer requests to an academic health center.

Materials and methods: Data on interhospital transfers were queried from the electronic health record for the 6-month period from July 1, 2020 to December 31, 2020. The NLP model was allowed to generate predictions on the same cases as the human predictive workflow during the study period. These predictions were then retrospectively compared to the true TQ outcomes.

Results: There were 1895 transfer cases labeled by both the human predictive workflow and the NLP model, all of which had retrospective confirmation of the true TQ label. The NLP model receiver operating characteristic curve had an area under the curve of 0.91. Using a model probability threshold of ≥0.3 to be considered TQ positive, accuracy was 81.5% for the NLP model versus 80.3% for the human predictions (P =.198) while sensitivity was 83.6% versus 67.7% (P<.001).

Discussion: The NLP model was as accurate as the human workflow but significantly more sensitive. This translated to 15.9% more TQ cases identified by the NLP model.

Conclusion: Integrating an NLP model into existing workflows as automated decision support could translate to more TQ cases identified at the onset of the transfer process.

目的:三级和四级护理是指需要高度专业化医疗服务的复杂病例。我们的研究旨在比较自然语言处理(NLP)模型与现有人类工作流程在预测性识别向学术健康中心转移请求的TQ病例方面的能力。材料和方法:从电子健康记录中查询2020年7月1日至2020年12月31日6个月期间的院间转移数据。在研究期间,NLP模型被允许在与人类预测工作流程相同的情况下生成预测。然后将这些预测与真实的TQ结果进行回顾性比较。结果:共有1895例转移病例通过人类预测工作流程和NLP模型进行了标记,所有这些病例都对真实的TQ标记进行了回顾性确认。NLP模型接收机工作特性曲线的曲线下面积为0.91。使用≥0.3的模型概率阈值被认为是TQ阳性,NLP模型的准确率为81.5%,而人类预测的准确率则为80.3%(P = .198),而敏感性为83.6%对67.7%(P讨论:NLP模型与人类工作流程一样准确,但明显更敏感。这意味着NLP模型识别的TQ病例增加了15.9%。结论:将NLP模型作为自动化决策支持集成到现有工作流程中,可以转化为在转移过程开始时识别的更多TQ病例。
{"title":"Evaluating the predictive ability of natural language processing in identifying tertiary/quaternary cases in prioritization workflows for interhospital transfer.","authors":"Timothy Lee, Paul J Lukac, Sitaram Vangala, Kamran Kowsari, Vu Vu, Spencer Fogelman, Michael A Pfeffer, Douglas S Bell","doi":"10.1093/jamiaopen/ooad069","DOIUrl":"10.1093/jamiaopen/ooad069","url":null,"abstract":"<p><strong>Objectives: </strong>Tertiary and quaternary (TQ) care refers to complex cases requiring highly specialized health services. Our study aimed to compare the ability of a natural language processing (NLP) model to an existing human workflow in predictively identifying TQ cases for transfer requests to an academic health center.</p><p><strong>Materials and methods: </strong>Data on interhospital transfers were queried from the electronic health record for the 6-month period from July 1, 2020 to December 31, 2020. The NLP model was allowed to generate predictions on the same cases as the human predictive workflow during the study period. These predictions were then retrospectively compared to the true TQ outcomes.</p><p><strong>Results: </strong>There were 1895 transfer cases labeled by both the human predictive workflow and the NLP model, all of which had retrospective confirmation of the true TQ label. The NLP model receiver operating characteristic curve had an area under the curve of 0.91. Using a model probability threshold of ≥0.3 to be considered TQ positive, accuracy was 81.5% for the NLP model versus 80.3% for the human predictions (<i>P </i>=<i> </i>.198) while sensitivity was 83.6% versus 67.7% (<i>P</i><.001).</p><p><strong>Discussion: </strong>The NLP model was as accurate as the human workflow but significantly more sensitive. This translated to 15.9% more TQ cases identified by the NLP model.</p><p><strong>Conclusion: </strong>Integrating an NLP model into existing workflows as automated decision support could translate to more TQ cases identified at the onset of the transfer process.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2023-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/fd/7d/ooad069.PMC10435371.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10049396","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
JAMIA Open
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1