首页 > 最新文献

JAMIA Open最新文献

英文 中文
Predicting pediatric emergence delirium using data-driven machine learning applied to electronic health record dataset at a quaternary care pediatric hospital. 将数据驱动的机器学习应用于一家四级护理儿科医院的电子健康记录数据集,预测儿科突发谵妄。
IF 2.1 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2023-12-13 eCollection Date: 2023-12-01 DOI: 10.1093/jamiaopen/ooad106
Han Yu, Allan F Simpao, Victor M Ruiz, Olivia Nelson, Wallis T Muhly, Tori N Sutherland, Julia A Gálvez, Mykhailo B Pushkar, Paul A Stricker, Fuchiang Rich Tsui

Objectives: Pediatric emergence delirium is an undesirable outcome that is understudied. Development of a predictive model is an initial step toward reducing its occurrence. This study aimed to apply machine learning (ML) methods to a large clinical dataset to develop a predictive model for pediatric emergence delirium.

Materials and methods: We performed a single-center retrospective cohort study using electronic health record data from February 2015 to December 2019. We built and evaluated 4 commonly used ML models for predicting emergence delirium: least absolute shrinkage and selection operator, ridge regression, random forest, and extreme gradient boosting. The primary outcome was the occurrence of emergence delirium, defined as a Watcha score of 3 or 4 recorded at any time during recovery.

Results: The dataset included 54 776 encounters across 43 830 patients. The 4 ML models performed similarly with performance assessed by the area under the receiver operating characteristic curves ranging from 0.74 to 0.75. Notable variables associated with increased risk included adenoidectomy with or without tonsillectomy, decreasing age, midazolam premedication, and ondansetron administration, while intravenous induction and ketorolac were associated with reduced risk of emergence delirium.

Conclusions: Four different ML models demonstrated similar performance in predicting postoperative emergence delirium using a large pediatric dataset. The prediction performance of the models draws attention to our incomplete understanding of this phenomenon based on the studied variables. The results from our modeling could serve as a first step in designing a predictive clinical decision support system, but further optimization and validation are needed.

Clinical trial number and registry url: Not applicable.

目的:小儿急诊谵妄是一种不良后果,但研究不足。建立预测模型是减少其发生的第一步。本研究旨在将机器学习(ML)方法应用于大型临床数据集,以开发儿科突发谵妄的预测模型:我们使用 2015 年 2 月至 2019 年 12 月的电子健康记录数据进行了一项单中心回顾性队列研究。我们建立并评估了4种常用的预测突发谵妄的ML模型:最小绝对收缩和选择算子、脊回归、随机森林和极梯度提升。主要结果是出现谵妄,即在恢复期间的任何时间记录到 Watcha 评分为 3 或 4:数据集包括 43 830 名患者的 54 776 次就诊。4 个 ML 模型的表现类似,根据接收者操作特征曲线下面积评估的性能在 0.74 到 0.75 之间。与风险增加相关的显著变量包括腺样体切除术与扁桃体切除术、年龄降低、咪达唑仑预处理和昂丹司琼用药,而静脉诱导和酮咯酸与谵妄出现风险降低相关:使用大型儿科数据集预测术后出现谵妄时,四种不同的ML模型表现出相似的性能。这些模型的预测性能使我们注意到,基于所研究的变量,我们对这一现象的理解并不全面。我们的建模结果可以作为设计预测性临床决策支持系统的第一步,但还需要进一步的优化和验证:不适用。
{"title":"Predicting pediatric emergence delirium using data-driven machine learning applied to electronic health record dataset at a quaternary care pediatric hospital.","authors":"Han Yu, Allan F Simpao, Victor M Ruiz, Olivia Nelson, Wallis T Muhly, Tori N Sutherland, Julia A Gálvez, Mykhailo B Pushkar, Paul A Stricker, Fuchiang Rich Tsui","doi":"10.1093/jamiaopen/ooad106","DOIUrl":"https://doi.org/10.1093/jamiaopen/ooad106","url":null,"abstract":"<p><strong>Objectives: </strong>Pediatric emergence delirium is an undesirable outcome that is understudied. Development of a predictive model is an initial step toward reducing its occurrence. This study aimed to apply machine learning (ML) methods to a large clinical dataset to develop a predictive model for pediatric emergence delirium.</p><p><strong>Materials and methods: </strong>We performed a single-center retrospective cohort study using electronic health record data from February 2015 to December 2019. We built and evaluated 4 commonly used ML models for predicting emergence delirium: least absolute shrinkage and selection operator, ridge regression, random forest, and extreme gradient boosting. The primary outcome was the occurrence of emergence delirium, defined as a Watcha score of 3 or 4 recorded at any time during recovery.</p><p><strong>Results: </strong>The dataset included 54 776 encounters across 43 830 patients. The 4 ML models performed similarly with performance assessed by the area under the receiver operating characteristic curves ranging from 0.74 to 0.75. Notable variables associated with increased risk included adenoidectomy with or without tonsillectomy, decreasing age, midazolam premedication, and ondansetron administration, while intravenous induction and ketorolac were associated with reduced risk of emergence delirium.</p><p><strong>Conclusions: </strong>Four different ML models demonstrated similar performance in predicting postoperative emergence delirium using a large pediatric dataset. The prediction performance of the models draws attention to our incomplete understanding of this phenomenon based on the studied variables. The results from our modeling could serve as a first step in designing a predictive clinical decision support system, but further optimization and validation are needed.</p><p><strong>Clinical trial number and registry url: </strong>Not applicable.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"6 4","pages":"ooad106"},"PeriodicalIF":2.1,"publicationDate":"2023-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10719078/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138809941","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Selecting patient-reported outcome measures for a patient-facing technology. 为面向患者的技术选择患者报告的结果指标。
IF 2.1 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2023-12-13 eCollection Date: 2023-12-01 DOI: 10.1093/jamiaopen/ooad104
Priyank Raj, Youmin Cho, Yun Jiang, Yang Gong

Objective: This article provides insight into our process and considerations for selecting patient-reported outcome measures (PROMs) designed for self-reporting symptoms and quality-of-life among breast cancer (BCA) patients undergoing oral anticancer agent treatment via a patient-facing technology (PFT) platform.

Methods: Following established guidelines, we conducted a thorough assessment of a specific set of PROMs, comparing their content to identify the most suitable options for studying BCA patients.

Results: We recommend utilizing the combination of EORTC QLQ-C30 + EORTC QLQ-BR45 as the preferred instrument, especially when developing a dedicated "breast cancer-only" application.

Discussion: When developing and maintaining a dashboard for a PFT platform that includes multiple cancer types, it is important to consider the feasibility of interface design and workload. To achieve this, we recommend using PRO-CTCAE+PROMIS 10 GH for the PFT. Moreover, it is important to consider adding ad hoc items to complement the chosen PROM(s).

Conclusion: This article describes our efforts to identify PROMs for self-reported data while considering patient and developer burdens, providing guidance to PFT developers facing similar challenges in PROM selection.

目的:本文深入介绍了我们选择患者报告结果测量指标(PROMs)的过程和考虑因素,这些指标旨在通过面向患者的技术(PFT)平台自我报告接受口服抗癌药治疗的乳腺癌(BCA)患者的症状和生活质量:按照既定指南,我们对一组特定的 PROMs 进行了全面评估,比较了它们的内容,以确定最适合研究 BCA 患者的选项:结果:我们建议将 EORTC QLQ-C30 + EORTC QLQ-BR45 组合作为首选工具,尤其是在开发 "乳腺癌专用 "应用程序时:在开发和维护包含多种癌症类型的 PFT 平台仪表板时,必须考虑界面设计和工作量的可行性。为此,我们建议在 PFT 中使用 PRO-CTCAE+PROMIS 10 GH。此外,重要的是要考虑增加临时项目,以补充所选的 PROM:本文介绍了我们在考虑患者和开发人员负担的同时为自我报告数据确定 PROM 所做的努力,为在 PROM 选择方面面临类似挑战的 PFT 开发人员提供了指导。
{"title":"Selecting patient-reported outcome measures for a patient-facing technology.","authors":"Priyank Raj, Youmin Cho, Yun Jiang, Yang Gong","doi":"10.1093/jamiaopen/ooad104","DOIUrl":"10.1093/jamiaopen/ooad104","url":null,"abstract":"<p><strong>Objective: </strong>This article provides insight into our process and considerations for selecting patient-reported outcome measures (PROMs) designed for self-reporting symptoms and quality-of-life among breast cancer (BCA) patients undergoing oral anticancer agent treatment via a patient-facing technology (PFT) platform.</p><p><strong>Methods: </strong>Following established guidelines, we conducted a thorough assessment of a specific set of PROMs, comparing their content to identify the most suitable options for studying BCA patients.</p><p><strong>Results: </strong>We recommend utilizing the combination of EORTC QLQ-C30 + EORTC QLQ-BR45 as the preferred instrument, especially when developing a dedicated \"breast cancer-only\" application.</p><p><strong>Discussion: </strong>When developing and maintaining a dashboard for a PFT platform that includes multiple cancer types, it is important to consider the feasibility of interface design and workload. To achieve this, we recommend using PRO-CTCAE+PROMIS 10 GH for the PFT. Moreover, it is important to consider adding ad hoc items to complement the chosen PROM(s).</p><p><strong>Conclusion: </strong>This article describes our efforts to identify PROMs for self-reported data while considering patient and developer burdens, providing guidance to PFT developers facing similar challenges in PROM selection.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"6 4","pages":"ooad104"},"PeriodicalIF":2.1,"publicationDate":"2023-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10719077/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138809943","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The use of electronic health record embedded MRC-ICU as a metric for critical care pharmacist workload. 使用嵌入MRC-ICU的电子健康记录作为重症监护药剂师工作量的度量。
IF 2.1 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2023-12-05 eCollection Date: 2023-12-01 DOI: 10.1093/jamiaopen/ooad101
Andrew J Webb, Bayleigh Carver, Sandra Rowe, Andrea Sikora

Objectives: A lack of pharmacist-specific risk-stratification scores in the electronic health record (EHR) may limit resource optimization. The medication regimen complexity-intensive care unit (MRC-ICU) score was implemented into our center's EHR for use by clinical pharmacists. The purpose of this evaluation was to evaluate MRC-ICU as a predictor of pharmacist workload and to assess its potential as an additional dimension to traditional workload measures.

Materials and methods: Data were abstracted from the EHR on adult ICU patients, including MRC-ICU scores and 2 traditional measures of pharmacist workload: numbers of medication orders verified and interventions logged. This was a single-center study of an EHR-integrated MRC-ICU tool. The primary outcome was the association of MRC-ICU with institutional metrics of pharmacist workload. Associations were assessed using the initial 24-h maximum MRC-ICU score's Pearson's correlation with overall admission workload and the day-to-day association using generalized linear mixed-effects modeling.

Results: A total of 1205 patients over 5083 patient-days were evaluated. Baseline MRC-ICU was correlated with both cumulative order volume (Spearman's rho 0.41, P < .001) and cumulative interventions placed (Spearman's rho 0.27, P < .001). A 1-point increase in maximum daily MRC-ICU was associated with a 31% increase in order volume (95% CI, 24%-38%) and 4% increase in interventions (95% CI, 2%-5%).

Discussion and conclusion: The MRC-ICU is a validated score that has been previously correlated with important patient-centered outcomes. Here, MRC-ICU was modestly associated with 2 traditional objective measures of pharmacist workload, including orders verified and interventions placed, which is an important step for its use as a tool for resource utilization needs.

目的:在电子健康记录(EHR)中缺乏药剂师特定的风险分层评分可能会限制资源优化。将药物治疗方案复杂性-重症监护病房(MRC-ICU)评分纳入我中心的电子病历,供临床药师使用。本评估的目的是评估MRC-ICU作为药剂师工作量的预测因子,并评估其作为传统工作量测量的额外维度的潜力。材料和方法:从成人ICU患者的电子病历中提取数据,包括MRC-ICU评分和药剂师工作量的2个传统指标:验证的药物订单数量和记录的干预措施。这是一项ehr整合MRC-ICU工具的单中心研究。主要结局是MRC-ICU与药剂师工作量的机构指标的关联。使用最初24小时最大MRC-ICU评分与总体入院工作量的Pearson相关性和使用广义线性混合效应模型的日常关联来评估相关性。结果:共评估1205例患者,超过5083患者日。基线MRC-ICU与累积订单量相关(Spearman的rho为0.41,P)讨论和结论:MRC-ICU是一个经过验证的评分,以前与重要的以患者为中心的结果相关。在这里,MRC-ICU与药剂师工作量的两项传统客观指标适度相关,包括验证的订单和采取的干预措施,这是将其用作资源利用需求工具的重要一步。
{"title":"The use of electronic health record embedded MRC-ICU as a metric for critical care pharmacist workload.","authors":"Andrew J Webb, Bayleigh Carver, Sandra Rowe, Andrea Sikora","doi":"10.1093/jamiaopen/ooad101","DOIUrl":"10.1093/jamiaopen/ooad101","url":null,"abstract":"<p><strong>Objectives: </strong>A lack of pharmacist-specific risk-stratification scores in the electronic health record (EHR) may limit resource optimization. The medication regimen complexity-intensive care unit (MRC-ICU) score was implemented into our center's EHR for use by clinical pharmacists. The purpose of this evaluation was to evaluate MRC-ICU as a predictor of pharmacist workload and to assess its potential as an additional dimension to traditional workload measures.</p><p><strong>Materials and methods: </strong>Data were abstracted from the EHR on adult ICU patients, including MRC-ICU scores and 2 traditional measures of pharmacist workload: numbers of medication orders verified and interventions logged. This was a single-center study of an EHR-integrated MRC-ICU tool. The primary outcome was the association of MRC-ICU with institutional metrics of pharmacist workload. Associations were assessed using the initial 24-h maximum MRC-ICU score's Pearson's correlation with overall admission workload and the day-to-day association using generalized linear mixed-effects modeling.</p><p><strong>Results: </strong>A total of 1205 patients over 5083 patient-days were evaluated. Baseline MRC-ICU was correlated with both cumulative order volume (Spearman's rho 0.41, <i>P</i> < .001) and cumulative interventions placed (Spearman's rho 0.27, <i>P</i> < .001). A 1-point increase in maximum daily MRC-ICU was associated with a 31% increase in order volume (95% CI, 24%-38%) and 4% increase in interventions (95% CI, 2%-5%).</p><p><strong>Discussion and conclusion: </strong>The MRC-ICU is a validated score that has been previously correlated with important patient-centered outcomes. Here, MRC-ICU was modestly associated with 2 traditional objective measures of pharmacist workload, including orders verified and interventions placed, which is an important step for its use as a tool for resource utilization needs.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"6 4","pages":"ooad101"},"PeriodicalIF":2.1,"publicationDate":"2023-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10697785/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138499661","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Transforming Estonian health data to the Observational Medical Outcomes Partnership (OMOP) Common Data Model: lessons learned. 将爱沙尼亚卫生数据转化为观察性医疗成果伙伴关系(OMOP)共同数据模型:吸取的教训。
IF 2.1 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2023-12-05 eCollection Date: 2023-12-01 DOI: 10.1093/jamiaopen/ooad100
Marek Oja, Sirli Tamm, Kerli Mooses, Maarja Pajusalu, Harry-Anton Talvik, Anne Ott, Marianna Laht, Maria Malk, Marcus Lõo, Johannes Holm, Markus Haug, Hendrik Šuvalov, Dage Särg, Jaak Vilo, Sven Laur, Raivo Kolde, Sulev Reisberg

Objective: To describe the reusable transformation process of electronic health records (EHR), claims, and prescriptions data into Observational Medical Outcome Partnership (OMOP) Common Data Model (CDM), together with challenges faced and solutions implemented.

Materials and methods: We used Estonian national health databases that store almost all residents' claims, prescriptions, and EHR records. To develop and demonstrate the transformation process of Estonian health data to OMOP CDM, we used a 10% random sample of the Estonian population (n = 150 824 patients) from 2012 to 2019 (MAITT dataset). For the sample, complete information from all 3 databases was converted to OMOP CDM version 5.3. The validation was performed using open-source tools.

Results: In total, we transformed over 100 million entries to standard concepts using standard OMOP vocabularies with the average mapping rate 95%. For conditions, observations, drugs, and measurements, the mapping rate was over 90%. In most cases, SNOMED Clinical Terms were used as the target vocabulary.

Discussion: During the transformation process, we encountered several challenges, which are described in detail with concrete examples and solutions.

Conclusion: For a representative 10% random sample, we successfully transferred complete records from 3 national health databases to OMOP CDM and created a reusable transformation process. Our work helps future researchers to transform linked databases into OMOP CDM more efficiently, ultimately leading to better real-world evidence.

目的:描述电子健康记录(EHR)、理赔和处方数据向观察性医疗结果伙伴关系(OMOP)公共数据模型(CDM)的可重用转换过程,以及面临的挑战和实施的解决方案。材料和方法:我们使用爱沙尼亚国家卫生数据库,该数据库存储了几乎所有居民的索赔、处方和电子病历记录。为了开发和展示爱沙尼亚健康数据向OMOP CDM的转化过程,我们使用了2012年至2019年爱沙尼亚人口(n = 150824例患者)的10%随机样本(MAITT数据集)。对于示例,来自所有3个数据库的完整信息被转换为OMOP CDM版本5.3。验证是使用开源工具进行的。结果:我们总共使用标准OMOP词汇表将超过1亿个条目转换为标准概念,平均映射率为95%。对于条件、观察、药物和测量,作图率超过90%。在大多数情况下,使用SNOMED临床术语作为目标词汇。讨论:在转型过程中,我们遇到了一些挑战,并以具体的例子和解决方案进行了详细的描述。结论:对于具有代表性的10%随机样本,我们成功地将3个国家卫生数据库的完整记录转移到OMOP CDM,并创建了一个可重复使用的转换过程。我们的工作有助于未来的研究人员更有效地将链接数据库转换为OMOP CDM,最终获得更好的真实世界证据。
{"title":"Transforming Estonian health data to the Observational Medical Outcomes Partnership (OMOP) Common Data Model: lessons learned.","authors":"Marek Oja, Sirli Tamm, Kerli Mooses, Maarja Pajusalu, Harry-Anton Talvik, Anne Ott, Marianna Laht, Maria Malk, Marcus Lõo, Johannes Holm, Markus Haug, Hendrik Šuvalov, Dage Särg, Jaak Vilo, Sven Laur, Raivo Kolde, Sulev Reisberg","doi":"10.1093/jamiaopen/ooad100","DOIUrl":"10.1093/jamiaopen/ooad100","url":null,"abstract":"<p><strong>Objective: </strong>To describe the reusable transformation process of electronic health records (EHR), claims, and prescriptions data into Observational Medical Outcome Partnership (OMOP) Common Data Model (CDM), together with challenges faced and solutions implemented.</p><p><strong>Materials and methods: </strong>We used Estonian national health databases that store almost all residents' claims, prescriptions, and EHR records. To develop and demonstrate the transformation process of Estonian health data to OMOP CDM, we used a 10% random sample of the Estonian population (<i>n</i> = 150 824 patients) from 2012 to 2019 (MAITT dataset). For the sample, complete information from all 3 databases was converted to OMOP CDM version 5.3. The validation was performed using open-source tools.</p><p><strong>Results: </strong>In total, we transformed over 100 million entries to standard concepts using standard OMOP vocabularies with the average mapping rate 95%. For conditions, observations, drugs, and measurements, the mapping rate was over 90%. In most cases, SNOMED Clinical Terms were used as the target vocabulary.</p><p><strong>Discussion: </strong>During the transformation process, we encountered several challenges, which are described in detail with concrete examples and solutions.</p><p><strong>Conclusion: </strong>For a representative 10% random sample, we successfully transferred complete records from 3 national health databases to OMOP CDM and created a reusable transformation process. Our work helps future researchers to transform linked databases into OMOP CDM more efficiently, ultimately leading to better real-world evidence.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"6 4","pages":"ooad100"},"PeriodicalIF":2.1,"publicationDate":"2023-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10697784/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138499662","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Development of an interactive dashboard for gun violence pattern analysis and intervention design at the local level 开发互动式仪表板,用于地方一级的枪支暴力模式分析和干预设计
IF 2.1 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2023-12-01 DOI: 10.1093/jamiaopen/ooad105
Rashaud Senior, Lisa Pickett, Andrew Stirling, Shwetha Dash, Patti Gorgone, Georgina Durst, Debra Jones, Richard Shannon, N. Bhavsar, Armando Bedoya
Abstract Introduction Gun violence remains a concerning and persistent issue in our country. Novel dashboards may integrate and summarize important clinical and non-clinical data that can inform targeted interventions to address the underlying causes of gun violence. Methods Data from various clinical and non-clinical sources were sourced, cleaned, and integrated into a customizable dashboard that summarizes and provides insight into the underlying factors that impact local gun violence episodes. Results The dashboards contained data from 7786 encounters and 1152 distinct patients from our Emergency Department’s Trauma Registry with various patterns noted by the team. A multidisciplinary executive team, including subject matter experts in community-based interventions, epidemiology, and social sciences, was formed to design targeted interventions based on these observations. Conclusion Targeted interventions to reduce gun violence require a multimodal data sourcing and standardization approach, the inclusion of neighborhood-level data, and a dedicated multidisciplinary team to act on the generated insights.
枪支暴力在我国一直是一个令人关注且持续存在的问题。新型仪表板可以整合和总结重要的临床和非临床数据,这些数据可以为有针对性的干预提供信息,以解决枪支暴力的潜在原因。方法收集各种临床和非临床来源的数据,对其进行整理,并将其整合到一个可定制的仪表板中,该仪表板总结并提供影响当地枪支暴力事件的潜在因素。结果仪表板包含来自我们急诊科创伤登记处的7786名患者和1152名不同患者的数据,这些数据具有团队注意到的各种模式。由社区干预、流行病学和社会科学方面的主题专家组成的多学科执行小组根据这些观察结果设计有针对性的干预措施。有针对性的干预措施减少枪支暴力需要多模式的数据来源和标准化方法,包括社区层面的数据,以及一个专门的多学科团队根据所产生的见解采取行动。
{"title":"Development of an interactive dashboard for gun violence pattern analysis and intervention design at the local level","authors":"Rashaud Senior, Lisa Pickett, Andrew Stirling, Shwetha Dash, Patti Gorgone, Georgina Durst, Debra Jones, Richard Shannon, N. Bhavsar, Armando Bedoya","doi":"10.1093/jamiaopen/ooad105","DOIUrl":"https://doi.org/10.1093/jamiaopen/ooad105","url":null,"abstract":"Abstract Introduction Gun violence remains a concerning and persistent issue in our country. Novel dashboards may integrate and summarize important clinical and non-clinical data that can inform targeted interventions to address the underlying causes of gun violence. Methods Data from various clinical and non-clinical sources were sourced, cleaned, and integrated into a customizable dashboard that summarizes and provides insight into the underlying factors that impact local gun violence episodes. Results The dashboards contained data from 7786 encounters and 1152 distinct patients from our Emergency Department’s Trauma Registry with various patterns noted by the team. A multidisciplinary executive team, including subject matter experts in community-based interventions, epidemiology, and social sciences, was formed to design targeted interventions based on these observations. Conclusion Targeted interventions to reduce gun violence require a multimodal data sourcing and standardization approach, the inclusion of neighborhood-level data, and a dedicated multidisciplinary team to act on the generated insights.","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":" 16","pages":""},"PeriodicalIF":2.1,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138611536","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Development and external validation of multimodal postoperative acute kidney injury risk machine learning models 多模式术后急性肾损伤风险机器学习模型的开发和外部验证
IF 2.1 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2023-12-01 DOI: 10.1093/jamiaopen/ooad109
G. Karway, J. Koyner, John Caskey, Alexandra B Spicer, Kyle A. Carey, Emily R. Gilbert, D. Dligach, A. Mayampurath, Majid Afshar, M. Churpek
Abstract Objectives To develop and externally validate machine learning models using structured and unstructured electronic health record data to predict postoperative acute kidney injury (AKI) across inpatient settings. Materials and Methods Data for adult postoperative admissions to the Loyola University Medical Center (2009-2017) were used for model development and admissions to the University of Wisconsin-Madison (2009-2020) were used for validation. Structured features included demographics, vital signs, laboratory results, and nurse-documented scores. Unstructured text from clinical notes were converted into concept unique identifiers (CUIs) using the clinical Text Analysis and Knowledge Extraction System. The primary outcome was the development of Kidney Disease Improvement Global Outcomes stage 2 AKI within 7 days after leaving the operating room. We derived unimodal extreme gradient boosting machines (XGBoost) and elastic net logistic regression (GLMNET) models using structured-only data and multimodal models combining structured data with CUI features. Model comparison was performed using the receiver operating characteristic curve (AUROC), with Delong’s test for statistical differences. Results The study cohort included 138 389 adult patient admissions (mean [SD] age 58 [16] years; 11 506 [8%] African-American; and 70 826 [51%] female) across the 2 sites. Of those, 2959 (2.1%) developed stage 2 AKI or higher. Across all data types, XGBoost outperformed GLMNET (mean AUROC 0.81 [95% confidence interval (CI), 0.80-0.82] vs 0.78 [95% CI, 0.77-0.79]). The multimodal XGBoost model incorporating CUIs parameterized as term frequency-inverse document frequency (TF-IDF) showed the highest discrimination performance (AUROC 0.82 [95% CI, 0.81-0.83]) over unimodal models (AUROC 0.79 [95% CI, 0.78-0.80]). Discussion A multimodality approach with structured data and TF-IDF weighting of CUIs increased model performance over structured data-only models. Conclusion These findings highlight the predictive power of CUIs when merged with structured data for clinical prediction models, which may improve the detection of postoperative AKI.
摘要 目的 利用结构化和非结构化电子健康记录数据开发和外部验证机器学习模型,以预测不同住院环境下的术后急性肾损伤(AKI)。材料与方法 洛约拉大学医学中心(2009-2017 年)的成人术后入院数据用于模型开发,威斯康星大学麦迪逊分校(2009-2020 年)的入院数据用于验证。结构化特征包括人口统计学、生命体征、实验室结果和护士记录的评分。临床笔记中的非结构化文本通过临床文本分析和知识提取系统转换为概念唯一标识符(CUI)。主要结果是在离开手术室后 7 天内出现肾病改善全球结果 2 期 AKI。我们利用纯结构化数据推导出了单模态极端梯度提升机(XGBoost)和弹性网逻辑回归(GLMNET)模型,并结合结构化数据和 CUI 特征推导出了多模态模型。模型比较采用接收者操作特征曲线 (AUROC),并通过德龙检验法进行统计学差异检验。结果 研究队列包括两个地点收治的 138 389 名成年患者(平均 [SD] 年龄 58 [16] 岁;11 506 [8%] 非洲裔美国人;70 826 [51%] 女性)。其中 2959 人(2.1%)发展为 2 期 AKI 或以上。在所有数据类型中,XGBoost 的表现均优于 GLMNET(平均 AUROC 为 0.81 [95% 置信区间 (CI),0.80-0.82] vs 0.78 [95% CI,0.77-0.79])。与单模态模型(AUROC 0.79 [95% CI, 0.78-0.80])相比,以词频-反文档频率(TF-IDF)为参数的 CUI 多模态 XGBoost 模型显示出最高的识别性能(AUROC 0.82 [95% CI, 0.81-0.83])。讨论 与仅使用结构化数据的模型相比,使用结构化数据和 TF-IDF 加权 CUI 的多模态方法提高了模型性能。结论 这些研究结果凸显了 CUI 与结构化数据合并用于临床预测模型时的预测能力,这可能会改善术后 AKI 的检测。
{"title":"Development and external validation of multimodal postoperative acute kidney injury risk machine learning models","authors":"G. Karway, J. Koyner, John Caskey, Alexandra B Spicer, Kyle A. Carey, Emily R. Gilbert, D. Dligach, A. Mayampurath, Majid Afshar, M. Churpek","doi":"10.1093/jamiaopen/ooad109","DOIUrl":"https://doi.org/10.1093/jamiaopen/ooad109","url":null,"abstract":"Abstract Objectives To develop and externally validate machine learning models using structured and unstructured electronic health record data to predict postoperative acute kidney injury (AKI) across inpatient settings. Materials and Methods Data for adult postoperative admissions to the Loyola University Medical Center (2009-2017) were used for model development and admissions to the University of Wisconsin-Madison (2009-2020) were used for validation. Structured features included demographics, vital signs, laboratory results, and nurse-documented scores. Unstructured text from clinical notes were converted into concept unique identifiers (CUIs) using the clinical Text Analysis and Knowledge Extraction System. The primary outcome was the development of Kidney Disease Improvement Global Outcomes stage 2 AKI within 7 days after leaving the operating room. We derived unimodal extreme gradient boosting machines (XGBoost) and elastic net logistic regression (GLMNET) models using structured-only data and multimodal models combining structured data with CUI features. Model comparison was performed using the receiver operating characteristic curve (AUROC), with Delong’s test for statistical differences. Results The study cohort included 138 389 adult patient admissions (mean [SD] age 58 [16] years; 11 506 [8%] African-American; and 70 826 [51%] female) across the 2 sites. Of those, 2959 (2.1%) developed stage 2 AKI or higher. Across all data types, XGBoost outperformed GLMNET (mean AUROC 0.81 [95% confidence interval (CI), 0.80-0.82] vs 0.78 [95% CI, 0.77-0.79]). The multimodal XGBoost model incorporating CUIs parameterized as term frequency-inverse document frequency (TF-IDF) showed the highest discrimination performance (AUROC 0.82 [95% CI, 0.81-0.83]) over unimodal models (AUROC 0.79 [95% CI, 0.78-0.80]). Discussion A multimodality approach with structured data and TF-IDF weighting of CUIs increased model performance over structured data-only models. Conclusion These findings highlight the predictive power of CUIs when merged with structured data for clinical prediction models, which may improve the detection of postoperative AKI.","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"60 24","pages":""},"PeriodicalIF":2.1,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138985926","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Tracking pregnant women's mental health through social media: an analysis of reddit posts. 通过社交媒体跟踪孕妇的心理健康:对reddit帖子的分析。
IF 2.5 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2023-11-28 eCollection Date: 2023-12-01 DOI: 10.1093/jamiaopen/ooad094
Abhishek Dhankar, Alan Katz

Objectives: Present an artificial intelligence-enabled pipeline for estimating the prevalence of depression and general anxiety among pregnant women using texts from their social media posts. Use said pipeline to analyze mental health trends on subreddits frequented by pregnant women and report on interesting insights that could be helpful for policy-makers, clinicians, etc.

Materials and methods: We used pretrained transformer-based models to build a natural language processing pipeline that can automatically detect depressed pregnant women on social media and carry out topic modeling to detect their concerns.

Results: We detected depressed posts by pregnant women on Reddit and validated the performance of the depression classification model by carrying out topic modeling to reveal that depressive topics were detected. The proportion of potentially depressed surprisingly reduced during the pandemic (2020 and 2021). Queries related to antidepressants, such as Zoloft, and potential ways of managing mental health dominated discourse before the pandemic (2018 and 2019), whereas queries about pelvic pain and associated stress dominated the discourse during the pandemic.

Discussion and conclusion: Supportive online communities could be a factor in alleviating stress related to the pandemic, hence the reduction in the proportion of depressed users during the pandemic. Stress during the pandemic has been associated with pelvic pain among pregnant women, and this trend is confirmed through topic modeling of depressive posts during the pandemic.

目的:提出一种人工智能支持的管道,用于使用孕妇社交媒体帖子中的文本来估计抑郁和一般焦虑的患病率。使用该管道来分析孕妇经常访问的子reddit上的心理健康趋势,并报告可能对政策制定者、临床医生等有帮助的有趣见解。材料和方法:我们使用预训练的基于变压器的模型来构建自然语言处理管道,该管道可以自动检测社交媒体上的抑郁孕妇,并进行主题建模以检测他们的关注点。结果:我们检测了Reddit上孕妇的抑郁帖子,并通过主题建模验证了抑郁分类模型的性能,发现抑郁话题被检测到。在大流行期间(2020年和2021年),潜在抑郁症的比例出人意料地下降了。在大流行之前(2018年和2019年),与左洛复(Zoloft)等抗抑郁药和管理心理健康的潜在方法相关的问题占主导地位,而在大流行期间,关于盆腔疼痛和相关压力的问题占主导地位。讨论和结论:支持性在线社区可能是减轻与大流行有关的压力的一个因素,因此在大流行期间抑郁用户的比例减少。大流行期间的压力与孕妇的盆腔疼痛有关,这一趋势通过大流行期间抑郁帖子的主题建模得到证实。
{"title":"Tracking pregnant women's mental health through social media: an analysis of reddit posts.","authors":"Abhishek Dhankar, Alan Katz","doi":"10.1093/jamiaopen/ooad094","DOIUrl":"10.1093/jamiaopen/ooad094","url":null,"abstract":"<p><strong>Objectives: </strong>Present an artificial intelligence-enabled pipeline for estimating the prevalence of depression and general anxiety among pregnant women using texts from their social media posts. Use said pipeline to analyze mental health trends on subreddits frequented by pregnant women and report on interesting insights that could be helpful for policy-makers, clinicians, etc.</p><p><strong>Materials and methods: </strong>We used pretrained transformer-based models to build a natural language processing pipeline that can automatically detect depressed pregnant women on social media and carry out topic modeling to detect their concerns.</p><p><strong>Results: </strong>We detected depressed posts by pregnant women on Reddit and validated the performance of the depression classification model by carrying out topic modeling to reveal that depressive topics were detected. The proportion of potentially depressed surprisingly reduced during the pandemic (2020 and 2021). Queries related to antidepressants, such as Zoloft, and potential ways of managing mental health dominated discourse before the pandemic (2018 and 2019), whereas queries about pelvic pain and associated stress dominated the discourse during the pandemic.</p><p><strong>Discussion and conclusion: </strong>Supportive online communities could be a factor in alleviating stress related to the pandemic, hence the reduction in the proportion of depressed users during the pandemic. Stress during the pandemic has been associated with pelvic pain among pregnant women, and this trend is confirmed through topic modeling of depressive posts during the pandemic.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"6 4","pages":"ooad094"},"PeriodicalIF":2.5,"publicationDate":"2023-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10684261/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138463164","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
I'm not burned out. This is how I write notes. 我没有精疲力尽。这就是我写笔记的方式。
IF 2.1 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2023-11-28 eCollection Date: 2023-12-01 DOI: 10.1093/jamiaopen/ooad099
Thomas H Payne, Grace K Turner

Objectives: We describe an automated transcription system that addresses many documentation problems and fits within scheduled clinical hours.

Materials and methods: During visits, the provider listens to the patient while maintaining eye contact and making brief notes on paper. Immediately after the visit conclusion and before the next, the provider makes a short voice recording on a smartphone which is transmitted to the system. The system uses a public domain general language model, and a hypertuned provider-specific language model that is iteratively refined as each produced note is edited by the physician, followed by final automated processing steps to add any templated text to the note.

Results: The provider leaves the clinic having completed all voice files, median duration 3.4 minutes. Created notes are formatted as preferred and are a median of 363 words (range 125-1175).

Discussion: This approach permits documentation to occur almost entirely within scheduled clinic hours, without copy-forward errors, and without interference with patient-provider interaction.

Conclusion: Though no documentation method is likely to appeal to all, this approach may appeal to many physicians and avoid many current problems with documentation.

目的:我们描述了一个自动转录系统,解决了许多文件问题,并符合预定的临床时间。材料和方法:在就诊期间,提供者倾听患者,同时保持目光接触,并在纸上做简短的笔记。在访问结束后和下一次访问之前,提供者会在智能手机上录制一段简短的语音录音,并将其传输到系统中。该系统使用公共领域通用语言模型和超调的提供者特定语言模型,该模型在医生编辑每个生成的笔记时进行迭代改进,然后进行最终的自动化处理步骤,将任何模板文本添加到笔记中。结果:提供者完成所有语音文件离开诊所,中位持续时间3.4分钟。创建的注释按偏好格式化,中位数为363个单词(范围为125-1175)。讨论:这种方法允许记录几乎完全在预定的诊所时间内进行,没有复制转发错误,也不会干扰患者与提供者的互动。结论:虽然没有一种记录方法可能对所有人都有吸引力,但这种方法可能对许多医生有吸引力,并避免了目前记录的许多问题。
{"title":"I'm not burned out. This is how I write notes.","authors":"Thomas H Payne, Grace K Turner","doi":"10.1093/jamiaopen/ooad099","DOIUrl":"10.1093/jamiaopen/ooad099","url":null,"abstract":"<p><strong>Objectives: </strong>We describe an automated transcription system that addresses many documentation problems and fits within scheduled clinical hours.</p><p><strong>Materials and methods: </strong>During visits, the provider listens to the patient while maintaining eye contact and making brief notes on paper. Immediately after the visit conclusion and before the next, the provider makes a short voice recording on a smartphone which is transmitted to the system. The system uses a public domain general language model, and a hypertuned provider-specific language model that is iteratively refined as each produced note is edited by the physician, followed by final automated processing steps to add any templated text to the note.</p><p><strong>Results: </strong>The provider leaves the clinic having completed all voice files, median duration 3.4 minutes. Created notes are formatted as preferred and are a median of 363 words (range 125-1175).</p><p><strong>Discussion: </strong>This approach permits documentation to occur almost entirely within scheduled clinic hours, without copy-forward errors, and without interference with patient-provider interaction.</p><p><strong>Conclusion: </strong>Though no documentation method is likely to appeal to all, this approach may appeal to many physicians and avoid many current problems with documentation.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"6 4","pages":"ooad099"},"PeriodicalIF":2.1,"publicationDate":"2023-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10684266/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138463162","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Hospitals' electronic access to information needed to treat COVID-19. 医院对治疗COVID-19所需信息的电子访问。
IF 2.1 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2023-11-22 eCollection Date: 2023-12-01 DOI: 10.1093/jamiaopen/ooad103
Chelsea Richwine, Jordan Everson, Vaishali Patel

Objective: To understand whether hospitals had electronic access to information needed to treat COVID-19 patients and identify factors contributing to differences in information availability.

Materials and methods: Using 2021 data from the American Hospital Association IT Supplement, we produced national estimates on the electronic availability of information needed to treat COVID-19 at US non-federal acute care hospitals (N = 1976) and assessed differences in information availability by hospital characteristics and engagement in interoperable exchange.

Results: In 2021, 38% of hospitals electronically received information needed to effectively treat COVID-19 patients. Information availability was significantly higher among higher-resourced hospitals and those engaged in interoperable exchange (44%) compared to their counterparts. In adjusted analyses, hospitals engaged in interoperable exchange were 140% more likely to receive needed information electronically compared to those not engaged in exchange (relative risk [RR]=2.40, 95% CI, 1.82-3.17, P<.001). System member hospitals (RR = 1.62, 95% CI, 1.36-1.92, P<.001) and major teaching hospitals (RR = 1.35, 95% CI, 1.10-1.64, P=.004) were more likely to have information available; for-profit hospitals (RR = 0.14, 95% CI, 0.08-0.24, P<.001) and hospitals in high social deprivation areas (RR = 0.83, 95% CI, 0.71-0.98, P = .02) were less likely to have information available.

Discussion: Despite high rates of hospitals' engagement in interoperable exchange, hospitals' electronic access to information needed to support the care of COVID-19 patients was limited.

Conclusion: Limited electronic access to patient information from outside sources may impede hospitals' ability to effectively treat COVID-19 and support patient care during public health emergencies.

目的:了解医院是否拥有治疗COVID-19患者所需信息的电子访问,并确定导致信息可用性差异的因素。材料和方法:使用来自美国医院协会IT增刊的2021年数据,我们对美国非联邦急症护理医院治疗COVID-19所需信息的电子可用性进行了全国估计(N = 1976),并根据医院特征和参与互操作交换评估了信息可用性的差异。结果:2021年,38%的医院以电子方式接收有效治疗COVID-19患者所需的信息。与其他医院相比,资源丰富的医院和参与互操作交换的医院(44%)的信息可用性明显更高。在调整后的分析中,参与互操作交换的医院获得所需电子信息的可能性比不参与交换的医院高140%(相对风险[RR]=2.40, 95% CI, 1.82-3.17, PPP= 0.004),更有可能获得信息;营利性医院(RR = 0.14, 95% CI, 0.08-0.24, PP = 0.02)获得信息的可能性较小。讨论:尽管医院参与互操作交换的比例很高,但医院对支持COVID-19患者护理所需信息的电子访问有限。结论:从外部来源获取患者信息的电子途径有限,可能会阻碍医院在突发公共卫生事件中有效治疗COVID-19和支持患者护理的能力。
{"title":"Hospitals' electronic access to information needed to treat COVID-19.","authors":"Chelsea Richwine, Jordan Everson, Vaishali Patel","doi":"10.1093/jamiaopen/ooad103","DOIUrl":"10.1093/jamiaopen/ooad103","url":null,"abstract":"<p><strong>Objective: </strong>To understand whether hospitals had electronic access to information needed to treat COVID-19 patients and identify factors contributing to differences in information availability.</p><p><strong>Materials and methods: </strong>Using 2021 data from the American Hospital Association IT Supplement, we produced national estimates on the electronic availability of information needed to treat COVID-19 at US non-federal acute care hospitals (<i>N</i> = 1976) and assessed differences in information availability by hospital characteristics and engagement in interoperable exchange.</p><p><strong>Results: </strong>In 2021, 38% of hospitals electronically received information needed to effectively treat COVID-19 patients. Information availability was significantly higher among higher-resourced hospitals and those engaged in interoperable exchange (44%) compared to their counterparts. In adjusted analyses, hospitals engaged in interoperable exchange were 140% more likely to receive needed information electronically compared to those not engaged in exchange (relative risk [RR]=2.40, 95% CI, 1.82-3.17, <i>P</i><.001). System member hospitals (RR = 1.62, 95% CI, 1.36-1.92, <i>P</i><.001) and major teaching hospitals (RR = 1.35, 95% CI, 1.10-1.64, <i>P</i>=.004) were more likely to have information available; for-profit hospitals (RR = 0.14, 95% CI, 0.08-0.24, <i>P</i><.001) and hospitals in high social deprivation areas (RR = 0.83, 95% CI, 0.71-0.98, <i>P</i> = .02) were less likely to have information available.</p><p><strong>Discussion: </strong>Despite high rates of hospitals' engagement in interoperable exchange, hospitals' electronic access to information needed to support the care of COVID-19 patients was limited.</p><p><strong>Conclusion: </strong>Limited electronic access to patient information from outside sources may impede hospitals' ability to effectively treat COVID-19 and support patient care during public health emergencies.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"6 4","pages":"ooad103"},"PeriodicalIF":2.1,"publicationDate":"2023-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10684259/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138463161","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluating the impact of alternative phenotype definitions on incidence rates across a global data network. 评估全球数据网络中不同表型定义对发病率的影响。
IF 2.1 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2023-11-21 eCollection Date: 2023-12-01 DOI: 10.1093/jamiaopen/ooad096
Rupa Makadia, Azza Shoaibi, Gowtham A Rao, Anna Ostropolets, Peter R Rijnbeek, Erica A Voss, Talita Duarte-Salles, Juan Manuel Ramírez-Anguita, Miguel A Mayer, Filip Maljković, Spiros Denaxas, Fredrik Nyberg, Vaclav Papez, Anthony G Sena, Thamir M Alshammari, Lana Y H Lai, Kevin Haynes, Marc A Suchard, George Hripcsak, Patrick B Ryan

Objective: Developing accurate phenotype definitions is critical in obtaining reliable and reproducible background rates in safety research. This study aims to illustrate the differences in background incidence rates by comparing definitions for a given outcome.

Materials and methods: We used 16 data sources to systematically generate and evaluate outcomes for 13 adverse events and their overall background rates. We examined the effect of different modifications (inpatient setting, standardization of code set, and code set changes) to the computable phenotype on background incidence rates.

Results: Rate ratios (RRs) of the incidence rates from each computable phenotype definition varied across outcomes, with inpatient restriction showing the highest variation from 1 to 11.93. Standardization of code set RRs ranges from 1 to 1.64, and code set changes range from 1 to 2.52.

Discussion: The modification that has the highest impact is requiring inpatient place of service, leading to at least a 2-fold higher incidence rate in the base definition. Standardization showed almost no change when using source code variations. The strength of the effect in the inpatient restriction is highly dependent on the outcome. Changing definitions from broad to narrow showed the most variability by age/gender/database across phenotypes and less than a 2-fold increase in rate compared to the base definition.

Conclusion: Characterization of outcomes across a network of databases yields insights into sensitivity and specificity trade-offs when definitions are altered. Outcomes should be thoroughly evaluated prior to use for background rates for their plausibility for use across a global network.

目的:发展准确的表型定义是在安全性研究中获得可靠和可重复的背景率的关键。本研究旨在通过比较给定结果的定义来说明背景发病率的差异。材料和方法:我们使用16个数据来源系统地生成和评估13个不良事件及其总体背景发生率的结果。我们检查了不同修改(住院环境、编码集标准化和编码集更改)对可计算表型对背景发病率的影响。结果:每个可计算表型定义的发病率的比率(rr)在不同的结果中有所不同,住院限制显示出最高的变化,从1到11.93。码集标准化rr的取值范围是1 ~ 1.64,码集变化的取值范围是1 ~ 2.52。讨论:影响最大的修改是要求住院服务场所,导致基本定义中的发病率至少高出2倍。使用源代码变体时,标准化显示几乎没有变化。住院限制的效果强度高度依赖于结果。从广义到狭义的定义变化显示了年龄/性别/数据库在表型上的最大变异性,与基本定义相比,变异性增加了不到2倍。结论:通过数据库网络对结果进行表征,可以深入了解定义改变时的敏感性和特异性权衡。在使用背景费率之前,应彻底评估其在全球网络中使用的合理性。
{"title":"Evaluating the impact of alternative phenotype definitions on incidence rates across a global data network.","authors":"Rupa Makadia, Azza Shoaibi, Gowtham A Rao, Anna Ostropolets, Peter R Rijnbeek, Erica A Voss, Talita Duarte-Salles, Juan Manuel Ramírez-Anguita, Miguel A Mayer, Filip Maljković, Spiros Denaxas, Fredrik Nyberg, Vaclav Papez, Anthony G Sena, Thamir M Alshammari, Lana Y H Lai, Kevin Haynes, Marc A Suchard, George Hripcsak, Patrick B Ryan","doi":"10.1093/jamiaopen/ooad096","DOIUrl":"10.1093/jamiaopen/ooad096","url":null,"abstract":"<p><strong>Objective: </strong>Developing accurate phenotype definitions is critical in obtaining reliable and reproducible background rates in safety research. This study aims to illustrate the differences in background incidence rates by comparing definitions for a given outcome.</p><p><strong>Materials and methods: </strong>We used 16 data sources to systematically generate and evaluate outcomes for 13 adverse events and their overall background rates. We examined the effect of different modifications (inpatient setting, standardization of code set, and code set changes) to the computable phenotype on background incidence rates.</p><p><strong>Results: </strong>Rate ratios (RRs) of the incidence rates from each computable phenotype definition varied across outcomes, with inpatient restriction showing the highest variation from 1 to 11.93. Standardization of code set RRs ranges from 1 to 1.64, and code set changes range from 1 to 2.52.</p><p><strong>Discussion: </strong>The modification that has the highest impact is requiring inpatient place of service, leading to at least a 2-fold higher incidence rate in the base definition. Standardization showed almost no change when using source code variations. The strength of the effect in the inpatient restriction is highly dependent on the outcome. Changing definitions from broad to narrow showed the most variability by age/gender/database across phenotypes and less than a 2-fold increase in rate compared to the base definition.</p><p><strong>Conclusion: </strong>Characterization of outcomes across a network of databases yields insights into sensitivity and specificity trade-offs when definitions are altered. Outcomes should be thoroughly evaluated prior to use for background rates for their plausibility for use across a global network.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"6 4","pages":"ooad096"},"PeriodicalIF":2.1,"publicationDate":"2023-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10662662/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138463160","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
JAMIA Open
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1