首页 > 最新文献

Journal of the American Medical Informatics Association最新文献

英文 中文
User guide for Social Determinants of Health Survey data in the All of Us Research Program. 全民研究计划中的社会决定因素健康调查数据用户指南。
IF 4.7 2区 医学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-08-27 DOI: 10.1093/jamia/ocae214
Theresa A Koleck, Caitlin Dreisbach, Chen Zhang, Susan Grayson, Maichou Lor, Zhirui Deng, Alex Conway, Peter D R Higgins, Suzanne Bakken

Objectives: Integration of social determinants of health into health outcomes research will allow researchers to study health inequities. The All of Us Research Program has the potential to be a rich source of social determinants of health data. However, user-friendly recommendations for scoring and interpreting the All of Us Social Determinants of Health Survey are needed to return value to communities through advancing researcher competencies in use of the All of Us Research Hub Researcher Workbench. We created a user guide aimed at providing researchers with an overview of the Social Determinants of Health Survey, recommendations for scoring and interpreting participant responses, and readily executable R and Python functions.

Target audience: This user guide targets registered users of the All of Us Research Hub Researcher Workbench, a cloud-based platform that supports analysis of All of Us data, who are currently conducting or planning to conduct analyses using the Social Determinants of Health Survey.

Scope: We introduce 14 constructs evaluated as part of the Social Determinants of Health Survey and summarize construct operationalization. We offer 30 literature-informed recommendations for scoring participant responses and interpreting scores, with multiple options available for 8 of the constructs. Then, we walk through example R and Python functions for relabeling responses and scoring constructs that can be directly implemented in Jupyter Notebook or RStudio within the Researcher Workbench. Full source code is available in supplemental files and GitHub. Finally, we discuss psychometric considerations related to the Social Determinants of Health Survey for researchers.

目标:将健康的社会决定因素纳入健康结果研究将使研究人员能够研究健康不平等问题。我们所有人研究计划有可能成为丰富的健康社会决定因素数据来源。然而,我们需要用户友好型的建议来对 "我们所有人的社会决定因素健康调查 "进行评分和解释,以便通过提高研究人员使用 "我们所有人的研究中心 "研究人员工作台的能力来为社区创造价值。我们创建了一份用户指南,旨在为研究人员提供健康状况社会决定因素调查的概述、对参与者回复进行评分和解释的建议,以及易于执行的 R 和 Python 函数:本用户指南的目标受众是 "我们所有人 "研究中心(All of Us Research Hub)研究人员工作台(Researcher Workbench)的注册用户,该工作台是一个支持 "我们所有人 "数据分析的云平台,目前正在使用或计划使用健康社会决定因素调查进行分析:我们介绍了作为健康社会决定因素调查一部分而评估的 14 个构造,并总结了构造的可操作性。我们提供了 30 项参考文献的建议,用于对参与者的回答进行评分和解释分数,其中 8 个构像有多个选项。然后,我们将通过 R 和 Python 函数示例来重新标注回答和结构式评分,这些函数可直接在研究者工作台的 Jupyter Notebook 或 RStudio 中实现。完整的源代码可在补充文件和 GitHub 中获取。最后,我们将讨论与研究人员健康社会决定因素调查相关的心理测量注意事项。
{"title":"User guide for Social Determinants of Health Survey data in the All of Us Research Program.","authors":"Theresa A Koleck, Caitlin Dreisbach, Chen Zhang, Susan Grayson, Maichou Lor, Zhirui Deng, Alex Conway, Peter D R Higgins, Suzanne Bakken","doi":"10.1093/jamia/ocae214","DOIUrl":"https://doi.org/10.1093/jamia/ocae214","url":null,"abstract":"<p><strong>Objectives: </strong>Integration of social determinants of health into health outcomes research will allow researchers to study health inequities. The All of Us Research Program has the potential to be a rich source of social determinants of health data. However, user-friendly recommendations for scoring and interpreting the All of Us Social Determinants of Health Survey are needed to return value to communities through advancing researcher competencies in use of the All of Us Research Hub Researcher Workbench. We created a user guide aimed at providing researchers with an overview of the Social Determinants of Health Survey, recommendations for scoring and interpreting participant responses, and readily executable R and Python functions.</p><p><strong>Target audience: </strong>This user guide targets registered users of the All of Us Research Hub Researcher Workbench, a cloud-based platform that supports analysis of All of Us data, who are currently conducting or planning to conduct analyses using the Social Determinants of Health Survey.</p><p><strong>Scope: </strong>We introduce 14 constructs evaluated as part of the Social Determinants of Health Survey and summarize construct operationalization. We offer 30 literature-informed recommendations for scoring participant responses and interpreting scores, with multiple options available for 8 of the constructs. Then, we walk through example R and Python functions for relabeling responses and scoring constructs that can be directly implemented in Jupyter Notebook or RStudio within the Researcher Workbench. Full source code is available in supplemental files and GitHub. Finally, we discuss psychometric considerations related to the Social Determinants of Health Survey for researchers.</p>","PeriodicalId":50016,"journal":{"name":"Journal of the American Medical Informatics Association","volume":null,"pages":null},"PeriodicalIF":4.7,"publicationDate":"2024-08-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142082352","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A GIS software-based method to identify public health data belonging to address-defined communities. 一种基于地理信息系统软件的方法,用于识别属于地址定义社区的公共卫生数据。
IF 4.7 2区 医学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-08-26 DOI: 10.1093/jamia/ocae235
Amanda M Lam, Mariana C Singletary, Theresa Cullen

Objective: This communication presents the results of defining a tribal health jurisdiction by a combination of tribal affiliation and case address.

Methods: Through a county-tribal partnership, GIS software and custom code were used to extract tribal data from county data by identifying reservation addresses in county extracts of COVID-19 case records from December 30, 2019, to December 31, 2022 (n = 374,653) and COVID-19 vaccination records from December 1, 2020, to April 18, 2023 (n = 2,355,058).

Results: The tool identified 1.91 times as many case records and 3.76 times as many vaccination records as filtering by tribal affiliation alone.

Discussion and conclusion: This method of identifying communities by patient address, in combination with tribal affiliation and enrollment, can help tribal health jurisdictions attain equitable access to public health data, when done in partnership with a data sharing agreement. This methodology has potential applications for other populations underrepresented in public health and clinical research.

目的本通报介绍了通过部落隶属关系和病例地址组合定义部落卫生管辖区的结果:通过县与部落合作,使用 GIS 软件和自定义代码从县数据中提取部落数据,方法是在县提取的 2019 年 12 月 30 日至 2022 年 12 月 31 日的 COVID-19 病例记录(n = 374,653 个)和 2020 年 12 月 1 日至 2023 年 4 月 18 日的 COVID-19 疫苗接种记录(n = 2,355,058 个)中识别保留地地址:结果:该工具识别出的病例记录和疫苗接种记录分别是通过部落隶属关系筛选出的病例记录和疫苗接种记录的 1.91 倍和 3.76 倍:这种通过患者地址识别社区的方法与部落隶属关系和注册情况相结合,如果与数据共享协议合作,可以帮助部落卫生辖区公平地获取公共卫生数据。这种方法还有可能应用于其他在公共卫生和临床研究中代表性不足的人群。
{"title":"A GIS software-based method to identify public health data belonging to address-defined communities.","authors":"Amanda M Lam, Mariana C Singletary, Theresa Cullen","doi":"10.1093/jamia/ocae235","DOIUrl":"https://doi.org/10.1093/jamia/ocae235","url":null,"abstract":"<p><strong>Objective: </strong>This communication presents the results of defining a tribal health jurisdiction by a combination of tribal affiliation and case address.</p><p><strong>Methods: </strong>Through a county-tribal partnership, GIS software and custom code were used to extract tribal data from county data by identifying reservation addresses in county extracts of COVID-19 case records from December 30, 2019, to December 31, 2022 (n = 374,653) and COVID-19 vaccination records from December 1, 2020, to April 18, 2023 (n = 2,355,058).</p><p><strong>Results: </strong>The tool identified 1.91 times as many case records and 3.76 times as many vaccination records as filtering by tribal affiliation alone.</p><p><strong>Discussion and conclusion: </strong>This method of identifying communities by patient address, in combination with tribal affiliation and enrollment, can help tribal health jurisdictions attain equitable access to public health data, when done in partnership with a data sharing agreement. This methodology has potential applications for other populations underrepresented in public health and clinical research.</p>","PeriodicalId":50016,"journal":{"name":"Journal of the American Medical Informatics Association","volume":null,"pages":null},"PeriodicalIF":4.7,"publicationDate":"2024-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142057033","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
BioASQ Synergy: A Dialogue between QA systems and biomedical experts for promoting COVID-19 research. BioASQ Synergy:质量保证系统与生物医学专家之间的对话,促进 COVID-19 研究。
IF 4.7 2区 医学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-08-24 DOI: 10.1093/jamia/ocae232
Anastasia Krithara, Anastasios Nentidis, Eirini Vandorou, Georgios Katsimpras, Yannis Almirantis, Magda Arnal, Adomas Bunevicius, Eulalia Farre-Maduell, Maya Kassiss, Vasileios Konstantakos, Sherri Matis-Mitchell, Dimitris Polychronopoulos, Jesus Rodriguez-Pascual, Eleftherios G Samaras, Martina Samiotaki, Despina Sanoudou, Aspasia Vozi, Georgios Paliouras

Objective: This paper presents the novel BioASQ Synergy research process which aims to facilitate the interaction between biomedical experts and automated question answering systems.

Materials and methods: The proposed research allows systems to provide answers to emerging questions, which in turn are assessed by experts. The assessment of the experts is fed back to the systems, together with new questions. With this iteration, we aim to facilitate the incremental understanding of a developing problem and contribute to solution discovery.

Results: The results suggest that the proposed approach can assist researchers to navigate available resources. The experts seem to be very satisfied with the quality of the ideal answers provided by the systems, suggesting that such systems are already useful in answering open research questions.

Discussion: BioASQ Synergy aspire to provide a tool that gives the experts easy and personalised access to the latest findings in a fast growing corpus of material.

Conclusion: In this paper we envisioned BioASQ Synergy as a continuous dialogue between experts and systems to issue open questions. We ran an initial proof-of-concept of the approach, in order to evaluate its usefulness, both from the side of the experts, as well as from the side of the participating systems.

目的本文介绍了新颖的 BioASQ Synergy 研究过程,该过程旨在促进生物医学专家与自动问题解答系统之间的互动:所提议的研究允许系统为新出现的问题提供答案,然后由专家进行评估。专家的评估结果与新问题一起反馈给系统。通过这种迭代,我们旨在促进对发展中问题的渐进式理解,并为发现解决方案做出贡献:结果:结果表明,所提出的方法可以帮助研究人员浏览可用资源。专家们似乎对系统所提供的理想答案的质量非常满意,这表明此类系统在回答开放式研究问题时已经非常有用:讨论:BioASQ Synergy 希望提供一种工具,让专家们能够轻松、个性化地访问快速增长的资料库中的最新研究成果:在本文中,我们将 BioASQ Synergy 设想为专家与系统之间的持续对话,以提出开放性问题。我们对该方法进行了初步概念验证,以便从专家和参与系统两方面评估其实用性。
{"title":"BioASQ Synergy: A Dialogue between QA systems and biomedical experts for promoting COVID-19 research.","authors":"Anastasia Krithara, Anastasios Nentidis, Eirini Vandorou, Georgios Katsimpras, Yannis Almirantis, Magda Arnal, Adomas Bunevicius, Eulalia Farre-Maduell, Maya Kassiss, Vasileios Konstantakos, Sherri Matis-Mitchell, Dimitris Polychronopoulos, Jesus Rodriguez-Pascual, Eleftherios G Samaras, Martina Samiotaki, Despina Sanoudou, Aspasia Vozi, Georgios Paliouras","doi":"10.1093/jamia/ocae232","DOIUrl":"https://doi.org/10.1093/jamia/ocae232","url":null,"abstract":"<p><strong>Objective: </strong>This paper presents the novel BioASQ Synergy research process which aims to facilitate the interaction between biomedical experts and automated question answering systems.</p><p><strong>Materials and methods: </strong>The proposed research allows systems to provide answers to emerging questions, which in turn are assessed by experts. The assessment of the experts is fed back to the systems, together with new questions. With this iteration, we aim to facilitate the incremental understanding of a developing problem and contribute to solution discovery.</p><p><strong>Results: </strong>The results suggest that the proposed approach can assist researchers to navigate available resources. The experts seem to be very satisfied with the quality of the ideal answers provided by the systems, suggesting that such systems are already useful in answering open research questions.</p><p><strong>Discussion: </strong>BioASQ Synergy aspire to provide a tool that gives the experts easy and personalised access to the latest findings in a fast growing corpus of material.</p><p><strong>Conclusion: </strong>In this paper we envisioned BioASQ Synergy as a continuous dialogue between experts and systems to issue open questions. We ran an initial proof-of-concept of the approach, in order to evaluate its usefulness, both from the side of the experts, as well as from the side of the participating systems.</p>","PeriodicalId":50016,"journal":{"name":"Journal of the American Medical Informatics Association","volume":null,"pages":null},"PeriodicalIF":4.7,"publicationDate":"2024-08-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142047392","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Characterizing apparent treatment resistant hypertension in the United States: insights from the All of Us Research Program. 美国明显耐药性高血压的特征:"我们所有人 "研究计划的启示。
IF 4.7 2区 医学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-08-24 DOI: 10.1093/jamia/ocae227
Mona Alshahawey, Eissa Jafari, Steven M Smith, Caitrin W McDonough

Background: Hypertension (HTN) remains a significant public health concern and the primary modifiable risk factor for cardiovascular disease, which is the leading cause of death in the United States. We applied our validated HTN computable phenotypes within the All of Us Research Program to uncover prevalence and characteristics of HTN and apparent treatment-resistant hypertension (aTRH) in United States.

Methods: Within the All of Us Researcher Workbench, we built a retrospective cohort (January 1, 2008-July 1, 2023), identifying all adults with available age data, at least one blood pressure (BP) measurement, prescribed at least one antihypertensive medication, and with at least one SNOMED "Essential hypertension" diagnosis code.

Results: We identified 99 461 participants with HTN who met the eligibility criteria. Following the application of our computable phenotypes, an overall population of 81 462 were further categorized to aTRH (14.4%), stable-controlled HTN (SCH) (39.5%), and Other HTN (46.1%). Compared to participants with SCH, participants with aTRH were older, more likely to be of Black or African American race, had higher levels of social deprivation, and a heightened prevalence of comorbidities such as hyperlipidemia and diabetes. Heart failure, chronic kidney disease, and diabetes were the comorbidities most strongly associated with aTRH. β-blockers were the most prescribed antihypertensive medication. At index date, the overall BP control rate was 62%.

Discussion and conclusion: All of Us provides a unique opportunity to characterize HTN in the United States. Consistent findings from this study with our prior research highlight the interoperability of our computable phenotypes.

背景:高血压(HTN)仍然是一个重大的公共卫生问题,也是心血管疾病的主要可改变风险因素,而心血管疾病是美国人的主要死因。我们在 "我们所有人 "研究计划中应用了经过验证的高血压可计算表型,以揭示美国高血压和明显耐药高血压(aTRH)的患病率和特征:我们在 "我们所有人 "研究人员工作台(All of Us Researcher Workbench)中建立了一个回顾性队列(2008 年 1 月 1 日至 2023 年 7 月 1 日),识别了所有有年龄数据、至少测量过一次血压(BP)、至少服用过一种降压药、至少有一个 SNOMED "本质性高血压 "诊断代码的成年人:我们确定了 99 461 名符合资格标准的高血压患者。在应用我们的可计算表型后,81 462 名参与者被进一步划分为高血压患者(14.4%)、稳定控制型高血压(SCH)患者(39.5%)和其他高血压患者(46.1%)。与 SCH 患者相比,aTRH 患者年龄更大,更可能是黑人或非裔美国人,社会贫困程度更高,高脂血症和糖尿病等合并症的发病率更高。心力衰竭、慢性肾病和糖尿病是与 aTRH 关系最密切的合并症。β受体阻滞剂是最常用的降压药物。在指数日期,总体血压控制率为 62%:我们所有人》为了解美国高血压的特点提供了一个独特的机会。这项研究的结果与我们之前的研究结果一致,突出了我们可计算表型的互操作性。
{"title":"Characterizing apparent treatment resistant hypertension in the United States: insights from the All of Us Research Program.","authors":"Mona Alshahawey, Eissa Jafari, Steven M Smith, Caitrin W McDonough","doi":"10.1093/jamia/ocae227","DOIUrl":"https://doi.org/10.1093/jamia/ocae227","url":null,"abstract":"<p><strong>Background: </strong>Hypertension (HTN) remains a significant public health concern and the primary modifiable risk factor for cardiovascular disease, which is the leading cause of death in the United States. We applied our validated HTN computable phenotypes within the All of Us Research Program to uncover prevalence and characteristics of HTN and apparent treatment-resistant hypertension (aTRH) in United States.</p><p><strong>Methods: </strong>Within the All of Us Researcher Workbench, we built a retrospective cohort (January 1, 2008-July 1, 2023), identifying all adults with available age data, at least one blood pressure (BP) measurement, prescribed at least one antihypertensive medication, and with at least one SNOMED \"Essential hypertension\" diagnosis code.</p><p><strong>Results: </strong>We identified 99 461 participants with HTN who met the eligibility criteria. Following the application of our computable phenotypes, an overall population of 81 462 were further categorized to aTRH (14.4%), stable-controlled HTN (SCH) (39.5%), and Other HTN (46.1%). Compared to participants with SCH, participants with aTRH were older, more likely to be of Black or African American race, had higher levels of social deprivation, and a heightened prevalence of comorbidities such as hyperlipidemia and diabetes. Heart failure, chronic kidney disease, and diabetes were the comorbidities most strongly associated with aTRH. β-blockers were the most prescribed antihypertensive medication. At index date, the overall BP control rate was 62%.</p><p><strong>Discussion and conclusion: </strong>All of Us provides a unique opportunity to characterize HTN in the United States. Consistent findings from this study with our prior research highlight the interoperability of our computable phenotypes.</p>","PeriodicalId":50016,"journal":{"name":"Journal of the American Medical Informatics Association","volume":null,"pages":null},"PeriodicalIF":4.7,"publicationDate":"2024-08-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142057034","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Generating colloquial radiology reports with large language models. 利用大型语言模型生成口语化的放射学报告。
IF 4.7 2区 医学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-08-23 DOI: 10.1093/jamia/ocae223
Cynthia Crystal Tang, Supriya Nagesh, David A Fussell, Justin Glavis-Bloom, Nina Mishra, Charles Li, Gillean Cortes, Robert Hill, Jasmine Zhao, Angellica Gordon, Joshua Wright, Hayden Troutt, Rod Tarrago, Daniel S Chow

Objectives: Patients are increasingly being given direct access to their medical records. However, radiology reports are written for clinicians and typically contain medical jargon, which can be confusing. One solution is for radiologists to provide a "colloquial" version that is accessible to the layperson. Because manually generating these colloquial translations would represent a significant burden for radiologists, a way to automatically produce accurate, accessible patient-facing reports is desired. We propose a novel method to produce colloquial translations of radiology reports by providing specialized prompts to a large language model (LLM).

Materials and methods: Our method automatically extracts and defines medical terms and includes their definitions in the LLM prompt. Using our method and a naive strategy, translations were generated at 4 different reading levels for 100 de-identified neuroradiology reports from an academic medical center. Translations were evaluated by a panel of radiologists for accuracy, likability, harm potential, and readability.

Results: Our approach translated the Findings and Impression sections at the 8th-grade level with accuracies of 88% and 93%, respectively. Across all grade levels, our approach was 20% more accurate than the baseline method. Overall, translations were more readable than the original reports, as evaluated using standard readability indices.

Conclusion: We find that our translations at the eighth-grade level strike an optimal balance between accuracy and readability. Notably, this corresponds to nationally recognized recommendations for patient-facing health communication. We believe that using this approach to draft patient-accessible reports will benefit patients without significantly increasing the burden on radiologists.

目的:越来越多的患者可以直接查阅自己的医疗记录。然而,放射学报告是为临床医生撰写的,通常包含医学术语,容易引起混淆。一种解决方案是由放射科医生提供外行人也能理解的 "口语化 "版本。由于手动生成这些口语化翻译会给放射科医生带来很大负担,因此需要一种方法来自动生成准确、易懂的面向患者的报告。我们提出了一种新方法,通过向大语言模型(LLM)提供专门提示来生成放射学报告的口语化翻译:我们的方法可自动提取和定义医学术语,并将其定义纳入 LLM 提示中。使用我们的方法和一种天真的策略,在 4 个不同的阅读级别上为一个学术医疗中心的 100 份去标识化神经放射学报告生成了译文。由放射科专家组成的小组对翻译的准确性、可读性、潜在危害性和可读性进行了评估:结果:我们的方法翻译了八年级水平的 "检查结果 "和 "印象 "部分,准确率分别为 88% 和 93%。在所有年级中,我们的方法比基准方法的准确率高出 20%。总体而言,根据标准的可读性指数评估,译文比原始报告更具可读性:我们发现,我们在八年级的翻译在准确性和可读性之间取得了最佳平衡。值得注意的是,这符合国家认可的面向患者的健康交流建议。我们相信,使用这种方法起草患者可读的报告将使患者受益,同时又不会明显加重放射科医生的负担。
{"title":"Generating colloquial radiology reports with large language models.","authors":"Cynthia Crystal Tang, Supriya Nagesh, David A Fussell, Justin Glavis-Bloom, Nina Mishra, Charles Li, Gillean Cortes, Robert Hill, Jasmine Zhao, Angellica Gordon, Joshua Wright, Hayden Troutt, Rod Tarrago, Daniel S Chow","doi":"10.1093/jamia/ocae223","DOIUrl":"https://doi.org/10.1093/jamia/ocae223","url":null,"abstract":"<p><strong>Objectives: </strong>Patients are increasingly being given direct access to their medical records. However, radiology reports are written for clinicians and typically contain medical jargon, which can be confusing. One solution is for radiologists to provide a \"colloquial\" version that is accessible to the layperson. Because manually generating these colloquial translations would represent a significant burden for radiologists, a way to automatically produce accurate, accessible patient-facing reports is desired. We propose a novel method to produce colloquial translations of radiology reports by providing specialized prompts to a large language model (LLM).</p><p><strong>Materials and methods: </strong>Our method automatically extracts and defines medical terms and includes their definitions in the LLM prompt. Using our method and a naive strategy, translations were generated at 4 different reading levels for 100 de-identified neuroradiology reports from an academic medical center. Translations were evaluated by a panel of radiologists for accuracy, likability, harm potential, and readability.</p><p><strong>Results: </strong>Our approach translated the Findings and Impression sections at the 8th-grade level with accuracies of 88% and 93%, respectively. Across all grade levels, our approach was 20% more accurate than the baseline method. Overall, translations were more readable than the original reports, as evaluated using standard readability indices.</p><p><strong>Conclusion: </strong>We find that our translations at the eighth-grade level strike an optimal balance between accuracy and readability. Notably, this corresponds to nationally recognized recommendations for patient-facing health communication. We believe that using this approach to draft patient-accessible reports will benefit patients without significantly increasing the burden on radiologists.</p>","PeriodicalId":50016,"journal":{"name":"Journal of the American Medical Informatics Association","volume":null,"pages":null},"PeriodicalIF":4.7,"publicationDate":"2024-08-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142044248","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Predicting physical functioning status in older adults: insights from wrist accelerometer sensors and derived digital biomarkers of physical activity. 预测老年人的身体机能状况:从手腕加速度传感器和衍生的体力活动数字生物标志物中获得的启示。
IF 4.7 2区 医学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-08-23 DOI: 10.1093/jamia/ocae224
Lingjie Fan, Junhan Zhao, Yao Hu, Junjie Zhang, Xiyue Wang, Fengyi Wang, Mengyi Wu, Tao Lin

Objective: Conventional physical activity (PA) metrics derived from wearable sensors may not capture the cumulative, transitions from sedentary to active, and multidimensional patterns of PA, limiting the ability to predict physical function impairment (PFI) in older adults. This study aims to identify unique temporal patterns and develop novel digital biomarkers from wrist accelerometer data for predicting PFI and its subtypes using explainable artificial intelligence techniques.

Materials and methods: Wrist accelerometer streaming data from 747 participants in the National Health and Aging Trends Study (NHATS) were used to calculate 231 PA features through time-series analysis techniques-Tsfresh. Predictive models for PFI and its subtypes (walking, balance, and extremity strength) were developed using 6 machine learning (ML) algorithms with hyperparameter optimization. The SHapley Additive exPlanations method was employed to interpret the ML models and rank the importance of input features.

Results: Temporal analysis revealed peak PA differences between PFI and healthy controls from 9:00 to 11:00 am. The best-performing model (Gradient boosting Tree) achieved an area under the curve score of 85.93%, accuracy of 81.52%, sensitivity of 77.03%, and specificity of 87.50% when combining wrist accelerometer streaming data (WAPAS) features with demographic data.

Discussion: The novel digital biomarkers, including change quantiles, Fourier transform (FFT) coefficients, and Aggregated (AGG) Linear Trend, outperformed traditional PA metrics in predicting PFI. These findings highlight the importance of capturing the multidimensional nature of PA patterns for PFI.

Conclusion: This study investigates the potential of wrist accelerometer digital biomarkers in predicting PFI and its subtypes in older adults. Integrated PFI monitoring systems with digital biomarkers would improve the current state of remote PFI surveillance.

目的:从可穿戴传感器获得的传统体力活动(PA)指标可能无法捕捉到体力活动的累积、从久坐到活动的过渡以及多维模式,从而限制了预测老年人身体功能损伤(PFI)的能力。本研究旨在利用可解释的人工智能技术,从腕部加速度计数据中识别独特的时间模式并开发新型数字生物标志物,用于预测PFI及其亚型:通过时间序列分析技术计算出231个PA特征。使用 6 种带有超参数优化的机器学习(ML)算法开发了 PFI 及其亚型(步行、平衡和四肢力量)的预测模型。采用 SHapley Additive exPlanations 方法对 ML 模型进行解释,并对输入特征的重要性进行排序:时间分析表明,PFI 和健康对照组在上午 9:00 至 11:00 之间存在 PA 峰值差异。将腕部加速度计流数据(WAPAS)特征与人口统计学数据相结合时,表现最好的模型(梯度提升树)的曲线下面积得分为 85.93%,准确率为 81.52%,灵敏度为 77.03%,特异性为 87.50%:讨论:新型数字生物标志物(包括变化量级、傅立叶变换(FFT)系数和聚合(AGG)线性趋势)在预测 PFI 方面优于传统的 PA 指标。这些发现凸显了捕捉 PA 模式的多维性对于 PFI 的重要性:本研究探讨了手腕加速度计数字生物标志物在预测老年人 PFI 及其亚型方面的潜力。带有数字生物标志物的综合 PFI 监测系统将改善目前远程 PFI 监测的状况。
{"title":"Predicting physical functioning status in older adults: insights from wrist accelerometer sensors and derived digital biomarkers of physical activity.","authors":"Lingjie Fan, Junhan Zhao, Yao Hu, Junjie Zhang, Xiyue Wang, Fengyi Wang, Mengyi Wu, Tao Lin","doi":"10.1093/jamia/ocae224","DOIUrl":"https://doi.org/10.1093/jamia/ocae224","url":null,"abstract":"<p><strong>Objective: </strong>Conventional physical activity (PA) metrics derived from wearable sensors may not capture the cumulative, transitions from sedentary to active, and multidimensional patterns of PA, limiting the ability to predict physical function impairment (PFI) in older adults. This study aims to identify unique temporal patterns and develop novel digital biomarkers from wrist accelerometer data for predicting PFI and its subtypes using explainable artificial intelligence techniques.</p><p><strong>Materials and methods: </strong>Wrist accelerometer streaming data from 747 participants in the National Health and Aging Trends Study (NHATS) were used to calculate 231 PA features through time-series analysis techniques-Tsfresh. Predictive models for PFI and its subtypes (walking, balance, and extremity strength) were developed using 6 machine learning (ML) algorithms with hyperparameter optimization. The SHapley Additive exPlanations method was employed to interpret the ML models and rank the importance of input features.</p><p><strong>Results: </strong>Temporal analysis revealed peak PA differences between PFI and healthy controls from 9:00 to 11:00 am. The best-performing model (Gradient boosting Tree) achieved an area under the curve score of 85.93%, accuracy of 81.52%, sensitivity of 77.03%, and specificity of 87.50% when combining wrist accelerometer streaming data (WAPAS) features with demographic data.</p><p><strong>Discussion: </strong>The novel digital biomarkers, including change quantiles, Fourier transform (FFT) coefficients, and Aggregated (AGG) Linear Trend, outperformed traditional PA metrics in predicting PFI. These findings highlight the importance of capturing the multidimensional nature of PA patterns for PFI.</p><p><strong>Conclusion: </strong>This study investigates the potential of wrist accelerometer digital biomarkers in predicting PFI and its subtypes in older adults. Integrated PFI monitoring systems with digital biomarkers would improve the current state of remote PFI surveillance.</p>","PeriodicalId":50016,"journal":{"name":"Journal of the American Medical Informatics Association","volume":null,"pages":null},"PeriodicalIF":4.7,"publicationDate":"2024-08-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142044249","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Communicating research findings as a return of value to All of Us Research Program participants: insights from staff at Federally Qualified Health Centers. 将研究成果作为对 "全民研究计划 "参与者的价值回报进行宣传:联邦合格卫生中心工作人员的见解。
IF 4.7 2区 医学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-08-22 DOI: 10.1093/jamia/ocae207
Kathryn P Smith, Jenn Holmes, Jennifer Shelley

Objectives: Research participants value learning how their data contributions are advancing health research (ie, data stories). The All of Us Research Program gathered insights from program staff to learn what research topics they think are of interest to participants, what support staff need to communicate data stories, and how staff use data story dissemination tools.

Materials and methods: Using an online 25-item assessment, we collected information from All of Us staff at 7 Federally Qualified Health Centers.

Results: Topics of greatest interest or relevance included income insecurity (83%), diabetes (78%), and mental health (78%). Respondents prioritized in-person outreach in the community (70%) as a preferred setting to share data stories. Familiarity with available dissemination tools varied.

Discussion: Responses support prioritizing materials for in-person outreach and training staff how to use dissemination tools.

Conclusion: The findings will inform All of Us communication strategy, content, materials, and staff training resources to effectively deliver data stories as return of value to participants.

目标:研究参与者重视了解他们的数据贡献是如何推动健康研究的(即数据故事)。我们所有人研究项目收集了项目员工的意见,以了解他们认为参与者感兴趣的研究课题、员工在传播数据故事时需要哪些支持,以及员工如何使用数据故事传播工具:我们使用 25 个项目的在线评估,向 7 个联邦合格医疗中心的 "我们所有人 "项目员工收集信息:最感兴趣或最相关的主题包括收入无保障(83%)、糖尿病(78%)和心理健康(78%)。受访者优先选择在社区(70%)进行面对面宣传,以分享数据故事。对现有传播工具的熟悉程度各不相同:讨论:受访者支持优先使用面对面宣传材料,并培训员工如何使用传播工具:结论:调查结果将为 "我们所有人 "的传播战略、内容、材料和员工培训资源提供参考,从而有效地传播数据故事,为参与者带来价值回报。
{"title":"Communicating research findings as a return of value to All of Us Research Program participants: insights from staff at Federally Qualified Health Centers.","authors":"Kathryn P Smith, Jenn Holmes, Jennifer Shelley","doi":"10.1093/jamia/ocae207","DOIUrl":"https://doi.org/10.1093/jamia/ocae207","url":null,"abstract":"<p><strong>Objectives: </strong>Research participants value learning how their data contributions are advancing health research (ie, data stories). The All of Us Research Program gathered insights from program staff to learn what research topics they think are of interest to participants, what support staff need to communicate data stories, and how staff use data story dissemination tools.</p><p><strong>Materials and methods: </strong>Using an online 25-item assessment, we collected information from All of Us staff at 7 Federally Qualified Health Centers.</p><p><strong>Results: </strong>Topics of greatest interest or relevance included income insecurity (83%), diabetes (78%), and mental health (78%). Respondents prioritized in-person outreach in the community (70%) as a preferred setting to share data stories. Familiarity with available dissemination tools varied.</p><p><strong>Discussion: </strong>Responses support prioritizing materials for in-person outreach and training staff how to use dissemination tools.</p><p><strong>Conclusion: </strong>The findings will inform All of Us communication strategy, content, materials, and staff training resources to effectively deliver data stories as return of value to participants.</p>","PeriodicalId":50016,"journal":{"name":"Journal of the American Medical Informatics Association","volume":null,"pages":null},"PeriodicalIF":4.7,"publicationDate":"2024-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142019381","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Increasing adherence and collecting symptom-specific biometric signals in remote monitoring of heart failure patients: a randomized controlled trial. 提高心衰患者远程监护的依从性并收集症状特异性生物测量信号:随机对照试验。
IF 4.7 2区 医学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-08-22 DOI: 10.1093/jamia/ocae221
Sukanya Mohapatra, Mirna Issa, Vedrana Ivezic, Rose Doherty, Stephanie Marks, Esther Lan, Shawn Chen, Keith Rozett, Lauren Cullen, Wren Reynolds, Rose Rocchio, Gregg C Fonarow, Michael K Ong, William F Speier, Corey W Arnold

Objectives: Mobile health (mHealth) regimens can improve health through the continuous monitoring of biometric parameters paired with appropriate interventions. However, adherence to monitoring tends to decay over time. Our randomized controlled trial sought to determine: (1) if a mobile app with gamification and financial incentives significantly increases adherence to mHealth monitoring in a population of heart failure patients; and (2) if activity data correlate with disease-specific symptoms.

Materials and methods: We recruited individuals with heart failure into a prospective 180-day monitoring study with 3 arms. All 3 arms included monitoring with a connected weight scale and an activity tracker. The second arm included an additional mobile app with gamification, and the third arm included the mobile app and a financial incentive awarded based on adherence to mobile monitoring.

Results: We recruited 111 heart failure patients into the study. We found that the arm including the financial incentive led to significantly higher adherence to activity tracker (95% vs 72.2%, P = .01) and weight (87.5% vs 69.4%, P = .002) monitoring compared to the arm that included the monitoring devices alone. Furthermore, we found a significant correlation between daily steps and daily symptom severity.

Discussion and conclusion: Our findings indicate that mobile apps with added engagement features can be useful tools for improving adherence over time and may thus increase the impact of mHealth-driven interventions. Additionally, activity tracker data can provide passive monitoring of disease burden that may be used to predict future events.

目的:移动保健(mHealth)疗法可通过持续监测生物计量参数并配以适当的干预措施来改善健康状况。然而,随着时间的推移,监测的依从性往往会下降。我们的随机对照试验旨在确定:(1) 带有游戏化和经济激励的移动应用程序是否能显著提高心力衰竭患者对移动医疗监测的依从性;(2) 活动数据是否与疾病特异性症状相关:我们招募了心力衰竭患者参加一项为期 180 天的前瞻性监测研究,研究分为 3 个阶段。所有 3 个观察组都包括使用连接的体重秤和活动追踪器进行监测。第二组包括一个额外的游戏化移动应用程序,第三组包括移动应用程序和基于坚持移动监测的经济奖励:我们招募了 111 名心衰患者参与研究。结果:我们招募了 111 名心衰患者参与研究。我们发现,与仅使用监测设备的研究组相比,使用经济奖励的研究组对活动追踪器(95% vs 72.2%,P = .01)和体重(87.5% vs 69.4%,P = .002)监测的依从性明显更高。此外,我们还发现每日步数与每日症状严重程度之间存在明显的相关性:我们的研究结果表明,增加了参与功能的移动应用程序可以成为提高长期依从性的有用工具,从而提高移动健康干预的效果。此外,活动追踪器数据还能提供对疾病负担的被动监测,可用于预测未来事件。
{"title":"Increasing adherence and collecting symptom-specific biometric signals in remote monitoring of heart failure patients: a randomized controlled trial.","authors":"Sukanya Mohapatra, Mirna Issa, Vedrana Ivezic, Rose Doherty, Stephanie Marks, Esther Lan, Shawn Chen, Keith Rozett, Lauren Cullen, Wren Reynolds, Rose Rocchio, Gregg C Fonarow, Michael K Ong, William F Speier, Corey W Arnold","doi":"10.1093/jamia/ocae221","DOIUrl":"https://doi.org/10.1093/jamia/ocae221","url":null,"abstract":"<p><strong>Objectives: </strong>Mobile health (mHealth) regimens can improve health through the continuous monitoring of biometric parameters paired with appropriate interventions. However, adherence to monitoring tends to decay over time. Our randomized controlled trial sought to determine: (1) if a mobile app with gamification and financial incentives significantly increases adherence to mHealth monitoring in a population of heart failure patients; and (2) if activity data correlate with disease-specific symptoms.</p><p><strong>Materials and methods: </strong>We recruited individuals with heart failure into a prospective 180-day monitoring study with 3 arms. All 3 arms included monitoring with a connected weight scale and an activity tracker. The second arm included an additional mobile app with gamification, and the third arm included the mobile app and a financial incentive awarded based on adherence to mobile monitoring.</p><p><strong>Results: </strong>We recruited 111 heart failure patients into the study. We found that the arm including the financial incentive led to significantly higher adherence to activity tracker (95% vs 72.2%, P = .01) and weight (87.5% vs 69.4%, P = .002) monitoring compared to the arm that included the monitoring devices alone. Furthermore, we found a significant correlation between daily steps and daily symptom severity.</p><p><strong>Discussion and conclusion: </strong>Our findings indicate that mobile apps with added engagement features can be useful tools for improving adherence over time and may thus increase the impact of mHealth-driven interventions. Additionally, activity tracker data can provide passive monitoring of disease burden that may be used to predict future events.</p>","PeriodicalId":50016,"journal":{"name":"Journal of the American Medical Informatics Association","volume":null,"pages":null},"PeriodicalIF":4.7,"publicationDate":"2024-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142037585","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Visualizing Multilayer Spatiotemporal Epidemiological Data with Animated Geocircles. 用动画地圈可视化多层时空流行病学数据
IF 4.7 2区 医学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-08-21 DOI: 10.1093/jamia/ocae234
Brian Ondov, Harsh B Patel, Ai-Te Kuo, John Kastner, Yunheng Han, Hong Wei, Niklas Elmqvist, Hanan Samet

Objective: The COVID-19 pandemic emphasized the value of geospatial visual analytics for both epidemiologists and the general public. However, systems struggled to encode temporal and geospatial trends of multiple, potentially interacting variables, such as active cases, deaths, and vaccinations. We sought to ask (1) how epidemiologists interact with visual analytics tools, (2) how multiple, time-varying, geospatial variables can be conveyed in a unified view, and (3) how complex spatiotemporal encodings affect utility for both experts and non-experts.

Materials and methods: We propose encoding variables with animated, concentric, hollow circles, allowing multiple variables via color encoding and avoiding occlusion problems, and we implement this method in a browser-based tool called CoronaViz. We conduct task-based evaluations with non-experts, as well as in-depth interviews and observational sessions with epidemiologists, covering a range of tools and encodings.

Results: Sessions with epidemiologists confirmed the importance of multivariate, spatiotemporal queries and the utility of CoronaViz for answering them, while providing direction for future development. Non-experts tasked with performing spatiotemporal queries unanimously preferred animation to multi-view dashboards.

Discussion: We find that conveying complex, multivariate data necessarily involves trade-offs. Yet, our studies suggest the importance of complementary visualization strategies, with our animated multivariate spatiotemporal encoding filling important needs for exploration and presentation.

Conclusion: CoronaViz's unique ability to convey multiple, time-varying, geospatial variables makes it both a valuable addition to interactive COVID-19 dashboards and a platform for empowering experts and the public during future disease outbreaks. CoronaViz is open-source and a live instance is freely hosted at http://coronaviz.umiacs.io.

目的:COVID-19 大流行强调了地理空间可视分析对流行病学家和普通大众的价值。然而,该系统在编码多个可能相互作用的变量(如活动病例、死亡病例和疫苗接种)的时间和地理空间趋势方面举步维艰。我们试图探究:(1) 流行病学家如何与可视化分析工具互动;(2) 如何在统一的视图中传达多个时变的地理空间变量;(3) 复杂的时空编码如何影响专家和非专家的实用性:我们建议使用动画同心空心圆对变量进行编码,通过颜色编码允许使用多个变量,并避免遮挡问题,我们在基于浏览器的工具 CoronaViz 中实现了这种方法。我们对非专家进行了基于任务的评估,并对流行病学家进行了深入访谈和观察,涵盖了一系列工具和编码:结果:与流行病学家的会谈证实了多变量时空查询的重要性以及 CoronaViz 在回答这些问题时的实用性,同时也为未来的发展指明了方向。执行时空查询任务的非专业人员一致认为动画比多视图仪表盘更受欢迎:讨论:我们发现,传递复杂的多变量数据必然需要权衡利弊。然而,我们的研究表明,互补的可视化策略非常重要,我们的多变量时空动画编码满足了探索和展示的重要需求:CoronaViz在表达多种时变地理空间变量方面的独特能力使其成为 COVID-19 交互式仪表盘的重要补充,同时也是在未来疾病爆发期间增强专家和公众能力的平台。CoronaViz 是开源的,其实时实例可在 http://coronaviz.umiacs.io 免费托管。
{"title":"Visualizing Multilayer Spatiotemporal Epidemiological Data with Animated Geocircles.","authors":"Brian Ondov, Harsh B Patel, Ai-Te Kuo, John Kastner, Yunheng Han, Hong Wei, Niklas Elmqvist, Hanan Samet","doi":"10.1093/jamia/ocae234","DOIUrl":"https://doi.org/10.1093/jamia/ocae234","url":null,"abstract":"<p><strong>Objective: </strong>The COVID-19 pandemic emphasized the value of geospatial visual analytics for both epidemiologists and the general public. However, systems struggled to encode temporal and geospatial trends of multiple, potentially interacting variables, such as active cases, deaths, and vaccinations. We sought to ask (1) how epidemiologists interact with visual analytics tools, (2) how multiple, time-varying, geospatial variables can be conveyed in a unified view, and (3) how complex spatiotemporal encodings affect utility for both experts and non-experts.</p><p><strong>Materials and methods: </strong>We propose encoding variables with animated, concentric, hollow circles, allowing multiple variables via color encoding and avoiding occlusion problems, and we implement this method in a browser-based tool called CoronaViz. We conduct task-based evaluations with non-experts, as well as in-depth interviews and observational sessions with epidemiologists, covering a range of tools and encodings.</p><p><strong>Results: </strong>Sessions with epidemiologists confirmed the importance of multivariate, spatiotemporal queries and the utility of CoronaViz for answering them, while providing direction for future development. Non-experts tasked with performing spatiotemporal queries unanimously preferred animation to multi-view dashboards.</p><p><strong>Discussion: </strong>We find that conveying complex, multivariate data necessarily involves trade-offs. Yet, our studies suggest the importance of complementary visualization strategies, with our animated multivariate spatiotemporal encoding filling important needs for exploration and presentation.</p><p><strong>Conclusion: </strong>CoronaViz's unique ability to convey multiple, time-varying, geospatial variables makes it both a valuable addition to interactive COVID-19 dashboards and a platform for empowering experts and the public during future disease outbreaks. CoronaViz is open-source and a live instance is freely hosted at http://coronaviz.umiacs.io.</p>","PeriodicalId":50016,"journal":{"name":"Journal of the American Medical Informatics Association","volume":null,"pages":null},"PeriodicalIF":4.7,"publicationDate":"2024-08-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142019382","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Development of electronic health record based algorithms to identify individuals with diabetic retinopathy. 开发基于电子健康记录的算法,以识别糖尿病视网膜病变患者。
IF 4.7 2区 医学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-08-19 DOI: 10.1093/jamia/ocae213
Joseph H Breeyear, Sabrina L Mitchell, Cari L Nealon, Jacklyn N Hellwege, Brian Charest, Anjali Khakharia, Christopher W Halladay, Janine Yang, Gustavo A Garriga, Otis D Wilson, Til B Basnet, Adriana M Hung, Peter D Reaven, James B Meigs, Mary K Rhee, Yang Sun, Mary G Lynch, Lucia Sobrin, Milam A Brantley, Yan V Sun, Peter W Wilson, Sudha K Iyengar, Neal S Peachey, Lawrence S Phillips, Todd L Edwards, Ayush Giri

Objectives: To develop, validate, and implement algorithms to identify diabetic retinopathy (DR) cases and controls from electronic health care records (EHRs).

Materials and methods: We developed and validated electronic health record (EHR)-based algorithms to identify DR cases and individuals with type I or II diabetes without DR (controls) in 3 independent EHR systems: Vanderbilt University Medical Center Synthetic Derivative (VUMC), the VA Northeast Ohio Healthcare System (VANEOHS), and Massachusetts General Brigham (MGB). Cases were required to meet 1 of the following 3 criteria: (1) 2 or more dates with any DR ICD-9/10 code documented in the EHR, (2) at least one affirmative health-factor or EPIC code for DR along with an ICD9/10 code for DR on a different day, or (3) at least one ICD-9/10 code for any DR occurring within 24 hours of an ophthalmology examination. Criteria for controls included affirmative evidence for diabetes as well as an ophthalmology examination.

Results: The algorithms, developed and evaluated in VUMC through manual chart review, resulted in a positive predictive value (PPV) of 0.93 for cases and negative predictive value (NPV) of 0.91 for controls. Implementation of algorithms yielded similar metrics in VANEOHS (PPV = 0.94; NPV = 0.86) and lower in MGB (PPV = 0.84; NPV = 0.76). In comparison, the algorithm for DR implemented in Phenome-wide association study (PheWAS) in VUMC yielded similar PPV (0.92) but substantially reduced NPV (0.48). Implementation of the algorithms to the Million Veteran Program identified over 62 000 DR cases with genetic data including 14 549 African Americans and 6209 Hispanics with DR.

Conclusions/discussion: We demonstrate the robustness of the algorithms at 3 separate healthcare centers, with a minimum PPV of 0.84 and substantially improved NPV than existing automated methods. We strongly encourage independent validation and incorporation of features unique to each EHR to enhance algorithm performance for DR cases and controls.

目的开发、验证和实施从电子医疗记录(EHR)中识别糖尿病视网膜病变(DR)病例和对照组的算法:我们开发并验证了基于电子健康记录(EHR)的算法,以在 3 个独立的电子健康记录系统中识别糖尿病视网膜病变病例和无糖尿病视网膜病变的 I 型或 II 型糖尿病患者(对照组):范德比尔特大学医疗中心合成衍生系统 (VUMC)、退伍军人俄亥俄州东北部医疗保健系统 (VANEOHS) 和麻省总医院 (MGB)。病例必须符合以下 3 个标准中的 1 个:(1) 电子病历中记录了 2 个或 2 个以上日期的任何 DR ICD-9/10 代码;(2) 至少有一个肯定的健康因素或 EPIC 代码为 DR,同时有一个 ICD9/10 代码为不同日期的 DR;或 (3) 至少有一个 ICD-9/10 代码为眼科检查后 24 小时内发生的任何 DR。对照组的标准包括糖尿病确诊证据和眼科检查结果:VUMC 通过人工病历审查开发并评估了这些算法,结果显示病例的阳性预测值 (PPV) 为 0.93,对照组的阴性预测值 (NPV) 为 0.91。在 VANEOHS(PPV = 0.94;NPV = 0.86)和 MGB(PPV = 0.84;NPV = 0.76)中,算法的实施产生了类似的指标。相比之下,VUMC 在全基因组关联研究 (Phenome-wide association study, PheWAS) 中采用的 DR 算法的 PPV 值(0.92)与之相似,但 NPV 值(0.48)却大大降低。在 "百万退伍军人计划"(Million Veteran Program)中使用这些算法发现了 62 000 多例具有遗传数据的 DR 病例,其中包括 14 549 名非洲裔美国人和 6209 名患有 DR 的西班牙裔美国人:我们在 3 个独立的医疗保健中心证明了算法的稳健性,PPV 最低为 0.84,NPV 比现有的自动方法大幅提高。我们强烈鼓励对每种电子病历进行独立验证并纳入其特有功能,以提高 DR 病例和对照的算法性能。
{"title":"Development of electronic health record based algorithms to identify individuals with diabetic retinopathy.","authors":"Joseph H Breeyear, Sabrina L Mitchell, Cari L Nealon, Jacklyn N Hellwege, Brian Charest, Anjali Khakharia, Christopher W Halladay, Janine Yang, Gustavo A Garriga, Otis D Wilson, Til B Basnet, Adriana M Hung, Peter D Reaven, James B Meigs, Mary K Rhee, Yang Sun, Mary G Lynch, Lucia Sobrin, Milam A Brantley, Yan V Sun, Peter W Wilson, Sudha K Iyengar, Neal S Peachey, Lawrence S Phillips, Todd L Edwards, Ayush Giri","doi":"10.1093/jamia/ocae213","DOIUrl":"10.1093/jamia/ocae213","url":null,"abstract":"<p><strong>Objectives: </strong>To develop, validate, and implement algorithms to identify diabetic retinopathy (DR) cases and controls from electronic health care records (EHRs).</p><p><strong>Materials and methods: </strong>We developed and validated electronic health record (EHR)-based algorithms to identify DR cases and individuals with type I or II diabetes without DR (controls) in 3 independent EHR systems: Vanderbilt University Medical Center Synthetic Derivative (VUMC), the VA Northeast Ohio Healthcare System (VANEOHS), and Massachusetts General Brigham (MGB). Cases were required to meet 1 of the following 3 criteria: (1) 2 or more dates with any DR ICD-9/10 code documented in the EHR, (2) at least one affirmative health-factor or EPIC code for DR along with an ICD9/10 code for DR on a different day, or (3) at least one ICD-9/10 code for any DR occurring within 24 hours of an ophthalmology examination. Criteria for controls included affirmative evidence for diabetes as well as an ophthalmology examination.</p><p><strong>Results: </strong>The algorithms, developed and evaluated in VUMC through manual chart review, resulted in a positive predictive value (PPV) of 0.93 for cases and negative predictive value (NPV) of 0.91 for controls. Implementation of algorithms yielded similar metrics in VANEOHS (PPV = 0.94; NPV = 0.86) and lower in MGB (PPV = 0.84; NPV = 0.76). In comparison, the algorithm for DR implemented in Phenome-wide association study (PheWAS) in VUMC yielded similar PPV (0.92) but substantially reduced NPV (0.48). Implementation of the algorithms to the Million Veteran Program identified over 62 000 DR cases with genetic data including 14 549 African Americans and 6209 Hispanics with DR.</p><p><strong>Conclusions/discussion: </strong>We demonstrate the robustness of the algorithms at 3 separate healthcare centers, with a minimum PPV of 0.84 and substantially improved NPV than existing automated methods. We strongly encourage independent validation and incorporation of features unique to each EHR to enhance algorithm performance for DR cases and controls.</p>","PeriodicalId":50016,"journal":{"name":"Journal of the American Medical Informatics Association","volume":null,"pages":null},"PeriodicalIF":4.7,"publicationDate":"2024-08-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142001161","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of the American Medical Informatics Association
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1