建立时间序列模型预测家庭医疗保健住院风险:对发展、准确性和公平性的洞察。

IF 4.2 2区 医学 Q2 GERIATRICS & GERONTOLOGY Journal of the American Medical Directors Association Pub Date : 2024-12-26 DOI:10.1016/j.jamda.2024.105417
Maxim Topaz, Anahita Davoudi, Lauren Evans, Sridevi Sridharan, Jiyoun Song, Sena Chae, Yolanda Barrón, Mollie Hobensack, Danielle Scharp, Kenrick Cato, Sarah Collins Rossetti, Piotr Kapela, Zidu Xu, Pallavi Gupta, Zhihong Zhang, Margaret V Mcdonald, Kathryn H Bowles
{"title":"建立时间序列模型预测家庭医疗保健住院风险:对发展、准确性和公平性的洞察。","authors":"Maxim Topaz, Anahita Davoudi, Lauren Evans, Sridevi Sridharan, Jiyoun Song, Sena Chae, Yolanda Barrón, Mollie Hobensack, Danielle Scharp, Kenrick Cato, Sarah Collins Rossetti, Piotr Kapela, Zidu Xu, Pallavi Gupta, Zhihong Zhang, Margaret V Mcdonald, Kathryn H Bowles","doi":"10.1016/j.jamda.2024.105417","DOIUrl":null,"url":null,"abstract":"<p><strong>Objectives: </strong>Home health care (HHC) serves more than 5 million older adults annually in the United States, aiming to prevent unnecessary hospitalizations and emergency department (ED) visits. Despite efforts, up to 25% of patients in HHC experience these adverse events. The underutilization of clinical notes, aggregated data approaches, and potential demographic biases have limited previous HHC risk prediction models. This study aimed to develop a time-series risk model to predict hospitalizations and ED visits in patients in HHC, examine model performance over various prediction windows, identify top predictive variables and map them to data standards, and assess model fairness across demographic subgroups.</p><p><strong>Setting and participants: </strong>A total of 27,222 HHC episodes between 2015 and 2017.</p><p><strong>Methods: </strong>The study used health care process modeling of electronic health records, including clinical notes processed with natural language processing techniques and Medicare claims data. A Light Gradient Boosting Machine algorithm was used to develop the risk prediction model, with performance evaluated using 5-fold cross-validation. Model fairness was assessed across gender, race/ethnicity, and socioeconomic subgroups.</p><p><strong>Results: </strong>The model achieved high predictive performance, with an F1 score of 0.84 for a 5-day prediction window. Twenty top predictive variables were identified, including novel indicators such as the length of nurse-patient visits and visit frequency. Eighty-five percent of these variables mapped completely to the US Core Data for Interoperability standard. Fairness assessment revealed performance disparities across demographic and socioeconomic groups, with lower model effectiveness for more historically underserved populations.</p><p><strong>Conclusions and implications: </strong>This study developed a robust time-series risk model for predicting adverse events in patients in HHC, incorporating diverse data types and demonstrating high predictive accuracy. The findings highlight the importance of considering established and novel risk factors in HHC. Importantly, the observed performance disparities across subgroups emphasize the need for fairness adjustments to ensure equitable risk prediction across all patient populations.</p>","PeriodicalId":17180,"journal":{"name":"Journal of the American Medical Directors Association","volume":" ","pages":"105417"},"PeriodicalIF":4.2000,"publicationDate":"2024-12-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Building a Time-Series Model to Predict Hospitalization Risks in Home Health Care: Insights Into Development, Accuracy, and Fairness.\",\"authors\":\"Maxim Topaz, Anahita Davoudi, Lauren Evans, Sridevi Sridharan, Jiyoun Song, Sena Chae, Yolanda Barrón, Mollie Hobensack, Danielle Scharp, Kenrick Cato, Sarah Collins Rossetti, Piotr Kapela, Zidu Xu, Pallavi Gupta, Zhihong Zhang, Margaret V Mcdonald, Kathryn H Bowles\",\"doi\":\"10.1016/j.jamda.2024.105417\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Objectives: </strong>Home health care (HHC) serves more than 5 million older adults annually in the United States, aiming to prevent unnecessary hospitalizations and emergency department (ED) visits. Despite efforts, up to 25% of patients in HHC experience these adverse events. The underutilization of clinical notes, aggregated data approaches, and potential demographic biases have limited previous HHC risk prediction models. This study aimed to develop a time-series risk model to predict hospitalizations and ED visits in patients in HHC, examine model performance over various prediction windows, identify top predictive variables and map them to data standards, and assess model fairness across demographic subgroups.</p><p><strong>Setting and participants: </strong>A total of 27,222 HHC episodes between 2015 and 2017.</p><p><strong>Methods: </strong>The study used health care process modeling of electronic health records, including clinical notes processed with natural language processing techniques and Medicare claims data. A Light Gradient Boosting Machine algorithm was used to develop the risk prediction model, with performance evaluated using 5-fold cross-validation. Model fairness was assessed across gender, race/ethnicity, and socioeconomic subgroups.</p><p><strong>Results: </strong>The model achieved high predictive performance, with an F1 score of 0.84 for a 5-day prediction window. Twenty top predictive variables were identified, including novel indicators such as the length of nurse-patient visits and visit frequency. Eighty-five percent of these variables mapped completely to the US Core Data for Interoperability standard. Fairness assessment revealed performance disparities across demographic and socioeconomic groups, with lower model effectiveness for more historically underserved populations.</p><p><strong>Conclusions and implications: </strong>This study developed a robust time-series risk model for predicting adverse events in patients in HHC, incorporating diverse data types and demonstrating high predictive accuracy. The findings highlight the importance of considering established and novel risk factors in HHC. Importantly, the observed performance disparities across subgroups emphasize the need for fairness adjustments to ensure equitable risk prediction across all patient populations.</p>\",\"PeriodicalId\":17180,\"journal\":{\"name\":\"Journal of the American Medical Directors Association\",\"volume\":\" \",\"pages\":\"105417\"},\"PeriodicalIF\":4.2000,\"publicationDate\":\"2024-12-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of the American Medical Directors Association\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1016/j.jamda.2024.105417\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"GERIATRICS & GERONTOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of the American Medical Directors Association","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.jamda.2024.105417","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"GERIATRICS & GERONTOLOGY","Score":null,"Total":0}
引用次数: 0

摘要

目的:家庭保健(HHC)每年为美国500多万老年人提供服务,旨在防止不必要的住院和急诊(ED)就诊。尽管做出了努力,但高达25%的HHC患者经历了这些不良事件。临床记录的利用不足、汇总数据方法和潜在的人口统计学偏差限制了以前的HHC风险预测模型。本研究旨在建立一个时间序列风险模型来预测HHC患者的住院和急诊科就诊,在各种预测窗口中检查模型的性能,确定最佳预测变量并将其映射到数据标准,并评估模型在人口统计亚组中的公平性。环境和参与者:2015年至2017年期间共有27,222例HHC发作。方法:采用电子健康记录的医疗过程建模,包括用自然语言处理技术处理的临床记录和医疗保险索赔数据。采用光梯度增强机(Light Gradient Boosting Machine)算法建立风险预测模型,并通过5次交叉验证对其性能进行评估。模型公平性是在性别、种族/民族和社会经济亚群体中进行评估的。结果:该模型具有较高的预测性能,5天预测窗口的F1得分为0.84。确定了20个最重要的预测变量,包括新的指标,如护患访问的长度和访问频率。85%的这些变量完全映射到美国核心数据互操作性标准。公平评估揭示了人口统计和社会经济群体之间的表现差异,对于历史上服务不足的人群,模型的有效性较低。结论和意义:本研究建立了一个预测HHC患者不良事件的稳健时间序列风险模型,纳入了不同的数据类型,并显示出较高的预测准确性。研究结果强调了在HHC中考虑现有和新的危险因素的重要性。重要的是,观察到的亚组间的表现差异强调了公平调整的必要性,以确保所有患者群体的公平风险预测。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Building a Time-Series Model to Predict Hospitalization Risks in Home Health Care: Insights Into Development, Accuracy, and Fairness.

Objectives: Home health care (HHC) serves more than 5 million older adults annually in the United States, aiming to prevent unnecessary hospitalizations and emergency department (ED) visits. Despite efforts, up to 25% of patients in HHC experience these adverse events. The underutilization of clinical notes, aggregated data approaches, and potential demographic biases have limited previous HHC risk prediction models. This study aimed to develop a time-series risk model to predict hospitalizations and ED visits in patients in HHC, examine model performance over various prediction windows, identify top predictive variables and map them to data standards, and assess model fairness across demographic subgroups.

Setting and participants: A total of 27,222 HHC episodes between 2015 and 2017.

Methods: The study used health care process modeling of electronic health records, including clinical notes processed with natural language processing techniques and Medicare claims data. A Light Gradient Boosting Machine algorithm was used to develop the risk prediction model, with performance evaluated using 5-fold cross-validation. Model fairness was assessed across gender, race/ethnicity, and socioeconomic subgroups.

Results: The model achieved high predictive performance, with an F1 score of 0.84 for a 5-day prediction window. Twenty top predictive variables were identified, including novel indicators such as the length of nurse-patient visits and visit frequency. Eighty-five percent of these variables mapped completely to the US Core Data for Interoperability standard. Fairness assessment revealed performance disparities across demographic and socioeconomic groups, with lower model effectiveness for more historically underserved populations.

Conclusions and implications: This study developed a robust time-series risk model for predicting adverse events in patients in HHC, incorporating diverse data types and demonstrating high predictive accuracy. The findings highlight the importance of considering established and novel risk factors in HHC. Importantly, the observed performance disparities across subgroups emphasize the need for fairness adjustments to ensure equitable risk prediction across all patient populations.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
11.10
自引率
6.60%
发文量
472
审稿时长
44 days
期刊介绍: JAMDA, the official journal of AMDA - The Society for Post-Acute and Long-Term Care Medicine, is a leading peer-reviewed publication that offers practical information and research geared towards healthcare professionals in the post-acute and long-term care fields. It is also a valuable resource for policy-makers, organizational leaders, educators, and advocates. The journal provides essential information for various healthcare professionals such as medical directors, attending physicians, nurses, consultant pharmacists, geriatric psychiatrists, nurse practitioners, physician assistants, physical and occupational therapists, social workers, and others involved in providing, overseeing, and promoting quality
期刊最新文献
Medication Use in People Aged 90 Years and Older: A Nationwide Study. Adherence to Guideline Recommendations on Psychotropic Drug Use for Challenging Behavior in Dementia. Quality and Safety Indicators for Care Transitions by Older Adults: A Scoping Review. Experiences of Care Aides Caring for Residents with a History of Psychological Trauma in Long-Term Care Homes (Nursing Homes)-Early Findings. Association between Multimorbidity and End-of-Life Outcomes among Middle-Aged and Older Adults: Evidence from 28 Countries.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1