Predicting Hospitalization Risk Among Home Care Residents in the United Kingdom: Development and Validation of a Machine Learning-Based Predictive Model

Nathan Windle, Azeem Alam, Horus Patel, Jonathan M. Street, Megan Lathwood, Tessa Farrington, M. Maruthappu
{"title":"Predicting Hospitalization Risk Among Home Care Residents in the United Kingdom: Development and Validation of a Machine Learning-Based Predictive Model","authors":"Nathan Windle, Azeem Alam, Horus Patel, Jonathan M. Street, Megan Lathwood, Tessa Farrington, M. Maruthappu","doi":"10.1177/10848223241253839","DOIUrl":null,"url":null,"abstract":"Preventable hospital admissions in elderly home care residents are a major socioeconomic burden, whilst early detection of deterioration may improve outcomes. Our goal was to develop and validate a machine learning-based algorithm to predict hospitalization risk among home care users. Our primary outcome was hospitalization. An existing risk score (1-5) was assessed for its discriminatory capacity over time. We subsequently developed a new machine learning model using carer concerns, service user demographics, and other home care data between January and July 2021. We randomly selected 150 service user records for validation, which were evaluated by both the model and 10 clinicians (9 doctors and 1 nurse) to compare prediction time and accuracy to human experts. Comparison between model and human was via area under the receiver operating characteristic curve (AUC). A score of 5 conferred an 8x higher likelihood of hospitalization in the subsequent 7 days (15.4% vs 1.8%, p < .05), compared to a score of 1. The new model and risk score increased performance, detecting 182 hospitalizations/month (3.7x chance). The AUC for the model was significantly higher than for clinicians (0.87 vs 0.41-0.57, respectively; p < .05). The model took <1 minute, while clinicians typically took over 40 minutes. A risk prediction model using carer concerns and other home care data features detects 3.7x more hospitalizations than chance. The model is faster and more accurate than human clinicians, enabling low-cost scale-up. This study supports linking the model to a triage and intervention service to reduce preventable hospitalizations in the home care sector.","PeriodicalId":512411,"journal":{"name":"Home Health Care Management &amp; Practice","volume":"53 14","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-05-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Home Health Care Management &amp; Practice","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1177/10848223241253839","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Preventable hospital admissions in elderly home care residents are a major socioeconomic burden, whilst early detection of deterioration may improve outcomes. Our goal was to develop and validate a machine learning-based algorithm to predict hospitalization risk among home care users. Our primary outcome was hospitalization. An existing risk score (1-5) was assessed for its discriminatory capacity over time. We subsequently developed a new machine learning model using carer concerns, service user demographics, and other home care data between January and July 2021. We randomly selected 150 service user records for validation, which were evaluated by both the model and 10 clinicians (9 doctors and 1 nurse) to compare prediction time and accuracy to human experts. Comparison between model and human was via area under the receiver operating characteristic curve (AUC). A score of 5 conferred an 8x higher likelihood of hospitalization in the subsequent 7 days (15.4% vs 1.8%, p < .05), compared to a score of 1. The new model and risk score increased performance, detecting 182 hospitalizations/month (3.7x chance). The AUC for the model was significantly higher than for clinicians (0.87 vs 0.41-0.57, respectively; p < .05). The model took <1 minute, while clinicians typically took over 40 minutes. A risk prediction model using carer concerns and other home care data features detects 3.7x more hospitalizations than chance. The model is faster and more accurate than human clinicians, enabling low-cost scale-up. This study supports linking the model to a triage and intervention service to reduce preventable hospitalizations in the home care sector.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
预测英国家庭护理居民的住院风险:基于机器学习的预测模型的开发与验证
老年居家护理居民可预防的入院治疗是一项重大的社会经济负担,而及早发现病情恶化可能会改善治疗效果。我们的目标是开发并验证一种基于机器学习的算法,用于预测居家养老用户的住院风险。我们的主要结果是住院。我们评估了现有风险评分(1-5 分)在一段时间内的判别能力。随后,我们利用护理人员的关注点、服务使用者的人口统计数据以及 2021 年 1 月至 7 月期间的其他家庭护理数据,开发了一个新的机器学习模型。我们随机选取了 150 份服务用户记录进行验证,由模型和 10 名临床医生(9 名医生和 1 名护士)对这些记录进行评估,将预测时间和准确性与人类专家进行比较。模型和人类专家之间的比较是通过接收者操作特征曲线下面积(AUC)进行的。与评分为 1 的人相比,评分为 5 的人在随后 7 天内住院的可能性要高出 8 倍(15.4% vs 1.8%,p < .05)。模型的AUC明显高于临床医生(分别为0.87 vs 0.41-0.57; p < .05)。该模型耗时小于 1 分钟,而临床医生通常需要 40 分钟以上。风险预测模型使用了护理人员的关注点和其他家庭护理数据特征,检测到的住院率是概率的 3.7 倍。该模型比人类临床医生更快、更准确,可实现低成本扩展。这项研究支持将该模型与分诊和干预服务联系起来,以减少家庭护理领域可预防的住院治疗。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Using Interpersonal Continuity of Care in Home Health Physical Therapy to Reduce Hospital Readmissions Ensuring Safe Medication Assessment for Older Adults: A Pilot Study Enhancing Physical Activity Recommendations to Support Cognition in Homecare: A Quality Improvement Project Predicting Hospitalization Risk Among Home Care Residents in the United Kingdom: Development and Validation of a Machine Learning-Based Predictive Model Coconstructing a Flexible At-Home Respite Model For and With Caregivers of Older Adults: A Living Lab Approach
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1