Enhancing Pressure Injury Surveillance Using Natural Language Processing.

IF 1.7 3区 医学 Q3 HEALTH CARE SCIENCES & SERVICES Journal of Patient Safety Pub Date : 2024-03-01 Epub Date: 2023-12-26 DOI:10.1097/PTS.0000000000001193
Carly E Milliren, Al Ozonoff, Kerri A Fournier, Jennifer Welcher, Assaf Landschaft, Amir A Kimia
{"title":"Enhancing Pressure Injury Surveillance Using Natural Language Processing.","authors":"Carly E Milliren, Al Ozonoff, Kerri A Fournier, Jennifer Welcher, Assaf Landschaft, Amir A Kimia","doi":"10.1097/PTS.0000000000001193","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>This study assessed the feasibility of nursing handoff notes to identify underreported hospital-acquired pressure injury (HAPI) events.</p><p><strong>Methods: </strong>We have established a natural language processing-assisted manual review process and workflow for data extraction from a corpus of nursing notes across all medical inpatient and intensive care units in a tertiary care pediatric center. This system is trained by 2 domain experts. Our workflow started with keywords around HAPI and treatments, then regular expressions, distributive semantics, and finally a document classifier. We generated 3 models: a tri-gram classifier, binary logistic regression model using the regular expressions as predictors, and a random forest model using both models together. Our final output presented to the event screener was generated using a random forest model validated using derivation and validation sets.</p><p><strong>Results: </strong>Our initial corpus involved 70,981 notes during a 1-year period from 5484 unique admissions for 4220 patients. Our interrater human reviewer agreement on identifying HAPI was high ( κ = 0.67; 95% confidence interval [CI], 0.58-0.75). Our random forest model had 95% sensitivity (95% CI, 90.6%-99.3%), 71.2% specificity (95% CI, 65.1%-77.2%), and 78.7% accuracy (95% CI, 74.1%-83.2%). A total of 264 notes from 148 unique admissions (2.7% of all admissions) were identified describing likely HAPI. Sixty-one described new injuries, and 64 describe known yet possibly evolving injuries. Relative to the total patient population during our study period, HAPI incidence was 11.9 per 1000 discharges, and incidence rate was 1.2 per 1000 bed-days.</p><p><strong>Conclusions: </strong>Natural language processing-based surveillance is proven to be feasible and high yield using nursing handoff notes.</p>","PeriodicalId":48901,"journal":{"name":"Journal of Patient Safety","volume":null,"pages":null},"PeriodicalIF":1.7000,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10922576/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Patient Safety","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1097/PTS.0000000000001193","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/12/26 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0

Abstract

Objective: This study assessed the feasibility of nursing handoff notes to identify underreported hospital-acquired pressure injury (HAPI) events.

Methods: We have established a natural language processing-assisted manual review process and workflow for data extraction from a corpus of nursing notes across all medical inpatient and intensive care units in a tertiary care pediatric center. This system is trained by 2 domain experts. Our workflow started with keywords around HAPI and treatments, then regular expressions, distributive semantics, and finally a document classifier. We generated 3 models: a tri-gram classifier, binary logistic regression model using the regular expressions as predictors, and a random forest model using both models together. Our final output presented to the event screener was generated using a random forest model validated using derivation and validation sets.

Results: Our initial corpus involved 70,981 notes during a 1-year period from 5484 unique admissions for 4220 patients. Our interrater human reviewer agreement on identifying HAPI was high ( κ = 0.67; 95% confidence interval [CI], 0.58-0.75). Our random forest model had 95% sensitivity (95% CI, 90.6%-99.3%), 71.2% specificity (95% CI, 65.1%-77.2%), and 78.7% accuracy (95% CI, 74.1%-83.2%). A total of 264 notes from 148 unique admissions (2.7% of all admissions) were identified describing likely HAPI. Sixty-one described new injuries, and 64 describe known yet possibly evolving injuries. Relative to the total patient population during our study period, HAPI incidence was 11.9 per 1000 discharges, and incidence rate was 1.2 per 1000 bed-days.

Conclusions: Natural language processing-based surveillance is proven to be feasible and high yield using nursing handoff notes.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
利用自然语言处理技术加强压力伤害监测。
目的本研究评估了护理交接班记录识别未充分报告的医院获得性压伤(HAPI)事件的可行性:我们建立了一个自然语言处理辅助人工审核流程和工作流程,用于从一个三级医疗儿科中心所有内科住院和重症监护病房的护理记录语料库中提取数据。该系统由两名领域专家进行培训。我们的工作流程从围绕 HAPI 和治疗的关键词开始,然后是正则表达式、分布语义,最后是文档分类器。我们生成了 3 个模型:一个三元组分类器,一个使用正则表达式作为预测因子的二元逻辑回归模型,以及一个同时使用这两个模型的随机森林模型。我们向事件筛选器提供的最终输出是通过使用衍生集和验证集验证的随机森林模型生成的:我们的初始语料库涉及 4220 名患者的 5484 份独特入院记录中的 70981 份记录,时间跨度为 1 年。在识别 HAPI 方面,评阅者之间的一致性很高(κ = 0.67;95% 置信区间 [CI],0.58-0.75)。我们的随机森林模型具有 95% 的灵敏度(95% CI,90.6%-99.3%)、71.2% 的特异性(95% CI,65.1%-77.2%)和 78.7% 的准确性(95% CI,74.1%-83.2%)。从 148 份独特的入院记录(占所有入院记录的 2.7%)中共识别出 264 份记录描述了可能的 HAPI。其中 61 份描述了新的损伤,64 份描述了已知但可能正在发展的损伤。在我们的研究期间,相对于患者总人数,每 1000 名出院患者中有 11.9 例发生 HAPI,每 1000 个住院日中有 1.2 例发生 HAPI:事实证明,使用护理交接记录进行基于自然语言处理的监控是可行的,而且收益很高。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Journal of Patient Safety
Journal of Patient Safety HEALTH CARE SCIENCES & SERVICES-
CiteScore
4.60
自引率
13.60%
发文量
302
期刊介绍: Journal of Patient Safety (ISSN 1549-8417; online ISSN 1549-8425) is dedicated to presenting research advances and field applications in every area of patient safety. While Journal of Patient Safety has a research emphasis, it also publishes articles describing near-miss opportunities, system modifications that are barriers to error, and the impact of regulatory changes on healthcare delivery. This mix of research and real-world findings makes Journal of Patient Safety a valuable resource across the breadth of health professions and from bench to bedside.
期刊最新文献
Response to the Letter to the Editor by Cioccari et al. Implementation and Evaluation of Clinical Decision Support for Apixaban Dosing in a Community Teaching Hospital. Patient Harm Events and Associated Cost Outcomes Reported to a Patient Safety Organization. Advancing Patient Safety: Harnessing Multimedia Tools to Alleviate Perioperative Anxiety and Pain. Translation and Comprehensive Validation of the Hebrew Survey on Patient Safety Culture (HSOPS 2.0).
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1