Improved Interpretability Without Performance Reduction in a Sepsis Prediction Risk Score.

IF 3.3 3区 医学 Q1 MEDICINE, GENERAL & INTERNAL Diagnostics Pub Date : 2025-01-28 DOI:10.3390/diagnostics15030307
Adam Kotter, Samir Abdelrahman, Yi-Ki Jacob Wan, Karl Madaras-Kelly, Keaton L Morgan, Chin Fung Kelvin Kan, Guilherme Del Fiol
{"title":"Improved Interpretability Without Performance Reduction in a Sepsis Prediction Risk Score.","authors":"Adam Kotter, Samir Abdelrahman, Yi-Ki Jacob Wan, Karl Madaras-Kelly, Keaton L Morgan, Chin Fung Kelvin Kan, Guilherme Del Fiol","doi":"10.3390/diagnostics15030307","DOIUrl":null,"url":null,"abstract":"<p><p><b>Objective</b>: Sepsis is a life-threatening response to infection and a major cause of hospital mortality. Machine learning (ML) models have demonstrated better sepsis prediction performance than integer risk scores but are less widely used in clinical settings, in part due to lower interpretability. This study aimed to improve the interpretability of an ML-based model without reducing its performance in non-ICU sepsis prediction. <b>Methods</b>: A logistic regression model was trained to predict sepsis onset and then converted into a more interpretable integer point system, STEWS, using its regression coefficients. We compared STEWS with the logistic regression model using PPV at 90% sensitivity. <b>Results</b>: STEWS was significantly equivalent to logistic regression using the two one-sided tests procedure (0.051 vs. 0.051; <i>p</i> = 0.004). <b>Conclusions</b>: STEWS demonstrated equivalent performance to a comparable logistic regression model for non-ICU sepsis prediction, suggesting that converting ML models into more interpretable forms does not necessarily reduce predictive power.</p>","PeriodicalId":11225,"journal":{"name":"Diagnostics","volume":"15 3","pages":""},"PeriodicalIF":3.3000,"publicationDate":"2025-01-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11817530/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Diagnostics","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.3390/diagnostics15030307","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MEDICINE, GENERAL & INTERNAL","Score":null,"Total":0}
引用次数: 0

Abstract

Objective: Sepsis is a life-threatening response to infection and a major cause of hospital mortality. Machine learning (ML) models have demonstrated better sepsis prediction performance than integer risk scores but are less widely used in clinical settings, in part due to lower interpretability. This study aimed to improve the interpretability of an ML-based model without reducing its performance in non-ICU sepsis prediction. Methods: A logistic regression model was trained to predict sepsis onset and then converted into a more interpretable integer point system, STEWS, using its regression coefficients. We compared STEWS with the logistic regression model using PPV at 90% sensitivity. Results: STEWS was significantly equivalent to logistic regression using the two one-sided tests procedure (0.051 vs. 0.051; p = 0.004). Conclusions: STEWS demonstrated equivalent performance to a comparable logistic regression model for non-ICU sepsis prediction, suggesting that converting ML models into more interpretable forms does not necessarily reduce predictive power.

Abstract Image

Abstract Image

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
脓毒症预测风险评分在不降低性能的情况下提高了可解释性。
目的:脓毒症是一种危及生命的感染反应和医院死亡率的主要原因。机器学习(ML)模型显示出比整数风险评分更好的脓毒症预测性能,但在临床环境中应用较少,部分原因是可解释性较低。本研究旨在提高基于ml的模型的可解释性,同时不降低其在非icu脓毒症预测中的性能。方法:训练逻辑回归模型来预测脓毒症的发作,然后使用其回归系数将其转换为更可解释的整数点系统STEWS。我们将STEWS与使用PPV的逻辑回归模型进行比较,灵敏度为90%。结果:采用两个单侧检验程序进行logistic回归分析,STEWS与logistic回归显著相等(0.051 vs. 0.051;P = 0.004)。结论:在非icu脓毒症预测中,STEWS表现出与可比较的逻辑回归模型相当的性能,这表明将ML模型转换为更可解释的形式并不一定会降低预测能力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Diagnostics
Diagnostics Biochemistry, Genetics and Molecular Biology-Clinical Biochemistry
CiteScore
4.70
自引率
8.30%
发文量
2699
审稿时长
19.64 days
期刊介绍: Diagnostics (ISSN 2075-4418) is an international scholarly open access journal on medical diagnostics. It publishes original research articles, reviews, communications and short notes on the research and development of medical diagnostics. There is no restriction on the length of the papers. Our aim is to encourage scientists to publish their experimental and theoretical research in as much detail as possible. Full experimental and/or methodological details must be provided for research articles.
期刊最新文献
Evaluation of the Impact of Different Skeletal Orthodontic Anomalies on Condylar Asymmetry Using Cone-Beam Computed Tomography. Association Between Serum Testosterone Levels and Coronary Artery Stenosis: A Cross-Sectional Study in Central European Population. A Novel Dual-Modality Dual-View Hybrid Deep Learning-Machine Learning Framework for the Prediction of Carotid Plaque Vulnerability via Late Fusion. AI-Assisted OCT Imaging for Core Needle Biopsy Guidance: The 1st in Humans Study. Assessment of Optimal Stent Implantation with the Use of Optical Coherence Tomography in Patients with Coronary Artery Disease.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1