Wei Jun Dan Ong , Chun Hung How , Woon Hean Keenan Chong , Faheem Ahmed Khan , Kee Yuan Ngiam , Amit Kansal
{"title":"使用机器学习模型预测成人机械通气患者的预后,并与传统统计方法进行比较:单中心回顾性研究","authors":"Wei Jun Dan Ong , Chun Hung How , Woon Hean Keenan Chong , Faheem Ahmed Khan , Kee Yuan Ngiam , Amit Kansal","doi":"10.1016/j.ibmed.2024.100165","DOIUrl":null,"url":null,"abstract":"<div><p>In this retrospective single-centre study spanning five years (2016–2021) and involving 2368 adult Intensive Care Unit (ICU) patients requiring over 4 h of mechanical ventilation (MV) in a tertiary care hospital, we investigated the feasibility and accuracy of using machine learning (ML) models in predicting outcomes post-ICU discharge compared to conventional statistical methods (CSM). The study aimed to identify associated risk factors impacting these outcomes. Poor outcomes, defined as ICU readmission, mortality, and prolonged hospital stays, affected 40.2 % of the discharged MV patients. The Extreme Gradient Boost (XGBoost) ML model showed superior performance compared to CSM (Area under the receiver operating characteristic curve: 0.693 vs. 0.667; p-value = 0.03). At 95 % specificity, XGBoost displayed enhanced sensitivity (30.6 % vs. 23.8 %) compared to CSM. Risk factors such as Glasgow Coma Score (GCS) and GCS best motor score at ICU discharge, MV duration, ICU length of stay, and Charlson Comorbidity Index were identified. While both ML and CSM exhibited moderate accuracy, the study suggests ML algorithms have the potential for better predictive capabilities and individual risk factor identification, potentially aiding in the improvement of patient outcomes by identifying high-risk patients requiring closer monitoring. Further validation in larger studies is necessary, but the study underscores the potential for real-time application of ML algorithms developed from the increasing availability of electronic medical records (EMR).</p></div>","PeriodicalId":73399,"journal":{"name":"Intelligence-based medicine","volume":"10 ","pages":"Article 100165"},"PeriodicalIF":0.0000,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666521224000322/pdfft?md5=9b5e16fa3de6867cc99501f81f07c14a&pid=1-s2.0-S2666521224000322-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Outcome prediction for adult mechanically ventilated patients using machine learning models and comparison with conventional statistical methods: A single-centre retrospective study\",\"authors\":\"Wei Jun Dan Ong , Chun Hung How , Woon Hean Keenan Chong , Faheem Ahmed Khan , Kee Yuan Ngiam , Amit Kansal\",\"doi\":\"10.1016/j.ibmed.2024.100165\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>In this retrospective single-centre study spanning five years (2016–2021) and involving 2368 adult Intensive Care Unit (ICU) patients requiring over 4 h of mechanical ventilation (MV) in a tertiary care hospital, we investigated the feasibility and accuracy of using machine learning (ML) models in predicting outcomes post-ICU discharge compared to conventional statistical methods (CSM). The study aimed to identify associated risk factors impacting these outcomes. Poor outcomes, defined as ICU readmission, mortality, and prolonged hospital stays, affected 40.2 % of the discharged MV patients. The Extreme Gradient Boost (XGBoost) ML model showed superior performance compared to CSM (Area under the receiver operating characteristic curve: 0.693 vs. 0.667; p-value = 0.03). At 95 % specificity, XGBoost displayed enhanced sensitivity (30.6 % vs. 23.8 %) compared to CSM. Risk factors such as Glasgow Coma Score (GCS) and GCS best motor score at ICU discharge, MV duration, ICU length of stay, and Charlson Comorbidity Index were identified. While both ML and CSM exhibited moderate accuracy, the study suggests ML algorithms have the potential for better predictive capabilities and individual risk factor identification, potentially aiding in the improvement of patient outcomes by identifying high-risk patients requiring closer monitoring. Further validation in larger studies is necessary, but the study underscores the potential for real-time application of ML algorithms developed from the increasing availability of electronic medical records (EMR).</p></div>\",\"PeriodicalId\":73399,\"journal\":{\"name\":\"Intelligence-based medicine\",\"volume\":\"10 \",\"pages\":\"Article 100165\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S2666521224000322/pdfft?md5=9b5e16fa3de6867cc99501f81f07c14a&pid=1-s2.0-S2666521224000322-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Intelligence-based medicine\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2666521224000322\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Intelligence-based medicine","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666521224000322","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
在这项为期五年(2016-2021 年)的回顾性单中心研究中,我们调查了与传统统计方法(CSM)相比,使用机器学习(ML)模型预测 ICU 出院后预后的可行性和准确性。该研究旨在确定影响这些结果的相关风险因素。40.2%的中风病人出院后会出现不良后果,即ICU再入院、死亡和住院时间延长。与 CSM 相比,Extreme Gradient Boost (XGBoost) ML 模型显示出更优越的性能(接收器工作特征曲线下面积:0.693 vs. 0.693):0.693 对 0.667;P 值 = 0.03)。在特异性为 95% 时,XGBoost 与 CSM 相比显示出更高的灵敏度(30.6% 对 23.8%)。确定了一些风险因素,如 ICU 出院时的格拉斯哥昏迷评分(GCS)和 GCS 最佳运动评分、MV 持续时间、ICU 住院时间和 Charlson 合并症指数。虽然 ML 和 CSM 都表现出中等准确性,但研究表明 ML 算法有可能具有更好的预测能力和个体风险因素识别能力,通过识别需要更密切监测的高危患者,有可能帮助改善患者预后。有必要在更大规模的研究中进行进一步验证,但这项研究强调了实时应用从日益普及的电子病历(EMR)中开发的 ML 算法的潜力。
Outcome prediction for adult mechanically ventilated patients using machine learning models and comparison with conventional statistical methods: A single-centre retrospective study
In this retrospective single-centre study spanning five years (2016–2021) and involving 2368 adult Intensive Care Unit (ICU) patients requiring over 4 h of mechanical ventilation (MV) in a tertiary care hospital, we investigated the feasibility and accuracy of using machine learning (ML) models in predicting outcomes post-ICU discharge compared to conventional statistical methods (CSM). The study aimed to identify associated risk factors impacting these outcomes. Poor outcomes, defined as ICU readmission, mortality, and prolonged hospital stays, affected 40.2 % of the discharged MV patients. The Extreme Gradient Boost (XGBoost) ML model showed superior performance compared to CSM (Area under the receiver operating characteristic curve: 0.693 vs. 0.667; p-value = 0.03). At 95 % specificity, XGBoost displayed enhanced sensitivity (30.6 % vs. 23.8 %) compared to CSM. Risk factors such as Glasgow Coma Score (GCS) and GCS best motor score at ICU discharge, MV duration, ICU length of stay, and Charlson Comorbidity Index were identified. While both ML and CSM exhibited moderate accuracy, the study suggests ML algorithms have the potential for better predictive capabilities and individual risk factor identification, potentially aiding in the improvement of patient outcomes by identifying high-risk patients requiring closer monitoring. Further validation in larger studies is necessary, but the study underscores the potential for real-time application of ML algorithms developed from the increasing availability of electronic medical records (EMR).