Hye Yoon Park , Hyoju Sohn , Arum Hong , Soo Wan Han , Yuna Jang , EKyong Yoon , Myeongju Kim , Hye Youn Park
{"title":"机器学习在COVID-19住院患者谵妄预测及相关因素分析中的应用:韩国谵妄预防多学科队列(KoMCoDe)的比较研究","authors":"Hye Yoon Park , Hyoju Sohn , Arum Hong , Soo Wan Han , Yuna Jang , EKyong Yoon , Myeongju Kim , Hye Youn Park","doi":"10.1016/j.ijmedinf.2024.105747","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><div>The incidence of delirium in hospitalized coronavirus disease 2019 (COVID-19) patients is linked to adverse health outcomes. Predicting the occurrence and risk factors of delirium is key to preventing its sudden onset.</div></div><div><h3>Aims</h3><div>To explore the factors associated with delirium in hospitalized COVID-19 patients and to compare the performance of various machine learning (ML) techniques for future use in predicting delirium.</div></div><div><h3>Methods</h3><div>We analyzed a dataset of 1,031 cases from two healthcare centers, which included 178 variables such as demographics, clinical data, and medication information. The ML techniques used in this study were extreme gradient boosting (XGB), light gradient boosting machine (LGBM), logistic regression (LR), random forest (RF), and support vector machine (SVM).</div></div><div><h3>Results</h3><div>The RF model emerged as the most effective for predicting delirium, achieving an area under the curve (AUC) of 0.923. It showed a sensitivity of 0.639, accuracy of 0.900, specificity of 0.934, positive predictive value (PPV) of 0.561, negative predictive value (NPV) of 0.952, and an F1 score of 0.597. The RF model identified key variables related to delirium, including medication type (antipsychotic, sedative, opioid), duration of hospital stay, remdesivir usage, and patient age. The reliability of the model was affirmed through calibration plots and Brier score evaluations.</div></div><div><h3>Conclusions</h3><div>This research developed and validated an RF-based ML model for predicting delirium in hospitalized COVID-19 patients. The model demonstrates superior accuracy and reliability compared to other ML methods and would possibly serve as a valuable tool for managing and anticipating delirium in COVID-19 patients, with the potential to enhance patient outcomes.</div></div>","PeriodicalId":54950,"journal":{"name":"International Journal of Medical Informatics","volume":"195 ","pages":"Article 105747"},"PeriodicalIF":3.7000,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Application of machine learning for delirium prediction and analysis of associated factors in hospitalized COVID-19 patients: A comparative study using the Korean Multidisciplinary cohort for delirium prevention (KoMCoDe)\",\"authors\":\"Hye Yoon Park , Hyoju Sohn , Arum Hong , Soo Wan Han , Yuna Jang , EKyong Yoon , Myeongju Kim , Hye Youn Park\",\"doi\":\"10.1016/j.ijmedinf.2024.105747\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Background</h3><div>The incidence of delirium in hospitalized coronavirus disease 2019 (COVID-19) patients is linked to adverse health outcomes. Predicting the occurrence and risk factors of delirium is key to preventing its sudden onset.</div></div><div><h3>Aims</h3><div>To explore the factors associated with delirium in hospitalized COVID-19 patients and to compare the performance of various machine learning (ML) techniques for future use in predicting delirium.</div></div><div><h3>Methods</h3><div>We analyzed a dataset of 1,031 cases from two healthcare centers, which included 178 variables such as demographics, clinical data, and medication information. The ML techniques used in this study were extreme gradient boosting (XGB), light gradient boosting machine (LGBM), logistic regression (LR), random forest (RF), and support vector machine (SVM).</div></div><div><h3>Results</h3><div>The RF model emerged as the most effective for predicting delirium, achieving an area under the curve (AUC) of 0.923. It showed a sensitivity of 0.639, accuracy of 0.900, specificity of 0.934, positive predictive value (PPV) of 0.561, negative predictive value (NPV) of 0.952, and an F1 score of 0.597. The RF model identified key variables related to delirium, including medication type (antipsychotic, sedative, opioid), duration of hospital stay, remdesivir usage, and patient age. The reliability of the model was affirmed through calibration plots and Brier score evaluations.</div></div><div><h3>Conclusions</h3><div>This research developed and validated an RF-based ML model for predicting delirium in hospitalized COVID-19 patients. The model demonstrates superior accuracy and reliability compared to other ML methods and would possibly serve as a valuable tool for managing and anticipating delirium in COVID-19 patients, with the potential to enhance patient outcomes.</div></div>\",\"PeriodicalId\":54950,\"journal\":{\"name\":\"International Journal of Medical Informatics\",\"volume\":\"195 \",\"pages\":\"Article 105747\"},\"PeriodicalIF\":3.7000,\"publicationDate\":\"2024-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Medical Informatics\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1386505624004106\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Medical Informatics","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1386505624004106","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
Application of machine learning for delirium prediction and analysis of associated factors in hospitalized COVID-19 patients: A comparative study using the Korean Multidisciplinary cohort for delirium prevention (KoMCoDe)
Background
The incidence of delirium in hospitalized coronavirus disease 2019 (COVID-19) patients is linked to adverse health outcomes. Predicting the occurrence and risk factors of delirium is key to preventing its sudden onset.
Aims
To explore the factors associated with delirium in hospitalized COVID-19 patients and to compare the performance of various machine learning (ML) techniques for future use in predicting delirium.
Methods
We analyzed a dataset of 1,031 cases from two healthcare centers, which included 178 variables such as demographics, clinical data, and medication information. The ML techniques used in this study were extreme gradient boosting (XGB), light gradient boosting machine (LGBM), logistic regression (LR), random forest (RF), and support vector machine (SVM).
Results
The RF model emerged as the most effective for predicting delirium, achieving an area under the curve (AUC) of 0.923. It showed a sensitivity of 0.639, accuracy of 0.900, specificity of 0.934, positive predictive value (PPV) of 0.561, negative predictive value (NPV) of 0.952, and an F1 score of 0.597. The RF model identified key variables related to delirium, including medication type (antipsychotic, sedative, opioid), duration of hospital stay, remdesivir usage, and patient age. The reliability of the model was affirmed through calibration plots and Brier score evaluations.
Conclusions
This research developed and validated an RF-based ML model for predicting delirium in hospitalized COVID-19 patients. The model demonstrates superior accuracy and reliability compared to other ML methods and would possibly serve as a valuable tool for managing and anticipating delirium in COVID-19 patients, with the potential to enhance patient outcomes.
期刊介绍:
International Journal of Medical Informatics provides an international medium for dissemination of original results and interpretative reviews concerning the field of medical informatics. The Journal emphasizes the evaluation of systems in healthcare settings.
The scope of journal covers:
Information systems, including national or international registration systems, hospital information systems, departmental and/or physician''s office systems, document handling systems, electronic medical record systems, standardization, systems integration etc.;
Computer-aided medical decision support systems using heuristic, algorithmic and/or statistical methods as exemplified in decision theory, protocol development, artificial intelligence, etc.
Educational computer based programs pertaining to medical informatics or medicine in general;
Organizational, economic, social, clinical impact, ethical and cost-benefit aspects of IT applications in health care.