Lihi Danay , Roni Ramon-Gonen , Maria Gorodetski , David G. Schwartz
{"title":"Evaluating the effectiveness of a sliding window technique in machine learning models for mortality prediction in ICU cardiac arrest patients","authors":"Lihi Danay , Roni Ramon-Gonen , Maria Gorodetski , David G. Schwartz","doi":"10.1016/j.ijmedinf.2024.105565","DOIUrl":null,"url":null,"abstract":"<div><p>Extensive research has been devoted to predicting ICU mortality, to assist clinical teams managing critical patients. Electronic health records (EHR) contain both static and dynamic medical data, with the latter accumulating during ICU stays. Existing models often rely on a fixed time window (e.g., first 24 h) for prediction, potentially missing vital post-24-hour data. The present study aims to improve mortality prediction for ICU patients following Cardiac Arrest (CA) using a dynamic sliding window approach that accommodates evolving data characteristics.</p><p>Our cohort included 2331 CA patients, of whom 684 died in the ICU and 1647 survived. Applying the sliding window technique, we created six different time windows and used each separately for model training and validation. We compared our results to a baseline accumulative window.</p><p>The different time windows created by the sliding window technique differed in their prediction performance and outperformed the baseline 24-hour window significantly. The XGBoost model outperformed all other models, with the 30–42 h time window achieving the best results (AUC = 0.8, accuracy = 0.77).</p><p>Our work shows that the sliding window technique is effective in improving mortality prediction. We demonstrated how important time-window selection is and showed that enhancing it can save time and thus improve mortality prediction. These findings promise to improve the clinical team’s efficiency in prioritizing patients and giving greater attention to higher-risk patients.</p><p>To conclude, mortality prediction in the ICU can be improved if we consider alternative time windows instead of the 24-hour window, which is currently the most widely accepted among scoring systems today.</p></div>","PeriodicalId":54950,"journal":{"name":"International Journal of Medical Informatics","volume":null,"pages":null},"PeriodicalIF":3.7000,"publicationDate":"2024-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Medical Informatics","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1386505624002284","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Extensive research has been devoted to predicting ICU mortality, to assist clinical teams managing critical patients. Electronic health records (EHR) contain both static and dynamic medical data, with the latter accumulating during ICU stays. Existing models often rely on a fixed time window (e.g., first 24 h) for prediction, potentially missing vital post-24-hour data. The present study aims to improve mortality prediction for ICU patients following Cardiac Arrest (CA) using a dynamic sliding window approach that accommodates evolving data characteristics.
Our cohort included 2331 CA patients, of whom 684 died in the ICU and 1647 survived. Applying the sliding window technique, we created six different time windows and used each separately for model training and validation. We compared our results to a baseline accumulative window.
The different time windows created by the sliding window technique differed in their prediction performance and outperformed the baseline 24-hour window significantly. The XGBoost model outperformed all other models, with the 30–42 h time window achieving the best results (AUC = 0.8, accuracy = 0.77).
Our work shows that the sliding window technique is effective in improving mortality prediction. We demonstrated how important time-window selection is and showed that enhancing it can save time and thus improve mortality prediction. These findings promise to improve the clinical team’s efficiency in prioritizing patients and giving greater attention to higher-risk patients.
To conclude, mortality prediction in the ICU can be improved if we consider alternative time windows instead of the 24-hour window, which is currently the most widely accepted among scoring systems today.
期刊介绍:
International Journal of Medical Informatics provides an international medium for dissemination of original results and interpretative reviews concerning the field of medical informatics. The Journal emphasizes the evaluation of systems in healthcare settings.
The scope of journal covers:
Information systems, including national or international registration systems, hospital information systems, departmental and/or physician''s office systems, document handling systems, electronic medical record systems, standardization, systems integration etc.;
Computer-aided medical decision support systems using heuristic, algorithmic and/or statistical methods as exemplified in decision theory, protocol development, artificial intelligence, etc.
Educational computer based programs pertaining to medical informatics or medicine in general;
Organizational, economic, social, clinical impact, ethical and cost-benefit aspects of IT applications in health care.