Jicheng Huang , Yufeng Cai , Xusheng Wu , Xin Huang , Jianwei Liu , Dehua Hu
{"title":"基于深度神经网络的重症监护室急性心力衰竭患者死亡事件预测","authors":"Jicheng Huang , Yufeng Cai , Xusheng Wu , Xin Huang , Jianwei Liu , Dehua Hu","doi":"10.1016/j.cmpb.2024.108403","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><p>Acute heart failure (AHF) in the intensive care unit (ICU) is characterized by its criticality, rapid progression, complex and changeable condition, and its pathophysiological process involves the interaction of multiple organs and systems. This makes it difficult to predict in-hospital mortality events comprehensively and accurately. Traditional analysis methods based on statistics and machine learning suffer from insufficient model performance, poor accuracy caused by prior dependence, and difficulty in adequately considering the complex relationships between multiple risk factors. Therefore, the application of deep neural network (DNN) techniques to the specific scenario, predicting mortality events of patients with AHF under intensive care, has become a research frontier.</p></div><div><h3>Methods</h3><p>This research utilized the MIMIC-IV critical care database as the primary data source and employed the synthetic minority over-sampling technique (SMOTE) to balance the dataset. Deep neural network models—backpropagation neural network (BPNN) and recurrent neural network (RNN), which are based on electronic medical record data mining, were employed to investigate the in-hospital death event judgment task of patients with AHF under intensive care. Additionally, multiple single machine learning models and ensemble learning models were constructed for comparative experiments. Moreover, we achieved various optimal performance combinations by modifying the classification threshold of deep neural network models to address the diverse real-world requirements in the ICU. Finally, we conducted an interpretable deep model using SHapley Additive exPlanations (SHAP) to uncover the most influential medical record features for each patient from the aspects of global and local interpretation.</p></div><div><h3>Results</h3><p>In terms of model performance in this scenario, deep neural network models outperform both single machine learning models and ensemble learning models, achieving the highest Accuracy, Precision, Recall, F1 value, and Area under the ROC curve, which can reach 0.949, 0.925, 0.983, 0.953, and 0.987 respectively. SHAP value analysis revealed that the ICU scores (APSIII, OASIS, SOFA) are significantly correlated with the occurrence of in-hospital fatal events.</p></div><div><h3>Conclusions</h3><p>Our study underscores that DNN-based mortality event classifier offers a novel intelligent approach for forecasting and assessing the prognosis of AHF patients in the ICU. Additionally, the ICU scores stand out as the most predictive features, which implies that in the decision-making process of the models, ICU scores can provide the most crucial information, making the greatest positive or negative contribution to influence the incidence of in-hospital mortality among patients with acute heart failure.</p></div>","PeriodicalId":10624,"journal":{"name":"Computer methods and programs in biomedicine","volume":"256 ","pages":"Article 108403"},"PeriodicalIF":4.9000,"publicationDate":"2024-08-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0169260724003961/pdfft?md5=603e2fe58aafff457c4aa49d7025c8c7&pid=1-s2.0-S0169260724003961-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Prediction of mortality events of patients with acute heart failure in intensive care unit based on deep neural network\",\"authors\":\"Jicheng Huang , Yufeng Cai , Xusheng Wu , Xin Huang , Jianwei Liu , Dehua Hu\",\"doi\":\"10.1016/j.cmpb.2024.108403\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Background</h3><p>Acute heart failure (AHF) in the intensive care unit (ICU) is characterized by its criticality, rapid progression, complex and changeable condition, and its pathophysiological process involves the interaction of multiple organs and systems. This makes it difficult to predict in-hospital mortality events comprehensively and accurately. Traditional analysis methods based on statistics and machine learning suffer from insufficient model performance, poor accuracy caused by prior dependence, and difficulty in adequately considering the complex relationships between multiple risk factors. Therefore, the application of deep neural network (DNN) techniques to the specific scenario, predicting mortality events of patients with AHF under intensive care, has become a research frontier.</p></div><div><h3>Methods</h3><p>This research utilized the MIMIC-IV critical care database as the primary data source and employed the synthetic minority over-sampling technique (SMOTE) to balance the dataset. Deep neural network models—backpropagation neural network (BPNN) and recurrent neural network (RNN), which are based on electronic medical record data mining, were employed to investigate the in-hospital death event judgment task of patients with AHF under intensive care. Additionally, multiple single machine learning models and ensemble learning models were constructed for comparative experiments. Moreover, we achieved various optimal performance combinations by modifying the classification threshold of deep neural network models to address the diverse real-world requirements in the ICU. Finally, we conducted an interpretable deep model using SHapley Additive exPlanations (SHAP) to uncover the most influential medical record features for each patient from the aspects of global and local interpretation.</p></div><div><h3>Results</h3><p>In terms of model performance in this scenario, deep neural network models outperform both single machine learning models and ensemble learning models, achieving the highest Accuracy, Precision, Recall, F1 value, and Area under the ROC curve, which can reach 0.949, 0.925, 0.983, 0.953, and 0.987 respectively. SHAP value analysis revealed that the ICU scores (APSIII, OASIS, SOFA) are significantly correlated with the occurrence of in-hospital fatal events.</p></div><div><h3>Conclusions</h3><p>Our study underscores that DNN-based mortality event classifier offers a novel intelligent approach for forecasting and assessing the prognosis of AHF patients in the ICU. Additionally, the ICU scores stand out as the most predictive features, which implies that in the decision-making process of the models, ICU scores can provide the most crucial information, making the greatest positive or negative contribution to influence the incidence of in-hospital mortality among patients with acute heart failure.</p></div>\",\"PeriodicalId\":10624,\"journal\":{\"name\":\"Computer methods and programs in biomedicine\",\"volume\":\"256 \",\"pages\":\"Article 108403\"},\"PeriodicalIF\":4.9000,\"publicationDate\":\"2024-08-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S0169260724003961/pdfft?md5=603e2fe58aafff457c4aa49d7025c8c7&pid=1-s2.0-S0169260724003961-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computer methods and programs in biomedicine\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0169260724003961\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer methods and programs in biomedicine","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0169260724003961","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
Prediction of mortality events of patients with acute heart failure in intensive care unit based on deep neural network
Background
Acute heart failure (AHF) in the intensive care unit (ICU) is characterized by its criticality, rapid progression, complex and changeable condition, and its pathophysiological process involves the interaction of multiple organs and systems. This makes it difficult to predict in-hospital mortality events comprehensively and accurately. Traditional analysis methods based on statistics and machine learning suffer from insufficient model performance, poor accuracy caused by prior dependence, and difficulty in adequately considering the complex relationships between multiple risk factors. Therefore, the application of deep neural network (DNN) techniques to the specific scenario, predicting mortality events of patients with AHF under intensive care, has become a research frontier.
Methods
This research utilized the MIMIC-IV critical care database as the primary data source and employed the synthetic minority over-sampling technique (SMOTE) to balance the dataset. Deep neural network models—backpropagation neural network (BPNN) and recurrent neural network (RNN), which are based on electronic medical record data mining, were employed to investigate the in-hospital death event judgment task of patients with AHF under intensive care. Additionally, multiple single machine learning models and ensemble learning models were constructed for comparative experiments. Moreover, we achieved various optimal performance combinations by modifying the classification threshold of deep neural network models to address the diverse real-world requirements in the ICU. Finally, we conducted an interpretable deep model using SHapley Additive exPlanations (SHAP) to uncover the most influential medical record features for each patient from the aspects of global and local interpretation.
Results
In terms of model performance in this scenario, deep neural network models outperform both single machine learning models and ensemble learning models, achieving the highest Accuracy, Precision, Recall, F1 value, and Area under the ROC curve, which can reach 0.949, 0.925, 0.983, 0.953, and 0.987 respectively. SHAP value analysis revealed that the ICU scores (APSIII, OASIS, SOFA) are significantly correlated with the occurrence of in-hospital fatal events.
Conclusions
Our study underscores that DNN-based mortality event classifier offers a novel intelligent approach for forecasting and assessing the prognosis of AHF patients in the ICU. Additionally, the ICU scores stand out as the most predictive features, which implies that in the decision-making process of the models, ICU scores can provide the most crucial information, making the greatest positive or negative contribution to influence the incidence of in-hospital mortality among patients with acute heart failure.
期刊介绍:
To encourage the development of formal computing methods, and their application in biomedical research and medical practice, by illustration of fundamental principles in biomedical informatics research; to stimulate basic research into application software design; to report the state of research of biomedical information processing projects; to report new computer methodologies applied in biomedical areas; the eventual distribution of demonstrable software to avoid duplication of effort; to provide a forum for discussion and improvement of existing software; to optimize contact between national organizations and regional user groups by promoting an international exchange of information on formal methods, standards and software in biomedicine.
Computer Methods and Programs in Biomedicine covers computing methodology and software systems derived from computing science for implementation in all aspects of biomedical research and medical practice. It is designed to serve: biochemists; biologists; geneticists; immunologists; neuroscientists; pharmacologists; toxicologists; clinicians; epidemiologists; psychiatrists; psychologists; cardiologists; chemists; (radio)physicists; computer scientists; programmers and systems analysts; biomedical, clinical, electrical and other engineers; teachers of medical informatics and users of educational software.