Ching-Chi Huang , Wan-Yin Kuo , Yu-Ting Shen , Chia-Jung Chen , Hung-Jung Lin , Chien-Chin Hsu , Chung-Feng Liu , Chien-Cheng Huang
{"title":"人工智能预测痴呆症患者的院内死亡率:一项多中心研究","authors":"Ching-Chi Huang , Wan-Yin Kuo , Yu-Ting Shen , Chia-Jung Chen , Hung-Jung Lin , Chien-Chin Hsu , Chung-Feng Liu , Chien-Cheng Huang","doi":"10.1016/j.ijmedinf.2024.105590","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><p>Prediction of mortality is very important for care planning in hospitalized patients with dementia and artificial intelligence has the potential to serve as a solution; however, this issue remains unclear. Thus, this study was conducted to elucidate this matter.</p></div><div><h3>Methods</h3><p>We identified 10,573 hospitalized patients aged ≥ 45 years with dementia from three hospitals between 2010 and 2020 for this study. Utilizing 44 feature variables extracted from electronic medical records, an artificial intelligence (AI) model was constructed to predict death during hospitalization. The data was randomly separated into 70 % training set and 30 % testing set. We compared predictive accuracy among six algorithms including logistic regression, random forest, extreme gradient boosting (XGBoost), Light Gradient Boosting Machine (LightGBM), multilayer perceptron (MLP), and support vector machine (SVM). Additionally, another set of data collected in 2021 was used as the validation set to assess the performance of six algorithms.</p></div><div><h3>Results</h3><p>The average age was 79.8 years, with females constituting 54.5 % of the sample. The in-hospital mortality rate was 6.7 %. LightGBM exhibited the highest area under the curve (0.991) for predicting mortality compared to other algorithms (XGBoost: 0.987, random forest: 0.985, logistic regression: 0.918, MLP: 0.898, SVM: 0.897). The accuracy, sensitivity, positive predictive value, and negative predictive value of LightGBM were 0.943, 0.944, 0.943, 0.542, and 0.996, respectively. Among the features in LightGBM, the three most important variables were the Glasgow Coma Scale, respiratory rate, and blood urea nitrogen. In the validation set, the area under the curve of LightGBM reached 0.753.</p></div><div><h3>Conclusions</h3><p>The AI prediction model demonstrates strong accuracy in predicting in-hospital mortality among patients with dementia, suggesting its potential implementation to enhance future care quality.</p></div>","PeriodicalId":54950,"journal":{"name":"International Journal of Medical Informatics","volume":"191 ","pages":"Article 105590"},"PeriodicalIF":3.7000,"publicationDate":"2024-08-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Artificial intelligence prediction of In-Hospital mortality in patients with dementia: A multi-center study\",\"authors\":\"Ching-Chi Huang , Wan-Yin Kuo , Yu-Ting Shen , Chia-Jung Chen , Hung-Jung Lin , Chien-Chin Hsu , Chung-Feng Liu , Chien-Cheng Huang\",\"doi\":\"10.1016/j.ijmedinf.2024.105590\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Background</h3><p>Prediction of mortality is very important for care planning in hospitalized patients with dementia and artificial intelligence has the potential to serve as a solution; however, this issue remains unclear. Thus, this study was conducted to elucidate this matter.</p></div><div><h3>Methods</h3><p>We identified 10,573 hospitalized patients aged ≥ 45 years with dementia from three hospitals between 2010 and 2020 for this study. Utilizing 44 feature variables extracted from electronic medical records, an artificial intelligence (AI) model was constructed to predict death during hospitalization. The data was randomly separated into 70 % training set and 30 % testing set. We compared predictive accuracy among six algorithms including logistic regression, random forest, extreme gradient boosting (XGBoost), Light Gradient Boosting Machine (LightGBM), multilayer perceptron (MLP), and support vector machine (SVM). Additionally, another set of data collected in 2021 was used as the validation set to assess the performance of six algorithms.</p></div><div><h3>Results</h3><p>The average age was 79.8 years, with females constituting 54.5 % of the sample. The in-hospital mortality rate was 6.7 %. LightGBM exhibited the highest area under the curve (0.991) for predicting mortality compared to other algorithms (XGBoost: 0.987, random forest: 0.985, logistic regression: 0.918, MLP: 0.898, SVM: 0.897). The accuracy, sensitivity, positive predictive value, and negative predictive value of LightGBM were 0.943, 0.944, 0.943, 0.542, and 0.996, respectively. Among the features in LightGBM, the three most important variables were the Glasgow Coma Scale, respiratory rate, and blood urea nitrogen. In the validation set, the area under the curve of LightGBM reached 0.753.</p></div><div><h3>Conclusions</h3><p>The AI prediction model demonstrates strong accuracy in predicting in-hospital mortality among patients with dementia, suggesting its potential implementation to enhance future care quality.</p></div>\",\"PeriodicalId\":54950,\"journal\":{\"name\":\"International Journal of Medical Informatics\",\"volume\":\"191 \",\"pages\":\"Article 105590\"},\"PeriodicalIF\":3.7000,\"publicationDate\":\"2024-08-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Medical Informatics\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1386505624002533\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Medical Informatics","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1386505624002533","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
Artificial intelligence prediction of In-Hospital mortality in patients with dementia: A multi-center study
Background
Prediction of mortality is very important for care planning in hospitalized patients with dementia and artificial intelligence has the potential to serve as a solution; however, this issue remains unclear. Thus, this study was conducted to elucidate this matter.
Methods
We identified 10,573 hospitalized patients aged ≥ 45 years with dementia from three hospitals between 2010 and 2020 for this study. Utilizing 44 feature variables extracted from electronic medical records, an artificial intelligence (AI) model was constructed to predict death during hospitalization. The data was randomly separated into 70 % training set and 30 % testing set. We compared predictive accuracy among six algorithms including logistic regression, random forest, extreme gradient boosting (XGBoost), Light Gradient Boosting Machine (LightGBM), multilayer perceptron (MLP), and support vector machine (SVM). Additionally, another set of data collected in 2021 was used as the validation set to assess the performance of six algorithms.
Results
The average age was 79.8 years, with females constituting 54.5 % of the sample. The in-hospital mortality rate was 6.7 %. LightGBM exhibited the highest area under the curve (0.991) for predicting mortality compared to other algorithms (XGBoost: 0.987, random forest: 0.985, logistic regression: 0.918, MLP: 0.898, SVM: 0.897). The accuracy, sensitivity, positive predictive value, and negative predictive value of LightGBM were 0.943, 0.944, 0.943, 0.542, and 0.996, respectively. Among the features in LightGBM, the three most important variables were the Glasgow Coma Scale, respiratory rate, and blood urea nitrogen. In the validation set, the area under the curve of LightGBM reached 0.753.
Conclusions
The AI prediction model demonstrates strong accuracy in predicting in-hospital mortality among patients with dementia, suggesting its potential implementation to enhance future care quality.
期刊介绍:
International Journal of Medical Informatics provides an international medium for dissemination of original results and interpretative reviews concerning the field of medical informatics. The Journal emphasizes the evaluation of systems in healthcare settings.
The scope of journal covers:
Information systems, including national or international registration systems, hospital information systems, departmental and/or physician''s office systems, document handling systems, electronic medical record systems, standardization, systems integration etc.;
Computer-aided medical decision support systems using heuristic, algorithmic and/or statistical methods as exemplified in decision theory, protocol development, artificial intelligence, etc.
Educational computer based programs pertaining to medical informatics or medicine in general;
Organizational, economic, social, clinical impact, ethical and cost-benefit aspects of IT applications in health care.