Evi Diana Omar, Hasnah Mat, Ainil Zafirah Abd Karim, Ridwan Sanaudi, Fairol H Ibrahim, Mohd Azahadi Omar, Muhd Zulfadli Hafiz Ismail, Vivek Jason Jayaraj, Bak Leong Goh
{"title":"逻辑回归、梯度提升树、SVM 和随机森林算法在预测心脏手术后需要透析的急性肾损伤方面的比较分析。","authors":"Evi Diana Omar, Hasnah Mat, Ainil Zafirah Abd Karim, Ridwan Sanaudi, Fairol H Ibrahim, Mohd Azahadi Omar, Muhd Zulfadli Hafiz Ismail, Vivek Jason Jayaraj, Bak Leong Goh","doi":"10.2147/IJNRD.S461028","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>This study aimed to identify the best-performing algorithm for predicting Acute Kidney Injury (AKI) necessitating dialysis following cardiac surgery.</p><p><strong>Patients and methods: </strong>The dataset encompassed patient data from a tertiary cardiothoracic center in Malaysia between 2011 and 2015, sourced from electronic health records. Extensive preprocessing and feature selection ensured data quality and relevance. Four machine learning algorithms were applied: Logistic Regression, Gradient Boosted Trees, Support Vector Machine, and Random Forest. The dataset was split into training and validation sets and the hyperparameters were tuned. Accuracy, Area Under the ROC Curve (AUC), precision, F-measure, sensitivity, and specificity were some of the evaluation criteria. Ethical guidelines for data use and patient privacy were rigorously followed throughout the study.</p><p><strong>Results: </strong>With the highest accuracy (88.66%), AUC (94.61%), and sensitivity (91.30%), Gradient Boosted Trees emerged as the top performance. Random Forest displayed strong AUC (94.78%) and accuracy (87.39%). In contrast, the Support Vector Machine showed higher sensitivity (98.57%) with lower specificity (59.55%), but lower accuracy (79.02%) and precision (70.81%). Sensitivity (87.70%) and specificity (87.05%) were maintained in balance via Logistic Regression.</p><p><strong>Conclusion: </strong>These findings imply that Gradient Boosted Trees and Random Forest might be an effective method for identifying patients who would develop AKI following heart surgery. However specific goals, sensitivity/specificity trade-offs, and consideration of the practical ramifications should all be considered when choosing an algorithm.</p>","PeriodicalId":14181,"journal":{"name":"International Journal of Nephrology and Renovascular Disease","volume":"17 ","pages":"197-204"},"PeriodicalIF":2.1000,"publicationDate":"2024-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11283789/pdf/","citationCount":"0","resultStr":"{\"title\":\"Comparative Analysis of Logistic Regression, Gradient Boosted Trees, SVM, and Random Forest Algorithms for Prediction of Acute Kidney Injury Requiring Dialysis After Cardiac Surgery.\",\"authors\":\"Evi Diana Omar, Hasnah Mat, Ainil Zafirah Abd Karim, Ridwan Sanaudi, Fairol H Ibrahim, Mohd Azahadi Omar, Muhd Zulfadli Hafiz Ismail, Vivek Jason Jayaraj, Bak Leong Goh\",\"doi\":\"10.2147/IJNRD.S461028\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Purpose: </strong>This study aimed to identify the best-performing algorithm for predicting Acute Kidney Injury (AKI) necessitating dialysis following cardiac surgery.</p><p><strong>Patients and methods: </strong>The dataset encompassed patient data from a tertiary cardiothoracic center in Malaysia between 2011 and 2015, sourced from electronic health records. Extensive preprocessing and feature selection ensured data quality and relevance. Four machine learning algorithms were applied: Logistic Regression, Gradient Boosted Trees, Support Vector Machine, and Random Forest. The dataset was split into training and validation sets and the hyperparameters were tuned. Accuracy, Area Under the ROC Curve (AUC), precision, F-measure, sensitivity, and specificity were some of the evaluation criteria. Ethical guidelines for data use and patient privacy were rigorously followed throughout the study.</p><p><strong>Results: </strong>With the highest accuracy (88.66%), AUC (94.61%), and sensitivity (91.30%), Gradient Boosted Trees emerged as the top performance. Random Forest displayed strong AUC (94.78%) and accuracy (87.39%). In contrast, the Support Vector Machine showed higher sensitivity (98.57%) with lower specificity (59.55%), but lower accuracy (79.02%) and precision (70.81%). Sensitivity (87.70%) and specificity (87.05%) were maintained in balance via Logistic Regression.</p><p><strong>Conclusion: </strong>These findings imply that Gradient Boosted Trees and Random Forest might be an effective method for identifying patients who would develop AKI following heart surgery. However specific goals, sensitivity/specificity trade-offs, and consideration of the practical ramifications should all be considered when choosing an algorithm.</p>\",\"PeriodicalId\":14181,\"journal\":{\"name\":\"International Journal of Nephrology and Renovascular Disease\",\"volume\":\"17 \",\"pages\":\"197-204\"},\"PeriodicalIF\":2.1000,\"publicationDate\":\"2024-07-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11283789/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Nephrology and Renovascular Disease\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.2147/IJNRD.S461028\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/1/1 0:00:00\",\"PubModel\":\"eCollection\",\"JCR\":\"Q2\",\"JCRName\":\"UROLOGY & NEPHROLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Nephrology and Renovascular Disease","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2147/IJNRD.S461028","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/1/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"UROLOGY & NEPHROLOGY","Score":null,"Total":0}
引用次数: 0
摘要
目的:本研究旨在确定预测心脏手术后需要透析的急性肾损伤(AKI)的最佳算法:数据集包括马来西亚一家三级心胸中心 2011 年至 2015 年间的患者数据,数据来源于电子健康记录。广泛的预处理和特征选择确保了数据的质量和相关性。应用了四种机器学习算法:逻辑回归、梯度提升树、支持向量机和随机森林。数据集被分成训练集和验证集,并对超参数进行了调整。评估标准包括准确度、ROC 曲线下面积(AUC)、精确度、F 值、灵敏度和特异性。整个研究过程严格遵守了数据使用和患者隐私的伦理准则:梯度提升树的准确率(88.66%)、AUC(94.61%)和灵敏度(91.30%)最高,表现最佳。随机森林的 AUC(94.78%)和准确率(87.39%)都很高。相比之下,支持向量机的灵敏度(98.57%)较高,特异度(59.55%)较低,但准确度(79.02%)和精确度(70.81%)较低。通过逻辑回归,灵敏度(87.70%)和特异度(87.05%)保持平衡:这些研究结果表明,梯度提升树和随机森林可能是识别心脏手术后发生 AKI 患者的有效方法。不过,在选择算法时应考虑具体目标、灵敏度/特异性权衡以及实际影响。
Comparative Analysis of Logistic Regression, Gradient Boosted Trees, SVM, and Random Forest Algorithms for Prediction of Acute Kidney Injury Requiring Dialysis After Cardiac Surgery.
Purpose: This study aimed to identify the best-performing algorithm for predicting Acute Kidney Injury (AKI) necessitating dialysis following cardiac surgery.
Patients and methods: The dataset encompassed patient data from a tertiary cardiothoracic center in Malaysia between 2011 and 2015, sourced from electronic health records. Extensive preprocessing and feature selection ensured data quality and relevance. Four machine learning algorithms were applied: Logistic Regression, Gradient Boosted Trees, Support Vector Machine, and Random Forest. The dataset was split into training and validation sets and the hyperparameters were tuned. Accuracy, Area Under the ROC Curve (AUC), precision, F-measure, sensitivity, and specificity were some of the evaluation criteria. Ethical guidelines for data use and patient privacy were rigorously followed throughout the study.
Results: With the highest accuracy (88.66%), AUC (94.61%), and sensitivity (91.30%), Gradient Boosted Trees emerged as the top performance. Random Forest displayed strong AUC (94.78%) and accuracy (87.39%). In contrast, the Support Vector Machine showed higher sensitivity (98.57%) with lower specificity (59.55%), but lower accuracy (79.02%) and precision (70.81%). Sensitivity (87.70%) and specificity (87.05%) were maintained in balance via Logistic Regression.
Conclusion: These findings imply that Gradient Boosted Trees and Random Forest might be an effective method for identifying patients who would develop AKI following heart surgery. However specific goals, sensitivity/specificity trade-offs, and consideration of the practical ramifications should all be considered when choosing an algorithm.
期刊介绍:
International Journal of Nephrology and Renovascular Disease is an international, peer-reviewed, open-access journal focusing on the pathophysiology of the kidney and vascular supply. Epidemiology, screening, diagnosis, and treatment interventions are covered as well as basic science, biochemical and immunological studies. In particular, emphasis will be given to: -Chronic kidney disease- Complications of renovascular disease- Imaging techniques- Renal hypertension- Renal cancer- Treatment including pharmacological and transplantation- Dialysis and treatment of complications of dialysis and renal disease- Quality of Life- Patient satisfaction and preference- Health economic evaluations. The journal welcomes submitted papers covering original research, basic science, clinical studies, reviews & evaluations, guidelines, expert opinion and commentary, case reports and extended reports. The main focus of the journal will be to publish research and clinical results in humans but preclinical, animal and in vitro studies will be published where they shed light on disease processes and potential new therapies and interventions.