Tzu-Chun Wu, Abraham Kim, Ching-Tzu Tsai, Andy Gao, Taran Ghuman, Anne Paul, Alexandra Castillo, Joseph Cheng, Owoicho Adogwa, Laura B Ngwenya, Brandon Foreman, Danny T Y Wu
{"title":"一家学术医院利用机器学习、工作流程分析和仿真技术开展神经外科再入院率降低项目。","authors":"Tzu-Chun Wu, Abraham Kim, Ching-Tzu Tsai, Andy Gao, Taran Ghuman, Anne Paul, Alexandra Castillo, Joseph Cheng, Owoicho Adogwa, Laura B Ngwenya, Brandon Foreman, Danny T Y Wu","doi":"10.1055/s-0044-1787119","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong> Predicting 30-day hospital readmissions is crucial for improving patient outcomes, optimizing resource allocation, and achieving financial savings. Existing studies reporting the development of machine learning (ML) models predictive of neurosurgical readmissions do not report factors related to clinical implementation.</p><p><strong>Objectives: </strong> Train individual predictive models with good performance (area under the receiver operating characteristic curve or AUROC > 0.8), identify potential interventions through semi-structured interviews, and demonstrate estimated clinical and financial impact of these models.</p><p><strong>Methods: </strong> Electronic health records were utilized with five ML methodologies: gradient boosting, decision tree, random forest, ridge logistic regression, and linear support vector machine. Variables of interest were determined by domain experts and literature. The dataset was split divided 80% for training and validation and 20% for testing randomly. Clinical workflow analysis was conducted using semi-structured interviews to identify possible intervention points. Calibrated agent-based models (ABMs), based on a previous study with interventions, were applied to simulate reductions of the 30-day readmission rate and financial costs.</p><p><strong>Results: </strong> The dataset covered 12,334 neurosurgical intensive care unit (NSICU) admissions (11,029 patients); 1,903 spine surgery admissions (1,641 patients), and 2,208 traumatic brain injury (TBI) admissions (2,185 patients), with readmission rate of 13.13, 13.93, and 23.73%, respectively. The random forest model for NSICU achieved best performance with an AUROC score of 0.89, capturing potential patients effectively. Six interventions were identified through 12 semi-structured interviews targeting preoperative, inpatient stay, discharge phases, and follow-up phases. Calibrated ABMs simulated median readmission reduction rates and resulted in 13.13 to 10.12% (NSICU), 13.90 to 10.98% (spine surgery), and 23.64 to 21.20% (TBI). Approximately $1,300,614.28 in saving resulted from potential interventions.</p><p><strong>Conclusion: </strong> This study reports the successful development and simulation of an ML-based approach for predicting and reducing 30-day hospital readmissions in neurosurgery. The intervention shows feasibility in improving patient outcomes and reducing financial losses.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"15 3","pages":"479-488"},"PeriodicalIF":2.1000,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11186699/pdf/","citationCount":"0","resultStr":"{\"title\":\"A Neurosurgical Readmissions Reduction Program in an Academic Hospital Leveraging Machine Learning, Workflow Analysis, and Simulation.\",\"authors\":\"Tzu-Chun Wu, Abraham Kim, Ching-Tzu Tsai, Andy Gao, Taran Ghuman, Anne Paul, Alexandra Castillo, Joseph Cheng, Owoicho Adogwa, Laura B Ngwenya, Brandon Foreman, Danny T Y Wu\",\"doi\":\"10.1055/s-0044-1787119\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong> Predicting 30-day hospital readmissions is crucial for improving patient outcomes, optimizing resource allocation, and achieving financial savings. Existing studies reporting the development of machine learning (ML) models predictive of neurosurgical readmissions do not report factors related to clinical implementation.</p><p><strong>Objectives: </strong> Train individual predictive models with good performance (area under the receiver operating characteristic curve or AUROC > 0.8), identify potential interventions through semi-structured interviews, and demonstrate estimated clinical and financial impact of these models.</p><p><strong>Methods: </strong> Electronic health records were utilized with five ML methodologies: gradient boosting, decision tree, random forest, ridge logistic regression, and linear support vector machine. Variables of interest were determined by domain experts and literature. The dataset was split divided 80% for training and validation and 20% for testing randomly. Clinical workflow analysis was conducted using semi-structured interviews to identify possible intervention points. Calibrated agent-based models (ABMs), based on a previous study with interventions, were applied to simulate reductions of the 30-day readmission rate and financial costs.</p><p><strong>Results: </strong> The dataset covered 12,334 neurosurgical intensive care unit (NSICU) admissions (11,029 patients); 1,903 spine surgery admissions (1,641 patients), and 2,208 traumatic brain injury (TBI) admissions (2,185 patients), with readmission rate of 13.13, 13.93, and 23.73%, respectively. The random forest model for NSICU achieved best performance with an AUROC score of 0.89, capturing potential patients effectively. Six interventions were identified through 12 semi-structured interviews targeting preoperative, inpatient stay, discharge phases, and follow-up phases. Calibrated ABMs simulated median readmission reduction rates and resulted in 13.13 to 10.12% (NSICU), 13.90 to 10.98% (spine surgery), and 23.64 to 21.20% (TBI). Approximately $1,300,614.28 in saving resulted from potential interventions.</p><p><strong>Conclusion: </strong> This study reports the successful development and simulation of an ML-based approach for predicting and reducing 30-day hospital readmissions in neurosurgery. The intervention shows feasibility in improving patient outcomes and reducing financial losses.</p>\",\"PeriodicalId\":48956,\"journal\":{\"name\":\"Applied Clinical Informatics\",\"volume\":\"15 3\",\"pages\":\"479-488\"},\"PeriodicalIF\":2.1000,\"publicationDate\":\"2024-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11186699/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Applied Clinical Informatics\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1055/s-0044-1787119\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/6/19 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q4\",\"JCRName\":\"MEDICAL INFORMATICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Clinical Informatics","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1055/s-0044-1787119","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/6/19 0:00:00","PubModel":"Epub","JCR":"Q4","JCRName":"MEDICAL INFORMATICS","Score":null,"Total":0}
A Neurosurgical Readmissions Reduction Program in an Academic Hospital Leveraging Machine Learning, Workflow Analysis, and Simulation.
Background: Predicting 30-day hospital readmissions is crucial for improving patient outcomes, optimizing resource allocation, and achieving financial savings. Existing studies reporting the development of machine learning (ML) models predictive of neurosurgical readmissions do not report factors related to clinical implementation.
Objectives: Train individual predictive models with good performance (area under the receiver operating characteristic curve or AUROC > 0.8), identify potential interventions through semi-structured interviews, and demonstrate estimated clinical and financial impact of these models.
Methods: Electronic health records were utilized with five ML methodologies: gradient boosting, decision tree, random forest, ridge logistic regression, and linear support vector machine. Variables of interest were determined by domain experts and literature. The dataset was split divided 80% for training and validation and 20% for testing randomly. Clinical workflow analysis was conducted using semi-structured interviews to identify possible intervention points. Calibrated agent-based models (ABMs), based on a previous study with interventions, were applied to simulate reductions of the 30-day readmission rate and financial costs.
Results: The dataset covered 12,334 neurosurgical intensive care unit (NSICU) admissions (11,029 patients); 1,903 spine surgery admissions (1,641 patients), and 2,208 traumatic brain injury (TBI) admissions (2,185 patients), with readmission rate of 13.13, 13.93, and 23.73%, respectively. The random forest model for NSICU achieved best performance with an AUROC score of 0.89, capturing potential patients effectively. Six interventions were identified through 12 semi-structured interviews targeting preoperative, inpatient stay, discharge phases, and follow-up phases. Calibrated ABMs simulated median readmission reduction rates and resulted in 13.13 to 10.12% (NSICU), 13.90 to 10.98% (spine surgery), and 23.64 to 21.20% (TBI). Approximately $1,300,614.28 in saving resulted from potential interventions.
Conclusion: This study reports the successful development and simulation of an ML-based approach for predicting and reducing 30-day hospital readmissions in neurosurgery. The intervention shows feasibility in improving patient outcomes and reducing financial losses.
期刊介绍:
ACI is the third Schattauer journal dealing with biomedical and health informatics. It perfectly complements our other journals Öffnet internen Link im aktuellen FensterMethods of Information in Medicine and the Öffnet internen Link im aktuellen FensterYearbook of Medical Informatics. The Yearbook of Medical Informatics being the “Milestone” or state-of-the-art journal and Methods of Information in Medicine being the “Science and Research” journal of IMIA, ACI intends to be the “Practical” journal of IMIA.