Benjamin S Hopkins, Michael B Cloney, Ekamjeet S Dhillon, Pavlos Texakalidis, Jonathan Dallas, Vincent N Nguyen, Matthew Ordon, Najib El Tecle, Thomas C Chen, Patrick C Hsieh, John C Liu, Tyler R Koski, Nader S Dahdaleh
{"title":"使用机器学习和大数据预测脊柱手术后静脉血栓栓塞事件:对6869名患者队列的多个模型的单中心回顾性分析。","authors":"Benjamin S Hopkins, Michael B Cloney, Ekamjeet S Dhillon, Pavlos Texakalidis, Jonathan Dallas, Vincent N Nguyen, Matthew Ordon, Najib El Tecle, Thomas C Chen, Patrick C Hsieh, John C Liu, Tyler R Koski, Nader S Dahdaleh","doi":"10.4103/jcvjs.jcvjs_69_23","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>Venous thromboembolic event (VTE) after spine surgery is a rare but potentially devastating complication. With the advent of machine learning, an opportunity exists for more accurate prediction of such events to aid in prevention and treatment.</p><p><strong>Methods: </strong>Seven models were screened using 108 database variables and 62 preoperative variables. These models included deep neural network (DNN), DNN with synthetic minority oversampling technique (SMOTE), logistic regression, ridge regression, lasso regression, simple linear regression, and gradient boosting classifier. Relevant metrics were compared between each model. The top four models were selected based on area under the receiver operator curve; these models included DNN with SMOTE, linear regression, lasso regression, and ridge regression. Separate random sampling of each model was performed 1000 additional independent times using a randomly generated training/testing distribution. Variable weights and magnitudes were analyzed after sampling.</p><p><strong>Results: </strong>Using all patient-related variables, DNN using SMOTE was the top-performing model in predicting postoperative VTE after spinal surgery (area under the curve [AUC] =0.904), followed by lasso regression (AUC = 0.894), ridge regression (AUC = 0.873), and linear regression (AUC = 0.864). When analyzing a subset of only preoperative variables, the top-performing models were lasso regression (AUC = 0.865) and DNN with SMOTE (AUC = 0.864), both of which outperform any currently published models. Main model contributions relied heavily on variables associated with history of thromboembolic events, length of surgical/anesthetic time, and use of postoperative chemoprophylaxis.</p><p><strong>Conclusions: </strong>The current study provides promise toward machine learning methods geared toward predicting postoperative complications after spine surgery. Further study is needed in order to best quantify and model real-world risk for such events.</p>","PeriodicalId":51721,"journal":{"name":"Journal of Craniovertebral Junction and Spine","volume":null,"pages":null},"PeriodicalIF":1.4000,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/09/53/JCVJS-14-221.PMC10583792.pdf","citationCount":"0","resultStr":"{\"title\":\"Using machine learning and big data for the prediction of venous thromboembolic events after spine surgery: A single-center retrospective analysis of multiple models on a cohort of 6869 patients.\",\"authors\":\"Benjamin S Hopkins, Michael B Cloney, Ekamjeet S Dhillon, Pavlos Texakalidis, Jonathan Dallas, Vincent N Nguyen, Matthew Ordon, Najib El Tecle, Thomas C Chen, Patrick C Hsieh, John C Liu, Tyler R Koski, Nader S Dahdaleh\",\"doi\":\"10.4103/jcvjs.jcvjs_69_23\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Objective: </strong>Venous thromboembolic event (VTE) after spine surgery is a rare but potentially devastating complication. With the advent of machine learning, an opportunity exists for more accurate prediction of such events to aid in prevention and treatment.</p><p><strong>Methods: </strong>Seven models were screened using 108 database variables and 62 preoperative variables. These models included deep neural network (DNN), DNN with synthetic minority oversampling technique (SMOTE), logistic regression, ridge regression, lasso regression, simple linear regression, and gradient boosting classifier. Relevant metrics were compared between each model. The top four models were selected based on area under the receiver operator curve; these models included DNN with SMOTE, linear regression, lasso regression, and ridge regression. Separate random sampling of each model was performed 1000 additional independent times using a randomly generated training/testing distribution. Variable weights and magnitudes were analyzed after sampling.</p><p><strong>Results: </strong>Using all patient-related variables, DNN using SMOTE was the top-performing model in predicting postoperative VTE after spinal surgery (area under the curve [AUC] =0.904), followed by lasso regression (AUC = 0.894), ridge regression (AUC = 0.873), and linear regression (AUC = 0.864). When analyzing a subset of only preoperative variables, the top-performing models were lasso regression (AUC = 0.865) and DNN with SMOTE (AUC = 0.864), both of which outperform any currently published models. Main model contributions relied heavily on variables associated with history of thromboembolic events, length of surgical/anesthetic time, and use of postoperative chemoprophylaxis.</p><p><strong>Conclusions: </strong>The current study provides promise toward machine learning methods geared toward predicting postoperative complications after spine surgery. Further study is needed in order to best quantify and model real-world risk for such events.</p>\",\"PeriodicalId\":51721,\"journal\":{\"name\":\"Journal of Craniovertebral Junction and Spine\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.4000,\"publicationDate\":\"2023-07-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/09/53/JCVJS-14-221.PMC10583792.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Craniovertebral Junction and Spine\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.4103/jcvjs.jcvjs_69_23\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2023/9/18 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q2\",\"JCRName\":\"OTORHINOLARYNGOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Craniovertebral Junction and Spine","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.4103/jcvjs.jcvjs_69_23","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/9/18 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"OTORHINOLARYNGOLOGY","Score":null,"Total":0}
Using machine learning and big data for the prediction of venous thromboembolic events after spine surgery: A single-center retrospective analysis of multiple models on a cohort of 6869 patients.
Objective: Venous thromboembolic event (VTE) after spine surgery is a rare but potentially devastating complication. With the advent of machine learning, an opportunity exists for more accurate prediction of such events to aid in prevention and treatment.
Methods: Seven models were screened using 108 database variables and 62 preoperative variables. These models included deep neural network (DNN), DNN with synthetic minority oversampling technique (SMOTE), logistic regression, ridge regression, lasso regression, simple linear regression, and gradient boosting classifier. Relevant metrics were compared between each model. The top four models were selected based on area under the receiver operator curve; these models included DNN with SMOTE, linear regression, lasso regression, and ridge regression. Separate random sampling of each model was performed 1000 additional independent times using a randomly generated training/testing distribution. Variable weights and magnitudes were analyzed after sampling.
Results: Using all patient-related variables, DNN using SMOTE was the top-performing model in predicting postoperative VTE after spinal surgery (area under the curve [AUC] =0.904), followed by lasso regression (AUC = 0.894), ridge regression (AUC = 0.873), and linear regression (AUC = 0.864). When analyzing a subset of only preoperative variables, the top-performing models were lasso regression (AUC = 0.865) and DNN with SMOTE (AUC = 0.864), both of which outperform any currently published models. Main model contributions relied heavily on variables associated with history of thromboembolic events, length of surgical/anesthetic time, and use of postoperative chemoprophylaxis.
Conclusions: The current study provides promise toward machine learning methods geared toward predicting postoperative complications after spine surgery. Further study is needed in order to best quantify and model real-world risk for such events.