{"title":"7. Development of a web application for predicting Asia Impairment Scale at discharge in spinal cord injury patients: a machine learning approach","authors":"Kyota Kitagawa MD , Satoshi Maki MD, PhD , Takeo Furuya MD, PhD , Juntaro Maruyama MD , Yasunori Toki MD , Seiji Ohtori MD, PhD","doi":"10.1016/j.xnsj.2024.100345","DOIUrl":null,"url":null,"abstract":"<div><h3>BACKGROUND CONTEXT</h3><p>Precise ASIA Impairment Scale (AIS) prediction at discharge for spinal cord injury (SCI) patients is crucial for guiding treatments, indicating regenerative medicine, and rehabilitation. Machine learning (ML) models are promising to improve such prognostic accuracy and aid clinical decisions.</p></div><div><h3>PURPOSE</h3><p>We aimed to create an ML model that predicts discharge AIS, to identify predictive factors, and to integrate this model into a web application.</p></div><div><h3>STUDY DESIGN/SETTING</h3><p>A retrospective cohort study.</p></div><div><h3>PATIENT SAMPLE</h3><p>This study used data from a nationwide database in Japan, the Japan Rehabilitation Database (JARD), consisting of records from 1991 to 2015. JARD contains both the SCI patients admitted to the SCI center right after the injury and the SCI patients referred to a rehabilitation hospital following acute phase treatment. In total, 3,703 cases formed the study cohort.</p></div><div><h3>OUTCOME MEASURES</h3><p>N/A</p></div><div><h3>METHODS</h3><p>Patient demographics, SCI-specific characteristics, and neurological evaluations at admission were used for ML model training. Utilizing the PyCaret library for preprocessing and validating the models, the best-performing algorithm was selected based on R², accuracy, and the weighted Kappa coefficient. Shapley additive explanations (SHAP) were used to determine the contribution of individual variables to the model's predictions. Using the optimal ML model and Streamlit, a web application to predict AIS at discharge was deployed.</p></div><div><h3>RESULTS</h3><p>The study divided the dataset into 2,592 training cases and 1,111 testing cases. The best-performing model exhibited an R² of 0.869, an accuracy of 0.814, and a weighted Kappa of 0.940. Eleven significant variables were identified with SHAP, including AIS at admission, days from injury to admission, and the motor score of L3. Using the Streamlit library, this best-performing model was deployed as an open-access web application. (<span><span>http://3.138.174.54:8502/</span><svg><path></path></svg></span>)</p></div><div><h3>CONCLUSIONS</h3><p>The developed ML model accurately predicts the AIS at discharge, using 11 essential variables. It has been integrated into a publicly accessible web application.</p></div><div><h3>FDA Device/Drug Status</h3><p>This abstract does not discuss or include any applicable devices or drugs.</p></div>","PeriodicalId":34622,"journal":{"name":"North American Spine Society Journal","volume":"18 ","pages":"Article 100345"},"PeriodicalIF":0.0000,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666548424000386/pdfft?md5=d34e96581a3d3ea707979096af6848aa&pid=1-s2.0-S2666548424000386-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"North American Spine Society Journal","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666548424000386","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"Medicine","Score":null,"Total":0}
引用次数: 0
Abstract
BACKGROUND CONTEXT
Precise ASIA Impairment Scale (AIS) prediction at discharge for spinal cord injury (SCI) patients is crucial for guiding treatments, indicating regenerative medicine, and rehabilitation. Machine learning (ML) models are promising to improve such prognostic accuracy and aid clinical decisions.
PURPOSE
We aimed to create an ML model that predicts discharge AIS, to identify predictive factors, and to integrate this model into a web application.
STUDY DESIGN/SETTING
A retrospective cohort study.
PATIENT SAMPLE
This study used data from a nationwide database in Japan, the Japan Rehabilitation Database (JARD), consisting of records from 1991 to 2015. JARD contains both the SCI patients admitted to the SCI center right after the injury and the SCI patients referred to a rehabilitation hospital following acute phase treatment. In total, 3,703 cases formed the study cohort.
OUTCOME MEASURES
N/A
METHODS
Patient demographics, SCI-specific characteristics, and neurological evaluations at admission were used for ML model training. Utilizing the PyCaret library for preprocessing and validating the models, the best-performing algorithm was selected based on R², accuracy, and the weighted Kappa coefficient. Shapley additive explanations (SHAP) were used to determine the contribution of individual variables to the model's predictions. Using the optimal ML model and Streamlit, a web application to predict AIS at discharge was deployed.
RESULTS
The study divided the dataset into 2,592 training cases and 1,111 testing cases. The best-performing model exhibited an R² of 0.869, an accuracy of 0.814, and a weighted Kappa of 0.940. Eleven significant variables were identified with SHAP, including AIS at admission, days from injury to admission, and the motor score of L3. Using the Streamlit library, this best-performing model was deployed as an open-access web application. (http://3.138.174.54:8502/)
CONCLUSIONS
The developed ML model accurately predicts the AIS at discharge, using 11 essential variables. It has been integrated into a publicly accessible web application.
FDA Device/Drug Status
This abstract does not discuss or include any applicable devices or drugs.