Xin Chang Zou, Cheng Wei Luo, Rong Man Yuan, Meng Ni Jin, Tao Zeng, Hai Chao Chao
{"title":"Develop a radiomics-based machine learning model to predict the stone-free rate post-percutaneous nephrolithotomy","authors":"Xin Chang Zou, Cheng Wei Luo, Rong Man Yuan, Meng Ni Jin, Tao Zeng, Hai Chao Chao","doi":"10.1007/s00240-024-01562-7","DOIUrl":null,"url":null,"abstract":"<p>Radiomics and machine learning have been extensively utilized in the realm of urinary stones, particularly in forecasting stone treatment outcomes. The objective of this study was to integrate clinical variables and radiomic features to develop a machine learning model for predicting the stone-free rate (SFR) following percutaneous nephrolithotomy (PCNL). A total of 212 eligible patients who underwent PCNL surgery at the Second Affiliated Hospital of Nanchang University were included in a retrospective analysis. Preoperative clinical variables and non-contrast-enhanced CT images of all patients were collected, and radiomic features were extracted after delineating the stone ROI. Univariate analysis was conducted to identify clinical variables strongly correlated with the stone-free rate after PCNL, and the least absolute shrinkage and selection operator algorithm (lasso regression) was utilized to screen radiomic features. Four supervised machine learning algorithms, including Logistic Regression, Random Forest (RF), Extreme Gradient Boosting (XGBoost), and Gradient Boosting Decision Tree (GBDT), were employed. The clinical variables with strong correlation and screened radiomic features were integrated into the four machine learning algorithms to construct a prediction model, and the receiver operating curve was plotted. The area under the receiver operating curve (AUC), the accuracy rate, the specificity, etc., were used to evaluate the predictive performance of the four models. After analyzing postoperative statistics, the stone-free rate following the procedure was found to be 70.3% (<i>n</i> = 149). Among the various clinical variables examined, factors, such as stone number, stone diameter, stone CT value, stone location, and history of stone surgery, were identified as statistically significant in relation to the stone-free rate after PCNL. A total of 121 radiomic features were extracted, and through lasso regression, 7 features most closely associated with the stone-free rate post-PCNL were identified. The predictive accuracy of different models (Logistic Regression, RF, XGBoost, and GBDT) for determining the stone-free rate after PCNL was evaluated, yielding accuracies of 78.1%, 76.6%, 75.0%, and 73.4%, respectively. The corresponding area under the curve AUC (95%CI) were 0.85 (0.83–0.89), 0.81 (0.76–0.85), 0.82 (0.78–0.85), and 0.77 (0.73–0.81), positioning these models among the top performers in logistic regression prediction. In terms of predictive importance scores, the key factors identified by the logistic regression model were number of stone, zone percentage, stone diameter, and surface area. Similarly, the RF model highlighted number of stone, stone CT value, stone diameter, and surface area as the top predictors. Among the four machine learning models, the logistic regression model demonstrated the highest accuracy and discrimination ability in predicting the stone-free rate following PCNL. In comparison to XGBoost and GBDT, RF also exhibited superior accuracy and a certain level of discrimination ability. However, based on the performance of all four models, logistic regression is more likely to aid in clinical decision-making by assisting clinicians in diagnosing PCNL in patients. This enables us to effectively predict the presence of residual stones post-surgery and ultimately select patients who are suitable candidates for PCNL.</p>","PeriodicalId":23411,"journal":{"name":"Urolithiasis","volume":"252 1","pages":""},"PeriodicalIF":2.0000,"publicationDate":"2024-04-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Urolithiasis","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s00240-024-01562-7","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"UROLOGY & NEPHROLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Radiomics and machine learning have been extensively utilized in the realm of urinary stones, particularly in forecasting stone treatment outcomes. The objective of this study was to integrate clinical variables and radiomic features to develop a machine learning model for predicting the stone-free rate (SFR) following percutaneous nephrolithotomy (PCNL). A total of 212 eligible patients who underwent PCNL surgery at the Second Affiliated Hospital of Nanchang University were included in a retrospective analysis. Preoperative clinical variables and non-contrast-enhanced CT images of all patients were collected, and radiomic features were extracted after delineating the stone ROI. Univariate analysis was conducted to identify clinical variables strongly correlated with the stone-free rate after PCNL, and the least absolute shrinkage and selection operator algorithm (lasso regression) was utilized to screen radiomic features. Four supervised machine learning algorithms, including Logistic Regression, Random Forest (RF), Extreme Gradient Boosting (XGBoost), and Gradient Boosting Decision Tree (GBDT), were employed. The clinical variables with strong correlation and screened radiomic features were integrated into the four machine learning algorithms to construct a prediction model, and the receiver operating curve was plotted. The area under the receiver operating curve (AUC), the accuracy rate, the specificity, etc., were used to evaluate the predictive performance of the four models. After analyzing postoperative statistics, the stone-free rate following the procedure was found to be 70.3% (n = 149). Among the various clinical variables examined, factors, such as stone number, stone diameter, stone CT value, stone location, and history of stone surgery, were identified as statistically significant in relation to the stone-free rate after PCNL. A total of 121 radiomic features were extracted, and through lasso regression, 7 features most closely associated with the stone-free rate post-PCNL were identified. The predictive accuracy of different models (Logistic Regression, RF, XGBoost, and GBDT) for determining the stone-free rate after PCNL was evaluated, yielding accuracies of 78.1%, 76.6%, 75.0%, and 73.4%, respectively. The corresponding area under the curve AUC (95%CI) were 0.85 (0.83–0.89), 0.81 (0.76–0.85), 0.82 (0.78–0.85), and 0.77 (0.73–0.81), positioning these models among the top performers in logistic regression prediction. In terms of predictive importance scores, the key factors identified by the logistic regression model were number of stone, zone percentage, stone diameter, and surface area. Similarly, the RF model highlighted number of stone, stone CT value, stone diameter, and surface area as the top predictors. Among the four machine learning models, the logistic regression model demonstrated the highest accuracy and discrimination ability in predicting the stone-free rate following PCNL. In comparison to XGBoost and GBDT, RF also exhibited superior accuracy and a certain level of discrimination ability. However, based on the performance of all four models, logistic regression is more likely to aid in clinical decision-making by assisting clinicians in diagnosing PCNL in patients. This enables us to effectively predict the presence of residual stones post-surgery and ultimately select patients who are suitable candidates for PCNL.
期刊介绍:
Official Journal of the International Urolithiasis Society
The journal aims to publish original articles in the fields of clinical and experimental investigation only within the sphere of urolithiasis and its related areas of research. The journal covers all aspects of urolithiasis research including the diagnosis, epidemiology, pathogenesis, genetics, clinical biochemistry, open and non-invasive surgical intervention, nephrological investigation, chemistry and prophylaxis of the disorder. The Editor welcomes contributions on topics of interest to urologists, nephrologists, radiologists, clinical biochemists, epidemiologists, nutritionists, basic scientists and nurses working in that field.
Contributions may be submitted as full-length articles or as rapid communications in the form of Letters to the Editor. Articles should be original and should contain important new findings from carefully conducted studies designed to produce statistically significant data. Please note that we no longer publish articles classified as Case Reports. Editorials and review articles may be published by invitation from the Editorial Board. All submissions are peer-reviewed. Through an electronic system for the submission and review of manuscripts, the Editor and Associate Editors aim to make publication accessible as quickly as possible to a large number of readers throughout the world.