{"title":"Establishment and external validation of an early warning model of diabetic peripheral neuropathy based on random forest and logistic regression.","authors":"Lujie Wang, Jiajie Li, Yixuan Lin, Huilun Yuan, Zhaohui Fang, Aihua Fei, Guoming Shen, Aijuan Jiang","doi":"10.1186/s12902-024-01728-9","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>The primary objective of this study was to investigate the risk factors for diabetic peripheral neuropathy (DPN) and to establish an early diagnostic prediction model for its onset, based on clinical data and biochemical indices.</p><p><strong>Methods: </strong>Retrospective data were collected from 1,446 diabetic patients at the First Affiliated Hospital of Anhui University of Chinese Medicine and were split into training and internal validation sets in a 7:3 ratio. Additionally, 360 diabetic patients from the Second Affiliated Hospital were used as an external validation cohort. Feature selection was conducted within the training set, where univariate logistic regression identified variables with a p-value < 0.05, followed by backward elimination to construct the logistic regression model. Concurrently, the random forest algorithm was applied to the training set to identify the top 10 most important features, with hyperparameter optimization performed via grid search combined with cross-validation. Model performance was evaluated using ROC curves, decision curve analysis, and calibration curves. Model fit was assessed using the Hosmer-Lemeshow test, followed by Brier Score evaluation for the random forest model. Ten-fold cross-validation was employed for further validation, and SHAP analysis was conducted to enhance model interpretability.</p><p><strong>Results: </strong>A nomogram model was developed using logistic regression with key features: limb numbness, limb pain, diabetic retinopathy, diabetic kidney disease, urinary protein, diastolic blood pressure, white blood cell count, HbA1c, and high-density lipoprotein cholesterol. The model achieved AUCs of 0.91, 0.88, and 0.88 for the training, validation, and test sets, respectively, with a mean AUC of 0.902 across 10-fold cross-validation. Hosmer-Lemeshow test results showed p-values of 0.595, 0.418, and 0.126 for the training, validation, and test sets, respectively. The random forest model demonstrated AUCs of 0.95, 0.88, and 0.88 for the training, validation, and test sets, respectively, with a mean AUC of 0.886 across 10-fold cross-validation. The Brier score indicates a good calibration level, with values of 0.104, 0.143, and 0.142 for the training, validation, and test sets, respectively.</p><p><strong>Conclusion: </strong>The developed nomogram exhibits promise as an effective tool for the diagnosis of diabetic peripheral neuropathy in clinical settings.</p>","PeriodicalId":9152,"journal":{"name":"BMC Endocrine Disorders","volume":"24 1","pages":"196"},"PeriodicalIF":2.8000,"publicationDate":"2024-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11414046/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"BMC Endocrine Disorders","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s12902-024-01728-9","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENDOCRINOLOGY & METABOLISM","Score":null,"Total":0}
引用次数: 0
Abstract
Objective: The primary objective of this study was to investigate the risk factors for diabetic peripheral neuropathy (DPN) and to establish an early diagnostic prediction model for its onset, based on clinical data and biochemical indices.
Methods: Retrospective data were collected from 1,446 diabetic patients at the First Affiliated Hospital of Anhui University of Chinese Medicine and were split into training and internal validation sets in a 7:3 ratio. Additionally, 360 diabetic patients from the Second Affiliated Hospital were used as an external validation cohort. Feature selection was conducted within the training set, where univariate logistic regression identified variables with a p-value < 0.05, followed by backward elimination to construct the logistic regression model. Concurrently, the random forest algorithm was applied to the training set to identify the top 10 most important features, with hyperparameter optimization performed via grid search combined with cross-validation. Model performance was evaluated using ROC curves, decision curve analysis, and calibration curves. Model fit was assessed using the Hosmer-Lemeshow test, followed by Brier Score evaluation for the random forest model. Ten-fold cross-validation was employed for further validation, and SHAP analysis was conducted to enhance model interpretability.
Results: A nomogram model was developed using logistic regression with key features: limb numbness, limb pain, diabetic retinopathy, diabetic kidney disease, urinary protein, diastolic blood pressure, white blood cell count, HbA1c, and high-density lipoprotein cholesterol. The model achieved AUCs of 0.91, 0.88, and 0.88 for the training, validation, and test sets, respectively, with a mean AUC of 0.902 across 10-fold cross-validation. Hosmer-Lemeshow test results showed p-values of 0.595, 0.418, and 0.126 for the training, validation, and test sets, respectively. The random forest model demonstrated AUCs of 0.95, 0.88, and 0.88 for the training, validation, and test sets, respectively, with a mean AUC of 0.886 across 10-fold cross-validation. The Brier score indicates a good calibration level, with values of 0.104, 0.143, and 0.142 for the training, validation, and test sets, respectively.
Conclusion: The developed nomogram exhibits promise as an effective tool for the diagnosis of diabetic peripheral neuropathy in clinical settings.
期刊介绍:
BMC Endocrine Disorders is an open access, peer-reviewed journal that considers articles on all aspects of the prevention, diagnosis and management of endocrine disorders, as well as related molecular genetics, pathophysiology, and epidemiology.