Bing Li, Yanru Yang, Feng Shen, Yuelei Wang, Ting Wang, Xiaxia Chen, Chun Lu
{"title":"基于多中心临床数据的骨质疏松性骨折风险评估大数据机器学习分析模型在青岛市的临床应用","authors":"Bing Li, Yanru Yang, Feng Shen, Yuelei Wang, Ting Wang, Xiaxia Chen, Chun Lu","doi":"10.24976/Discov.Med.202537192.5","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Osteoporotic fractures (OPF) pose a public health issue, imposing significant burdens on families and societies worldwide. Currently, there is a lack of comprehensive and validated risk assessment models for OPF. This study aims to develop a model to assess and predict the risk of OPF in Qingdao City, China.</p><p><strong>Methods: </strong>From January 2021 to January 2023, we recruited 84 osteoporotic patients diagnosed with fractures from Qingdao University Affiliated Hospital, Qingdao Municipal Hospital, Qingdao Hiser Hospital Affiliated of Qingdao University, and Qingdao Central Hospital as the experimental group. In addition, 112 osteoporotic patients without fractures were recruited as the control group. In this study, we employed seven machine learning models, namely Adaboost, random forest (RF), K-Nearest Neighbors (KNN), Support Vector Machine (SVM), Logistic Regression (LR), Naive Bayes (NB), and Gradient Boosting Decision Trees (GBDT), to analyze the risk factors influencing the occurrence of OPF. Next, we plotted receiver operating characteristic (ROC), Precision-Recall (PR), and calibration curves to evaluate the predictive values of the different risk assessment models for OPF.</p><p><strong>Results: </strong>Among the seven models built based on the training set data, the Adaboost model showed area under the curve (AUC), sensitivity, and specificity values close to 1, indicating the best classification performance. In the test set, the AUC values for the RF, SVM, LR, KNN, NB, AdaBoost, and GBDT models were 0.936, 0.905, 0.88, 0.93, 0.862, 0.939, and 0.859, respectively (<i>p</i> < 0.001). All sensitivity and specificity values for these models were higher than 0.8, with sensitivity and specificity values of the Adaboost model closest to 1. Additionally, six models had an area under the Precision-Recall curve (prAUC) values higher than 0.9, except KNN at 0.284 (<i>p</i> < 0.001). The calibration curves of the seven models did not significantly deviate from the ideal curve, indicating acceptable discriminative ability and predictive performance of the predictive model. All results showed that trabecular bone score (TBS) was the most important variable affecting the model, followed by osteocalcin (OST) and hunchback.</p><p><strong>Conclusions: </strong>Given the various clinical data from patients with OPF, we assessed and demonstrated the good predictive performance of our risk predictive models. This model will enable us to take timely intervention measures to reduce the incidence of OPF and improve patient prognosis.</p>","PeriodicalId":93980,"journal":{"name":"Discovery medicine","volume":"37 192","pages":"55-63"},"PeriodicalIF":2.1000,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Clinical Application of a Big Data Machine Learning Analysis Model for Osteoporotic Fracture Risk Assessment Built on Multicenter Clinical Data in Qingdao City.\",\"authors\":\"Bing Li, Yanru Yang, Feng Shen, Yuelei Wang, Ting Wang, Xiaxia Chen, Chun Lu\",\"doi\":\"10.24976/Discov.Med.202537192.5\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Osteoporotic fractures (OPF) pose a public health issue, imposing significant burdens on families and societies worldwide. Currently, there is a lack of comprehensive and validated risk assessment models for OPF. This study aims to develop a model to assess and predict the risk of OPF in Qingdao City, China.</p><p><strong>Methods: </strong>From January 2021 to January 2023, we recruited 84 osteoporotic patients diagnosed with fractures from Qingdao University Affiliated Hospital, Qingdao Municipal Hospital, Qingdao Hiser Hospital Affiliated of Qingdao University, and Qingdao Central Hospital as the experimental group. In addition, 112 osteoporotic patients without fractures were recruited as the control group. In this study, we employed seven machine learning models, namely Adaboost, random forest (RF), K-Nearest Neighbors (KNN), Support Vector Machine (SVM), Logistic Regression (LR), Naive Bayes (NB), and Gradient Boosting Decision Trees (GBDT), to analyze the risk factors influencing the occurrence of OPF. Next, we plotted receiver operating characteristic (ROC), Precision-Recall (PR), and calibration curves to evaluate the predictive values of the different risk assessment models for OPF.</p><p><strong>Results: </strong>Among the seven models built based on the training set data, the Adaboost model showed area under the curve (AUC), sensitivity, and specificity values close to 1, indicating the best classification performance. In the test set, the AUC values for the RF, SVM, LR, KNN, NB, AdaBoost, and GBDT models were 0.936, 0.905, 0.88, 0.93, 0.862, 0.939, and 0.859, respectively (<i>p</i> < 0.001). All sensitivity and specificity values for these models were higher than 0.8, with sensitivity and specificity values of the Adaboost model closest to 1. Additionally, six models had an area under the Precision-Recall curve (prAUC) values higher than 0.9, except KNN at 0.284 (<i>p</i> < 0.001). The calibration curves of the seven models did not significantly deviate from the ideal curve, indicating acceptable discriminative ability and predictive performance of the predictive model. All results showed that trabecular bone score (TBS) was the most important variable affecting the model, followed by osteocalcin (OST) and hunchback.</p><p><strong>Conclusions: </strong>Given the various clinical data from patients with OPF, we assessed and demonstrated the good predictive performance of our risk predictive models. This model will enable us to take timely intervention measures to reduce the incidence of OPF and improve patient prognosis.</p>\",\"PeriodicalId\":93980,\"journal\":{\"name\":\"Discovery medicine\",\"volume\":\"37 192\",\"pages\":\"55-63\"},\"PeriodicalIF\":2.1000,\"publicationDate\":\"2025-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Discovery medicine\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.24976/Discov.Med.202537192.5\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Discovery medicine","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.24976/Discov.Med.202537192.5","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
背景:骨质疏松性骨折(OPF)是一个公共卫生问题,给全世界的家庭和社会带来了巨大的负担。目前,缺乏全面、有效的OPF风险评估模型。本研究旨在建立青岛市OPF风险评估与预测模型。方法:于2021年1月至2023年1月,在青岛大学附属医院、青岛市市立医院、青岛大学附属海泽医院、青岛市中心医院招募84例确诊为骨折的骨质疏松患者作为实验组。另外,选取112例无骨折的骨质疏松患者作为对照组。本研究采用Adaboost、随机森林(RF)、k近邻(KNN)、支持向量机(SVM)、Logistic回归(LR)、朴素贝叶斯(NB)和梯度增强决策树(GBDT) 7种机器学习模型,分析影响OPF发生的危险因素。接下来,我们绘制了受试者工作特征(ROC)、精确召回率(PR)和校准曲线,以评估不同风险评估模型对OPF的预测价值。结果:在基于训练集数据构建的7个模型中,Adaboost模型的曲线下面积(area under the curve, AUC)、灵敏度(sensitivity)和特异性(specificity)值均接近1,分类性能最好。在测试集中,RF、SVM、LR、KNN、NB、AdaBoost和GBDT模型的AUC值分别为0.936、0.905、0.88、0.93、0.862、0.939和0.859 (p < 0.001)。这些模型的敏感性和特异性值均大于0.8,其中Adaboost模型的敏感性和特异性值最接近于1。此外,除KNN为0.284 (p < 0.001)外,6个模型的Precision-Recall curve (prAUC)下面积均大于0.9。7个模型的校正曲线与理想曲线均无明显偏差,表明预测模型的判别能力和预测性能尚可。结果显示,骨小梁评分(TBS)是影响模型的最重要变量,其次是骨钙素(OST)和驼背。结论:考虑到来自OPF患者的各种临床数据,我们评估并证明了我们的风险预测模型的良好预测性能。该模型将使我们能够及时采取干预措施,降低OPF的发生率,改善患者预后。
Clinical Application of a Big Data Machine Learning Analysis Model for Osteoporotic Fracture Risk Assessment Built on Multicenter Clinical Data in Qingdao City.
Background: Osteoporotic fractures (OPF) pose a public health issue, imposing significant burdens on families and societies worldwide. Currently, there is a lack of comprehensive and validated risk assessment models for OPF. This study aims to develop a model to assess and predict the risk of OPF in Qingdao City, China.
Methods: From January 2021 to January 2023, we recruited 84 osteoporotic patients diagnosed with fractures from Qingdao University Affiliated Hospital, Qingdao Municipal Hospital, Qingdao Hiser Hospital Affiliated of Qingdao University, and Qingdao Central Hospital as the experimental group. In addition, 112 osteoporotic patients without fractures were recruited as the control group. In this study, we employed seven machine learning models, namely Adaboost, random forest (RF), K-Nearest Neighbors (KNN), Support Vector Machine (SVM), Logistic Regression (LR), Naive Bayes (NB), and Gradient Boosting Decision Trees (GBDT), to analyze the risk factors influencing the occurrence of OPF. Next, we plotted receiver operating characteristic (ROC), Precision-Recall (PR), and calibration curves to evaluate the predictive values of the different risk assessment models for OPF.
Results: Among the seven models built based on the training set data, the Adaboost model showed area under the curve (AUC), sensitivity, and specificity values close to 1, indicating the best classification performance. In the test set, the AUC values for the RF, SVM, LR, KNN, NB, AdaBoost, and GBDT models were 0.936, 0.905, 0.88, 0.93, 0.862, 0.939, and 0.859, respectively (p < 0.001). All sensitivity and specificity values for these models were higher than 0.8, with sensitivity and specificity values of the Adaboost model closest to 1. Additionally, six models had an area under the Precision-Recall curve (prAUC) values higher than 0.9, except KNN at 0.284 (p < 0.001). The calibration curves of the seven models did not significantly deviate from the ideal curve, indicating acceptable discriminative ability and predictive performance of the predictive model. All results showed that trabecular bone score (TBS) was the most important variable affecting the model, followed by osteocalcin (OST) and hunchback.
Conclusions: Given the various clinical data from patients with OPF, we assessed and demonstrated the good predictive performance of our risk predictive models. This model will enable us to take timely intervention measures to reduce the incidence of OPF and improve patient prognosis.