Huayu Ye, Hongrui Qin, Ying Tang, Nicha Ungvijanpunya, Yongchao Gou
{"title":"绘制预测女性青少年颈椎成熟阶段的智能算法图,具有高召回率和准确率。","authors":"Huayu Ye, Hongrui Qin, Ying Tang, Nicha Ungvijanpunya, Yongchao Gou","doi":"10.1186/s40510-024-00523-5","DOIUrl":null,"url":null,"abstract":"<p><strong>Backgrounds and objectives: </strong>The present study was designed to define a novel algorithm capable of predicting female adolescents' cervical vertebrae maturation stage with high recall and accuracy.</p><p><strong>Methods: </strong>A total of 560 female cephalograms were collected, and cephalograms with unclear vertebral shapes and deformed scales were removed. 480 films from female adolescents (mean age: 11.5 years; age range: 6-19 years) were used for the model development phase, and 80 subjects were randomly and stratified allocated to the validation cohort to further assess the model's performance. Derived significant predictive parameters from 15 anatomic points and 25 quantitative parameters of the second to fourth cervical vertebrae (C2-C4) to establish the ordinary logistic regression model. Evaluation metrics including precision, recall, and F1 score are employed to assess the efficacy of the models in each identified cervical vertebrae maturation stage (iCS). In cases of confusion and mispredictions, the model underwent modification to improve consistency.</p><p><strong>Results: </strong>Four significant parameters, including chronological age, the ratio of D3 to AH3 (D3:AH3), anterosuperior angle of C4 (@4), and distance between C3lp and C4up (C3lp-C4up) were administered into the ordinary regression model. The primary predicting model that implements the novel algorithm was built and the performance evaluation with all stages of 93.96% for accuracy, 93.98% for precision, 93.98% for recall, and 93.95% for F1-score were obtained. Despite the hybrid logistic-based model achieving high accuracy, the unsatisfactory performance of stage estimation was noticed for iCS3 in the primary cohort (89.17%) and validation cohort (85.00%). Through bivariate logistic regression analysis, the posterior height of C4 (PH4) was further selected in the iCS3 to establish a corrected model, thus the evaluation metrics were upgraded to 95.83% and 90.00%, respectively.</p><p><strong>Conclusions: </strong>An unbiased and objective assessment of the cervical vertebrae maturation (CVM) method can function as a decision-support tool, assisting in the evaluation of the optimal timing for treatment in growing adults. Our novel proposed logistic model yielded individual formulas for each specific CVM stage and attained exceptional performance, indicating the capability to function as a benchmark for maturity evaluation in clinical craniofacial orthopedics for Chinese female adolescents.</p>","PeriodicalId":56071,"journal":{"name":"Progress in Orthodontics","volume":"25 1","pages":"20"},"PeriodicalIF":4.8000,"publicationDate":"2024-05-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11109046/pdf/","citationCount":"0","resultStr":"{\"title\":\"Mapping an intelligent algorithm for predicting female adolescents' cervical vertebrae maturation stage with high recall and accuracy.\",\"authors\":\"Huayu Ye, Hongrui Qin, Ying Tang, Nicha Ungvijanpunya, Yongchao Gou\",\"doi\":\"10.1186/s40510-024-00523-5\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Backgrounds and objectives: </strong>The present study was designed to define a novel algorithm capable of predicting female adolescents' cervical vertebrae maturation stage with high recall and accuracy.</p><p><strong>Methods: </strong>A total of 560 female cephalograms were collected, and cephalograms with unclear vertebral shapes and deformed scales were removed. 480 films from female adolescents (mean age: 11.5 years; age range: 6-19 years) were used for the model development phase, and 80 subjects were randomly and stratified allocated to the validation cohort to further assess the model's performance. Derived significant predictive parameters from 15 anatomic points and 25 quantitative parameters of the second to fourth cervical vertebrae (C2-C4) to establish the ordinary logistic regression model. Evaluation metrics including precision, recall, and F1 score are employed to assess the efficacy of the models in each identified cervical vertebrae maturation stage (iCS). In cases of confusion and mispredictions, the model underwent modification to improve consistency.</p><p><strong>Results: </strong>Four significant parameters, including chronological age, the ratio of D3 to AH3 (D3:AH3), anterosuperior angle of C4 (@4), and distance between C3lp and C4up (C3lp-C4up) were administered into the ordinary regression model. The primary predicting model that implements the novel algorithm was built and the performance evaluation with all stages of 93.96% for accuracy, 93.98% for precision, 93.98% for recall, and 93.95% for F1-score were obtained. Despite the hybrid logistic-based model achieving high accuracy, the unsatisfactory performance of stage estimation was noticed for iCS3 in the primary cohort (89.17%) and validation cohort (85.00%). Through bivariate logistic regression analysis, the posterior height of C4 (PH4) was further selected in the iCS3 to establish a corrected model, thus the evaluation metrics were upgraded to 95.83% and 90.00%, respectively.</p><p><strong>Conclusions: </strong>An unbiased and objective assessment of the cervical vertebrae maturation (CVM) method can function as a decision-support tool, assisting in the evaluation of the optimal timing for treatment in growing adults. Our novel proposed logistic model yielded individual formulas for each specific CVM stage and attained exceptional performance, indicating the capability to function as a benchmark for maturity evaluation in clinical craniofacial orthopedics for Chinese female adolescents.</p>\",\"PeriodicalId\":56071,\"journal\":{\"name\":\"Progress in Orthodontics\",\"volume\":\"25 1\",\"pages\":\"20\"},\"PeriodicalIF\":4.8000,\"publicationDate\":\"2024-05-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11109046/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Progress in Orthodontics\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1186/s40510-024-00523-5\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"Dentistry\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Progress in Orthodontics","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s40510-024-00523-5","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"Dentistry","Score":null,"Total":0}
Mapping an intelligent algorithm for predicting female adolescents' cervical vertebrae maturation stage with high recall and accuracy.
Backgrounds and objectives: The present study was designed to define a novel algorithm capable of predicting female adolescents' cervical vertebrae maturation stage with high recall and accuracy.
Methods: A total of 560 female cephalograms were collected, and cephalograms with unclear vertebral shapes and deformed scales were removed. 480 films from female adolescents (mean age: 11.5 years; age range: 6-19 years) were used for the model development phase, and 80 subjects were randomly and stratified allocated to the validation cohort to further assess the model's performance. Derived significant predictive parameters from 15 anatomic points and 25 quantitative parameters of the second to fourth cervical vertebrae (C2-C4) to establish the ordinary logistic regression model. Evaluation metrics including precision, recall, and F1 score are employed to assess the efficacy of the models in each identified cervical vertebrae maturation stage (iCS). In cases of confusion and mispredictions, the model underwent modification to improve consistency.
Results: Four significant parameters, including chronological age, the ratio of D3 to AH3 (D3:AH3), anterosuperior angle of C4 (@4), and distance between C3lp and C4up (C3lp-C4up) were administered into the ordinary regression model. The primary predicting model that implements the novel algorithm was built and the performance evaluation with all stages of 93.96% for accuracy, 93.98% for precision, 93.98% for recall, and 93.95% for F1-score were obtained. Despite the hybrid logistic-based model achieving high accuracy, the unsatisfactory performance of stage estimation was noticed for iCS3 in the primary cohort (89.17%) and validation cohort (85.00%). Through bivariate logistic regression analysis, the posterior height of C4 (PH4) was further selected in the iCS3 to establish a corrected model, thus the evaluation metrics were upgraded to 95.83% and 90.00%, respectively.
Conclusions: An unbiased and objective assessment of the cervical vertebrae maturation (CVM) method can function as a decision-support tool, assisting in the evaluation of the optimal timing for treatment in growing adults. Our novel proposed logistic model yielded individual formulas for each specific CVM stage and attained exceptional performance, indicating the capability to function as a benchmark for maturity evaluation in clinical craniofacial orthopedics for Chinese female adolescents.
期刊介绍:
Progress in Orthodontics is a fully open access, international journal owned by the Italian Society of Orthodontics and published under the brand SpringerOpen. The Society is currently covering all publication costs so there are no article processing charges for authors.
It is a premier journal of international scope that fosters orthodontic research, including both basic research and development of innovative clinical techniques, with an emphasis on the following areas:
• Mechanisms to improve orthodontics
• Clinical studies and control animal studies
• Orthodontics and genetics, genomics
• Temporomandibular joint (TMJ) control clinical trials
• Efficacy of orthodontic appliances and animal models
• Systematic reviews and meta analyses
• Mechanisms to speed orthodontic treatment
Progress in Orthodontics will consider for publication only meritorious and original contributions. These may be:
• Original articles reporting the findings of clinical trials, clinically relevant basic scientific investigations, or novel therapeutic or diagnostic systems
• Review articles on current topics
• Articles on novel techniques and clinical tools
• Articles of contemporary interest