Xiaowu Tang MD, Weijie Ye MD, Yongkang Ou PhD, Hongsheng Ye MD, Xiran Zhu MCS, Dong Huang PhD, Jinming Liu MCS, Fei Zhao PhD, Wenting Deng MD, Chenlong Li PhD, Weiwei Cai MD, Yiqing Zheng PhD, Junbo Zeng MD, Yuexin Cai PhD
{"title":"Development and Validation of a Machine Learning Model for Detection and Classification of Vertigo","authors":"Xiaowu Tang MD, Weijie Ye MD, Yongkang Ou PhD, Hongsheng Ye MD, Xiran Zhu MCS, Dong Huang PhD, Jinming Liu MCS, Fei Zhao PhD, Wenting Deng MD, Chenlong Li PhD, Weiwei Cai MD, Yiqing Zheng PhD, Junbo Zeng MD, Yuexin Cai PhD","doi":"10.1002/lary.31959","DOIUrl":null,"url":null,"abstract":"<div>\n \n <section>\n \n <h3> Purpose</h3>\n \n <p>This study aims to investigate whether artificial intelligence can improve the diagnostic accuracy of vertigo related diseases.</p>\n </section>\n \n <section>\n \n <h3> Experimental Design</h3>\n \n <p>Based on the clinical guidelines, clinical symptoms and laboratory test results were extracted from electronic medical records as variables. These variables were then input into a machine learning diagnostic model for classification and diagnosis. This study encompasses two primary objectives: Task 1 to distinguish between patients with Benign Paroxysmal Positional Vertigo (BPPV) and non-BPPV. In Task 2, further classifying non-BPPV patients into Ménière's Disease (MD), Vestibular Migraine (VM), and Sudden Sensorineural Hearing Loss accompanied by Vertigo (SSNHLV). The sensitivity, precision, and area under the curve (AUC) metric is primarily used to assess the performance of the machine learning model development phase in a prospective validation cohort.</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>In our study, 1789 patients were recruited as the training cohort and 1148 patients as the prospective validation cohort. The comprehensive diagnostic performance of the XGBoost model surpasses that of traditional models. The sensitivity, accuracy, and AUC in task 1 were 98.32%, 87.03%, and 0.947, respectively. In task 2, the sensitivity values for MD, SSNHLV, and VM were 89.00%, 100.0%, and 79.40%, respectively. The precision values were 88.80%, 100.0%, and 80.00%, respectively. The AUC values were 0.933, 1.000, and 0.931, respectively. The model can significantly improve the accuracy of diagnosing vertigo diseases.</p>\n </section>\n \n <section>\n \n <h3> Conclusions</h3>\n \n <p>This system may enhance the accuracy of classification and diagnosis of vertigo diseases. It offers initial therapy or referrals to clinical doctors, particularly in resource-limited settings.</p>\n </section>\n \n <section>\n \n <h3> Level of Evidence</h3>\n \n <p>NA <i>Laryngoscope</i>, 135:1652–1660, 2025</p>\n </section>\n </div>","PeriodicalId":49921,"journal":{"name":"Laryngoscope","volume":"135 5","pages":"1652-1660"},"PeriodicalIF":2.0000,"publicationDate":"2024-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/lary.31959","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Laryngoscope","FirstCategoryId":"3","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/lary.31959","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"MEDICINE, RESEARCH & EXPERIMENTAL","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose
This study aims to investigate whether artificial intelligence can improve the diagnostic accuracy of vertigo related diseases.
Experimental Design
Based on the clinical guidelines, clinical symptoms and laboratory test results were extracted from electronic medical records as variables. These variables were then input into a machine learning diagnostic model for classification and diagnosis. This study encompasses two primary objectives: Task 1 to distinguish between patients with Benign Paroxysmal Positional Vertigo (BPPV) and non-BPPV. In Task 2, further classifying non-BPPV patients into Ménière's Disease (MD), Vestibular Migraine (VM), and Sudden Sensorineural Hearing Loss accompanied by Vertigo (SSNHLV). The sensitivity, precision, and area under the curve (AUC) metric is primarily used to assess the performance of the machine learning model development phase in a prospective validation cohort.
Results
In our study, 1789 patients were recruited as the training cohort and 1148 patients as the prospective validation cohort. The comprehensive diagnostic performance of the XGBoost model surpasses that of traditional models. The sensitivity, accuracy, and AUC in task 1 were 98.32%, 87.03%, and 0.947, respectively. In task 2, the sensitivity values for MD, SSNHLV, and VM were 89.00%, 100.0%, and 79.40%, respectively. The precision values were 88.80%, 100.0%, and 80.00%, respectively. The AUC values were 0.933, 1.000, and 0.931, respectively. The model can significantly improve the accuracy of diagnosing vertigo diseases.
Conclusions
This system may enhance the accuracy of classification and diagnosis of vertigo diseases. It offers initial therapy or referrals to clinical doctors, particularly in resource-limited settings.
期刊介绍:
The Laryngoscope has been the leading source of information on advances in the diagnosis and treatment of head and neck disorders since 1890. The Laryngoscope is the first choice among otolaryngologists for publication of their important findings and techniques. Each monthly issue of The Laryngoscope features peer-reviewed medical, clinical, and research contributions in general otolaryngology, allergy/rhinology, otology/neurotology, laryngology/bronchoesophagology, head and neck surgery, sleep medicine, pediatric otolaryngology, facial plastics and reconstructive surgery, oncology, and communicative disorders. Contributions include papers and posters presented at the Annual and Section Meetings of the Triological Society, as well as independent papers, "How I Do It", "Triological Best Practice" articles, and contemporary reviews. Theses authored by the Triological Society’s new Fellows as well as papers presented at meetings of the American Laryngological Association are published in The Laryngoscope.
• Broncho-esophagology
• Communicative disorders
• Head and neck surgery
• Plastic and reconstructive facial surgery
• Oncology
• Speech and hearing defects