Xiaowu Tang, Weijie Ye, Yongkang Ou, Hongsheng Ye, Xiran Zhu, Dong Huang, Jinming Liu, Fei Zhao, Wenting Deng, Chenlong Li, Weiwei Cai, Yiqing Zheng, Junbo Zeng, Yuexin Cai
{"title":"眩晕检测与分类机器学习模型的开发与验证。","authors":"Xiaowu Tang, Weijie Ye, Yongkang Ou, Hongsheng Ye, Xiran Zhu, Dong Huang, Jinming Liu, Fei Zhao, Wenting Deng, Chenlong Li, Weiwei Cai, Yiqing Zheng, Junbo Zeng, Yuexin Cai","doi":"10.1002/lary.31959","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>This study aims to investigate whether artificial intelligence can improve the diagnostic accuracy of vertigo related diseases.</p><p><strong>Experimental design: </strong>Based on the clinical guidelines, clinical symptoms and laboratory test results were extracted from electronic medical records as variables. These variables were then input into a machine learning diagnostic model for classification and diagnosis. This study encompasses two primary objectives: Task 1 to distinguish between patients with Benign Paroxysmal Positional Vertigo (BPPV) and non-BPPV. In Task 2, further classifying non-BPPV patients into Ménière's Disease (MD), Vestibular Migraine (VM), and Sudden Sensorineural Hearing Loss accompanied by Vertigo (SSNHLV). The sensitivity, precision, and area under the curve (AUC) metric is primarily used to assess the performance of the machine learning model development phase in a prospective validation cohort.</p><p><strong>Results: </strong>In our study, 1789 patients were recruited as the training cohort and 1148 patients as the prospective validation cohort. The comprehensive diagnostic performance of the XGBoost model surpasses that of traditional models. The sensitivity, accuracy, and AUC in task 1 were 98.32%, 87.03%, and 0.947, respectively. In task 2, the sensitivity values for MD, SSNHLV, and VM were 89.00%, 100.0%, and 79.40%, respectively. The precision values were 88.80%, 100.0%, and 80.00%, respectively. The AUC values were 0.933, 1.000, and 0.931, respectively. The model can significantly improve the accuracy of diagnosing vertigo diseases.</p><p><strong>Conclusions: </strong>This system may enhance the accuracy of classification and diagnosis of vertigo diseases. It offers initial therapy or referrals to clinical doctors, particularly in resource-limited settings.</p><p><strong>Level of evidence: </strong>N/A Laryngoscope, 2024.</p>","PeriodicalId":49921,"journal":{"name":"Laryngoscope","volume":" ","pages":""},"PeriodicalIF":2.2000,"publicationDate":"2024-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Development and Validation of a Machine Learning Model for Detection and Classification of Vertigo.\",\"authors\":\"Xiaowu Tang, Weijie Ye, Yongkang Ou, Hongsheng Ye, Xiran Zhu, Dong Huang, Jinming Liu, Fei Zhao, Wenting Deng, Chenlong Li, Weiwei Cai, Yiqing Zheng, Junbo Zeng, Yuexin Cai\",\"doi\":\"10.1002/lary.31959\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Purpose: </strong>This study aims to investigate whether artificial intelligence can improve the diagnostic accuracy of vertigo related diseases.</p><p><strong>Experimental design: </strong>Based on the clinical guidelines, clinical symptoms and laboratory test results were extracted from electronic medical records as variables. These variables were then input into a machine learning diagnostic model for classification and diagnosis. This study encompasses two primary objectives: Task 1 to distinguish between patients with Benign Paroxysmal Positional Vertigo (BPPV) and non-BPPV. In Task 2, further classifying non-BPPV patients into Ménière's Disease (MD), Vestibular Migraine (VM), and Sudden Sensorineural Hearing Loss accompanied by Vertigo (SSNHLV). The sensitivity, precision, and area under the curve (AUC) metric is primarily used to assess the performance of the machine learning model development phase in a prospective validation cohort.</p><p><strong>Results: </strong>In our study, 1789 patients were recruited as the training cohort and 1148 patients as the prospective validation cohort. The comprehensive diagnostic performance of the XGBoost model surpasses that of traditional models. The sensitivity, accuracy, and AUC in task 1 were 98.32%, 87.03%, and 0.947, respectively. In task 2, the sensitivity values for MD, SSNHLV, and VM were 89.00%, 100.0%, and 79.40%, respectively. The precision values were 88.80%, 100.0%, and 80.00%, respectively. The AUC values were 0.933, 1.000, and 0.931, respectively. The model can significantly improve the accuracy of diagnosing vertigo diseases.</p><p><strong>Conclusions: </strong>This system may enhance the accuracy of classification and diagnosis of vertigo diseases. It offers initial therapy or referrals to clinical doctors, particularly in resource-limited settings.</p><p><strong>Level of evidence: </strong>N/A Laryngoscope, 2024.</p>\",\"PeriodicalId\":49921,\"journal\":{\"name\":\"Laryngoscope\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":2.2000,\"publicationDate\":\"2024-12-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Laryngoscope\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1002/lary.31959\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"MEDICINE, RESEARCH & EXPERIMENTAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Laryngoscope","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1002/lary.31959","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"MEDICINE, RESEARCH & EXPERIMENTAL","Score":null,"Total":0}
Development and Validation of a Machine Learning Model for Detection and Classification of Vertigo.
Purpose: This study aims to investigate whether artificial intelligence can improve the diagnostic accuracy of vertigo related diseases.
Experimental design: Based on the clinical guidelines, clinical symptoms and laboratory test results were extracted from electronic medical records as variables. These variables were then input into a machine learning diagnostic model for classification and diagnosis. This study encompasses two primary objectives: Task 1 to distinguish between patients with Benign Paroxysmal Positional Vertigo (BPPV) and non-BPPV. In Task 2, further classifying non-BPPV patients into Ménière's Disease (MD), Vestibular Migraine (VM), and Sudden Sensorineural Hearing Loss accompanied by Vertigo (SSNHLV). The sensitivity, precision, and area under the curve (AUC) metric is primarily used to assess the performance of the machine learning model development phase in a prospective validation cohort.
Results: In our study, 1789 patients were recruited as the training cohort and 1148 patients as the prospective validation cohort. The comprehensive diagnostic performance of the XGBoost model surpasses that of traditional models. The sensitivity, accuracy, and AUC in task 1 were 98.32%, 87.03%, and 0.947, respectively. In task 2, the sensitivity values for MD, SSNHLV, and VM were 89.00%, 100.0%, and 79.40%, respectively. The precision values were 88.80%, 100.0%, and 80.00%, respectively. The AUC values were 0.933, 1.000, and 0.931, respectively. The model can significantly improve the accuracy of diagnosing vertigo diseases.
Conclusions: This system may enhance the accuracy of classification and diagnosis of vertigo diseases. It offers initial therapy or referrals to clinical doctors, particularly in resource-limited settings.
期刊介绍:
The Laryngoscope has been the leading source of information on advances in the diagnosis and treatment of head and neck disorders since 1890. The Laryngoscope is the first choice among otolaryngologists for publication of their important findings and techniques. Each monthly issue of The Laryngoscope features peer-reviewed medical, clinical, and research contributions in general otolaryngology, allergy/rhinology, otology/neurotology, laryngology/bronchoesophagology, head and neck surgery, sleep medicine, pediatric otolaryngology, facial plastics and reconstructive surgery, oncology, and communicative disorders. Contributions include papers and posters presented at the Annual and Section Meetings of the Triological Society, as well as independent papers, "How I Do It", "Triological Best Practice" articles, and contemporary reviews. Theses authored by the Triological Society’s new Fellows as well as papers presented at meetings of the American Laryngological Association are published in The Laryngoscope.
• Broncho-esophagology
• Communicative disorders
• Head and neck surgery
• Plastic and reconstructive facial surgery
• Oncology
• Speech and hearing defects