Dai Fu, Zhao Chuanliang, Yang Jingdong, Meng Yifei, Tan Shiwang, Qian Yue, Yu Shaoqing
{"title":"人工智能在过敏性鼻炎诊断中的应用:聚焦集合学习。","authors":"Dai Fu, Zhao Chuanliang, Yang Jingdong, Meng Yifei, Tan Shiwang, Qian Yue, Yu Shaoqing","doi":"10.5415/apallergy.0000000000000126","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>The diagnosis of allergic rhinitis (AR) primarily relies on symptoms and laboratory examinations. Due to limitations in outpatient settings, certain tests such as nasal provocation tests and nasal secretion smear examinations are not routinely conducted. Although there are clear diagnostic criteria, an accurate diagnosis still requires the expertise of an experienced doctor, considering the patient's medical history and conducting examinations. However, differences in physician knowledge and limitations of examination methods can result in variations in diagnosis.</p><p><strong>Objective: </strong>Artificial intelligence is a significant outcome of the rapid advancement in computer technology today. This study aims to present an intelligent diagnosis and detection method based on ensemble learning for AR.</p><p><strong>Method: </strong>We conducted a study on AR cases and 7 other diseases exhibiting similar symptoms, including rhinosinusitis, chronic rhinitis, upper respiratory tract infection, etc. Clinical data, encompassing medical history, clinical symptoms, allergen detection, and imaging, was collected. To develop an effective classifier, multiple models were employed to train on the same batch of data. By utilizing ensemble learning algorithms, we obtained the final ensemble classifier known as adaptive random forest-out of bag-easy ensemble (ARF-OOBEE). In order to perform comparative experiments, we selected 5 commonly used machine learning classification algorithms: Naive Bayes, support vector machine, logistic regression, multilayer perceptron, deep forest (GC Forest), and extreme gradient boosting (XGBoost).To evaluate the prediction performance of AR samples, various parameters such as precision, sensitivity, specificity, G-mean, F1-score, and area under the curve (AUC) of the receiver operating characteristic curve were jointly employed as evaluation indicators.</p><p><strong>Results: </strong>We compared 7 classification models, including probability models, tree models, linear models, ensemble models, and neural network models. The ensemble classification algorithms, namely ARF-OOBEE and GC Forest, outperformed the other algorithms in terms of the comprehensive classification evaluation index. The accuracy of G-mean and AUC parameters improved by nearly 2% when compared to the other algorithms. Moreover, these ensemble classifiers exhibited excellent performance in handling large-scale data and unbalanced samples.</p><p><strong>Conclusion: </strong>The ARF-OOBEE ensemble learning model demonstrates strong generalization performance and comprehensive classification abilities, making it suitable for effective application in auxiliary AR diagnosis.</p>","PeriodicalId":8488,"journal":{"name":"Asia Pacific Allergy","volume":"14 2","pages":"56-62"},"PeriodicalIF":1.6000,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11142760/pdf/","citationCount":"0","resultStr":"{\"title\":\"Artificial intelligence applications in allergic rhinitis diagnosis: Focus on ensemble learning.\",\"authors\":\"Dai Fu, Zhao Chuanliang, Yang Jingdong, Meng Yifei, Tan Shiwang, Qian Yue, Yu Shaoqing\",\"doi\":\"10.5415/apallergy.0000000000000126\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>The diagnosis of allergic rhinitis (AR) primarily relies on symptoms and laboratory examinations. Due to limitations in outpatient settings, certain tests such as nasal provocation tests and nasal secretion smear examinations are not routinely conducted. Although there are clear diagnostic criteria, an accurate diagnosis still requires the expertise of an experienced doctor, considering the patient's medical history and conducting examinations. However, differences in physician knowledge and limitations of examination methods can result in variations in diagnosis.</p><p><strong>Objective: </strong>Artificial intelligence is a significant outcome of the rapid advancement in computer technology today. This study aims to present an intelligent diagnosis and detection method based on ensemble learning for AR.</p><p><strong>Method: </strong>We conducted a study on AR cases and 7 other diseases exhibiting similar symptoms, including rhinosinusitis, chronic rhinitis, upper respiratory tract infection, etc. Clinical data, encompassing medical history, clinical symptoms, allergen detection, and imaging, was collected. To develop an effective classifier, multiple models were employed to train on the same batch of data. By utilizing ensemble learning algorithms, we obtained the final ensemble classifier known as adaptive random forest-out of bag-easy ensemble (ARF-OOBEE). In order to perform comparative experiments, we selected 5 commonly used machine learning classification algorithms: Naive Bayes, support vector machine, logistic regression, multilayer perceptron, deep forest (GC Forest), and extreme gradient boosting (XGBoost).To evaluate the prediction performance of AR samples, various parameters such as precision, sensitivity, specificity, G-mean, F1-score, and area under the curve (AUC) of the receiver operating characteristic curve were jointly employed as evaluation indicators.</p><p><strong>Results: </strong>We compared 7 classification models, including probability models, tree models, linear models, ensemble models, and neural network models. The ensemble classification algorithms, namely ARF-OOBEE and GC Forest, outperformed the other algorithms in terms of the comprehensive classification evaluation index. The accuracy of G-mean and AUC parameters improved by nearly 2% when compared to the other algorithms. Moreover, these ensemble classifiers exhibited excellent performance in handling large-scale data and unbalanced samples.</p><p><strong>Conclusion: </strong>The ARF-OOBEE ensemble learning model demonstrates strong generalization performance and comprehensive classification abilities, making it suitable for effective application in auxiliary AR diagnosis.</p>\",\"PeriodicalId\":8488,\"journal\":{\"name\":\"Asia Pacific Allergy\",\"volume\":\"14 2\",\"pages\":\"56-62\"},\"PeriodicalIF\":1.6000,\"publicationDate\":\"2024-06-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11142760/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Asia Pacific Allergy\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.5415/apallergy.0000000000000126\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2023/12/18 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q3\",\"JCRName\":\"ALLERGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Asia Pacific Allergy","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.5415/apallergy.0000000000000126","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/12/18 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"ALLERGY","Score":null,"Total":0}
引用次数: 0
摘要
背景:过敏性鼻炎(AR)的诊断主要依靠症状和实验室检查。由于门诊环境的限制,某些检查如鼻激发试验和鼻分泌物涂片检查并不是常规检查。虽然有明确的诊断标准,但准确的诊断仍需要经验丰富的医生通过考虑患者的病史和进行检查来获得。然而,医生知识的差异和检查方法的局限性会导致诊断结果的差异:人工智能是当今计算机技术飞速发展的重要成果。本研究旨在提出一种基于集合学习的 AR 智能诊断和检测方法:方法:我们对 AR 病例和其他 7 种症状相似的疾病(包括鼻炎、慢性鼻炎、上呼吸道感染等)进行了研究。我们收集了包括病史、临床症状、过敏原检测和影像学在内的临床数据。为了开发有效的分类器,采用了多个模型对同一批数据进行训练。通过使用集合学习算法,我们得到了最终的集合分类器,即自适应随机森林-袋易集合(ARF-OOBEE)。为了进行对比实验,我们选择了 5 种常用的机器学习分类算法:为了评估AR样本的预测性能,我们联合使用了精度、灵敏度、特异性、G均值、F1得分和接收者工作特征曲线下面积(AUC)等各种参数作为评估指标:我们比较了 7 种分类模型,包括概率模型、树模型、线性模型、集合模型和神经网络模型。在综合分类评价指标方面,ARF-OOBEE 和 GC Forest 等集合分类算法优于其他算法。与其他算法相比,G-mean 和 AUC 参数的准确率提高了近 2%。此外,这些集合分类器在处理大规模数据和不平衡样本时表现出色:ARF-OOBEE集合学习模型具有很强的泛化性能和综合分类能力,适合在AR辅助诊断中有效应用。
Artificial intelligence applications in allergic rhinitis diagnosis: Focus on ensemble learning.
Background: The diagnosis of allergic rhinitis (AR) primarily relies on symptoms and laboratory examinations. Due to limitations in outpatient settings, certain tests such as nasal provocation tests and nasal secretion smear examinations are not routinely conducted. Although there are clear diagnostic criteria, an accurate diagnosis still requires the expertise of an experienced doctor, considering the patient's medical history and conducting examinations. However, differences in physician knowledge and limitations of examination methods can result in variations in diagnosis.
Objective: Artificial intelligence is a significant outcome of the rapid advancement in computer technology today. This study aims to present an intelligent diagnosis and detection method based on ensemble learning for AR.
Method: We conducted a study on AR cases and 7 other diseases exhibiting similar symptoms, including rhinosinusitis, chronic rhinitis, upper respiratory tract infection, etc. Clinical data, encompassing medical history, clinical symptoms, allergen detection, and imaging, was collected. To develop an effective classifier, multiple models were employed to train on the same batch of data. By utilizing ensemble learning algorithms, we obtained the final ensemble classifier known as adaptive random forest-out of bag-easy ensemble (ARF-OOBEE). In order to perform comparative experiments, we selected 5 commonly used machine learning classification algorithms: Naive Bayes, support vector machine, logistic regression, multilayer perceptron, deep forest (GC Forest), and extreme gradient boosting (XGBoost).To evaluate the prediction performance of AR samples, various parameters such as precision, sensitivity, specificity, G-mean, F1-score, and area under the curve (AUC) of the receiver operating characteristic curve were jointly employed as evaluation indicators.
Results: We compared 7 classification models, including probability models, tree models, linear models, ensemble models, and neural network models. The ensemble classification algorithms, namely ARF-OOBEE and GC Forest, outperformed the other algorithms in terms of the comprehensive classification evaluation index. The accuracy of G-mean and AUC parameters improved by nearly 2% when compared to the other algorithms. Moreover, these ensemble classifiers exhibited excellent performance in handling large-scale data and unbalanced samples.
Conclusion: The ARF-OOBEE ensemble learning model demonstrates strong generalization performance and comprehensive classification abilities, making it suitable for effective application in auxiliary AR diagnosis.
期刊介绍:
Asia Pacific Allergy (AP Allergy) is the official journal of the Asia Pacific Association of Allergy, Asthma and Clinical Immunology (APAAACI). Although the primary aim of the journal is to promote communication between Asia Pacific scientists who are interested in allergy, asthma, and clinical immunology including immunodeficiency, the journal is intended to be available worldwide. To enable scientists and clinicians from emerging societies appreciate the scope and intent of the journal, early issues will contain more educational review material. For better communication and understanding, it will include rational concepts related to the diagnosis and management of asthma and other immunological conditions. Over time, the journal will increase the number of original research papers to become the foremost citation journal for allergy and clinical immunology information of the Asia Pacific in the future.