Albert Whata, Katlego Dibeco, Kudakwashe Madzima, Ibidun Obagbuwa
{"title":"使用 COVID-19 和肺炎的胸部 X 光图像进行多类图像分类的不确定性量化。","authors":"Albert Whata, Katlego Dibeco, Kudakwashe Madzima, Ibidun Obagbuwa","doi":"10.3389/frai.2024.1410841","DOIUrl":null,"url":null,"abstract":"<p><p>This paper investigates uncertainty quantification (UQ) techniques in multi-class classification of chest X-ray images (COVID-19, Pneumonia, and Normal). We evaluate Bayesian Neural Networks (BNN) and the Deep Neural Network with UQ (DNN with UQ) techniques, including Monte Carlo dropout, Ensemble Bayesian Neural Network (EBNN), Ensemble Monte Carlo (EMC) dropout, across different evaluation metrics. Our analysis reveals that DNN with UQ, especially EBNN and EMC dropout, consistently outperform BNNs. For example, in Class 0 vs. All, EBNN achieved a <i>U</i>Acc of 92.6%, <i>U</i>AUC-ROC of 95.0%, and a Brier Score of 0.157, significantly surpassing BNN's performance. Similarly, EMC Dropout excelled in Class 1 vs. All with a <i>U</i>Acc of 83.5%, <i>U</i>AUC-ROC of 95.8%, and a Brier Score of 0.165. These advanced models demonstrated higher accuracy, better discriaminative capability, and more accurate probabilistic predictions. Our findings highlight the efficacy of DNN with UQ in enhancing model reliability and interpretability, making them highly suitable for critical healthcare applications like chest X-ray imageQ6 classification.</p>","PeriodicalId":33315,"journal":{"name":"Frontiers in Artificial Intelligence","volume":"7 ","pages":"1410841"},"PeriodicalIF":3.0000,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11445153/pdf/","citationCount":"0","resultStr":"{\"title\":\"Uncertainty quantification in multi-class image classification using chest X-ray images of COVID-19 and pneumonia.\",\"authors\":\"Albert Whata, Katlego Dibeco, Kudakwashe Madzima, Ibidun Obagbuwa\",\"doi\":\"10.3389/frai.2024.1410841\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>This paper investigates uncertainty quantification (UQ) techniques in multi-class classification of chest X-ray images (COVID-19, Pneumonia, and Normal). We evaluate Bayesian Neural Networks (BNN) and the Deep Neural Network with UQ (DNN with UQ) techniques, including Monte Carlo dropout, Ensemble Bayesian Neural Network (EBNN), Ensemble Monte Carlo (EMC) dropout, across different evaluation metrics. Our analysis reveals that DNN with UQ, especially EBNN and EMC dropout, consistently outperform BNNs. For example, in Class 0 vs. All, EBNN achieved a <i>U</i>Acc of 92.6%, <i>U</i>AUC-ROC of 95.0%, and a Brier Score of 0.157, significantly surpassing BNN's performance. Similarly, EMC Dropout excelled in Class 1 vs. All with a <i>U</i>Acc of 83.5%, <i>U</i>AUC-ROC of 95.8%, and a Brier Score of 0.165. These advanced models demonstrated higher accuracy, better discriaminative capability, and more accurate probabilistic predictions. Our findings highlight the efficacy of DNN with UQ in enhancing model reliability and interpretability, making them highly suitable for critical healthcare applications like chest X-ray imageQ6 classification.</p>\",\"PeriodicalId\":33315,\"journal\":{\"name\":\"Frontiers in Artificial Intelligence\",\"volume\":\"7 \",\"pages\":\"1410841\"},\"PeriodicalIF\":3.0000,\"publicationDate\":\"2024-09-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11445153/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Frontiers in Artificial Intelligence\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.3389/frai.2024.1410841\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/1/1 0:00:00\",\"PubModel\":\"eCollection\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Frontiers in Artificial Intelligence","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3389/frai.2024.1410841","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/1/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
摘要
本文研究了胸部 X 光图像(COVID-19、肺炎和正常)多类分类中的不确定性量化(UQ)技术。我们评估了贝叶斯神经网络(BNN)和具有 UQ 的深度神经网络(DNN with UQ)技术,包括蒙特卡罗剔除、集合贝叶斯神经网络(EBNN)、集合蒙特卡罗剔除(EMC),以及不同的评估指标。我们的分析表明,具有 UQ 的 DNN,尤其是 EBNN 和 EMC dropout,始终优于 BNN。例如,在 Class 0 vs. All 中,EBNN 的 UAcc 为 92.6%,UAUC-ROC 为 95.0%,Brier Score 为 0.157,大大超过了 BNN 的表现。同样,EMC Dropout 在 Class 1 vs. All 中表现出色,UAcc 为 83.5%,UAUC-ROC 为 95.8%,Brier Score 为 0.165。这些高级模型表现出了更高的准确性、更好的判别能力和更准确的概率预测。我们的研究结果凸显了带有 UQ 的 DNN 在增强模型可靠性和可解释性方面的功效,使其非常适合胸部 X 光图像Q6 分类等关键医疗应用。
Uncertainty quantification in multi-class image classification using chest X-ray images of COVID-19 and pneumonia.
This paper investigates uncertainty quantification (UQ) techniques in multi-class classification of chest X-ray images (COVID-19, Pneumonia, and Normal). We evaluate Bayesian Neural Networks (BNN) and the Deep Neural Network with UQ (DNN with UQ) techniques, including Monte Carlo dropout, Ensemble Bayesian Neural Network (EBNN), Ensemble Monte Carlo (EMC) dropout, across different evaluation metrics. Our analysis reveals that DNN with UQ, especially EBNN and EMC dropout, consistently outperform BNNs. For example, in Class 0 vs. All, EBNN achieved a UAcc of 92.6%, UAUC-ROC of 95.0%, and a Brier Score of 0.157, significantly surpassing BNN's performance. Similarly, EMC Dropout excelled in Class 1 vs. All with a UAcc of 83.5%, UAUC-ROC of 95.8%, and a Brier Score of 0.165. These advanced models demonstrated higher accuracy, better discriaminative capability, and more accurate probabilistic predictions. Our findings highlight the efficacy of DNN with UQ in enhancing model reliability and interpretability, making them highly suitable for critical healthcare applications like chest X-ray imageQ6 classification.