基于不确定性估计的贝叶斯卷积神经网络图像分类

F. Bessai-Mechmache, Maya N. Ghaffar, Rayan Y. Laouti
{"title":"基于不确定性估计的贝叶斯卷积神经网络图像分类","authors":"F. Bessai-Mechmache, Maya N. Ghaffar, Rayan Y. Laouti","doi":"10.1109/EDiS57230.2022.9996478","DOIUrl":null,"url":null,"abstract":"Over the past decade, deep learning has led to a cutting-edge performance in a variety of fields. However, it faces a fundamental constraint which is the treatment of uncertainty. The representation of the model's uncertainty is of significant importance in areas subject to strict safety or reliability re-quirements. Bayesian deep learning offers a new approach that showcases the degree of reliability of predictions made by neural networks. The present work tests deep learning with Bayesian thinking through a case study of image classification. It puts into practice Bayesian inference to tackle the problem of uncertainty in deep learning and shows its correlation with data quality and model accuracy. To reach this goal, we have implemented a Bayesian convolutional neural network using the variational inference algorithm, Bayes by Backprop. The proposed model was evaluated on an image classification task, with two benchmark datasets. The results' review allowed for validation of the Bayesian approach and showed that it obtains comparable results to those of a non-Bayesian convolutional neural network. Furthermore, the uncertainty of the model was estimated in terms of aleatory and epistemic uncertainty.","PeriodicalId":288133,"journal":{"name":"2022 3rd International Conference on Embedded & Distributed Systems (EDiS)","volume":"2 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-11-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Bayesian Convolutional Neural Networks for Image Classification with Uncertainty Estimation\",\"authors\":\"F. Bessai-Mechmache, Maya N. Ghaffar, Rayan Y. Laouti\",\"doi\":\"10.1109/EDiS57230.2022.9996478\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Over the past decade, deep learning has led to a cutting-edge performance in a variety of fields. However, it faces a fundamental constraint which is the treatment of uncertainty. The representation of the model's uncertainty is of significant importance in areas subject to strict safety or reliability re-quirements. Bayesian deep learning offers a new approach that showcases the degree of reliability of predictions made by neural networks. The present work tests deep learning with Bayesian thinking through a case study of image classification. It puts into practice Bayesian inference to tackle the problem of uncertainty in deep learning and shows its correlation with data quality and model accuracy. To reach this goal, we have implemented a Bayesian convolutional neural network using the variational inference algorithm, Bayes by Backprop. The proposed model was evaluated on an image classification task, with two benchmark datasets. The results' review allowed for validation of the Bayesian approach and showed that it obtains comparable results to those of a non-Bayesian convolutional neural network. Furthermore, the uncertainty of the model was estimated in terms of aleatory and epistemic uncertainty.\",\"PeriodicalId\":288133,\"journal\":{\"name\":\"2022 3rd International Conference on Embedded & Distributed Systems (EDiS)\",\"volume\":\"2 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-11-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 3rd International Conference on Embedded & Distributed Systems (EDiS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/EDiS57230.2022.9996478\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 3rd International Conference on Embedded & Distributed Systems (EDiS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/EDiS57230.2022.9996478","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

在过去的十年里,深度学习在许多领域都取得了前沿的成绩。然而,它面临着一个基本的限制,即不确定性的处理。在有严格的安全或可靠性要求的领域,模型不确定性的表示是非常重要的。贝叶斯深度学习提供了一种新的方法,展示了神经网络预测的可靠性程度。本文以图像分类为例,对贝叶斯思维下的深度学习进行了验证。将贝叶斯推理应用于解决深度学习中的不确定性问题,并展示了其与数据质量和模型精度的相关性。为了达到这个目标,我们使用变分推理算法Bayes by Backprop实现了一个贝叶斯卷积神经网络。在一个图像分类任务上,用两个基准数据集对该模型进行了评估。结果审查允许验证贝叶斯方法,并表明它获得与非贝叶斯卷积神经网络相当的结果。在此基础上,对模型的不确定性进行了评价。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Bayesian Convolutional Neural Networks for Image Classification with Uncertainty Estimation
Over the past decade, deep learning has led to a cutting-edge performance in a variety of fields. However, it faces a fundamental constraint which is the treatment of uncertainty. The representation of the model's uncertainty is of significant importance in areas subject to strict safety or reliability re-quirements. Bayesian deep learning offers a new approach that showcases the degree of reliability of predictions made by neural networks. The present work tests deep learning with Bayesian thinking through a case study of image classification. It puts into practice Bayesian inference to tackle the problem of uncertainty in deep learning and shows its correlation with data quality and model accuracy. To reach this goal, we have implemented a Bayesian convolutional neural network using the variational inference algorithm, Bayes by Backprop. The proposed model was evaluated on an image classification task, with two benchmark datasets. The results' review allowed for validation of the Bayesian approach and showed that it obtains comparable results to those of a non-Bayesian convolutional neural network. Furthermore, the uncertainty of the model was estimated in terms of aleatory and epistemic uncertainty.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Toward an iterative discretization approach for optimal sensor placement Blockchain-Based Conditional Privacy-Preserving Authentication Mechanism for Vehicular Fog Networks Efficient energy smart sensor for fall detection based on accelerometer data and CNN model Fault Tolerant Analysis using Serial-Triple Modular Redundancy (S-TMR) on TBCD Ultra Low Energy Communication Protocol for Biosensors Unsupervised Two-Stage TR-PCANet Deep Network For Unconstrained Ear Identification
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1