Narit Hnoohom, Nagorn Maitrichit, K. Wongpatikaseree, Sumeth Yuenyong, S. Mekruksavanich, A. Jitpattanakul
{"title":"ResNet 101对吸塑包装分类的可视化解释","authors":"Narit Hnoohom, Nagorn Maitrichit, K. Wongpatikaseree, Sumeth Yuenyong, S. Mekruksavanich, A. Jitpattanakul","doi":"10.1109/RI2C56397.2022.9910317","DOIUrl":null,"url":null,"abstract":"This paper presents an efficient approach to generate visual explanations from a ResNet 101 model for identification of medication. The blister package dataset is used to train a deep learning model built on the PyTorch framework’s ResNet 101 pre-trained model. Visual inspections and a quantitative localization benchmark demonstrate that the model approach correctly identifies the critical components of blister packs for medicine identification. A Gradient-weighted Class Activation Mapping (Grad-CAM) method is used to extract the feature map, and then the attention mechanism is utilized to extract the high-level attention maps, that emphasizes the part of the image that is significant to the target class, which can be considered as a visual representation. The experimental results indicated that the Grad-CAM achieved the better visualization and interpretation of ResNet 101 in blister package classification.","PeriodicalId":403083,"journal":{"name":"2022 Research, Invention, and Innovation Congress: Innovative Electricals and Electronics (RI2C)","volume":"291 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-08-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Visual Explanations of ResNet 101 for Blister Package Classification\",\"authors\":\"Narit Hnoohom, Nagorn Maitrichit, K. Wongpatikaseree, Sumeth Yuenyong, S. Mekruksavanich, A. Jitpattanakul\",\"doi\":\"10.1109/RI2C56397.2022.9910317\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This paper presents an efficient approach to generate visual explanations from a ResNet 101 model for identification of medication. The blister package dataset is used to train a deep learning model built on the PyTorch framework’s ResNet 101 pre-trained model. Visual inspections and a quantitative localization benchmark demonstrate that the model approach correctly identifies the critical components of blister packs for medicine identification. A Gradient-weighted Class Activation Mapping (Grad-CAM) method is used to extract the feature map, and then the attention mechanism is utilized to extract the high-level attention maps, that emphasizes the part of the image that is significant to the target class, which can be considered as a visual representation. The experimental results indicated that the Grad-CAM achieved the better visualization and interpretation of ResNet 101 in blister package classification.\",\"PeriodicalId\":403083,\"journal\":{\"name\":\"2022 Research, Invention, and Innovation Congress: Innovative Electricals and Electronics (RI2C)\",\"volume\":\"291 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-08-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 Research, Invention, and Innovation Congress: Innovative Electricals and Electronics (RI2C)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/RI2C56397.2022.9910317\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 Research, Invention, and Innovation Congress: Innovative Electricals and Electronics (RI2C)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/RI2C56397.2022.9910317","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
本文提出了一种从ResNet 101模型生成用于识别药物的可视化解释的有效方法。blister包数据集用于训练基于PyTorch框架的ResNet 101预训练模型构建的深度学习模型。目视检查和定量定位基准表明,该模型方法正确地识别了用于药物识别的吸塑包装的关键部件。采用梯度加权类激活映射(Gradient-weighted Class Activation Mapping, Grad-CAM)方法提取特征图,然后利用注意机制提取高级注意图,该注意图强调图像中对目标类重要的部分,可视为视觉表示。实验结果表明,Grad-CAM在吸塑包装分类中能够较好地实现ResNet 101的可视化和解译。
Visual Explanations of ResNet 101 for Blister Package Classification
This paper presents an efficient approach to generate visual explanations from a ResNet 101 model for identification of medication. The blister package dataset is used to train a deep learning model built on the PyTorch framework’s ResNet 101 pre-trained model. Visual inspections and a quantitative localization benchmark demonstrate that the model approach correctly identifies the critical components of blister packs for medicine identification. A Gradient-weighted Class Activation Mapping (Grad-CAM) method is used to extract the feature map, and then the attention mechanism is utilized to extract the high-level attention maps, that emphasizes the part of the image that is significant to the target class, which can be considered as a visual representation. The experimental results indicated that the Grad-CAM achieved the better visualization and interpretation of ResNet 101 in blister package classification.