弱监督语义分割的区域引导像素级标签生成

Xinyu Fu, Xiao Yao
{"title":"弱监督语义分割的区域引导像素级标签生成","authors":"Xinyu Fu, Xiao Yao","doi":"10.1145/3484274.3484275","DOIUrl":null,"url":null,"abstract":"The lack of reliable segmentation labels is the major obstacles to weakly supervised semantic segmentation. We provide a pseudo-label generation approach based on a deep convolutional neural network, which is supervised by the image-level category labels only. However, the limitation of the region of interest in the targets influences the effectiveness and integrity of the traditional methods in obtaining pixel-level mask annotations. This paper studies the characteristics of class activation mapping in classification network, focusing on the methods to enhance the localization ability of class activation mapping. We propose a Region-guided Pixel-label Generation framework (RPG) for semantic segmentation. The proposed region guidance mechanism decreases the influence of category supervision and makes use of the known high-level semantic information to guide the network, attaining more complete pixel-level annotations via expanding the regions of interest. Experimental results of training and validation on the PASCALVOC 2012 data set prove to achieve better pixel labeling and segmentation accuracy comparing with state-of-the-art methods.","PeriodicalId":143540,"journal":{"name":"Proceedings of the 4th International Conference on Control and Computer Vision","volume":"14 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-08-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Region-Guided Pixel-Level Label Generation for Weakly Supervised Semantic Segmentation\",\"authors\":\"Xinyu Fu, Xiao Yao\",\"doi\":\"10.1145/3484274.3484275\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The lack of reliable segmentation labels is the major obstacles to weakly supervised semantic segmentation. We provide a pseudo-label generation approach based on a deep convolutional neural network, which is supervised by the image-level category labels only. However, the limitation of the region of interest in the targets influences the effectiveness and integrity of the traditional methods in obtaining pixel-level mask annotations. This paper studies the characteristics of class activation mapping in classification network, focusing on the methods to enhance the localization ability of class activation mapping. We propose a Region-guided Pixel-label Generation framework (RPG) for semantic segmentation. The proposed region guidance mechanism decreases the influence of category supervision and makes use of the known high-level semantic information to guide the network, attaining more complete pixel-level annotations via expanding the regions of interest. Experimental results of training and validation on the PASCALVOC 2012 data set prove to achieve better pixel labeling and segmentation accuracy comparing with state-of-the-art methods.\",\"PeriodicalId\":143540,\"journal\":{\"name\":\"Proceedings of the 4th International Conference on Control and Computer Vision\",\"volume\":\"14 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-08-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 4th International Conference on Control and Computer Vision\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3484274.3484275\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 4th International Conference on Control and Computer Vision","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3484274.3484275","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

缺乏可靠的分词标签是弱监督语义分词的主要障碍。我们提供了一种基于深度卷积神经网络的伪标签生成方法,该方法仅由图像级类别标签监督。然而,目标感兴趣区域的局限性影响了传统方法获取像素级蒙版注释的有效性和完整性。本文研究了分类网络中类激活映射的特点,重点研究了增强类激活映射定位能力的方法。我们提出了一个区域导向的像素标签生成框架(RPG)用于语义分割。提出的区域引导机制减少了类别监督的影响,利用已知的高级语义信息来引导网络,通过扩展感兴趣的区域来获得更完整的像素级标注。在PASCALVOC 2012数据集上进行训练和验证的实验结果表明,与现有方法相比,该方法具有更好的像素标记和分割精度。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Region-Guided Pixel-Level Label Generation for Weakly Supervised Semantic Segmentation
The lack of reliable segmentation labels is the major obstacles to weakly supervised semantic segmentation. We provide a pseudo-label generation approach based on a deep convolutional neural network, which is supervised by the image-level category labels only. However, the limitation of the region of interest in the targets influences the effectiveness and integrity of the traditional methods in obtaining pixel-level mask annotations. This paper studies the characteristics of class activation mapping in classification network, focusing on the methods to enhance the localization ability of class activation mapping. We propose a Region-guided Pixel-label Generation framework (RPG) for semantic segmentation. The proposed region guidance mechanism decreases the influence of category supervision and makes use of the known high-level semantic information to guide the network, attaining more complete pixel-level annotations via expanding the regions of interest. Experimental results of training and validation on the PASCALVOC 2012 data set prove to achieve better pixel labeling and segmentation accuracy comparing with state-of-the-art methods.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
An Object Detection Algorithm Combining FPN Structure With DETR DIB: Piled Man-made Object Detection and Pose Estimation in Point Cloud Blocks A Multi-Scale Self-Attention Network for Diabetic Retinopathy Retrieval Ensemble Multilayer Perceptron Model for Day-ahead Photovoltaic Forecasting Improvement of Detection Rate for Small Objects Using Pre-processing Network
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1