利用遮挡属性增强被遮挡人的再识别

IF 6 1区 计算机科学 0 COMPUTER SCIENCE, INFORMATION SYSTEMS Information Sciences Pub Date : 2025-05-01 Epub Date: 2025-01-08 DOI:10.1016/j.ins.2024.121866
Tengfei Ren , Qiusheng Lian , Jiale Chen
{"title":"利用遮挡属性增强被遮挡人的再识别","authors":"Tengfei Ren ,&nbsp;Qiusheng Lian ,&nbsp;Jiale Chen","doi":"10.1016/j.ins.2024.121866","DOIUrl":null,"url":null,"abstract":"<div><div>Occluded person re-identification (ReID) aims to address the potential occlusion problem when matching occluded or holistic pedestrians from different camera views. Currently, occlusion augmentation-based methods have not fully exploited the occlusion attributes, resulting in suboptimal results. We introduce a novel ReID framework, dubbed Occlusion Attributes boosted Occluded Person Re-Identification (OA-ReID), aimed at leveraging the occlusion attributes for pedestrian-focused feature learning. Firstly, we propose an occlusion emulator (OE) that generates artificially occluded images towards emulating the occlusion scenarios. Both the original image and the corresponding artificially occluded image are jointly used for model training. Secondly, we present two crucial components, namely the inductive hard (IH) sample mining and the Occlusion-Informed Part Transformer (OIPT). The IH sample mining leverages the obstacle category to construct inductive triplets, which induces the model to extract identity-relevant features. The OIPT integrates the obstacle position information into our ReID framework to rectify the erroneous attention on occlusions, promoting reliable target pedestrian localization. Through extensive experiments, we show OA-ReID achieves state-of-the-art performance on both occluded and holistic person ReID benchmarks.</div></div>","PeriodicalId":51063,"journal":{"name":"Information Sciences","volume":"701 ","pages":"Article 121866"},"PeriodicalIF":6.0000,"publicationDate":"2025-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Boosting occluded person re-identification by leveraging occlusion attributes\",\"authors\":\"Tengfei Ren ,&nbsp;Qiusheng Lian ,&nbsp;Jiale Chen\",\"doi\":\"10.1016/j.ins.2024.121866\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Occluded person re-identification (ReID) aims to address the potential occlusion problem when matching occluded or holistic pedestrians from different camera views. Currently, occlusion augmentation-based methods have not fully exploited the occlusion attributes, resulting in suboptimal results. We introduce a novel ReID framework, dubbed Occlusion Attributes boosted Occluded Person Re-Identification (OA-ReID), aimed at leveraging the occlusion attributes for pedestrian-focused feature learning. Firstly, we propose an occlusion emulator (OE) that generates artificially occluded images towards emulating the occlusion scenarios. Both the original image and the corresponding artificially occluded image are jointly used for model training. Secondly, we present two crucial components, namely the inductive hard (IH) sample mining and the Occlusion-Informed Part Transformer (OIPT). The IH sample mining leverages the obstacle category to construct inductive triplets, which induces the model to extract identity-relevant features. The OIPT integrates the obstacle position information into our ReID framework to rectify the erroneous attention on occlusions, promoting reliable target pedestrian localization. Through extensive experiments, we show OA-ReID achieves state-of-the-art performance on both occluded and holistic person ReID benchmarks.</div></div>\",\"PeriodicalId\":51063,\"journal\":{\"name\":\"Information Sciences\",\"volume\":\"701 \",\"pages\":\"Article 121866\"},\"PeriodicalIF\":6.0000,\"publicationDate\":\"2025-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Information Sciences\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0020025524017808\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/1/8 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"0\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Sciences","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0020025524017808","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/8 0:00:00","PubModel":"Epub","JCR":"0","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

摘要

遮挡人再识别(ReID)旨在解决在匹配来自不同摄像机视图的遮挡或整体行人时潜在的遮挡问题。目前,基于遮挡增强的方法没有充分利用遮挡属性,导致结果不理想。我们引入了一种新的ReID框架,称为遮挡属性增强遮挡人再识别(OA-ReID),旨在利用遮挡属性进行以行人为中心的特征学习。首先,我们提出了一个遮挡模拟器(OE),生成人工遮挡的图像来模拟遮挡场景。将原始图像和相应的人工遮挡图像联合用于模型训练。其次,我们提出了两个关键组件,即电感硬(IH)样本挖掘和闭塞通知部分变压器(OIPT)。IH样本挖掘利用障碍类别构造归纳三元组,归纳模型提取身份相关特征。OIPT将障碍物位置信息整合到我们的ReID框架中,以纠正对遮挡的错误关注,促进可靠的目标行人定位。通过广泛的实验,我们表明OA-ReID在闭塞和整体人ReID基准上都达到了最先进的性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Boosting occluded person re-identification by leveraging occlusion attributes
Occluded person re-identification (ReID) aims to address the potential occlusion problem when matching occluded or holistic pedestrians from different camera views. Currently, occlusion augmentation-based methods have not fully exploited the occlusion attributes, resulting in suboptimal results. We introduce a novel ReID framework, dubbed Occlusion Attributes boosted Occluded Person Re-Identification (OA-ReID), aimed at leveraging the occlusion attributes for pedestrian-focused feature learning. Firstly, we propose an occlusion emulator (OE) that generates artificially occluded images towards emulating the occlusion scenarios. Both the original image and the corresponding artificially occluded image are jointly used for model training. Secondly, we present two crucial components, namely the inductive hard (IH) sample mining and the Occlusion-Informed Part Transformer (OIPT). The IH sample mining leverages the obstacle category to construct inductive triplets, which induces the model to extract identity-relevant features. The OIPT integrates the obstacle position information into our ReID framework to rectify the erroneous attention on occlusions, promoting reliable target pedestrian localization. Through extensive experiments, we show OA-ReID achieves state-of-the-art performance on both occluded and holistic person ReID benchmarks.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Information Sciences
Information Sciences 工程技术-计算机:信息系统
CiteScore
14.00
自引率
17.30%
发文量
1322
审稿时长
10.4 months
期刊介绍: Informatics and Computer Science Intelligent Systems Applications is an esteemed international journal that focuses on publishing original and creative research findings in the field of information sciences. We also feature a limited number of timely tutorial and surveying contributions. Our journal aims to cater to a diverse audience, including researchers, developers, managers, strategic planners, graduate students, and anyone interested in staying up-to-date with cutting-edge research in information science, knowledge engineering, and intelligent systems. While readers are expected to share a common interest in information science, they come from varying backgrounds such as engineering, mathematics, statistics, physics, computer science, cell biology, molecular biology, management science, cognitive science, neurobiology, behavioral sciences, and biochemistry.
期刊最新文献
LaPathZK: Parallel threshold path zk-SNARK leveraging high-dimensional lattices Integrating lexical semantics for deep conceptual similarity: A WordNet-based vector framework A2RCMatch: dual-attention framework for reliable sample selection and consistency regularization in semi-supervised learning Mutual Information-Guided Multi-Population differential evolution with dynamic resource allocation for gene selection Reversible data hiding for medical images using multi-branch CNNs and class-aware spatial-domain embedding
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1