{"title":"Text-Guided Prototype Generation for Occluded Person Re-Identification","authors":"Min Jiang;Xinyu Liu;Jun Kong","doi":"10.1109/LSP.2024.3456007","DOIUrl":null,"url":null,"abstract":"Occluded person re-identification (ReID) focuses on identifying persons who are partially occluded, especially in multi-camera scenarios. The majority of methods employ the background to make artificial occlusions. However, simple artificial occlusions could not effectively simulate real-world occluded scenarios, due to its lack of semantic information and its limitation in disrupting the model's attention. In this paper, we present the Text-Guided Prototype Generation (TGPG) for occluded person ReID. On the one hand, to fully employ the potential of text as priori information, the Mask Prototype Generation (MPG) strategy is presented to generate the prototypes that could capture attention in the pretrained model, similar to the realistic occlusions. On the other hand, to create a relationship between holistic person features and occluded person features, the Intra-modality Spatial Consistency (ISC) loss is introduced, enhancing the consistency and representativeness of the generated mask prototypes. Comprehensive experiments conducted on the Occluded-Duke and Occluded-ReID datasets confirm our method's superiority over state-of-the-art approaches.","PeriodicalId":13154,"journal":{"name":"IEEE Signal Processing Letters","volume":null,"pages":null},"PeriodicalIF":3.2000,"publicationDate":"2024-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Signal Processing Letters","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10669214/","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Occluded person re-identification (ReID) focuses on identifying persons who are partially occluded, especially in multi-camera scenarios. The majority of methods employ the background to make artificial occlusions. However, simple artificial occlusions could not effectively simulate real-world occluded scenarios, due to its lack of semantic information and its limitation in disrupting the model's attention. In this paper, we present the Text-Guided Prototype Generation (TGPG) for occluded person ReID. On the one hand, to fully employ the potential of text as priori information, the Mask Prototype Generation (MPG) strategy is presented to generate the prototypes that could capture attention in the pretrained model, similar to the realistic occlusions. On the other hand, to create a relationship between holistic person features and occluded person features, the Intra-modality Spatial Consistency (ISC) loss is introduced, enhancing the consistency and representativeness of the generated mask prototypes. Comprehensive experiments conducted on the Occluded-Duke and Occluded-ReID datasets confirm our method's superiority over state-of-the-art approaches.
期刊介绍:
The IEEE Signal Processing Letters is a monthly, archival publication designed to provide rapid dissemination of original, cutting-edge ideas and timely, significant contributions in signal, image, speech, language and audio processing. Papers published in the Letters can be presented within one year of their appearance in signal processing conferences such as ICASSP, GlobalSIP and ICIP, and also in several workshop organized by the Signal Processing Society.