Shihong Yao;Keyu Pan;Tao Wang;Zhigao Zheng;Jing Jin;Chuli Hu
{"title":"AAGNet:基于属性感知图的网络,用于模糊行人再识别","authors":"Shihong Yao;Keyu Pan;Tao Wang;Zhigao Zheng;Jing Jin;Chuli Hu","doi":"10.1109/TCE.2024.3453890","DOIUrl":null,"url":null,"abstract":"In large consumer sites, pedestrian re-identification (Re-ID) has the potential to enhance identify loyal consumers and create a more enjoyable shopping experience. Current Re-ID models always rely on some certain pedestrian feature descriptors, including body parts matching and pose key points, to extract part-level features. However, occlusion always causes a tremendous amount of noise and affects the feature representation, thereby significantly degrading the performance of those models. To address this problem, we propose an attribute-aware graph-based network (AAGNet) for Occluded Re-ID. Specifically, we develop a part-attribute feature extractor that maps the manually labeled pedestrian features into word vectors, and combines them with specific body part to obtain both attribute features and part features. The weight information of body parts and attributes are learned through graph convolution networks. Moreover, we introduce an occluded Re-ID dataset called Occluded-Market that can support the subsequent studies of occluded Re-ID. Comparative experimental results evidently demonstrate that the AAGNet shows superior performance in terms of accuracy, efficiency, and robustness on two open-source data sets. Our study can provide data and methodological support for further research on the occluded Re-ID and technological baseline for Re-ID-based commercial analytic applications in large consumer sites. The dataset is available at: github.com/Occluded_Market.","PeriodicalId":13208,"journal":{"name":"IEEE Transactions on Consumer Electronics","volume":"70 4","pages":"6580-6588"},"PeriodicalIF":4.3000,"publicationDate":"2024-09-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"AAGNet: Attribute-Aware Graph-Based Network for Occluded Pedestrian Re-Identification\",\"authors\":\"Shihong Yao;Keyu Pan;Tao Wang;Zhigao Zheng;Jing Jin;Chuli Hu\",\"doi\":\"10.1109/TCE.2024.3453890\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In large consumer sites, pedestrian re-identification (Re-ID) has the potential to enhance identify loyal consumers and create a more enjoyable shopping experience. Current Re-ID models always rely on some certain pedestrian feature descriptors, including body parts matching and pose key points, to extract part-level features. However, occlusion always causes a tremendous amount of noise and affects the feature representation, thereby significantly degrading the performance of those models. To address this problem, we propose an attribute-aware graph-based network (AAGNet) for Occluded Re-ID. Specifically, we develop a part-attribute feature extractor that maps the manually labeled pedestrian features into word vectors, and combines them with specific body part to obtain both attribute features and part features. The weight information of body parts and attributes are learned through graph convolution networks. Moreover, we introduce an occluded Re-ID dataset called Occluded-Market that can support the subsequent studies of occluded Re-ID. Comparative experimental results evidently demonstrate that the AAGNet shows superior performance in terms of accuracy, efficiency, and robustness on two open-source data sets. Our study can provide data and methodological support for further research on the occluded Re-ID and technological baseline for Re-ID-based commercial analytic applications in large consumer sites. The dataset is available at: github.com/Occluded_Market.\",\"PeriodicalId\":13208,\"journal\":{\"name\":\"IEEE Transactions on Consumer Electronics\",\"volume\":\"70 4\",\"pages\":\"6580-6588\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2024-09-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Consumer Electronics\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10663678/\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Consumer Electronics","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10663678/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
AAGNet: Attribute-Aware Graph-Based Network for Occluded Pedestrian Re-Identification
In large consumer sites, pedestrian re-identification (Re-ID) has the potential to enhance identify loyal consumers and create a more enjoyable shopping experience. Current Re-ID models always rely on some certain pedestrian feature descriptors, including body parts matching and pose key points, to extract part-level features. However, occlusion always causes a tremendous amount of noise and affects the feature representation, thereby significantly degrading the performance of those models. To address this problem, we propose an attribute-aware graph-based network (AAGNet) for Occluded Re-ID. Specifically, we develop a part-attribute feature extractor that maps the manually labeled pedestrian features into word vectors, and combines them with specific body part to obtain both attribute features and part features. The weight information of body parts and attributes are learned through graph convolution networks. Moreover, we introduce an occluded Re-ID dataset called Occluded-Market that can support the subsequent studies of occluded Re-ID. Comparative experimental results evidently demonstrate that the AAGNet shows superior performance in terms of accuracy, efficiency, and robustness on two open-source data sets. Our study can provide data and methodological support for further research on the occluded Re-ID and technological baseline for Re-ID-based commercial analytic applications in large consumer sites. The dataset is available at: github.com/Occluded_Market.
期刊介绍:
The main focus for the IEEE Transactions on Consumer Electronics is the engineering and research aspects of the theory, design, construction, manufacture or end use of mass market electronics, systems, software and services for consumers.