{"title":"Progressive de-preference task-specific processing for generalizable person re-identification","authors":"Haishun Du, Jieru Li, Linbing Cao, Xinxin Hao","doi":"10.1016/j.knosys.2024.112779","DOIUrl":null,"url":null,"abstract":"<div><div>Recently, domain generalization (DG) person re-identification (ReID) has attracted attention. Existing DG person ReID methods train on mixed datasets containing all source domains. However, these mixed datasets have huge inter-domain differences because of varying data distributions across different source domains. Such differences hinder models from learning domain-invariant representations, affecting generalization on unseen domains. To address this issue, we propose a progressive de-preference task-specific processing network (PDTP-Net) for DG person ReID. Initially, we design a progressive de-preference domain segmentation strategy to mitigate inter-domain differences by dividing multiple source domains into different phases, each comprising several training tasks. We then design a global and task-specific processing module that enhances extraction of domain-invariant features by integrating statistical information from other source domains. Finally, we design a multi-granularity attention module and a group-aware batch normalization strategy to ensure the features are more discriminative and better suited for person ReID tasks. The proposed model is validated using three DG person ReID experimental protocols: Protocol-1, Protocol-2, and leave-one-out experiments. On Protocol-1, the model improves mean average precision (mAP) and Rank-1 accuracy on all datasets by an average of 0.7% and 0.3%, respectively. On Protocol-2, the model improves mAP and Rank-1 accuracy on all datasets by an average of 2.525% and 2.725%, respectively. On the leave-one-out experiments, the model improves mAP and Rank-1 accuracy on all tasks by an average of 0.65% and 0.18%, respectively. The results on several popular datasets suggest that the model achieves state-of-the-art performance in DG person ReID.</div></div>","PeriodicalId":49939,"journal":{"name":"Knowledge-Based Systems","volume":"309 ","pages":"Article 112779"},"PeriodicalIF":7.2000,"publicationDate":"2024-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Knowledge-Based Systems","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0950705124014138","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Recently, domain generalization (DG) person re-identification (ReID) has attracted attention. Existing DG person ReID methods train on mixed datasets containing all source domains. However, these mixed datasets have huge inter-domain differences because of varying data distributions across different source domains. Such differences hinder models from learning domain-invariant representations, affecting generalization on unseen domains. To address this issue, we propose a progressive de-preference task-specific processing network (PDTP-Net) for DG person ReID. Initially, we design a progressive de-preference domain segmentation strategy to mitigate inter-domain differences by dividing multiple source domains into different phases, each comprising several training tasks. We then design a global and task-specific processing module that enhances extraction of domain-invariant features by integrating statistical information from other source domains. Finally, we design a multi-granularity attention module and a group-aware batch normalization strategy to ensure the features are more discriminative and better suited for person ReID tasks. The proposed model is validated using three DG person ReID experimental protocols: Protocol-1, Protocol-2, and leave-one-out experiments. On Protocol-1, the model improves mean average precision (mAP) and Rank-1 accuracy on all datasets by an average of 0.7% and 0.3%, respectively. On Protocol-2, the model improves mAP and Rank-1 accuracy on all datasets by an average of 2.525% and 2.725%, respectively. On the leave-one-out experiments, the model improves mAP and Rank-1 accuracy on all tasks by an average of 0.65% and 0.18%, respectively. The results on several popular datasets suggest that the model achieves state-of-the-art performance in DG person ReID.
近年来,领域泛化(DG)中的人物再识别(ReID)受到了广泛关注。现有的DG person ReID方法在包含所有源域的混合数据集上进行训练。然而,由于不同源域的数据分布不同,这些混合数据集具有巨大的域间差异。这种差异阻碍了模型学习领域不变表示,影响了对未知领域的泛化。为了解决这个问题,我们提出了一个递进的去偏好任务特定处理网络(PDTP-Net),用于DG人的ReID。首先,我们设计了一种渐进式的去偏好域分割策略,通过将多个源域划分为不同的阶段来缓解域间的差异,每个阶段包含几个训练任务。然后,我们设计了一个全局和特定任务的处理模块,通过集成来自其他源域的统计信息来增强域不变特征的提取。最后,我们设计了一个多粒度关注模块和一个组感知批归一化策略,以确保特征更具区别性,更适合个人ReID任务。采用三种DG人ReID实验协议(Protocol-1、Protocol-2和leave-one实验)验证了所提出的模型。在Protocol-1上,该模型在所有数据集上的平均精度(mAP)和Rank-1精度平均分别提高了0.7%和0.3%。在Protocol-2上,该模型在所有数据集上mAP和Rank-1的准确率平均分别提高了2.525%和2.725%。在left -one-out实验中,该模型在所有任务上的mAP和Rank-1准确率平均分别提高了0.65%和0.18%。在几个流行的数据集上的结果表明,该模型在DG人ReID中达到了最先进的性能。
期刊介绍:
Knowledge-Based Systems, an international and interdisciplinary journal in artificial intelligence, publishes original, innovative, and creative research results in the field. It focuses on knowledge-based and other artificial intelligence techniques-based systems. The journal aims to support human prediction and decision-making through data science and computation techniques, provide a balanced coverage of theory and practical study, and encourage the development and implementation of knowledge-based intelligence models, methods, systems, and software tools. Applications in business, government, education, engineering, and healthcare are emphasized.