{"title":"用于单级物体检测的抗错位域自适应学习","authors":"Yunfei Bai , Chang Liu , Rui Yang , Xiaomao Li","doi":"10.1016/j.knosys.2024.112605","DOIUrl":null,"url":null,"abstract":"<div><div>Without consideration of task specificity, directly transforming domain adaptive pipelines from classification to one-stage detection tends to pose severer misalignments. These misalignments include: (1) Foreground misalignment that the domain discriminator obsessively concentrates on backgrounds since one-stage detectors do not contain proposals for instance-level discrimination. (2) Localization misalignment that domain-adaptive features supervised by the domain discriminator are not suitable for localization tasks, as the discriminator is a classifier in essence. To tackle these problems, we propose the <strong>Misalignment-Resistant Domain Adaption</strong> (MRDA) for one-stage detectors. Specifically, to alleviate foreground misalignment, a mask-based domain discriminator is proposed to perform instance-level discrimination by assigning the pixel-level domain labels based on instance-level masks. As for localization misalignment, a localization discriminator is introduced to learn domain-adaptive features for localization tasks. It employs an additional box-regression branch with an IoU loss to perform adversarial mutual supervision with the feature extractor. Comprehensive experiments demonstrate that our method effectively mitigates the misalignments and achieves state-of-the-art detection across multiple datasets.</div></div>","PeriodicalId":49939,"journal":{"name":"Knowledge-Based Systems","volume":null,"pages":null},"PeriodicalIF":7.2000,"publicationDate":"2024-10-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Misalignment-resistant domain adaptive learning for one-stage object detection\",\"authors\":\"Yunfei Bai , Chang Liu , Rui Yang , Xiaomao Li\",\"doi\":\"10.1016/j.knosys.2024.112605\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Without consideration of task specificity, directly transforming domain adaptive pipelines from classification to one-stage detection tends to pose severer misalignments. These misalignments include: (1) Foreground misalignment that the domain discriminator obsessively concentrates on backgrounds since one-stage detectors do not contain proposals for instance-level discrimination. (2) Localization misalignment that domain-adaptive features supervised by the domain discriminator are not suitable for localization tasks, as the discriminator is a classifier in essence. To tackle these problems, we propose the <strong>Misalignment-Resistant Domain Adaption</strong> (MRDA) for one-stage detectors. Specifically, to alleviate foreground misalignment, a mask-based domain discriminator is proposed to perform instance-level discrimination by assigning the pixel-level domain labels based on instance-level masks. As for localization misalignment, a localization discriminator is introduced to learn domain-adaptive features for localization tasks. It employs an additional box-regression branch with an IoU loss to perform adversarial mutual supervision with the feature extractor. Comprehensive experiments demonstrate that our method effectively mitigates the misalignments and achieves state-of-the-art detection across multiple datasets.</div></div>\",\"PeriodicalId\":49939,\"journal\":{\"name\":\"Knowledge-Based Systems\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":7.2000,\"publicationDate\":\"2024-10-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Knowledge-Based Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0950705124012395\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Knowledge-Based Systems","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0950705124012395","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Misalignment-resistant domain adaptive learning for one-stage object detection
Without consideration of task specificity, directly transforming domain adaptive pipelines from classification to one-stage detection tends to pose severer misalignments. These misalignments include: (1) Foreground misalignment that the domain discriminator obsessively concentrates on backgrounds since one-stage detectors do not contain proposals for instance-level discrimination. (2) Localization misalignment that domain-adaptive features supervised by the domain discriminator are not suitable for localization tasks, as the discriminator is a classifier in essence. To tackle these problems, we propose the Misalignment-Resistant Domain Adaption (MRDA) for one-stage detectors. Specifically, to alleviate foreground misalignment, a mask-based domain discriminator is proposed to perform instance-level discrimination by assigning the pixel-level domain labels based on instance-level masks. As for localization misalignment, a localization discriminator is introduced to learn domain-adaptive features for localization tasks. It employs an additional box-regression branch with an IoU loss to perform adversarial mutual supervision with the feature extractor. Comprehensive experiments demonstrate that our method effectively mitigates the misalignments and achieves state-of-the-art detection across multiple datasets.
期刊介绍:
Knowledge-Based Systems, an international and interdisciplinary journal in artificial intelligence, publishes original, innovative, and creative research results in the field. It focuses on knowledge-based and other artificial intelligence techniques-based systems. The journal aims to support human prediction and decision-making through data science and computation techniques, provide a balanced coverage of theory and practical study, and encourage the development and implementation of knowledge-based intelligence models, methods, systems, and software tools. Applications in business, government, education, engineering, and healthcare are emphasized.