Yan He;Fei Peng;Rizhao Cai;Zitong Yu;Min Long;Kwok-Yan Lam
{"title":"Category-Conditional Gradient Alignment for Domain Adaptive Face Anti-Spoofing","authors":"Yan He;Fei Peng;Rizhao Cai;Zitong Yu;Min Long;Kwok-Yan Lam","doi":"10.1109/TIFS.2024.3486098","DOIUrl":null,"url":null,"abstract":"In view of inconsistent face acquisition procedure in face anti-spoofing, the detection performance on the target domain generally suffers severe degradation under source-specific gradient optimization. Existing domain adaptation face anti-spoofing methods focus on improving model generalization capability through feature matching, which do not consider the gradient discrepancy between the source and target domains. To this end, this work develops a category-conditional gradient alignment guided face anti-spoofing algorithm (CCGA-FAS) from a novel perspective of gradient discrepancy elimination. Technically, the category-conditional gradient alignment mechanism maximizes the cosine similarity of the gradient vectors generated by source and target samples within the live and spoof categories separately, which promotes the source and target domains to follow similar gradient descent directions during optimization. Considering that the gradient vector generation and alignment is computationally dependent on reliable category information, a temporal knowledge and flexible threshold based dynamic category measurer is devised to provide pseudo category information for unlabelled target samples in an easy-to-hard manner. The optimization for CCGA-FAS is implemented under the teacher-student structure, where the student model serves as the gradient optimization backbone, and the category prediction simultaneously benefits from the teacher and student models to consolidate the alignment stability. Experimental results and analysis demonstrate that the proposed method outperforms the state-of-the-art methods in both unsupervised and K-shot semi-supervised domain adaptive face anti-spoofing scenarios.","PeriodicalId":13492,"journal":{"name":"IEEE Transactions on Information Forensics and Security","volume":"19 ","pages":"10071-10085"},"PeriodicalIF":6.3000,"publicationDate":"2024-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Information Forensics and Security","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10734389/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, THEORY & METHODS","Score":null,"Total":0}
引用次数: 0
Abstract
In view of inconsistent face acquisition procedure in face anti-spoofing, the detection performance on the target domain generally suffers severe degradation under source-specific gradient optimization. Existing domain adaptation face anti-spoofing methods focus on improving model generalization capability through feature matching, which do not consider the gradient discrepancy between the source and target domains. To this end, this work develops a category-conditional gradient alignment guided face anti-spoofing algorithm (CCGA-FAS) from a novel perspective of gradient discrepancy elimination. Technically, the category-conditional gradient alignment mechanism maximizes the cosine similarity of the gradient vectors generated by source and target samples within the live and spoof categories separately, which promotes the source and target domains to follow similar gradient descent directions during optimization. Considering that the gradient vector generation and alignment is computationally dependent on reliable category information, a temporal knowledge and flexible threshold based dynamic category measurer is devised to provide pseudo category information for unlabelled target samples in an easy-to-hard manner. The optimization for CCGA-FAS is implemented under the teacher-student structure, where the student model serves as the gradient optimization backbone, and the category prediction simultaneously benefits from the teacher and student models to consolidate the alignment stability. Experimental results and analysis demonstrate that the proposed method outperforms the state-of-the-art methods in both unsupervised and K-shot semi-supervised domain adaptive face anti-spoofing scenarios.
期刊介绍:
The IEEE Transactions on Information Forensics and Security covers the sciences, technologies, and applications relating to information forensics, information security, biometrics, surveillance and systems applications that incorporate these features