利用耦合对抗性学习提高跨域多指指纹匹配的互操作性

IF 1.8 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE IET Biometrics Pub Date : 2023-07-24 DOI:10.1049/bme2.12117
Md Mahedi Hasan, Nasser Nasrabadi, Jeremy Dawson
{"title":"利用耦合对抗性学习提高跨域多指指纹匹配的互操作性","authors":"Md Mahedi Hasan,&nbsp;Nasser Nasrabadi,&nbsp;Jeremy Dawson","doi":"10.1049/bme2.12117","DOIUrl":null,"url":null,"abstract":"<p>Improving interoperability in contactless-to-contact fingerprint matching is a crucial factor for the mainstream adoption of contactless fingerphoto devices. However, matching contactless probe images against legacy contact-based gallery images is very challenging due to the presence of heterogeneity between these domains. Moreover, unconstrained acquisition of fingerphotos produces perspective distortion. Therefore, direct matching of fingerprint features suffers severe performance degradation on cross-domain interoperability. In this study, to address this issue, the authors propose a coupled adversarial learning framework to learn a fingerprint representation in a low-dimensional subspace that is discriminative and domain-invariant in nature. In fact, using a conditional coupled generative adversarial network, the authors project both the contactless and the contact-based fingerprint into a latent subspace to explore the hidden relationship between them using class-specific contrastive loss and ArcFace loss. The ArcFace loss ensures intra-class compactness and inter-class separability, whereas the contrastive loss minimises the distance between the subspaces for the same finger. Experiments on four challenging datasets demonstrate that our proposed model outperforms state-of-the methods and two top-performing commercial-off-the-shelf SDKs, that is, Verifinger v12.0 and Innovatrics. In addition, the authors also introduce a multi-finger score fusion network that significantly boosts interoperability by effectively utilising the multi-finger input of the same subject for both cross-domain and cross-sensor settings.</p>","PeriodicalId":48821,"journal":{"name":"IET Biometrics","volume":"12 4","pages":"194-210"},"PeriodicalIF":1.8000,"publicationDate":"2023-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/bme2.12117","citationCount":"0","resultStr":"{\"title\":\"On improving interoperability for cross-domain multi-finger fingerprint matching using coupled adversarial learning\",\"authors\":\"Md Mahedi Hasan,&nbsp;Nasser Nasrabadi,&nbsp;Jeremy Dawson\",\"doi\":\"10.1049/bme2.12117\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Improving interoperability in contactless-to-contact fingerprint matching is a crucial factor for the mainstream adoption of contactless fingerphoto devices. However, matching contactless probe images against legacy contact-based gallery images is very challenging due to the presence of heterogeneity between these domains. Moreover, unconstrained acquisition of fingerphotos produces perspective distortion. Therefore, direct matching of fingerprint features suffers severe performance degradation on cross-domain interoperability. In this study, to address this issue, the authors propose a coupled adversarial learning framework to learn a fingerprint representation in a low-dimensional subspace that is discriminative and domain-invariant in nature. In fact, using a conditional coupled generative adversarial network, the authors project both the contactless and the contact-based fingerprint into a latent subspace to explore the hidden relationship between them using class-specific contrastive loss and ArcFace loss. The ArcFace loss ensures intra-class compactness and inter-class separability, whereas the contrastive loss minimises the distance between the subspaces for the same finger. Experiments on four challenging datasets demonstrate that our proposed model outperforms state-of-the methods and two top-performing commercial-off-the-shelf SDKs, that is, Verifinger v12.0 and Innovatrics. In addition, the authors also introduce a multi-finger score fusion network that significantly boosts interoperability by effectively utilising the multi-finger input of the same subject for both cross-domain and cross-sensor settings.</p>\",\"PeriodicalId\":48821,\"journal\":{\"name\":\"IET Biometrics\",\"volume\":\"12 4\",\"pages\":\"194-210\"},\"PeriodicalIF\":1.8000,\"publicationDate\":\"2023-07-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1049/bme2.12117\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IET Biometrics\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1049/bme2.12117\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IET Biometrics","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1049/bme2.12117","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

提高非接触指纹匹配的互操作性是非接触指纹照相设备主流采用的关键因素。然而,由于这些领域之间存在异质性,将非接触式探针图像与传统的基于接触的图库图像进行匹配是非常具有挑战性的。此外,不受约束地获取手指照片会产生透视失真。因此,指纹特征的直接匹配在跨域互操作性方面遭受严重的性能退化。在这项研究中,为了解决这个问题,作者提出了一个耦合对抗性学习框架来学习低维子空间中的指纹表示,该子空间本质上是判别性的和域不变的。事实上,使用条件耦合的生成对抗性网络,作者将非接触指纹和基于接触的指纹投影到一个潜在的子空间中,使用特定类别的对比损失和ArcFace损失来探索它们之间的隐藏关系。ArcFace损失确保了类内紧凑性和类间可分性,而对比损失最小化了同一手指的子空间之间的距离。在四个具有挑战性的数据集上的实验表明,我们提出的模型优于现有方法和两个性能最好的商业现成SDK,即Verifinger v12.0和Innovatrics。此外,作者还介绍了一种多手指分数融合网络,该网络通过在跨域和跨传感器设置中有效利用同一对象的多手指输入,显著提高了互操作性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

摘要图片

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
On improving interoperability for cross-domain multi-finger fingerprint matching using coupled adversarial learning

Improving interoperability in contactless-to-contact fingerprint matching is a crucial factor for the mainstream adoption of contactless fingerphoto devices. However, matching contactless probe images against legacy contact-based gallery images is very challenging due to the presence of heterogeneity between these domains. Moreover, unconstrained acquisition of fingerphotos produces perspective distortion. Therefore, direct matching of fingerprint features suffers severe performance degradation on cross-domain interoperability. In this study, to address this issue, the authors propose a coupled adversarial learning framework to learn a fingerprint representation in a low-dimensional subspace that is discriminative and domain-invariant in nature. In fact, using a conditional coupled generative adversarial network, the authors project both the contactless and the contact-based fingerprint into a latent subspace to explore the hidden relationship between them using class-specific contrastive loss and ArcFace loss. The ArcFace loss ensures intra-class compactness and inter-class separability, whereas the contrastive loss minimises the distance between the subspaces for the same finger. Experiments on four challenging datasets demonstrate that our proposed model outperforms state-of-the methods and two top-performing commercial-off-the-shelf SDKs, that is, Verifinger v12.0 and Innovatrics. In addition, the authors also introduce a multi-finger score fusion network that significantly boosts interoperability by effectively utilising the multi-finger input of the same subject for both cross-domain and cross-sensor settings.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IET Biometrics
IET Biometrics COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE-
CiteScore
5.90
自引率
0.00%
发文量
46
审稿时长
33 weeks
期刊介绍: The field of biometric recognition - automated recognition of individuals based on their behavioural and biological characteristics - has now reached a level of maturity where viable practical applications are both possible and increasingly available. The biometrics field is characterised especially by its interdisciplinarity since, while focused primarily around a strong technological base, effective system design and implementation often requires a broad range of skills encompassing, for example, human factors, data security and database technologies, psychological and physiological awareness, and so on. Also, the technology focus itself embraces diversity, since the engineering of effective biometric systems requires integration of image analysis, pattern recognition, sensor technology, database engineering, security design and many other strands of understanding. The scope of the journal is intentionally relatively wide. While focusing on core technological issues, it is recognised that these may be inherently diverse and in many cases may cross traditional disciplinary boundaries. The scope of the journal will therefore include any topics where it can be shown that a paper can increase our understanding of biometric systems, signal future developments and applications for biometrics, or promote greater practical uptake for relevant technologies: Development and enhancement of individual biometric modalities including the established and traditional modalities (e.g. face, fingerprint, iris, signature and handwriting recognition) and also newer or emerging modalities (gait, ear-shape, neurological patterns, etc.) Multibiometrics, theoretical and practical issues, implementation of practical systems, multiclassifier and multimodal approaches Soft biometrics and information fusion for identification, verification and trait prediction Human factors and the human-computer interface issues for biometric systems, exception handling strategies Template construction and template management, ageing factors and their impact on biometric systems Usability and user-oriented design, psychological and physiological principles and system integration Sensors and sensor technologies for biometric processing Database technologies to support biometric systems Implementation of biometric systems, security engineering implications, smartcard and associated technologies in implementation, implementation platforms, system design and performance evaluation Trust and privacy issues, security of biometric systems and supporting technological solutions, biometric template protection Biometric cryptosystems, security and biometrics-linked encryption Links with forensic processing and cross-disciplinary commonalities Core underpinning technologies (e.g. image analysis, pattern recognition, computer vision, signal processing, etc.), where the specific relevance to biometric processing can be demonstrated Applications and application-led considerations Position papers on technology or on the industrial context of biometric system development Adoption and promotion of standards in biometrics, improving technology acceptance, deployment and interoperability, avoiding cross-cultural and cross-sector restrictions Relevant ethical and social issues
期刊最新文献
A Multimodal Biometric Recognition Method Based on Federated Learning Deep and Shallow Feature Fusion in Feature Score Level for Palmprint Recognition Research on TCN Model Based on SSARF Feature Selection in the Field of Human Behavior Recognition A Finger Vein Recognition Algorithm Based on the Histogram of Variable Curvature Directional Binary Statistics A Survey on Automatic Face Recognition Using Side-View Face Images
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1