虹膜分析的深度伪造检测

IF 3.4 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS IEEE Access Pub Date : 2025-01-09 DOI:10.1109/ACCESS.2025.3527868
Elisabeth Tchaptchet;Elie Fute Tagne;Jaime Acosta;Danda B. Rawat;Charles Kamhoua
{"title":"虹膜分析的深度伪造检测","authors":"Elisabeth Tchaptchet;Elie Fute Tagne;Jaime Acosta;Danda B. Rawat;Charles Kamhoua","doi":"10.1109/ACCESS.2025.3527868","DOIUrl":null,"url":null,"abstract":"Deepfake is an advanced technology that creates extremely realistic facial images and videos. This new technique operates under specific conditions and has a wide range of applications. For example, it can be used in the entertainment industry to create impressive visual effects or to insert actors into scenes convincingly. Similarly, in the film industry, deepfakes can help make movies by faithfully reproducing the appearance of actors who are not physically present. It is also useful for creating realistic digital avatars of people, which can be used in virtual environments, video games, or augmented reality applications. Recently, the emergence of new content generation models capable of creating impressively realistic images has been gaining momentum. Despite their advantages, they also cause significant issues when used maliciously, such as for identity theft, misinformation, and obscene depictions of well-known individuals. Therefore, it is crucial to implement effective methods to expose this generated content and thus reduce crime associated with deepfakes. This article presents a novel method for detecting fake content based on an in-depth analysis of the characteristics of eye irises. By applying a gradient map to the iris, it is possible to visualize the biological characteristics specific to eye irises, such as the round shape, identical reflections in the two irises of the same face, the size of the iris, etc. The gradient map highlights all the contours of the objects present in the iris; thus, the reflected light present in the corneas is represented by brighter pixels comparable to heat. We show that two irises of the same face are almost identical in shape, reflection, and size. Our experimental results on the Flickr-Faces-HQ (FFHQ) dataset and images obtained from StyleGAN2 demonstrate that our algorithm achieves a remarkable detection accuracy of 0.979 and 0.921 sensitivity. Furthermore, the method has a specificity of 0.937 and a precision of 0.960, thereby proving the effectiveness of the gradient map associated with the shape of the pupil in detecting Generative adversarial network (GAN) generated faces.","PeriodicalId":13079,"journal":{"name":"IEEE Access","volume":"13 ","pages":"8977-8987"},"PeriodicalIF":3.4000,"publicationDate":"2025-01-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10835076","citationCount":"0","resultStr":"{\"title\":\"Deepfakes Detection by Iris Analysis\",\"authors\":\"Elisabeth Tchaptchet;Elie Fute Tagne;Jaime Acosta;Danda B. Rawat;Charles Kamhoua\",\"doi\":\"10.1109/ACCESS.2025.3527868\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Deepfake is an advanced technology that creates extremely realistic facial images and videos. This new technique operates under specific conditions and has a wide range of applications. For example, it can be used in the entertainment industry to create impressive visual effects or to insert actors into scenes convincingly. Similarly, in the film industry, deepfakes can help make movies by faithfully reproducing the appearance of actors who are not physically present. It is also useful for creating realistic digital avatars of people, which can be used in virtual environments, video games, or augmented reality applications. Recently, the emergence of new content generation models capable of creating impressively realistic images has been gaining momentum. Despite their advantages, they also cause significant issues when used maliciously, such as for identity theft, misinformation, and obscene depictions of well-known individuals. Therefore, it is crucial to implement effective methods to expose this generated content and thus reduce crime associated with deepfakes. This article presents a novel method for detecting fake content based on an in-depth analysis of the characteristics of eye irises. By applying a gradient map to the iris, it is possible to visualize the biological characteristics specific to eye irises, such as the round shape, identical reflections in the two irises of the same face, the size of the iris, etc. The gradient map highlights all the contours of the objects present in the iris; thus, the reflected light present in the corneas is represented by brighter pixels comparable to heat. We show that two irises of the same face are almost identical in shape, reflection, and size. Our experimental results on the Flickr-Faces-HQ (FFHQ) dataset and images obtained from StyleGAN2 demonstrate that our algorithm achieves a remarkable detection accuracy of 0.979 and 0.921 sensitivity. Furthermore, the method has a specificity of 0.937 and a precision of 0.960, thereby proving the effectiveness of the gradient map associated with the shape of the pupil in detecting Generative adversarial network (GAN) generated faces.\",\"PeriodicalId\":13079,\"journal\":{\"name\":\"IEEE Access\",\"volume\":\"13 \",\"pages\":\"8977-8987\"},\"PeriodicalIF\":3.4000,\"publicationDate\":\"2025-01-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10835076\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Access\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10835076/\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Access","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10835076/","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

摘要

Deepfake是一项先进的技术,可以创建非常逼真的面部图像和视频。这项新技术在特定条件下运行,具有广泛的应用前景。例如,它可以在娱乐行业中用于创造令人印象深刻的视觉效果或将演员插入令人信服的场景。同样,在电影行业,深度造假可以通过忠实地再现演员的外表来帮助制作电影,而演员本人并不在场。它还可用于创建逼真的数字人物,可用于虚拟环境、视频游戏或增强现实应用程序。最近,能够创造令人印象深刻的逼真图像的新内容生成模型的出现势头正猛。尽管它们具有优势,但当恶意使用时,它们也会导致严重的问题,例如身份盗窃、错误信息和对知名人士的淫秽描述。因此,实施有效的方法来暴露这些生成的内容,从而减少与深度伪造相关的犯罪是至关重要的。本文在深入分析人眼虹膜特征的基础上,提出了一种检测虚假内容的新方法。通过对虹膜应用梯度图,可以可视化虹膜特有的生物特征,例如圆形,同一张脸的两个虹膜的相同反射,虹膜的大小等。梯度图突出了虹膜中物体的所有轮廓;因此,存在于角膜中的反射光是由比热更亮的像素表示的。我们发现,同一张脸的两道虹膜在形状、反射和大小上几乎是相同的。我们在Flickr-Faces-HQ (FFHQ)数据集和StyleGAN2获得的图像上的实验结果表明,我们的算法达到了0.979的检测精度和0.921的灵敏度。此外,该方法的特异性为0.937,精度为0.960,从而证明了瞳孔形状相关的梯度图在检测生成对抗网络(GAN)生成的人脸方面的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Deepfakes Detection by Iris Analysis
Deepfake is an advanced technology that creates extremely realistic facial images and videos. This new technique operates under specific conditions and has a wide range of applications. For example, it can be used in the entertainment industry to create impressive visual effects or to insert actors into scenes convincingly. Similarly, in the film industry, deepfakes can help make movies by faithfully reproducing the appearance of actors who are not physically present. It is also useful for creating realistic digital avatars of people, which can be used in virtual environments, video games, or augmented reality applications. Recently, the emergence of new content generation models capable of creating impressively realistic images has been gaining momentum. Despite their advantages, they also cause significant issues when used maliciously, such as for identity theft, misinformation, and obscene depictions of well-known individuals. Therefore, it is crucial to implement effective methods to expose this generated content and thus reduce crime associated with deepfakes. This article presents a novel method for detecting fake content based on an in-depth analysis of the characteristics of eye irises. By applying a gradient map to the iris, it is possible to visualize the biological characteristics specific to eye irises, such as the round shape, identical reflections in the two irises of the same face, the size of the iris, etc. The gradient map highlights all the contours of the objects present in the iris; thus, the reflected light present in the corneas is represented by brighter pixels comparable to heat. We show that two irises of the same face are almost identical in shape, reflection, and size. Our experimental results on the Flickr-Faces-HQ (FFHQ) dataset and images obtained from StyleGAN2 demonstrate that our algorithm achieves a remarkable detection accuracy of 0.979 and 0.921 sensitivity. Furthermore, the method has a specificity of 0.937 and a precision of 0.960, thereby proving the effectiveness of the gradient map associated with the shape of the pupil in detecting Generative adversarial network (GAN) generated faces.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Access
IEEE Access COMPUTER SCIENCE, INFORMATION SYSTEMSENGIN-ENGINEERING, ELECTRICAL & ELECTRONIC
CiteScore
9.80
自引率
7.70%
发文量
6673
审稿时长
6 weeks
期刊介绍: IEEE Access® is a multidisciplinary, open access (OA), applications-oriented, all-electronic archival journal that continuously presents the results of original research or development across all of IEEE''s fields of interest. IEEE Access will publish articles that are of high interest to readers, original, technically correct, and clearly presented. Supported by author publication charges (APC), its hallmarks are a rapid peer review and publication process with open access to all readers. Unlike IEEE''s traditional Transactions or Journals, reviews are "binary", in that reviewers will either Accept or Reject an article in the form it is submitted in order to achieve rapid turnaround. Especially encouraged are submissions on: Multidisciplinary topics, or applications-oriented articles and negative results that do not fit within the scope of IEEE''s traditional journals. Practical articles discussing new experiments or measurement techniques, interesting solutions to engineering. Development of new or improved fabrication or manufacturing techniques. Reviews or survey articles of new or evolving fields oriented to assist others in understanding the new area.
期刊最新文献
Editorial Board IEEE Access™ Editorial Board Corrections to “The Recent Technologies to Curb the Second-Wave of COVID-19 Pandemic” Corrections to “Decentralized Asynchronous Formation Planning of Multirotor Aerial Vehicles in Dynamic Environments Using Flexible Formation Graphs and Tight Trajectory Hulls” Study on the Motion Patterns of Nested Test Cabin and Its Shock Response Spectrum Analysis
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1