使用基于迁移学习的 Xception 模型进行深度伪造检测

Velusamy Rajakumareswaran, Surendran Raguvaran, Venkatachalam Chandrasekar, Sugavanam Rajkumar, Vijayakumar Arun
{"title":"使用基于迁移学习的 Xception 模型进行深度伪造检测","authors":"Velusamy Rajakumareswaran, Surendran Raguvaran, Venkatachalam Chandrasekar, Sugavanam Rajkumar, Vijayakumar Arun","doi":"10.20998/2522-9052.2024.2.10","DOIUrl":null,"url":null,"abstract":"Justification of the purpose of the research. In recent times, several approaches for face manipulation in videos have been extensively applied and availed to the public which makes editing faces in video easy for everyone effortlessly with realistic efforts.  While beneficial in various domains, these methods could significantly harm society if employed to spread misinformation. So, it is also vital to properly detect whether a face has been distorted in a video series. To detect this deepfake, convolutional neural networks can be used in past works. However, it needs a greater number of parameters and more computations. So, to overcome these limitations and to accurately detect deepfakes in videos, a transfer learning-based model named the Improved Xception model is suggested. Obtained results. This model is trained using extracted facial landmark features with robust training. Moreover, the improved Xception model's detection accuracy is evaluated alongside ResNet and Inception, considering model loss, accuracy, ROC, training time, and the Precision-Recall curve. The outcomes confirm the success of the proposed model, which employs transfer learning techniques to identify fraudulent videos. Furthermore, the method demonstrates a noteworthy 5% increase in efficiency compared to current systems.","PeriodicalId":275587,"journal":{"name":"Advanced Information Systems","volume":"4 9","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"DEEPFAKE DETECTION USING TRANSFER LEARNING-BASED XCEPTION MODEL\",\"authors\":\"Velusamy Rajakumareswaran, Surendran Raguvaran, Venkatachalam Chandrasekar, Sugavanam Rajkumar, Vijayakumar Arun\",\"doi\":\"10.20998/2522-9052.2024.2.10\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Justification of the purpose of the research. In recent times, several approaches for face manipulation in videos have been extensively applied and availed to the public which makes editing faces in video easy for everyone effortlessly with realistic efforts.  While beneficial in various domains, these methods could significantly harm society if employed to spread misinformation. So, it is also vital to properly detect whether a face has been distorted in a video series. To detect this deepfake, convolutional neural networks can be used in past works. However, it needs a greater number of parameters and more computations. So, to overcome these limitations and to accurately detect deepfakes in videos, a transfer learning-based model named the Improved Xception model is suggested. Obtained results. This model is trained using extracted facial landmark features with robust training. Moreover, the improved Xception model's detection accuracy is evaluated alongside ResNet and Inception, considering model loss, accuracy, ROC, training time, and the Precision-Recall curve. The outcomes confirm the success of the proposed model, which employs transfer learning techniques to identify fraudulent videos. Furthermore, the method demonstrates a noteworthy 5% increase in efficiency compared to current systems.\",\"PeriodicalId\":275587,\"journal\":{\"name\":\"Advanced Information Systems\",\"volume\":\"4 9\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-06-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Advanced Information Systems\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.20998/2522-9052.2024.2.10\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Information Systems","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.20998/2522-9052.2024.2.10","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

研究目的的合理性。近来,在视频中处理人脸的几种方法已被广泛应用并提供给公众,这使得每个人都能毫不费力地编辑视频中的人脸,而且只需付出实际的努力。 虽然这些方法在不同领域都有益处,但如果被用于传播错误信息,则可能对社会造成严重危害。因此,正确检测视频系列中的人脸是否被篡改也至关重要。为了检测这种深度伪造,在过去的工作中可以使用卷积神经网络。然而,它需要更多的参数和更多的计算。因此,为了克服这些局限性并准确检测视频中的深度伪造,我们提出了一种基于迁移学习的模型,名为 "改进的 Xception 模型"。结果该模型使用提取的面部地标特征进行鲁棒训练。此外,考虑到模型损失、准确性、ROC、训练时间和精度-召回曲线,对改进 Xception 模型的检测准确性与 ResNet 和 Inception 进行了评估。结果证实了所提出模型的成功,该模型采用了迁移学习技术来识别欺诈视频。此外,与现有系统相比,该方法的效率显著提高了 5%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
DEEPFAKE DETECTION USING TRANSFER LEARNING-BASED XCEPTION MODEL
Justification of the purpose of the research. In recent times, several approaches for face manipulation in videos have been extensively applied and availed to the public which makes editing faces in video easy for everyone effortlessly with realistic efforts.  While beneficial in various domains, these methods could significantly harm society if employed to spread misinformation. So, it is also vital to properly detect whether a face has been distorted in a video series. To detect this deepfake, convolutional neural networks can be used in past works. However, it needs a greater number of parameters and more computations. So, to overcome these limitations and to accurately detect deepfakes in videos, a transfer learning-based model named the Improved Xception model is suggested. Obtained results. This model is trained using extracted facial landmark features with robust training. Moreover, the improved Xception model's detection accuracy is evaluated alongside ResNet and Inception, considering model loss, accuracy, ROC, training time, and the Precision-Recall curve. The outcomes confirm the success of the proposed model, which employs transfer learning techniques to identify fraudulent videos. Furthermore, the method demonstrates a noteworthy 5% increase in efficiency compared to current systems.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
MEDOIDS AS A PACKING OF ORB IMAGE DESCRIPTORS THE METHOD OF RANKING EFFECTIVE PROJECT SOLUTIONS IN CONDITIONS OF INCOMPLETE CERTAINTY ENSURING THE FUNCTIONAL STABILITY OF THE INFORMATION SYSTEM OF THE POWER PLANT ON THE BASIS OF MONITORING THE PARAMETERS OF THE WORKING CONDITION OF COMPUTER DEVICES COMPARATIVE ANALYSIS OF SPECTRAL ANOMALIES DETECTION METHODS ON IMAGES FROM ON-BOARD REMOTE SENSING SYSTEMS FPGA-BASED IMPLEMENTATION OF A GAUSSIAN SMOOTHING FILTER WITH POWERS-OF-TWO COEFFICIENTS
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1