Advanced framework for multilevel detection of digital video forgeries.

IF 4.1 3区 综合性期刊 Q1 MULTIDISCIPLINARY SCIENCES Annals of the New York Academy of Sciences Pub Date : 2024-11-19 DOI:10.1111/nyas.15257
Upasana Singh, Sandeep Rathor, Manoj Kumar
{"title":"Advanced framework for multilevel detection of digital video forgeries.","authors":"Upasana Singh, Sandeep Rathor, Manoj Kumar","doi":"10.1111/nyas.15257","DOIUrl":null,"url":null,"abstract":"<p><p>The rapid expansion of digital media has sparked significant concerns regarding the swift dissemination and potential misuse of forged video content. Existing forgery detection technologies primarily focus on simple forgeries and are still evolving, resulting in a critical gap in the detection of multilevel forgeries, where one forgery is layered over another. This paper presents an innovative framework designed to address this challenge by extracting intricate features from forged frames using attention-augmented convolutional neural networks (AACNNs). A U-Net-based CycleGAN is employed to accurately localize forged regions, enabling a comprehensive analysis that identifies both two- and three-level forgeries by leveraging AACNN's local and global attention mechanisms. To enhance robustness and accuracy, we integrate a model-agnostic meta-learning approach. Our meticulously curated custom dataset, which represents complex forgery scenarios, underpins the effectiveness of our framework. In a 10-shot scenario, the AACNN backbone achieved an impressive accuracy of 98.2%, alongside a sensitivity of 96.3%, specificity of 97.6%, and an F1-score of 96.8%. These results represent a significant advancement in the accuracy and reliability of sophisticated video forgery detection.</p>","PeriodicalId":8250,"journal":{"name":"Annals of the New York Academy of Sciences","volume":" ","pages":""},"PeriodicalIF":4.1000,"publicationDate":"2024-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Annals of the New York Academy of Sciences","FirstCategoryId":"103","ListUrlMain":"https://doi.org/10.1111/nyas.15257","RegionNum":3,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MULTIDISCIPLINARY SCIENCES","Score":null,"Total":0}
引用次数: 0

Abstract

The rapid expansion of digital media has sparked significant concerns regarding the swift dissemination and potential misuse of forged video content. Existing forgery detection technologies primarily focus on simple forgeries and are still evolving, resulting in a critical gap in the detection of multilevel forgeries, where one forgery is layered over another. This paper presents an innovative framework designed to address this challenge by extracting intricate features from forged frames using attention-augmented convolutional neural networks (AACNNs). A U-Net-based CycleGAN is employed to accurately localize forged regions, enabling a comprehensive analysis that identifies both two- and three-level forgeries by leveraging AACNN's local and global attention mechanisms. To enhance robustness and accuracy, we integrate a model-agnostic meta-learning approach. Our meticulously curated custom dataset, which represents complex forgery scenarios, underpins the effectiveness of our framework. In a 10-shot scenario, the AACNN backbone achieved an impressive accuracy of 98.2%, alongside a sensitivity of 96.3%, specificity of 97.6%, and an F1-score of 96.8%. These results represent a significant advancement in the accuracy and reliability of sophisticated video forgery detection.

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
数字视频伪造多级检测高级框架。
数字媒体的迅速发展引发了人们对伪造视频内容的迅速传播和潜在滥用的极大关注。现有的伪造检测技术主要针对简单的伪造,并且仍在不断发展,导致在多层次伪造(一种伪造叠加在另一种伪造之上)检测方面存在重大差距。本文提出了一个创新框架,旨在利用注意力增强卷积神经网络(AACNN)从伪造帧中提取复杂特征,从而应对这一挑战。本文采用基于 U-Net 的 CycleGAN 来精确定位伪造区域,并利用 AACNN 的局部和全局注意力机制进行综合分析,从而识别两级和三级伪造。为了提高鲁棒性和准确性,我们整合了一种与模型无关的元学习方法。我们精心策划的定制数据集代表了复杂的伪造场景,为我们框架的有效性奠定了基础。在 10 次伪造场景中,AACNN 主干网的准确率达到了令人印象深刻的 98.2%,灵敏度为 96.3%,特异性为 97.6%,F1 分数为 96.8%。这些结果表明,在复杂视频伪造检测的准确性和可靠性方面取得了重大进展。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Annals of the New York Academy of Sciences
Annals of the New York Academy of Sciences 综合性期刊-综合性期刊
CiteScore
11.00
自引率
1.90%
发文量
193
审稿时长
2-4 weeks
期刊介绍: Published on behalf of the New York Academy of Sciences, Annals of the New York Academy of Sciences provides multidisciplinary perspectives on research of current scientific interest with far-reaching implications for the wider scientific community and society at large. Each special issue assembles the best thinking of key contributors to a field of investigation at a time when emerging developments offer the promise of new insight. Individually themed, Annals special issues stimulate new ways to think about science by providing a neutral forum for discourse—within and across many institutions and fields.
期刊最新文献
Researching gender and loneliness differently The helmeted hornbill casque is reinforced by a bundle of exceptionally thick, rod‐like trabeculae Audio-visual concert performances synchronize audience's heart rates Geometric series exists in nature: Evidence from sorted area sequences of floral parts and leaves The rhythm of horse gaits
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1