FLDCF: A Collaborative Framework for Forgery Localization and Detection in Satellite Imagery

IF 7.5 1区 地球科学 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC IEEE Transactions on Geoscience and Remote Sensing Pub Date : 2024-11-18 DOI:10.1109/TGRS.2024.3502035
Jialu Sui;Ding Ma;C.-C. Jay Kuo;Man-On Pun
{"title":"FLDCF: A Collaborative Framework for Forgery Localization and Detection in Satellite Imagery","authors":"Jialu Sui;Ding Ma;C.-C. Jay Kuo;Man-On Pun","doi":"10.1109/TGRS.2024.3502035","DOIUrl":null,"url":null,"abstract":"Satellite images are highly susceptible to forgery due to various editing techniques. Traditional forgery detection methods, designed for natural images, often fail when applied to satellite images because of differences in sensing technology and processing protocols. The rise of generative models, such as diffusion models, has further complicated the detection of forgeries in satellite images. This study tackles these challenges from both methodological and data perspectives. We introduce a multitask forgery localization and detection collaborative framework (FLDCF), comprising a multiview forgery localization network (M-FLnet) and a forgery detection network. The M-FLnet, leveraging a content-based prior, generates forgery masks that serve as auxiliary information to improve the detection network’s accuracy. Conversely, the detection network refines these masks, reducing noise for authentic images. Furthermore, two novel forgery datasets, namely, Fake-Vaihingen and Fake-LoveDA, are derived from the Vaihingen and LoveDA satellite image sets, respectively, by exploiting the latest generative models. These datasets represent the first open-source datasets for forgery localization and detection in remote sensing. Extensive experimental results on Fake-Vaihingen and Fake-LoveDA demonstrate that the proposed FLDCF can effectively detect sophisticated forgeries in satellite imagery. The source code and datasets in this work are available at \n<uri>https://github.com/littlebeen/Forgery-localization-for-remote-sensing</uri>\n.","PeriodicalId":13213,"journal":{"name":"IEEE Transactions on Geoscience and Remote Sensing","volume":"62 ","pages":"1-13"},"PeriodicalIF":7.5000,"publicationDate":"2024-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Geoscience and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10756746/","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Satellite images are highly susceptible to forgery due to various editing techniques. Traditional forgery detection methods, designed for natural images, often fail when applied to satellite images because of differences in sensing technology and processing protocols. The rise of generative models, such as diffusion models, has further complicated the detection of forgeries in satellite images. This study tackles these challenges from both methodological and data perspectives. We introduce a multitask forgery localization and detection collaborative framework (FLDCF), comprising a multiview forgery localization network (M-FLnet) and a forgery detection network. The M-FLnet, leveraging a content-based prior, generates forgery masks that serve as auxiliary information to improve the detection network’s accuracy. Conversely, the detection network refines these masks, reducing noise for authentic images. Furthermore, two novel forgery datasets, namely, Fake-Vaihingen and Fake-LoveDA, are derived from the Vaihingen and LoveDA satellite image sets, respectively, by exploiting the latest generative models. These datasets represent the first open-source datasets for forgery localization and detection in remote sensing. Extensive experimental results on Fake-Vaihingen and Fake-LoveDA demonstrate that the proposed FLDCF can effectively detect sophisticated forgeries in satellite imagery. The source code and datasets in this work are available at https://github.com/littlebeen/Forgery-localization-for-remote-sensing .
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
FLDCF:卫星图像伪造定位和检测协作框架
由于各种各样的编辑技术,卫星图像很容易被伪造。传统的伪造检测方法是针对自然图像设计的,但由于传感技术和处理协议的差异,在应用于卫星图像时往往失败。扩散模型等生成模型的兴起,使卫星图像的伪造检测进一步复杂化。本研究从方法论和数据角度解决了这些挑战。提出了一种多任务伪造定位与检测协同框架(FLDCF),该框架由多视图伪造定位网络(M-FLnet)和伪造检测网络组成。M-FLnet利用基于内容的先验,生成伪造掩码作为辅助信息,以提高检测网络的准确性。相反,检测网络细化这些掩模,减少真实图像的噪声。此外,利用最新的生成模型,分别从Vaihingen和LoveDA卫星图像集衍生出两个新的伪造数据集,即Fake-Vaihingen和Fake-LoveDA。这些数据集代表了第一个用于遥感伪造定位和检测的开源数据集。在Fake-Vaihingen和Fake-LoveDA上的大量实验结果表明,所提出的FLDCF可以有效地检测卫星图像中的复杂伪造。本工作中的源代码和数据集可在https://github.com/littlebeen/Forgery-localization-for-remote-sensing上获得。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
IEEE Transactions on Geoscience and Remote Sensing
IEEE Transactions on Geoscience and Remote Sensing 工程技术-地球化学与地球物理
CiteScore
11.50
自引率
28.00%
发文量
1912
审稿时长
4.0 months
期刊介绍: IEEE Transactions on Geoscience and Remote Sensing (TGRS) is a monthly publication that focuses on the theory, concepts, and techniques of science and engineering as applied to sensing the land, oceans, atmosphere, and space; and the processing, interpretation, and dissemination of this information.
期刊最新文献
SS-PLRQR: Super-Spectrum Parallel Low-Rank Quaternion Recovery for Hyperspectral Image Classification Interactive and Supervised Dual-Mode Attention Network for Remote Sensing Image Change Detection Dual-Domain Optimization Model Based on Discrete Fourier Transform and Frequency Domain Fusion for Remote Sensing Single-image Super-Resolution An Efficient Point Spread Function Inversion Method for Image-Domain One-Way Wave-Equation Least-Squares Migration Insect Symmetry-Driven Orientation Estimation for Entomological Radar Using Multi-Frequency Scattering Matrices
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1