{"title":"FLDCF: A Collaborative Framework for Forgery Localization and Detection in Satellite Imagery","authors":"Jialu Sui;Ding Ma;C.-C. Jay Kuo;Man-On Pun","doi":"10.1109/TGRS.2024.3502035","DOIUrl":null,"url":null,"abstract":"Satellite images are highly susceptible to forgery due to various editing techniques. Traditional forgery detection methods, designed for natural images, often fail when applied to satellite images because of differences in sensing technology and processing protocols. The rise of generative models, such as diffusion models, has further complicated the detection of forgeries in satellite images. This study tackles these challenges from both methodological and data perspectives. We introduce a multitask forgery localization and detection collaborative framework (FLDCF), comprising a multiview forgery localization network (M-FLnet) and a forgery detection network. The M-FLnet, leveraging a content-based prior, generates forgery masks that serve as auxiliary information to improve the detection network’s accuracy. Conversely, the detection network refines these masks, reducing noise for authentic images. Furthermore, two novel forgery datasets, namely, Fake-Vaihingen and Fake-LoveDA, are derived from the Vaihingen and LoveDA satellite image sets, respectively, by exploiting the latest generative models. These datasets represent the first open-source datasets for forgery localization and detection in remote sensing. Extensive experimental results on Fake-Vaihingen and Fake-LoveDA demonstrate that the proposed FLDCF can effectively detect sophisticated forgeries in satellite imagery. The source code and datasets in this work are available at \n<uri>https://github.com/littlebeen/Forgery-localization-for-remote-sensing</uri>\n.","PeriodicalId":13213,"journal":{"name":"IEEE Transactions on Geoscience and Remote Sensing","volume":"62 ","pages":"1-13"},"PeriodicalIF":7.5000,"publicationDate":"2024-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Geoscience and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10756746/","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Satellite images are highly susceptible to forgery due to various editing techniques. Traditional forgery detection methods, designed for natural images, often fail when applied to satellite images because of differences in sensing technology and processing protocols. The rise of generative models, such as diffusion models, has further complicated the detection of forgeries in satellite images. This study tackles these challenges from both methodological and data perspectives. We introduce a multitask forgery localization and detection collaborative framework (FLDCF), comprising a multiview forgery localization network (M-FLnet) and a forgery detection network. The M-FLnet, leveraging a content-based prior, generates forgery masks that serve as auxiliary information to improve the detection network’s accuracy. Conversely, the detection network refines these masks, reducing noise for authentic images. Furthermore, two novel forgery datasets, namely, Fake-Vaihingen and Fake-LoveDA, are derived from the Vaihingen and LoveDA satellite image sets, respectively, by exploiting the latest generative models. These datasets represent the first open-source datasets for forgery localization and detection in remote sensing. Extensive experimental results on Fake-Vaihingen and Fake-LoveDA demonstrate that the proposed FLDCF can effectively detect sophisticated forgeries in satellite imagery. The source code and datasets in this work are available at
https://github.com/littlebeen/Forgery-localization-for-remote-sensing
.
期刊介绍:
IEEE Transactions on Geoscience and Remote Sensing (TGRS) is a monthly publication that focuses on the theory, concepts, and techniques of science and engineering as applied to sensing the land, oceans, atmosphere, and space; and the processing, interpretation, and dissemination of this information.