Weizhi Liu, Yue Li, Dongdong Lin, Hui Tian, Haizhou Li
{"title":"GROOT:为基于扩散模型的音频合成生成鲁棒水印","authors":"Weizhi Liu, Yue Li, Dongdong Lin, Hui Tian, Haizhou Li","doi":"arxiv-2407.10471","DOIUrl":null,"url":null,"abstract":"Amid the burgeoning development of generative models like diffusion models,\nthe task of differentiating synthesized audio from its natural counterpart\ngrows more daunting. Deepfake detection offers a viable solution to combat this\nchallenge. Yet, this defensive measure unintentionally fuels the continued\nrefinement of generative models. Watermarking emerges as a proactive and\nsustainable tactic, preemptively regulating the creation and dissemination of\nsynthesized content. Thus, this paper, as a pioneer, proposes the generative\nrobust audio watermarking method (Groot), presenting a paradigm for proactively\nsupervising the synthesized audio and its source diffusion models. In this\nparadigm, the processes of watermark generation and audio synthesis occur\nsimultaneously, facilitated by parameter-fixed diffusion models equipped with a\ndedicated encoder. The watermark embedded within the audio can subsequently be\nretrieved by a lightweight decoder. The experimental results highlight Groot's\noutstanding performance, particularly in terms of robustness, surpassing that\nof the leading state-of-the-art methods. Beyond its impressive resilience\nagainst individual post-processing attacks, Groot exhibits exceptional\nrobustness when facing compound attacks, maintaining an average watermark\nextraction accuracy of around 95%.","PeriodicalId":501178,"journal":{"name":"arXiv - CS - Sound","volume":"105 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"GROOT: Generating Robust Watermark for Diffusion-Model-Based Audio Synthesis\",\"authors\":\"Weizhi Liu, Yue Li, Dongdong Lin, Hui Tian, Haizhou Li\",\"doi\":\"arxiv-2407.10471\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Amid the burgeoning development of generative models like diffusion models,\\nthe task of differentiating synthesized audio from its natural counterpart\\ngrows more daunting. Deepfake detection offers a viable solution to combat this\\nchallenge. Yet, this defensive measure unintentionally fuels the continued\\nrefinement of generative models. Watermarking emerges as a proactive and\\nsustainable tactic, preemptively regulating the creation and dissemination of\\nsynthesized content. Thus, this paper, as a pioneer, proposes the generative\\nrobust audio watermarking method (Groot), presenting a paradigm for proactively\\nsupervising the synthesized audio and its source diffusion models. In this\\nparadigm, the processes of watermark generation and audio synthesis occur\\nsimultaneously, facilitated by parameter-fixed diffusion models equipped with a\\ndedicated encoder. The watermark embedded within the audio can subsequently be\\nretrieved by a lightweight decoder. The experimental results highlight Groot's\\noutstanding performance, particularly in terms of robustness, surpassing that\\nof the leading state-of-the-art methods. Beyond its impressive resilience\\nagainst individual post-processing attacks, Groot exhibits exceptional\\nrobustness when facing compound attacks, maintaining an average watermark\\nextraction accuracy of around 95%.\",\"PeriodicalId\":501178,\"journal\":{\"name\":\"arXiv - CS - Sound\",\"volume\":\"105 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-07-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - CS - Sound\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2407.10471\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Sound","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2407.10471","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
随着扩散模型等生成模型的蓬勃发展,区分合成音频和自然音频的任务变得更加艰巨。深度伪造检测为应对这一挑战提供了可行的解决方案。然而,这种防御措施无意中助长了生成模型的不断完善。水印作为一种积极主动、可持续发展的策略出现了,它可以先发制人地规范合成内容的创建和传播。因此,本文作为先驱,提出了生成式音频水印方法(Groot),提出了一种主动监督合成音频及其源扩散模型的范式。在这一范例中,水印生成和音频合成过程同时进行,并通过配备专用编码器的固定参数扩散模型来实现。嵌入音频中的水印随后可以通过轻量级解码器提取出来。实验结果凸显了 Groot 的卓越性能,特别是在鲁棒性方面,超过了最先进的领先方法。除了对单个后处理攻击具有令人印象深刻的抗击打能力外,Groot 在面对复合攻击时也表现出了卓越的鲁棒性,水印提取的平均准确率保持在 95% 左右。
GROOT: Generating Robust Watermark for Diffusion-Model-Based Audio Synthesis
Amid the burgeoning development of generative models like diffusion models,
the task of differentiating synthesized audio from its natural counterpart
grows more daunting. Deepfake detection offers a viable solution to combat this
challenge. Yet, this defensive measure unintentionally fuels the continued
refinement of generative models. Watermarking emerges as a proactive and
sustainable tactic, preemptively regulating the creation and dissemination of
synthesized content. Thus, this paper, as a pioneer, proposes the generative
robust audio watermarking method (Groot), presenting a paradigm for proactively
supervising the synthesized audio and its source diffusion models. In this
paradigm, the processes of watermark generation and audio synthesis occur
simultaneously, facilitated by parameter-fixed diffusion models equipped with a
dedicated encoder. The watermark embedded within the audio can subsequently be
retrieved by a lightweight decoder. The experimental results highlight Groot's
outstanding performance, particularly in terms of robustness, surpassing that
of the leading state-of-the-art methods. Beyond its impressive resilience
against individual post-processing attacks, Groot exhibits exceptional
robustness when facing compound attacks, maintaining an average watermark
extraction accuracy of around 95%.