未揭示的威胁:水下图像增强模型的对抗鲁棒性综合研究

Siyu Zhai, Zhibo He, Xiaofeng Cong, Junming Hou, Jie Gui, Jian Wei You, Xin Gong, James Tin-Yau Kwok, Yuan Yan Tang
{"title":"未揭示的威胁:水下图像增强模型的对抗鲁棒性综合研究","authors":"Siyu Zhai, Zhibo He, Xiaofeng Cong, Junming Hou, Jie Gui, Jian Wei You, Xin Gong, James Tin-Yau Kwok, Yuan Yan Tang","doi":"arxiv-2409.06420","DOIUrl":null,"url":null,"abstract":"Learning-based methods for underwater image enhancement (UWIE) have undergone\nextensive exploration. However, learning-based models are usually vulnerable to\nadversarial examples so as the UWIE models. To the best of our knowledge, there\nis no comprehensive study on the adversarial robustness of UWIE models, which\nindicates that UWIE models are potentially under the threat of adversarial\nattacks. In this paper, we propose a general adversarial attack protocol. We\nmake a first attempt to conduct adversarial attacks on five well-designed UWIE\nmodels on three common underwater image benchmark datasets. Considering the\nscattering and absorption of light in the underwater environment, there exists\na strong correlation between color correction and underwater image enhancement.\nOn the basis of that, we also design two effective UWIE-oriented adversarial\nattack methods Pixel Attack and Color Shift Attack targeting different color\nspaces. The results show that five models exhibit varying degrees of\nvulnerability to adversarial attacks and well-designed small perturbations on\ndegraded images are capable of preventing UWIE models from generating enhanced\nresults. Further, we conduct adversarial training on these models and\nsuccessfully mitigated the effectiveness of adversarial attacks. In summary, we\nreveal the adversarial vulnerability of UWIE models and propose a new\nevaluation dimension of UWIE models.","PeriodicalId":501289,"journal":{"name":"arXiv - EE - Image and Video Processing","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Unrevealed Threats: A Comprehensive Study of the Adversarial Robustness of Underwater Image Enhancement Models\",\"authors\":\"Siyu Zhai, Zhibo He, Xiaofeng Cong, Junming Hou, Jie Gui, Jian Wei You, Xin Gong, James Tin-Yau Kwok, Yuan Yan Tang\",\"doi\":\"arxiv-2409.06420\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Learning-based methods for underwater image enhancement (UWIE) have undergone\\nextensive exploration. However, learning-based models are usually vulnerable to\\nadversarial examples so as the UWIE models. To the best of our knowledge, there\\nis no comprehensive study on the adversarial robustness of UWIE models, which\\nindicates that UWIE models are potentially under the threat of adversarial\\nattacks. In this paper, we propose a general adversarial attack protocol. We\\nmake a first attempt to conduct adversarial attacks on five well-designed UWIE\\nmodels on three common underwater image benchmark datasets. Considering the\\nscattering and absorption of light in the underwater environment, there exists\\na strong correlation between color correction and underwater image enhancement.\\nOn the basis of that, we also design two effective UWIE-oriented adversarial\\nattack methods Pixel Attack and Color Shift Attack targeting different color\\nspaces. The results show that five models exhibit varying degrees of\\nvulnerability to adversarial attacks and well-designed small perturbations on\\ndegraded images are capable of preventing UWIE models from generating enhanced\\nresults. Further, we conduct adversarial training on these models and\\nsuccessfully mitigated the effectiveness of adversarial attacks. In summary, we\\nreveal the adversarial vulnerability of UWIE models and propose a new\\nevaluation dimension of UWIE models.\",\"PeriodicalId\":501289,\"journal\":{\"name\":\"arXiv - EE - Image and Video Processing\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-09-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - EE - Image and Video Processing\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2409.06420\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - EE - Image and Video Processing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.06420","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

基于学习的水下图像增强(UWIE)方法已经得到了广泛的探索。然而,基于学习的模型通常容易受到对抗性实例的影响,UWIE 模型也是如此。据我们所知,目前还没有关于 UWIE 模型对抗鲁棒性的全面研究,这表明 UWIE 模型有可能受到对抗攻击的威胁。本文提出了一种通用对抗攻击协议。我们首次尝试在三个常见的水下图像基准数据集上对五个精心设计的 UWIE 模型进行对抗性攻击。考虑到水下环境中光的散射和吸收,色彩校正与水下图像增强之间存在很强的相关性。在此基础上,我们还针对不同的色彩空间设计了两种有效的面向 UWIE 的对抗攻击方法:像素攻击(Pixel Attack)和色彩偏移攻击(Color Shift Attack)。结果表明,五种模型在对抗性攻击面前表现出不同程度的脆弱性,而精心设计的对降级图像的小扰动能够阻止 UWIE 模型生成增强结果。此外,我们还对这些模型进行了对抗训练,并成功降低了对抗攻击的有效性。总之,我们揭示了 UWIE 模型的对抗脆弱性,并提出了 UWIE 模型的新评估维度。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Unrevealed Threats: A Comprehensive Study of the Adversarial Robustness of Underwater Image Enhancement Models
Learning-based methods for underwater image enhancement (UWIE) have undergone extensive exploration. However, learning-based models are usually vulnerable to adversarial examples so as the UWIE models. To the best of our knowledge, there is no comprehensive study on the adversarial robustness of UWIE models, which indicates that UWIE models are potentially under the threat of adversarial attacks. In this paper, we propose a general adversarial attack protocol. We make a first attempt to conduct adversarial attacks on five well-designed UWIE models on three common underwater image benchmark datasets. Considering the scattering and absorption of light in the underwater environment, there exists a strong correlation between color correction and underwater image enhancement. On the basis of that, we also design two effective UWIE-oriented adversarial attack methods Pixel Attack and Color Shift Attack targeting different color spaces. The results show that five models exhibit varying degrees of vulnerability to adversarial attacks and well-designed small perturbations on degraded images are capable of preventing UWIE models from generating enhanced results. Further, we conduct adversarial training on these models and successfully mitigated the effectiveness of adversarial attacks. In summary, we reveal the adversarial vulnerability of UWIE models and propose a new evaluation dimension of UWIE models.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
multiPI-TransBTS: A Multi-Path Learning Framework for Brain Tumor Image Segmentation Based on Multi-Physical Information Autopet III challenge: Incorporating anatomical knowledge into nnUNet for lesion segmentation in PET/CT Denoising diffusion models for high-resolution microscopy image restoration Tumor aware recurrent inter-patient deformable image registration of computed tomography scans with lung cancer Cross-Organ and Cross-Scanner Adenocarcinoma Segmentation using Rein to Fine-tune Vision Foundation Models
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1