基于自学习策略和高强度区域注意机制的水下增强

Q4 Computer Science Computer Graphics World Pub Date : 2022-08-01 DOI:10.48550/arXiv.2208.03319
Claudio D. Mello, Bryan U. Moreira, Paulo J. O. Evald, Paulo L. J. Drews-Jr, Silvia S. Botelho
{"title":"基于自学习策略和高强度区域注意机制的水下增强","authors":"Claudio D. Mello, Bryan U. Moreira, Paulo J. O. Evald, Paulo L. J. Drews-Jr, Silvia S. Botelho","doi":"10.48550/arXiv.2208.03319","DOIUrl":null,"url":null,"abstract":"Images acquired during underwater activities suffer from environmental properties of the water, such as turbidity and light attenuation. These phenomena cause color distortion, blurring, and contrast reduction. In addition, irregular ambient light distribution causes color channel unbalance and regions with high-intensity pixels. Recent works related to underwater image enhancement, and based on deep learning approaches, tackle the lack of paired datasets generating synthetic ground-truth. In this paper, we present a self-supervised learning methodology for underwater image enhancement based on deep learning that requires no paired datasets. The proposed method estimates the degradation present in underwater images. Besides, an autoencoder reconstructs this image, and its output image is degraded using the estimated degradation information. Therefore, the strategy replaces the output image with the degraded version in the loss function during the training phase. This procedure \\textit{misleads} the neural network that learns to compensate the additional degradation. As a result, the reconstructed image is an enhanced version of the input image. Also, the algorithm presents an attention module to reduce high-intensity areas generated in enhanced images by color channel unbalances and outlier regions. Furthermore, the proposed methodology requires no ground-truth. Besides, only real underwater images were used to train the neural network, and the results indicate the effectiveness of the method in terms of color preservation, color cast reduction, and contrast improvement.","PeriodicalId":51003,"journal":{"name":"Computer Graphics World","volume":"56 1","pages":"264-276"},"PeriodicalIF":0.0000,"publicationDate":"2022-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"5","resultStr":"{\"title\":\"Underwater enhancement based on a self-learning strategy and attention mechanism for high-intensity regions\",\"authors\":\"Claudio D. Mello, Bryan U. Moreira, Paulo J. O. Evald, Paulo L. J. Drews-Jr, Silvia S. Botelho\",\"doi\":\"10.48550/arXiv.2208.03319\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Images acquired during underwater activities suffer from environmental properties of the water, such as turbidity and light attenuation. These phenomena cause color distortion, blurring, and contrast reduction. In addition, irregular ambient light distribution causes color channel unbalance and regions with high-intensity pixels. Recent works related to underwater image enhancement, and based on deep learning approaches, tackle the lack of paired datasets generating synthetic ground-truth. In this paper, we present a self-supervised learning methodology for underwater image enhancement based on deep learning that requires no paired datasets. The proposed method estimates the degradation present in underwater images. Besides, an autoencoder reconstructs this image, and its output image is degraded using the estimated degradation information. Therefore, the strategy replaces the output image with the degraded version in the loss function during the training phase. This procedure \\\\textit{misleads} the neural network that learns to compensate the additional degradation. As a result, the reconstructed image is an enhanced version of the input image. Also, the algorithm presents an attention module to reduce high-intensity areas generated in enhanced images by color channel unbalances and outlier regions. Furthermore, the proposed methodology requires no ground-truth. Besides, only real underwater images were used to train the neural network, and the results indicate the effectiveness of the method in terms of color preservation, color cast reduction, and contrast improvement.\",\"PeriodicalId\":51003,\"journal\":{\"name\":\"Computer Graphics World\",\"volume\":\"56 1\",\"pages\":\"264-276\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"5\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computer Graphics World\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.48550/arXiv.2208.03319\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"Computer Science\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer Graphics World","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.48550/arXiv.2208.03319","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"Computer Science","Score":null,"Total":0}
引用次数: 5

摘要

在水下活动中获得的图像受到水的环境特性的影响,如浊度和光衰减。这些现象导致色彩失真、模糊和对比度降低。此外,不规则的环境光分布导致色彩通道不平衡和高强度像素区域。最近的工作与水下图像增强有关,并基于深度学习方法,解决了缺乏生成合成地面真相的配对数据集的问题。在本文中,我们提出了一种基于深度学习的水下图像增强自监督学习方法,该方法不需要配对数据集。提出的方法估计水下图像中存在的退化。此外,自动编码器重建该图像,并使用估计的退化信息对其输出图像进行降级。因此,该策略在训练阶段将输出图像替换为损失函数中的降级版本。这个过程\textit{会误导}神经网络去补偿额外的退化。因此,重建图像是输入图像的增强版本。此外,该算法还提出了一个关注模块,以减少彩色通道不平衡和异常区域在增强图像中产生的高强度区域。此外,所提出的方法不需要基础真理。此外,只使用真实的水下图像来训练神经网络,结果表明该方法在保持颜色、减少色偏和提高对比度方面是有效的。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Underwater enhancement based on a self-learning strategy and attention mechanism for high-intensity regions
Images acquired during underwater activities suffer from environmental properties of the water, such as turbidity and light attenuation. These phenomena cause color distortion, blurring, and contrast reduction. In addition, irregular ambient light distribution causes color channel unbalance and regions with high-intensity pixels. Recent works related to underwater image enhancement, and based on deep learning approaches, tackle the lack of paired datasets generating synthetic ground-truth. In this paper, we present a self-supervised learning methodology for underwater image enhancement based on deep learning that requires no paired datasets. The proposed method estimates the degradation present in underwater images. Besides, an autoencoder reconstructs this image, and its output image is degraded using the estimated degradation information. Therefore, the strategy replaces the output image with the degraded version in the loss function during the training phase. This procedure \textit{misleads} the neural network that learns to compensate the additional degradation. As a result, the reconstructed image is an enhanced version of the input image. Also, the algorithm presents an attention module to reduce high-intensity areas generated in enhanced images by color channel unbalances and outlier regions. Furthermore, the proposed methodology requires no ground-truth. Besides, only real underwater images were used to train the neural network, and the results indicate the effectiveness of the method in terms of color preservation, color cast reduction, and contrast improvement.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Computer Graphics World
Computer Graphics World 工程技术-计算机:软件工程
CiteScore
0.03
自引率
0.00%
发文量
0
审稿时长
>12 weeks
期刊最新文献
TARig: Adaptive template-aware neural rigging for humanoid characters Numerical approximations for energy preserving microfacet models Image super-resolution with multi-scale fractal residual attention network An overview on Meta-learning approaches for Few-shot Weakly-supervised Segmentation Omnidirectional visual computing: Foundations, challenges, and applications
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1