MDA-Net: A Multidistribution Aware Network for Underwater Image Enhancement

IF 7.5 1区 地球科学 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC IEEE Transactions on Geoscience and Remote Sensing Pub Date : 2025-01-06 DOI:10.1109/TGRS.2024.3524758
Xiaokai Liu;Yutong Jiang;Yangyang Wang;Taifei Liu;Jie Wang
{"title":"MDA-Net: A Multidistribution Aware Network for Underwater Image Enhancement","authors":"Xiaokai Liu;Yutong Jiang;Yangyang Wang;Taifei Liu;Jie Wang","doi":"10.1109/TGRS.2024.3524758","DOIUrl":null,"url":null,"abstract":"Underwater image enhancement plays a pivotal role in addressing the challenges posed by the complex and dynamic underwater environment. While the previous research has conducted valuable explorations from a global enhancement perspective, underwater settings often exhibit multidistribution characteristics in both spatial frequency and illumination conditions that require specialized attention, that is, multiple spatial frequencies and lighting conditions coexist in the same image, making it difficult to achieve optimal enhancement using global mapping. To address this challenge, we propose a multidistribution aware network (MDA-Net) that leverages local frequencies and illumination characteristics of images for adaptive adjustment to balance the diverse visual enhancement requirements of local regions. Specifically, to address the challenge of multiple spatial frequency distributions, we explore the correlation among spatial frequency, receptive field, and image quality perception, and design a frequency-aware kernel selection convolution, which could adaptively select the size of convolutional kernels based on the frequency complexity of each region, so as to balance the requirements of noise reduction and color fidelity in different regions. Furthermore, to address the challenge of multiple illumination distributions, we leverage the inherent illumination characteristics of the image to generate a gamma transformation-based illumination balancer (GIB), whose neurons can comprehensively perceive global and local illumination through multiparameter correction representation, thereby guiding the focus of the enhancement work. Extensive experiments with the ablation analysis show the effectiveness of our proposed MDA-Net on four benchmark datasets: UFO-120, UIEB, UIEB-U60, and U45.","PeriodicalId":13213,"journal":{"name":"IEEE Transactions on Geoscience and Remote Sensing","volume":"63 ","pages":"1-13"},"PeriodicalIF":7.5000,"publicationDate":"2025-01-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Geoscience and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10829689/","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Underwater image enhancement plays a pivotal role in addressing the challenges posed by the complex and dynamic underwater environment. While the previous research has conducted valuable explorations from a global enhancement perspective, underwater settings often exhibit multidistribution characteristics in both spatial frequency and illumination conditions that require specialized attention, that is, multiple spatial frequencies and lighting conditions coexist in the same image, making it difficult to achieve optimal enhancement using global mapping. To address this challenge, we propose a multidistribution aware network (MDA-Net) that leverages local frequencies and illumination characteristics of images for adaptive adjustment to balance the diverse visual enhancement requirements of local regions. Specifically, to address the challenge of multiple spatial frequency distributions, we explore the correlation among spatial frequency, receptive field, and image quality perception, and design a frequency-aware kernel selection convolution, which could adaptively select the size of convolutional kernels based on the frequency complexity of each region, so as to balance the requirements of noise reduction and color fidelity in different regions. Furthermore, to address the challenge of multiple illumination distributions, we leverage the inherent illumination characteristics of the image to generate a gamma transformation-based illumination balancer (GIB), whose neurons can comprehensively perceive global and local illumination through multiparameter correction representation, thereby guiding the focus of the enhancement work. Extensive experiments with the ablation analysis show the effectiveness of our proposed MDA-Net on four benchmark datasets: UFO-120, UIEB, UIEB-U60, and U45.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
MDA-Net:用于水下图像增强的多分布感知网络
水下图像增强对于解决复杂动态的水下环境所带来的挑战具有关键作用。虽然以往的研究从全局增强的角度进行了有价值的探索,但水下环境往往在空间频率和光照条件下都表现出多分布特征,需要特别注意,即在同一幅图像中存在多个空间频率和光照条件,这使得使用全局映射难以实现最佳增强。为了解决这一挑战,我们提出了一种多分布感知网络(MDA-Net),该网络利用图像的本地频率和照明特性进行自适应调整,以平衡局部区域的不同视觉增强需求。具体来说,针对多空间频率分布的挑战,我们探索了空间频率、感受场和图像质量感知之间的相关性,设计了一个频率感知的核选择卷积,该卷积可以根据每个区域的频率复杂度自适应选择卷积核的大小,从而平衡不同区域的降噪和色彩保真度要求。此外,为了解决多光照分布的挑战,我们利用图像固有的光照特征来生成基于伽马变换的光照平衡器(GIB),其神经元可以通过多参数校正表示来综合感知全局和局部光照,从而指导增强工作的重点。大量的烧蚀分析实验表明,我们提出的MDA-Net在四个基准数据集上的有效性:UFO-120、UIEB、UIEB- u60和U45。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
IEEE Transactions on Geoscience and Remote Sensing
IEEE Transactions on Geoscience and Remote Sensing 工程技术-地球化学与地球物理
CiteScore
11.50
自引率
28.00%
发文量
1912
审稿时长
4.0 months
期刊介绍: IEEE Transactions on Geoscience and Remote Sensing (TGRS) is a monthly publication that focuses on the theory, concepts, and techniques of science and engineering as applied to sensing the land, oceans, atmosphere, and space; and the processing, interpretation, and dissemination of this information.
期刊最新文献
Gaussian-Based Swap Operator for Context-Aware Extraction of Building Boundary Vectors A Dynamic Constraint Method for Retrieving Sea Surface Wind Speed Using High-Frequency Radars Global-Local Fusion with Semantic Information-Guidance For Accurate Small Object Detection in UAV Aerial Images A Spectral Hierarchical Machine Learning for Predicting Arsenic Concentration in Farmland Soil Using Sentinel-2 Imagery RescueADI: Adaptive Disaster Interpretation in Remote Sensing Images with Autonomous Agents
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1