Globally Deformable Information Selection Transformer for Underwater Image Enhancement

IF 11.1 1区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC IEEE Transactions on Circuits and Systems for Video Technology Pub Date : 2024-08-29 DOI:10.1109/TCSVT.2024.3451553
Junbin Zhuang;Yan Zheng;Baolong Guo;Yunyi Yan
{"title":"Globally Deformable Information Selection Transformer for Underwater Image Enhancement","authors":"Junbin Zhuang;Yan Zheng;Baolong Guo;Yunyi Yan","doi":"10.1109/TCSVT.2024.3451553","DOIUrl":null,"url":null,"abstract":"In the rapidly evolving image processing domain, transformers have emerged as powerful tools, yet significant challenges are encountered when they are applied to underwater image enhancement, such as visual disparity and computational inefficiency. Transformers do not have a unique module to maintain their performance while reducing the number of parameters. This study addresses the gap in the literature by introducing the globally deformable selection transformer (GS-Transformer), which is a model designed to enhance global feature selection and pixel connectivity, thereby reducing the computational complexity of the model while maintaining the image processing effect. Our novel multiresolution encoder-decoder module explicitly incorporates global information, overcoming the limitations of traditional transformers, whereas the multilocal coherence preserving loss (MCPL) mechanism ensures content integrity and coherence. Compared with the latest transform-based underwater image algorithms, this method is 15 times faster and utilizes only 41.7% (or approximately a half less) of the number of parameters. The experimental results on the UIEB, EUVP, and Synthesize datasets reveal that GS-Transformer achieves state-of-the-art performance in underwater image enhancement, with a reduced parameter number and improved efficiency, representing a significant advancement in the field. Our research will promote the application of the transformer in scenarios with high real-time performance.","PeriodicalId":13082,"journal":{"name":"IEEE Transactions on Circuits and Systems for Video Technology","volume":"35 1","pages":"19-32"},"PeriodicalIF":11.1000,"publicationDate":"2024-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10659034","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Circuits and Systems for Video Technology","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10659034/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

In the rapidly evolving image processing domain, transformers have emerged as powerful tools, yet significant challenges are encountered when they are applied to underwater image enhancement, such as visual disparity and computational inefficiency. Transformers do not have a unique module to maintain their performance while reducing the number of parameters. This study addresses the gap in the literature by introducing the globally deformable selection transformer (GS-Transformer), which is a model designed to enhance global feature selection and pixel connectivity, thereby reducing the computational complexity of the model while maintaining the image processing effect. Our novel multiresolution encoder-decoder module explicitly incorporates global information, overcoming the limitations of traditional transformers, whereas the multilocal coherence preserving loss (MCPL) mechanism ensures content integrity and coherence. Compared with the latest transform-based underwater image algorithms, this method is 15 times faster and utilizes only 41.7% (or approximately a half less) of the number of parameters. The experimental results on the UIEB, EUVP, and Synthesize datasets reveal that GS-Transformer achieves state-of-the-art performance in underwater image enhancement, with a reduced parameter number and improved efficiency, representing a significant advancement in the field. Our research will promote the application of the transformer in scenarios with high real-time performance.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
用于水下图像增强的全局可变形信息选择变换器
在快速发展的图像处理领域,变形器已经成为强大的工具,但当它们应用于水下图像增强时,遇到了重大的挑战,如视觉差异和计算效率低下。变压器没有一个独特的模块来保持其性能,同时减少参数的数量。本研究通过引入全局可变形选择变压器(GS-Transformer)来弥补文献的空白,该模型旨在增强全局特征选择和像素连通性,从而在保持图像处理效果的同时降低模型的计算复杂度。我们的新型多分辨率编码器-解码器模块明确地集成了全局信息,克服了传统变压器的局限性,而多局部相干保持损失(MCPL)机制确保了内容的完整性和相干性。与最新的基于变换的水下图像算法相比,该方法的速度提高了15倍,使用的参数数量仅为41.7%(约为一半)。在UIEB、EUVP和synthesis数据集上的实验结果表明,GS-Transformer在水下图像增强方面取得了最先进的性能,减少了参数数量,提高了效率,代表了该领域的重大进步。我们的研究将促进变压器在高实时性场景中的应用。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
13.80
自引率
27.40%
发文量
660
审稿时长
5 months
期刊介绍: The IEEE Transactions on Circuits and Systems for Video Technology (TCSVT) is dedicated to covering all aspects of video technologies from a circuits and systems perspective. We encourage submissions of general, theoretical, and application-oriented papers related to image and video acquisition, representation, presentation, and display. Additionally, we welcome contributions in areas such as processing, filtering, and transforms; analysis and synthesis; learning and understanding; compression, transmission, communication, and networking; as well as storage, retrieval, indexing, and search. Furthermore, papers focusing on hardware and software design and implementation are highly valued. Join us in advancing the field of video technology through innovative research and insights.
期刊最新文献
IEEE Circuits and Systems Society Information IEEE Circuits and Systems Society Information 2025 Index IEEE Transactions on Circuits and Systems for Video Technology IEEE Circuits and Systems Society Information IEEE Circuits and Systems Society Information
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1