利用相互学习实现伪监督低照度图像增强

IF 8.3 1区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC IEEE Transactions on Circuits and Systems for Video Technology Pub Date : 2023-06-09 DOI:10.1109/TCSVT.2023.3284856
Yu Luo;Bijia You;Guanghui Yue;Jie Ling
{"title":"利用相互学习实现伪监督低照度图像增强","authors":"Yu Luo;Bijia You;Guanghui Yue;Jie Ling","doi":"10.1109/TCSVT.2023.3284856","DOIUrl":null,"url":null,"abstract":"Low-light image enhancement (LIE) is important for many high-level vision tasks as the poor visibility of underexposed images can severely degrade the performance of the subsequent image recognition, analysis, etc. Although recent deep-learning-based LIE methods exhibit promising performance, most of them require a large number of paired training images, thereby limiting the practicability to real scenarios. In this paper, we propose a pseudo-supervised LIE method with the integration of mutual learning. Specifically, for the given low-light image, we first use a quadratic curve to generate a pseudo-clear image, which is served as the auxiliary ground truth for supervision, then the pseudo-paired images are simultaneously input to two parallel homogeneous branches to learn the expected enhanced result through the knowledge distillation of two branches via mutual learning. As both the generated image and the input low-light image underlies the desired solution, the mutual learning strategy enables the two branches learn from each other and produce the final results. Extensive experiments demonstrate that the proposed method outperforms most existing unsupervised LIE methods in terms of both qualitative and quantitative evaluations, and also achieves competitive performance against many supervised and semi-supervised methods.","PeriodicalId":13082,"journal":{"name":"IEEE Transactions on Circuits and Systems for Video Technology","volume":null,"pages":null},"PeriodicalIF":8.3000,"publicationDate":"2023-06-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Pseudo-Supervised Low-Light Image Enhancement With Mutual Learning\",\"authors\":\"Yu Luo;Bijia You;Guanghui Yue;Jie Ling\",\"doi\":\"10.1109/TCSVT.2023.3284856\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Low-light image enhancement (LIE) is important for many high-level vision tasks as the poor visibility of underexposed images can severely degrade the performance of the subsequent image recognition, analysis, etc. Although recent deep-learning-based LIE methods exhibit promising performance, most of them require a large number of paired training images, thereby limiting the practicability to real scenarios. In this paper, we propose a pseudo-supervised LIE method with the integration of mutual learning. Specifically, for the given low-light image, we first use a quadratic curve to generate a pseudo-clear image, which is served as the auxiliary ground truth for supervision, then the pseudo-paired images are simultaneously input to two parallel homogeneous branches to learn the expected enhanced result through the knowledge distillation of two branches via mutual learning. As both the generated image and the input low-light image underlies the desired solution, the mutual learning strategy enables the two branches learn from each other and produce the final results. Extensive experiments demonstrate that the proposed method outperforms most existing unsupervised LIE methods in terms of both qualitative and quantitative evaluations, and also achieves competitive performance against many supervised and semi-supervised methods.\",\"PeriodicalId\":13082,\"journal\":{\"name\":\"IEEE Transactions on Circuits and Systems for Video Technology\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":8.3000,\"publicationDate\":\"2023-06-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Circuits and Systems for Video Technology\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10147801/\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Circuits and Systems for Video Technology","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10147801/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

低照度图像增强(LIE)对于许多高级视觉任务非常重要,因为曝光不足的图像能见度低,会严重降低后续图像识别、分析等的性能。虽然最近基于深度学习的 LIE 方法表现出了良好的性能,但它们大多需要大量配对训练图像,从而限制了在实际场景中的实用性。在本文中,我们提出了一种融合了相互学习的伪监督 LIE 方法。具体来说,对于给定的低照度图像,我们首先使用二次曲线生成伪清晰图像,将其作为辅助地面真值进行监督,然后将伪配对图像同时输入两个并行的同质分支,通过两个分支的知识提炼,通过相互学习来学习预期的增强结果。由于生成的图像和输入的低照度图像都是预期解决方案的基础,相互学习策略使两个分支能够相互学习并产生最终结果。广泛的实验证明,所提出的方法在定性和定量评估方面都优于大多数现有的无监督 LIE 方法,在与许多有监督和半监督方法的比较中也取得了具有竞争力的性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Pseudo-Supervised Low-Light Image Enhancement With Mutual Learning
Low-light image enhancement (LIE) is important for many high-level vision tasks as the poor visibility of underexposed images can severely degrade the performance of the subsequent image recognition, analysis, etc. Although recent deep-learning-based LIE methods exhibit promising performance, most of them require a large number of paired training images, thereby limiting the practicability to real scenarios. In this paper, we propose a pseudo-supervised LIE method with the integration of mutual learning. Specifically, for the given low-light image, we first use a quadratic curve to generate a pseudo-clear image, which is served as the auxiliary ground truth for supervision, then the pseudo-paired images are simultaneously input to two parallel homogeneous branches to learn the expected enhanced result through the knowledge distillation of two branches via mutual learning. As both the generated image and the input low-light image underlies the desired solution, the mutual learning strategy enables the two branches learn from each other and produce the final results. Extensive experiments demonstrate that the proposed method outperforms most existing unsupervised LIE methods in terms of both qualitative and quantitative evaluations, and also achieves competitive performance against many supervised and semi-supervised methods.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
13.80
自引率
27.40%
发文量
660
审稿时长
5 months
期刊介绍: The IEEE Transactions on Circuits and Systems for Video Technology (TCSVT) is dedicated to covering all aspects of video technologies from a circuits and systems perspective. We encourage submissions of general, theoretical, and application-oriented papers related to image and video acquisition, representation, presentation, and display. Additionally, we welcome contributions in areas such as processing, filtering, and transforms; analysis and synthesis; learning and understanding; compression, transmission, communication, and networking; as well as storage, retrieval, indexing, and search. Furthermore, papers focusing on hardware and software design and implementation are highly valued. Join us in advancing the field of video technology through innovative research and insights.
期刊最新文献
From Method to Application: A Review of Deep 3D Human Motion Capture Video Visualization and Visual Analytics: A Task-Based and Application-Driven Investigation MLP: Motion Label Prior for Temporal Sentence Localization in Untrimmed 3D Human Motions Rethinking Domain Generalization: Discriminability and Generalizability Toward Quantifiable Face Age Transformation under Attribute Unbias
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1