通过参考驱动和对比学习方法增强热红外图像着色

IF 3.8 3区 物理与天体物理 Q2 INSTRUMENTS & INSTRUMENTATION Infrared Physics & Technology Pub Date : 2025-03-01 Epub Date: 2024-12-21 DOI:10.1016/j.infrared.2024.105675
Weida Zhan , Mingkai Shi , Yu Chen , Jingwen Zhang , Cong Zhang , Deng Han
{"title":"通过参考驱动和对比学习方法增强热红外图像着色","authors":"Weida Zhan ,&nbsp;Mingkai Shi ,&nbsp;Yu Chen ,&nbsp;Jingwen Zhang ,&nbsp;Cong Zhang ,&nbsp;Deng Han","doi":"10.1016/j.infrared.2024.105675","DOIUrl":null,"url":null,"abstract":"<div><div>Thermal infrared image colorization remains challenging due to limitations in existing methods, such as insufficient detail preservation and inaccurate color rendering. This paper presents a novel colorization approach that leverages reference images and contrastive learning to address these issues. Our model employs a dual-encoder generator architecture, allowing for detailed feature extraction from both infrared and reference images to enable precise color transfer. Key modules, including the Multi-Receptive Field Feature Integration Module (MFIM) and Channel–Spatial Feature Enhancement Module (CSFEM), enhance feature extraction and integration, while the Improved Stop-Gradient Attention Module (ISGA) ensures accurate feature alignment. A composite loss function combining adversarial, perceptual, and contrastive losses further refines the model’s output. Experimental results on benchmark datasets show that this method significantly improves colorization quality, generating visually realistic and detailed images, thus advancing applications in post-processing, object detection, and scene analysis within the infrared domain.</div></div>","PeriodicalId":13549,"journal":{"name":"Infrared Physics & Technology","volume":"145 ","pages":"Article 105675"},"PeriodicalIF":3.8000,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Enhancing thermal infrared image colorization through reference-driven and contrastive learning approaches\",\"authors\":\"Weida Zhan ,&nbsp;Mingkai Shi ,&nbsp;Yu Chen ,&nbsp;Jingwen Zhang ,&nbsp;Cong Zhang ,&nbsp;Deng Han\",\"doi\":\"10.1016/j.infrared.2024.105675\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Thermal infrared image colorization remains challenging due to limitations in existing methods, such as insufficient detail preservation and inaccurate color rendering. This paper presents a novel colorization approach that leverages reference images and contrastive learning to address these issues. Our model employs a dual-encoder generator architecture, allowing for detailed feature extraction from both infrared and reference images to enable precise color transfer. Key modules, including the Multi-Receptive Field Feature Integration Module (MFIM) and Channel–Spatial Feature Enhancement Module (CSFEM), enhance feature extraction and integration, while the Improved Stop-Gradient Attention Module (ISGA) ensures accurate feature alignment. A composite loss function combining adversarial, perceptual, and contrastive losses further refines the model’s output. Experimental results on benchmark datasets show that this method significantly improves colorization quality, generating visually realistic and detailed images, thus advancing applications in post-processing, object detection, and scene analysis within the infrared domain.</div></div>\",\"PeriodicalId\":13549,\"journal\":{\"name\":\"Infrared Physics & Technology\",\"volume\":\"145 \",\"pages\":\"Article 105675\"},\"PeriodicalIF\":3.8000,\"publicationDate\":\"2025-03-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Infrared Physics & Technology\",\"FirstCategoryId\":\"101\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1350449524005590\",\"RegionNum\":3,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/12/21 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q2\",\"JCRName\":\"INSTRUMENTS & INSTRUMENTATION\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Infrared Physics & Technology","FirstCategoryId":"101","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1350449524005590","RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/12/21 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"INSTRUMENTS & INSTRUMENTATION","Score":null,"Total":0}
引用次数: 0

摘要

由于现有方法的局限性,如细节保存不足和显色不准确,热红外图像的着色仍然具有挑战性。本文提出了一种新的着色方法,利用参考图像和对比学习来解决这些问题。我们的模型采用双编码器生成器架构,允许从红外和参考图像中提取详细的特征,以实现精确的颜色转移。关键模块,包括多感受场特征集成模块(MFIM)和通道空间特征增强模块(CSFEM),加强特征提取和集成,而改进的停止梯度注意模块(ISGA)确保准确的特征对齐。结合对抗损失、感知损失和对比损失的复合损失函数进一步改进了模型的输出。在基准数据集上的实验结果表明,该方法显著提高了着色质量,生成了视觉逼真、细节丰富的图像,从而推进了红外域内的后处理、目标检测和场景分析等方面的应用。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Enhancing thermal infrared image colorization through reference-driven and contrastive learning approaches
Thermal infrared image colorization remains challenging due to limitations in existing methods, such as insufficient detail preservation and inaccurate color rendering. This paper presents a novel colorization approach that leverages reference images and contrastive learning to address these issues. Our model employs a dual-encoder generator architecture, allowing for detailed feature extraction from both infrared and reference images to enable precise color transfer. Key modules, including the Multi-Receptive Field Feature Integration Module (MFIM) and Channel–Spatial Feature Enhancement Module (CSFEM), enhance feature extraction and integration, while the Improved Stop-Gradient Attention Module (ISGA) ensures accurate feature alignment. A composite loss function combining adversarial, perceptual, and contrastive losses further refines the model’s output. Experimental results on benchmark datasets show that this method significantly improves colorization quality, generating visually realistic and detailed images, thus advancing applications in post-processing, object detection, and scene analysis within the infrared domain.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
5.70
自引率
12.10%
发文量
400
审稿时长
67 days
期刊介绍: The Journal covers the entire field of infrared physics and technology: theory, experiment, application, devices and instrumentation. Infrared'' is defined as covering the near, mid and far infrared (terahertz) regions from 0.75um (750nm) to 1mm (300GHz.) Submissions in the 300GHz to 100GHz region may be accepted at the editors discretion if their content is relevant to shorter wavelengths. Submissions must be primarily concerned with and directly relevant to this spectral region. Its core topics can be summarized as the generation, propagation and detection, of infrared radiation; the associated optics, materials and devices; and its use in all fields of science, industry, engineering and medicine. Infrared techniques occur in many different fields, notably spectroscopy and interferometry; material characterization and processing; atmospheric physics, astronomy and space research. Scientific aspects include lasers, quantum optics, quantum electronics, image processing and semiconductor physics. Some important applications are medical diagnostics and treatment, industrial inspection and environmental monitoring.
期刊最新文献
PGTFusion: Pseudo ground truth guided infrared and visible image fusion Multi-scale fusion algorithm for infrared and visible images guided by semantic segmentation Infrared thermographic analysis of curing-dependent damage evolution in cemented fly ash backfill Flexible elliptical waveguides for low-loss single mode transmission at 100, 140, and 300 GHz frequency bands Identification of interfacial defects at composites-metal hybrid laminates using array infrared thermography and multi-fidelity data driven algorithms
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1