{"title":"MA-MFCNet:基于混合注意力的多尺度图像去重特征校准网络","authors":"Luqiao Li;Zhihua Chen;Lei Dai;Ran Li;Bin Sheng","doi":"10.1109/TETCI.2024.3382233","DOIUrl":null,"url":null,"abstract":"High-quality clear images are the basis for advanced vision tasks such as target detection and semantic segmentation. This paper proposes an image dehazing algorithm named mixed attention-based multi-scale feature calibration network, aiming at solving the problem of uneven haze distribution in low-quality fuzzy images acquired in foggy environments, which is difficult to remove effectively. Our algorithm adopts a U-shaped structure to extract multi-scale features and deep semantic information. In the encoding module, a mixed attention module is designed to assign different weights to each position in the feature map, focusing on the important information and regions where haze is difficult to be removed in the image. In the decoding module, a self-calibration recovery module is designed to fully integrate different levels of features, calibrate feature information, and restore spatial texture details. Finally, the multi-scale feature information is aggregated by the reconstruction module and accurately mapped into the solution space to obtain a clear image after haze removal. Extensive experiments show that our algorithm outperforms state-of-the-art image dehazing algorithms in various synthetic datasets and real hazy scenes in terms of qualitative and quantitative comparisons, and can effectively remove haze in different scenes and recover images with high quality.","PeriodicalId":13135,"journal":{"name":"IEEE Transactions on Emerging Topics in Computational Intelligence","volume":"8 5","pages":"3408-3421"},"PeriodicalIF":5.3000,"publicationDate":"2024-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"MA-MFCNet: Mixed Attention-Based Multi-Scale Feature Calibration Network for Image Dehazing\",\"authors\":\"Luqiao Li;Zhihua Chen;Lei Dai;Ran Li;Bin Sheng\",\"doi\":\"10.1109/TETCI.2024.3382233\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"High-quality clear images are the basis for advanced vision tasks such as target detection and semantic segmentation. This paper proposes an image dehazing algorithm named mixed attention-based multi-scale feature calibration network, aiming at solving the problem of uneven haze distribution in low-quality fuzzy images acquired in foggy environments, which is difficult to remove effectively. Our algorithm adopts a U-shaped structure to extract multi-scale features and deep semantic information. In the encoding module, a mixed attention module is designed to assign different weights to each position in the feature map, focusing on the important information and regions where haze is difficult to be removed in the image. In the decoding module, a self-calibration recovery module is designed to fully integrate different levels of features, calibrate feature information, and restore spatial texture details. Finally, the multi-scale feature information is aggregated by the reconstruction module and accurately mapped into the solution space to obtain a clear image after haze removal. Extensive experiments show that our algorithm outperforms state-of-the-art image dehazing algorithms in various synthetic datasets and real hazy scenes in terms of qualitative and quantitative comparisons, and can effectively remove haze in different scenes and recover images with high quality.\",\"PeriodicalId\":13135,\"journal\":{\"name\":\"IEEE Transactions on Emerging Topics in Computational Intelligence\",\"volume\":\"8 5\",\"pages\":\"3408-3421\"},\"PeriodicalIF\":5.3000,\"publicationDate\":\"2024-04-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Emerging Topics in Computational Intelligence\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10496923/\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Emerging Topics in Computational Intelligence","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10496923/","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
摘要
高质量的清晰图像是目标检测和语义分割等高级视觉任务的基础。本文提出了一种名为 "基于混合注意力的多尺度特征校准网络 "的图像去污算法,旨在解决雾霾环境下获取的低质量模糊图像中雾霾分布不均匀、难以有效去除的问题。我们的算法采用 U 型结构提取多尺度特征和深层语义信息。在编码模块中,设计了一个混合注意力模块,为特征图中的每个位置分配不同的权重,重点关注图像中的重要信息和难以去除雾霾的区域。在解码模块中,设计了一个自校准恢复模块,以充分整合不同层次的特征,校准特征信息,恢复空间纹理细节。最后,多尺度特征信息由重构模块汇总,并精确映射到解算空间,从而获得去除雾霾后的清晰图像。大量实验表明,在各种合成数据集和真实雾霾场景中,我们的算法在定性和定量比较方面都优于最先进的图像去雾霾算法,能有效去除不同场景中的雾霾,恢复出高质量的图像。
MA-MFCNet: Mixed Attention-Based Multi-Scale Feature Calibration Network for Image Dehazing
High-quality clear images are the basis for advanced vision tasks such as target detection and semantic segmentation. This paper proposes an image dehazing algorithm named mixed attention-based multi-scale feature calibration network, aiming at solving the problem of uneven haze distribution in low-quality fuzzy images acquired in foggy environments, which is difficult to remove effectively. Our algorithm adopts a U-shaped structure to extract multi-scale features and deep semantic information. In the encoding module, a mixed attention module is designed to assign different weights to each position in the feature map, focusing on the important information and regions where haze is difficult to be removed in the image. In the decoding module, a self-calibration recovery module is designed to fully integrate different levels of features, calibrate feature information, and restore spatial texture details. Finally, the multi-scale feature information is aggregated by the reconstruction module and accurately mapped into the solution space to obtain a clear image after haze removal. Extensive experiments show that our algorithm outperforms state-of-the-art image dehazing algorithms in various synthetic datasets and real hazy scenes in terms of qualitative and quantitative comparisons, and can effectively remove haze in different scenes and recover images with high quality.
期刊介绍:
The IEEE Transactions on Emerging Topics in Computational Intelligence (TETCI) publishes original articles on emerging aspects of computational intelligence, including theory, applications, and surveys.
TETCI is an electronics only publication. TETCI publishes six issues per year.
Authors are encouraged to submit manuscripts in any emerging topic in computational intelligence, especially nature-inspired computing topics not covered by other IEEE Computational Intelligence Society journals. A few such illustrative examples are glial cell networks, computational neuroscience, Brain Computer Interface, ambient intelligence, non-fuzzy computing with words, artificial life, cultural learning, artificial endocrine networks, social reasoning, artificial hormone networks, computational intelligence for the IoT and Smart-X technologies.