{"title":"频域特征驱动的红外图像超分辨率质量预测","authors":"Bin Feng;Yongzhou Chen;Yunlong Wu;Qing Ye;Lin Li","doi":"10.1109/JMASS.2024.3355545","DOIUrl":null,"url":null,"abstract":"In order to predict infrared image super-resolution (SR) quality under conditions of no SR image generation and no high-resolution reference image, this article proposes a fully connected neural network model for infrared image SR quality prediction driven by wavelet domain energy features. Utilizing the multiresolution and scale-invariant properties of undecimated wavelets, our model separates low-frequency information component and three high-frequency information components from a low-resolution image. Our model achieves decorrelation of image pixel information and generates wavelet domain energy normalization features. Utilizing a fully connected neural network, we construct a wavelet-based image SR quality prediction network. This neural network combines four subnetworks to enhance the network representation and learning capabilities. The network is trained using wavelet domain energy normalization features, while autonomously learning the mapping relationship between input data and evaluation metric. This model is validated on infrared image data sets. The experimental results indicate that the proposed model can accurately predict SR image quality metrics by utilizing frequency-domain energy features of a low-resolution image.","PeriodicalId":100624,"journal":{"name":"IEEE Journal on Miniaturization for Air and Space Systems","volume":"5 2","pages":"79-84"},"PeriodicalIF":0.0000,"publicationDate":"2024-01-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Infrared Image Super-Resolution Quality Prediction Driven by Frequency-Domain Features\",\"authors\":\"Bin Feng;Yongzhou Chen;Yunlong Wu;Qing Ye;Lin Li\",\"doi\":\"10.1109/JMASS.2024.3355545\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In order to predict infrared image super-resolution (SR) quality under conditions of no SR image generation and no high-resolution reference image, this article proposes a fully connected neural network model for infrared image SR quality prediction driven by wavelet domain energy features. Utilizing the multiresolution and scale-invariant properties of undecimated wavelets, our model separates low-frequency information component and three high-frequency information components from a low-resolution image. Our model achieves decorrelation of image pixel information and generates wavelet domain energy normalization features. Utilizing a fully connected neural network, we construct a wavelet-based image SR quality prediction network. This neural network combines four subnetworks to enhance the network representation and learning capabilities. The network is trained using wavelet domain energy normalization features, while autonomously learning the mapping relationship between input data and evaluation metric. This model is validated on infrared image data sets. The experimental results indicate that the proposed model can accurately predict SR image quality metrics by utilizing frequency-domain energy features of a low-resolution image.\",\"PeriodicalId\":100624,\"journal\":{\"name\":\"IEEE Journal on Miniaturization for Air and Space Systems\",\"volume\":\"5 2\",\"pages\":\"79-84\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-01-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Journal on Miniaturization for Air and Space Systems\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10404033/\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal on Miniaturization for Air and Space Systems","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10404033/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
为了在不生成 SR 图像和没有高分辨率参考图像的条件下预测红外图像的超分辨率(SR)质量,本文提出了一种由小波域能量特征驱动的红外图像 SR 质量预测全连接神经网络模型。利用未估计小波的多分辨率和尺度不变特性,我们的模型从低分辨率图像中分离出低频信息分量和三个高频信息分量。我们的模型实现了图像像素信息的去相关性,并生成了小波域能量归一化特征。利用全连接神经网络,我们构建了基于小波的图像 SR 质量预测网络。该神经网络结合了四个子网络,以增强网络的表示和学习能力。该网络利用小波域能量归一化特征进行训练,同时自主学习输入数据与评价指标之间的映射关系。该模型在红外图像数据集上进行了验证。实验结果表明,利用低分辨率图像的频域能量特征,所提出的模型可以准确预测 SR 图像质量指标。
Infrared Image Super-Resolution Quality Prediction Driven by Frequency-Domain Features
In order to predict infrared image super-resolution (SR) quality under conditions of no SR image generation and no high-resolution reference image, this article proposes a fully connected neural network model for infrared image SR quality prediction driven by wavelet domain energy features. Utilizing the multiresolution and scale-invariant properties of undecimated wavelets, our model separates low-frequency information component and three high-frequency information components from a low-resolution image. Our model achieves decorrelation of image pixel information and generates wavelet domain energy normalization features. Utilizing a fully connected neural network, we construct a wavelet-based image SR quality prediction network. This neural network combines four subnetworks to enhance the network representation and learning capabilities. The network is trained using wavelet domain energy normalization features, while autonomously learning the mapping relationship between input data and evaluation metric. This model is validated on infrared image data sets. The experimental results indicate that the proposed model can accurately predict SR image quality metrics by utilizing frequency-domain energy features of a low-resolution image.