Yunyun Wu, Han Liu, Xia Kong, Min Deng, Youfeng Li
{"title":"基于 GAN 的红外纹理生成仿真与评估","authors":"Yunyun Wu, Han Liu, Xia Kong, Min Deng, Youfeng Li","doi":"10.25103/jestr.171.16","DOIUrl":null,"url":null,"abstract":"At present, the demand for the simulation technology of infrared view is markedly expanding. However, the related main research orientations are influenced by numerous factors. Thus, the availability of infrared images for special scenes is difficult to determine, and their practical applications are limited. This study proposed a method based on generative adversarial network (GAN) to reveal its influence on the generation of infrared texture and produce infrared texture in infrared view simulation. By combining the needs of texture generation in infrared simulation and the superiority of image style transfer in texture generation, three algorithms for style transfer based on GAN, namely, Algorithms I, II, and III, were introduced to establish pretrained models. Simulation results of the three models were then evaluated using histograms, structural similarity (SSIM), and peak signal-to-noise ratio (PSNR), and the effects of colors of the infrared images in the texture generation were compared. The validity of these models was also verified. Results demonstrate that infrared images in a specified scene can be simulated without the need for a large number of training datasets, and the simulation images generated by transferring in black-and-white infrared style images are better than those in color infrared style images. The histogram evaluation index shows that Algorithm III is higher than Algorithms I and II by approximately 0.06. The SSIM evaluation index reveals that Algorithm II is higher than Algorithms I and II by 0.09 and 0.06 dB, respectively. The PSNR evaluation index indicates that Algorithm III is higher than Algorithms I and II by approximately 0.31 dB. Thus, this study provides a practical value in the field of infrared simulation technology.","PeriodicalId":15707,"journal":{"name":"Journal of Engineering Science and Technology Review","volume":"39 11","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Simulation and Evaluation of GAN-based Implementation of Infrared Texture Generation\",\"authors\":\"Yunyun Wu, Han Liu, Xia Kong, Min Deng, Youfeng Li\",\"doi\":\"10.25103/jestr.171.16\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"At present, the demand for the simulation technology of infrared view is markedly expanding. However, the related main research orientations are influenced by numerous factors. Thus, the availability of infrared images for special scenes is difficult to determine, and their practical applications are limited. This study proposed a method based on generative adversarial network (GAN) to reveal its influence on the generation of infrared texture and produce infrared texture in infrared view simulation. By combining the needs of texture generation in infrared simulation and the superiority of image style transfer in texture generation, three algorithms for style transfer based on GAN, namely, Algorithms I, II, and III, were introduced to establish pretrained models. Simulation results of the three models were then evaluated using histograms, structural similarity (SSIM), and peak signal-to-noise ratio (PSNR), and the effects of colors of the infrared images in the texture generation were compared. The validity of these models was also verified. Results demonstrate that infrared images in a specified scene can be simulated without the need for a large number of training datasets, and the simulation images generated by transferring in black-and-white infrared style images are better than those in color infrared style images. The histogram evaluation index shows that Algorithm III is higher than Algorithms I and II by approximately 0.06. The SSIM evaluation index reveals that Algorithm II is higher than Algorithms I and II by 0.09 and 0.06 dB, respectively. The PSNR evaluation index indicates that Algorithm III is higher than Algorithms I and II by approximately 0.31 dB. Thus, this study provides a practical value in the field of infrared simulation technology.\",\"PeriodicalId\":15707,\"journal\":{\"name\":\"Journal of Engineering Science and Technology Review\",\"volume\":\"39 11\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Engineering Science and Technology Review\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.25103/jestr.171.16\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"Engineering\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Engineering Science and Technology Review","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.25103/jestr.171.16","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"Engineering","Score":null,"Total":0}
引用次数: 0
摘要
目前,对红外视景仿真技术的需求明显扩大。然而,相关的主要研究方向受到诸多因素的影响。因此,特殊场景红外图像的可用性难以确定,其实际应用也受到限制。本研究提出了一种基于生成对抗网络(GAN)的方法,揭示其对红外纹理生成的影响,并在红外视景模拟中生成红外纹理。结合红外仿真中纹理生成的需求和图像风格转移在纹理生成中的优越性,引入了三种基于 GAN 的风格转移算法,即算法 I、算法 II 和算法 III,建立了预训练模型。然后使用直方图、结构相似度(SSIM)和峰值信噪比(PSNR)评估了三种模型的仿真结果,并比较了红外图像的颜色对纹理生成的影响。这些模型的有效性也得到了验证。结果表明,无需大量的训练数据集就能模拟指定场景中的红外图像,而且在黑白红外风格图像中传输生成的模拟图像比在彩色红外风格图像中传输生成的模拟图像更好。直方图评价指标显示,算法 III 比算法 I 和算法 II 高约 0.06。SSIM 评估指数显示,算法 II 分别比算法 I 和 II 高 0.09 和 0.06 dB。PSNR 评估指数表明,算法 III 比算法 I 和 II 高约 0.31 dB。因此,本研究在红外模拟技术领域具有实用价值。
Simulation and Evaluation of GAN-based Implementation of Infrared Texture Generation
At present, the demand for the simulation technology of infrared view is markedly expanding. However, the related main research orientations are influenced by numerous factors. Thus, the availability of infrared images for special scenes is difficult to determine, and their practical applications are limited. This study proposed a method based on generative adversarial network (GAN) to reveal its influence on the generation of infrared texture and produce infrared texture in infrared view simulation. By combining the needs of texture generation in infrared simulation and the superiority of image style transfer in texture generation, three algorithms for style transfer based on GAN, namely, Algorithms I, II, and III, were introduced to establish pretrained models. Simulation results of the three models were then evaluated using histograms, structural similarity (SSIM), and peak signal-to-noise ratio (PSNR), and the effects of colors of the infrared images in the texture generation were compared. The validity of these models was also verified. Results demonstrate that infrared images in a specified scene can be simulated without the need for a large number of training datasets, and the simulation images generated by transferring in black-and-white infrared style images are better than those in color infrared style images. The histogram evaluation index shows that Algorithm III is higher than Algorithms I and II by approximately 0.06. The SSIM evaluation index reveals that Algorithm II is higher than Algorithms I and II by 0.09 and 0.06 dB, respectively. The PSNR evaluation index indicates that Algorithm III is higher than Algorithms I and II by approximately 0.31 dB. Thus, this study provides a practical value in the field of infrared simulation technology.
期刊介绍:
The Journal of Engineering Science and Technology Review (JESTR) is a peer reviewed international journal publishing high quality articles dediicated to all aspects of engineering. The Journal considers only manuscripts that have not been published (or submitted simultaneously), at any language, elsewhere. Contributions are in English. The Journal is published by the Eastern Macedonia and Thrace Institute of Technology (EMaTTech), located in Kavala, Greece. All articles published in JESTR are licensed under a CC BY-NC license. Copyright is by the publisher and the authors.