{"title":"基于gan的昼夜图像跨域转换研究与应用","authors":"Bo-quan Yu, Hanting Wei, Wei Wang","doi":"10.1109/ICTech55460.2022.00053","DOIUrl":null,"url":null,"abstract":"With the development and application of deep learning in computer vision, the performance of many basic visual tasks such as object detection and semantic segmentation has been greatly improved. However, most of networks are based on standard illumination, which results in poor performance in low illumination scenarios, and it is difficult to collect datasets with different illumination levels in restricted scenes. In this paper, GAN and related derived networks are systematically studied and summarized, and based on the idea of generation-antagonism of GAN, the design of day-night cross-domain converter is completed on the basis of the structure of CycleGAN. Based on this, Inception layer is added to optimize the structure of the converter, and the performance of the day-night cross-domain converters before and after optimization are compared through experiments. The results show that the optimized day-night converter can make the converted image more realistic. It is of great significance for enhancing the quality of datasets in restricted scenes, improving the performance of object detection and segmentation models in low illumination scenes.","PeriodicalId":290836,"journal":{"name":"2022 11th International Conference of Information and Communication Technology (ICTech))","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"GAN-Based Day and Night Image Cross-Domain Conversion Research and Application\",\"authors\":\"Bo-quan Yu, Hanting Wei, Wei Wang\",\"doi\":\"10.1109/ICTech55460.2022.00053\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"With the development and application of deep learning in computer vision, the performance of many basic visual tasks such as object detection and semantic segmentation has been greatly improved. However, most of networks are based on standard illumination, which results in poor performance in low illumination scenarios, and it is difficult to collect datasets with different illumination levels in restricted scenes. In this paper, GAN and related derived networks are systematically studied and summarized, and based on the idea of generation-antagonism of GAN, the design of day-night cross-domain converter is completed on the basis of the structure of CycleGAN. Based on this, Inception layer is added to optimize the structure of the converter, and the performance of the day-night cross-domain converters before and after optimization are compared through experiments. The results show that the optimized day-night converter can make the converted image more realistic. It is of great significance for enhancing the quality of datasets in restricted scenes, improving the performance of object detection and segmentation models in low illumination scenes.\",\"PeriodicalId\":290836,\"journal\":{\"name\":\"2022 11th International Conference of Information and Communication Technology (ICTech))\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 11th International Conference of Information and Communication Technology (ICTech))\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICTech55460.2022.00053\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 11th International Conference of Information and Communication Technology (ICTech))","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICTech55460.2022.00053","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
GAN-Based Day and Night Image Cross-Domain Conversion Research and Application
With the development and application of deep learning in computer vision, the performance of many basic visual tasks such as object detection and semantic segmentation has been greatly improved. However, most of networks are based on standard illumination, which results in poor performance in low illumination scenarios, and it is difficult to collect datasets with different illumination levels in restricted scenes. In this paper, GAN and related derived networks are systematically studied and summarized, and based on the idea of generation-antagonism of GAN, the design of day-night cross-domain converter is completed on the basis of the structure of CycleGAN. Based on this, Inception layer is added to optimize the structure of the converter, and the performance of the day-night cross-domain converters before and after optimization are compared through experiments. The results show that the optimized day-night converter can make the converted image more realistic. It is of great significance for enhancing the quality of datasets in restricted scenes, improving the performance of object detection and segmentation models in low illumination scenes.