{"title":"基于双鉴别器的DCGAN语义人脸补全","authors":"Xiuhong Yang, Peng Xu, Haiyan Jin, Jie Zhang","doi":"10.1109/ICNISC54316.2021.00010","DOIUrl":null,"url":null,"abstract":"Image completion refers to utilizing image residual information to repair the missing part. In order to solve the problem that the existing models cannot learn the deep features of the image, resulting in inaccurate artifacts in the repaired details, and the inconsistency between the repaired part and the adjacent pixels, we propose a semantic face completion method based on DCGAN with dual discriminator in this paper. We improve DCGAN with dual discriminator to ensure the consistency of local part and global image. In addition, we utilize the VGG16 network to help learn the deep features of the image to make the repaired result clearer and more realistic at the pixel level. Therefore, our method generates images by optimizing the generators with three kinds of loss functions, which are composed of dual image reconstruction loss, dual adversarial loss, and dual image feature reconstruction loss. Experiments on celebA datasets show that the model can get reasonable repairing results, and PSNR and SSIM are higher than baseline on most test datasets.","PeriodicalId":396802,"journal":{"name":"2021 7th Annual International Conference on Network and Information Systems for Computers (ICNISC)","volume":"98 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Semantic Face Completion Based on DCGAN with Dual-Discriminator\",\"authors\":\"Xiuhong Yang, Peng Xu, Haiyan Jin, Jie Zhang\",\"doi\":\"10.1109/ICNISC54316.2021.00010\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Image completion refers to utilizing image residual information to repair the missing part. In order to solve the problem that the existing models cannot learn the deep features of the image, resulting in inaccurate artifacts in the repaired details, and the inconsistency between the repaired part and the adjacent pixels, we propose a semantic face completion method based on DCGAN with dual discriminator in this paper. We improve DCGAN with dual discriminator to ensure the consistency of local part and global image. In addition, we utilize the VGG16 network to help learn the deep features of the image to make the repaired result clearer and more realistic at the pixel level. Therefore, our method generates images by optimizing the generators with three kinds of loss functions, which are composed of dual image reconstruction loss, dual adversarial loss, and dual image feature reconstruction loss. Experiments on celebA datasets show that the model can get reasonable repairing results, and PSNR and SSIM are higher than baseline on most test datasets.\",\"PeriodicalId\":396802,\"journal\":{\"name\":\"2021 7th Annual International Conference on Network and Information Systems for Computers (ICNISC)\",\"volume\":\"98 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-07-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 7th Annual International Conference on Network and Information Systems for Computers (ICNISC)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICNISC54316.2021.00010\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 7th Annual International Conference on Network and Information Systems for Computers (ICNISC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICNISC54316.2021.00010","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Semantic Face Completion Based on DCGAN with Dual-Discriminator
Image completion refers to utilizing image residual information to repair the missing part. In order to solve the problem that the existing models cannot learn the deep features of the image, resulting in inaccurate artifacts in the repaired details, and the inconsistency between the repaired part and the adjacent pixels, we propose a semantic face completion method based on DCGAN with dual discriminator in this paper. We improve DCGAN with dual discriminator to ensure the consistency of local part and global image. In addition, we utilize the VGG16 network to help learn the deep features of the image to make the repaired result clearer and more realistic at the pixel level. Therefore, our method generates images by optimizing the generators with three kinds of loss functions, which are composed of dual image reconstruction loss, dual adversarial loss, and dual image feature reconstruction loss. Experiments on celebA datasets show that the model can get reasonable repairing results, and PSNR and SSIM are higher than baseline on most test datasets.