用于人脸补全的屏蔽 GAN:一种新颖的深度学习方法

Anshuman Sharma, Biswaroop Nath, Tejaswini Kar, D. Khasim
{"title":"用于人脸补全的屏蔽 GAN:一种新颖的深度学习方法","authors":"Anshuman Sharma, Biswaroop Nath, Tejaswini Kar, D. Khasim","doi":"10.4108/eetpht.9.4850","DOIUrl":null,"url":null,"abstract":"INTRODUCTION: Recent deep learning based image editing methods have achieved promising results for removing object in an image but fail to generate appreciable performance for removing large objects of complex nature, especially mask from facial images. Towards this goal the objective of this work is to remove mask objects in facial images. In this study, authors propose a novel approach for face completion using Generative Adversarial Networks (GANs) that utilize masked data. This technology can help in image restoration and preservation, thus enabling us to cherish those memories that are held dear to our hearts.OBJECTIVES: Train a GAN to learn the mapping from incomplete to complete face images by utilizing a masked input image.METHODS: The discriminator is trained to distinguish between face images and full ground truth images. Our results indicate that our technique generates high-quality, realistic facial images that are visually comparable to the ground truth and that it can generalise to new faces that were not encountered during training.RESULTS: Our findings indicate that GANs with masked inputs are a good approach for generating whole face images from partial or masked data.CONCLUSION: Our experimental findings show that our method produces facial images of great quality and realism that are visually equivalent to the actual thing. Our proposed approach can also be applied to fresh faces that weren’t seen. The performance can still be improved further using larger dataset. Also, further investigation into adversial attacks may help in improving performance. This technology can be further utilized for developing realtime mask removal software as well.","PeriodicalId":36936,"journal":{"name":"EAI Endorsed Transactions on Pervasive Health and Technology","volume":"14 2","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-01-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Masked GANs for Face Completion: A Novel Deep Learning Approach\",\"authors\":\"Anshuman Sharma, Biswaroop Nath, Tejaswini Kar, D. Khasim\",\"doi\":\"10.4108/eetpht.9.4850\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"INTRODUCTION: Recent deep learning based image editing methods have achieved promising results for removing object in an image but fail to generate appreciable performance for removing large objects of complex nature, especially mask from facial images. Towards this goal the objective of this work is to remove mask objects in facial images. In this study, authors propose a novel approach for face completion using Generative Adversarial Networks (GANs) that utilize masked data. This technology can help in image restoration and preservation, thus enabling us to cherish those memories that are held dear to our hearts.OBJECTIVES: Train a GAN to learn the mapping from incomplete to complete face images by utilizing a masked input image.METHODS: The discriminator is trained to distinguish between face images and full ground truth images. Our results indicate that our technique generates high-quality, realistic facial images that are visually comparable to the ground truth and that it can generalise to new faces that were not encountered during training.RESULTS: Our findings indicate that GANs with masked inputs are a good approach for generating whole face images from partial or masked data.CONCLUSION: Our experimental findings show that our method produces facial images of great quality and realism that are visually equivalent to the actual thing. Our proposed approach can also be applied to fresh faces that weren’t seen. The performance can still be improved further using larger dataset. Also, further investigation into adversial attacks may help in improving performance. This technology can be further utilized for developing realtime mask removal software as well.\",\"PeriodicalId\":36936,\"journal\":{\"name\":\"EAI Endorsed Transactions on Pervasive Health and Technology\",\"volume\":\"14 2\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-01-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"EAI Endorsed Transactions on Pervasive Health and Technology\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.4108/eetpht.9.4850\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"Computer Science\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"EAI Endorsed Transactions on Pervasive Health and Technology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.4108/eetpht.9.4850","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"Computer Science","Score":null,"Total":0}
引用次数: 0

摘要

简介:最近基于深度学习的图像编辑方法在移除图像中的物体方面取得了可喜的成果,但在移除性质复杂的大型物体,尤其是面部图像中的遮罩物方面,却未能产生可观的性能。为此,这项工作的目标是去除面部图像中的遮罩对象。在这项研究中,作者提出了一种利用生成对抗网络(GANs)来完成人脸补全的新方法。这项技术有助于图像修复和保存,从而让我们能够珍惜那些珍藏在心底的记忆:方法:训练判别器以区分人脸图像和完整的地面实况图像。结果:我们的研究结果表明,利用遮挡输入的 GANs 是一种从部分或遮挡数据生成完整人脸图像的好方法。结论:我们的实验结果表明,我们的方法生成的人脸图像质量高、逼真,在视觉上与实物相当。我们提出的方法还可用于未见过的新鲜人脸。使用更大的数据集还能进一步提高性能。此外,进一步研究对抗性攻击也有助于提高性能。这项技术还可进一步用于开发实时面具去除软件。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Masked GANs for Face Completion: A Novel Deep Learning Approach
INTRODUCTION: Recent deep learning based image editing methods have achieved promising results for removing object in an image but fail to generate appreciable performance for removing large objects of complex nature, especially mask from facial images. Towards this goal the objective of this work is to remove mask objects in facial images. In this study, authors propose a novel approach for face completion using Generative Adversarial Networks (GANs) that utilize masked data. This technology can help in image restoration and preservation, thus enabling us to cherish those memories that are held dear to our hearts.OBJECTIVES: Train a GAN to learn the mapping from incomplete to complete face images by utilizing a masked input image.METHODS: The discriminator is trained to distinguish between face images and full ground truth images. Our results indicate that our technique generates high-quality, realistic facial images that are visually comparable to the ground truth and that it can generalise to new faces that were not encountered during training.RESULTS: Our findings indicate that GANs with masked inputs are a good approach for generating whole face images from partial or masked data.CONCLUSION: Our experimental findings show that our method produces facial images of great quality and realism that are visually equivalent to the actual thing. Our proposed approach can also be applied to fresh faces that weren’t seen. The performance can still be improved further using larger dataset. Also, further investigation into adversial attacks may help in improving performance. This technology can be further utilized for developing realtime mask removal software as well.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
EAI Endorsed Transactions on Pervasive Health and Technology
EAI Endorsed Transactions on Pervasive Health and Technology Computer Science-Computer Science (miscellaneous)
CiteScore
3.50
自引率
0.00%
发文量
14
审稿时长
10 weeks
期刊最新文献
Thermal image processing system to monitor muscle warm-up in students prior to their sports activities Individual Intervention and Assessment of Students' Physical Fitness Based on the "Three Precision" Applet and Mixed Strategy Optimised CNN Networks Research on Portable Intelligent Terminal and APP Application Analysis and Intelligent Monitoring Method of College Students' Health Status Research on 2D Animation Simulation Based on Artificial Intelligence and Biomechanical Modeling Swift Diagnose: A High-Performance Shallow Convolutional Neural Network for Rapid and Reliable SARS-COV-2 Induced Pneumonia Detection
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1