通过改进边缘和身份保持网络增强人脸超分辨率

Mostafa Balouchzehi Shahbakhsh, H. Hassanpour
{"title":"通过改进边缘和身份保持网络增强人脸超分辨率","authors":"Mostafa Balouchzehi Shahbakhsh, H. Hassanpour","doi":"10.1109/ICSPIS54653.2021.9729372","DOIUrl":null,"url":null,"abstract":"Face super-resolution, known as face hallucination, is a domain-specific image super-resolution problem, which refers to generating high resolution face images from their low resolution. State-of-the-art face super-resolution methods used deep convolutional neural networks. However, due to significant pose changes and difficulty in recovering high-frequency details in facial areas, most of these methods do not deploy facial structures and identity information well, and it is tough for them to reconstruct super-resolved face images. According to previous researches, proper use of low-resolution image edges can be a solution for these problems. EIPNet (Edge and Identity Preserving Network) is one of the newest methods to achieve outstanding results in this area. In the EIPNet method, the authors used a lightweight edge extraction block in the proposed GAN structure. In this research, we intend to improve the performance of the EIPNet method by presenting a simple but efficient technique. Our proposed technique divides the face images into upper and lower parts. We train a separate network for each area. This technique reduces the number of face components to train from each area, and the networks can better be trained from their components. The results show that this technique can have an excellent effect on visual quality and quantitative measurements in face super-resolution.","PeriodicalId":286966,"journal":{"name":"2021 7th International Conference on Signal Processing and Intelligent Systems (ICSPIS)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-12-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Enhancing Face Super-Resolution via Improving the Edge and Identity Preserving Network\",\"authors\":\"Mostafa Balouchzehi Shahbakhsh, H. Hassanpour\",\"doi\":\"10.1109/ICSPIS54653.2021.9729372\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Face super-resolution, known as face hallucination, is a domain-specific image super-resolution problem, which refers to generating high resolution face images from their low resolution. State-of-the-art face super-resolution methods used deep convolutional neural networks. However, due to significant pose changes and difficulty in recovering high-frequency details in facial areas, most of these methods do not deploy facial structures and identity information well, and it is tough for them to reconstruct super-resolved face images. According to previous researches, proper use of low-resolution image edges can be a solution for these problems. EIPNet (Edge and Identity Preserving Network) is one of the newest methods to achieve outstanding results in this area. In the EIPNet method, the authors used a lightweight edge extraction block in the proposed GAN structure. In this research, we intend to improve the performance of the EIPNet method by presenting a simple but efficient technique. Our proposed technique divides the face images into upper and lower parts. We train a separate network for each area. This technique reduces the number of face components to train from each area, and the networks can better be trained from their components. The results show that this technique can have an excellent effect on visual quality and quantitative measurements in face super-resolution.\",\"PeriodicalId\":286966,\"journal\":{\"name\":\"2021 7th International Conference on Signal Processing and Intelligent Systems (ICSPIS)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-12-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 7th International Conference on Signal Processing and Intelligent Systems (ICSPIS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICSPIS54653.2021.9729372\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 7th International Conference on Signal Processing and Intelligent Systems (ICSPIS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICSPIS54653.2021.9729372","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

摘要

人脸超分辨率,又称人脸幻觉,是一种特定领域的图像超分辨率问题,指的是将低分辨率的人脸图像生成高分辨率的人脸图像。最先进的面部超分辨率方法使用了深度卷积神经网络。然而,由于姿态变化较大,难以恢复面部区域的高频细节,这些方法大多不能很好地部署面部结构和身份信息,难以重建超分辨人脸图像。根据以往的研究,适当使用低分辨率的图像边缘可以解决这些问题。边缘和身份保持网络(EIPNet)是在该领域取得突出成果的最新方法之一。在EIPNet方法中,作者在提出的GAN结构中使用了轻量级的边缘提取块。在这项研究中,我们打算通过提出一种简单而有效的技术来提高EIPNet方法的性能。我们提出的技术将人脸图像分为上下两个部分。我们为每个区域训练一个单独的网络。这种技术减少了从每个区域训练的人脸成分的数量,并且可以更好地从它们的成分中训练网络。结果表明,该技术在人脸超分辨率的视觉质量和定量测量方面都有很好的效果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Enhancing Face Super-Resolution via Improving the Edge and Identity Preserving Network
Face super-resolution, known as face hallucination, is a domain-specific image super-resolution problem, which refers to generating high resolution face images from their low resolution. State-of-the-art face super-resolution methods used deep convolutional neural networks. However, due to significant pose changes and difficulty in recovering high-frequency details in facial areas, most of these methods do not deploy facial structures and identity information well, and it is tough for them to reconstruct super-resolved face images. According to previous researches, proper use of low-resolution image edges can be a solution for these problems. EIPNet (Edge and Identity Preserving Network) is one of the newest methods to achieve outstanding results in this area. In the EIPNet method, the authors used a lightweight edge extraction block in the proposed GAN structure. In this research, we intend to improve the performance of the EIPNet method by presenting a simple but efficient technique. Our proposed technique divides the face images into upper and lower parts. We train a separate network for each area. This technique reduces the number of face components to train from each area, and the networks can better be trained from their components. The results show that this technique can have an excellent effect on visual quality and quantitative measurements in face super-resolution.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Intelligent Fault Diagnosis of Rolling BearingBased on Deep Transfer Learning Using Time-Frequency Representation Wind Energy Potential Approximation with Various Metaheuristic Optimization Techniques Deployment Listening to Sounds of Silence for Audio replay attack detection Transcranial Magnetic Stimulation of Prefrontal Cortex Alters Functional Brain Network Architecture: Graph Theoretical Analysis Anomaly Detection and Resilience-Oriented Countermeasures against Cyberattacks in Smart Grids
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1