从单个未校准图像进行无监督轻量级面部3D重建

Yuhang Shi, Huan Jin, Dapeng Tao
{"title":"从单个未校准图像进行无监督轻量级面部3D重建","authors":"Yuhang Shi, Huan Jin, Dapeng Tao","doi":"10.1145/3529570.3529599","DOIUrl":null,"url":null,"abstract":"Reconstruct 3D model from 2D image is an important task in the field of deep learning, which aims to make computers have the ability to perceive the 3D world like human-beings. In this paper, a lightweight method is proposed for 3D face reconstruction from a single image without any supervision. Specifically, our method employs encoder-decoder architectures to extract depth map, light condition, transformation matrix and albedo from input image. According to the principle of rendering, we can obtain the connection between 2D image coordinates and 3D model vertices coordinates, using the above elements, we can get the projection image of the reconstructed model. Then the reconstruction loss can be used to optimize the network parameters. Experiments show that our method surpasses the previous work in reconstruction speed and the size of model.","PeriodicalId":430367,"journal":{"name":"Proceedings of the 6th International Conference on Digital Signal Processing","volume":"104 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-02-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Unsupervised Lightweight Face 3D Reconstruction From a Single Uncalibrated Image\",\"authors\":\"Yuhang Shi, Huan Jin, Dapeng Tao\",\"doi\":\"10.1145/3529570.3529599\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Reconstruct 3D model from 2D image is an important task in the field of deep learning, which aims to make computers have the ability to perceive the 3D world like human-beings. In this paper, a lightweight method is proposed for 3D face reconstruction from a single image without any supervision. Specifically, our method employs encoder-decoder architectures to extract depth map, light condition, transformation matrix and albedo from input image. According to the principle of rendering, we can obtain the connection between 2D image coordinates and 3D model vertices coordinates, using the above elements, we can get the projection image of the reconstructed model. Then the reconstruction loss can be used to optimize the network parameters. Experiments show that our method surpasses the previous work in reconstruction speed and the size of model.\",\"PeriodicalId\":430367,\"journal\":{\"name\":\"Proceedings of the 6th International Conference on Digital Signal Processing\",\"volume\":\"104 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-02-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 6th International Conference on Digital Signal Processing\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3529570.3529599\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 6th International Conference on Digital Signal Processing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3529570.3529599","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

从二维图像重构三维模型是深度学习领域的一项重要任务,其目的是使计算机具有像人类一样感知三维世界的能力。本文提出了一种基于单幅图像的无监督三维人脸重建的轻量化方法。具体来说,我们的方法采用编码器-解码器架构从输入图像中提取深度图、光照条件、变换矩阵和反照率。根据绘制原理,我们可以得到二维图像坐标与三维模型顶点坐标之间的联系,利用上述元素,我们可以得到重建模型的投影图像。然后利用重构损失对网络参数进行优化。实验表明,该方法在重建速度和模型尺寸上都优于以往的方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Unsupervised Lightweight Face 3D Reconstruction From a Single Uncalibrated Image
Reconstruct 3D model from 2D image is an important task in the field of deep learning, which aims to make computers have the ability to perceive the 3D world like human-beings. In this paper, a lightweight method is proposed for 3D face reconstruction from a single image without any supervision. Specifically, our method employs encoder-decoder architectures to extract depth map, light condition, transformation matrix and albedo from input image. According to the principle of rendering, we can obtain the connection between 2D image coordinates and 3D model vertices coordinates, using the above elements, we can get the projection image of the reconstructed model. Then the reconstruction loss can be used to optimize the network parameters. Experiments show that our method surpasses the previous work in reconstruction speed and the size of model.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Inference and Prediction in Big Data Using Sparse Gaussian Process Method A SAR Image Denoising Method for Target Shadow Tracking Task Development of an English Teaching Robot for Japanese Students Joint Power and Bandwidth Allocation for 3D Video SoftCast Some Evaluations on Spectrogram Art Communications Exchanging Secret Visual Messages
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1