Mark Boss, Zixuan Huang, Aaryaman Vasishta, Varun Jampani
{"title":"SF3D:利用 UV 解包和照明解缠实现稳定的快速 3D 网格重构","authors":"Mark Boss, Zixuan Huang, Aaryaman Vasishta, Varun Jampani","doi":"arxiv-2408.00653","DOIUrl":null,"url":null,"abstract":"We present SF3D, a novel method for rapid and high-quality textured object\nmesh reconstruction from a single image in just 0.5 seconds. Unlike most\nexisting approaches, SF3D is explicitly trained for mesh generation,\nincorporating a fast UV unwrapping technique that enables swift texture\ngeneration rather than relying on vertex colors. The method also learns to\npredict material parameters and normal maps to enhance the visual quality of\nthe reconstructed 3D meshes. Furthermore, SF3D integrates a delighting step to\neffectively remove low-frequency illumination effects, ensuring that the\nreconstructed meshes can be easily used in novel illumination conditions.\nExperiments demonstrate the superior performance of SF3D over the existing\ntechniques. Project page: https://stable-fast-3d.github.io","PeriodicalId":501174,"journal":{"name":"arXiv - CS - Graphics","volume":"110 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglement\",\"authors\":\"Mark Boss, Zixuan Huang, Aaryaman Vasishta, Varun Jampani\",\"doi\":\"arxiv-2408.00653\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"We present SF3D, a novel method for rapid and high-quality textured object\\nmesh reconstruction from a single image in just 0.5 seconds. Unlike most\\nexisting approaches, SF3D is explicitly trained for mesh generation,\\nincorporating a fast UV unwrapping technique that enables swift texture\\ngeneration rather than relying on vertex colors. The method also learns to\\npredict material parameters and normal maps to enhance the visual quality of\\nthe reconstructed 3D meshes. Furthermore, SF3D integrates a delighting step to\\neffectively remove low-frequency illumination effects, ensuring that the\\nreconstructed meshes can be easily used in novel illumination conditions.\\nExperiments demonstrate the superior performance of SF3D over the existing\\ntechniques. Project page: https://stable-fast-3d.github.io\",\"PeriodicalId\":501174,\"journal\":{\"name\":\"arXiv - CS - Graphics\",\"volume\":\"110 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - CS - Graphics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2408.00653\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Graphics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2408.00653","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglement
We present SF3D, a novel method for rapid and high-quality textured object
mesh reconstruction from a single image in just 0.5 seconds. Unlike most
existing approaches, SF3D is explicitly trained for mesh generation,
incorporating a fast UV unwrapping technique that enables swift texture
generation rather than relying on vertex colors. The method also learns to
predict material parameters and normal maps to enhance the visual quality of
the reconstructed 3D meshes. Furthermore, SF3D integrates a delighting step to
effectively remove low-frequency illumination effects, ensuring that the
reconstructed meshes can be easily used in novel illumination conditions.
Experiments demonstrate the superior performance of SF3D over the existing
techniques. Project page: https://stable-fast-3d.github.io