{"title":"基于 DOE 的结构光用于稳健的 3D 重建","authors":"Bohuai Su, Feifei Gu, Hubing Du, Zhan Song","doi":"10.1109/ROBIO58561.2023.10354776","DOIUrl":null,"url":null,"abstract":"Spatial structured light (SL) enables three-dimensional measurements in a single shot by projecting patterns with coded information. However, conventional structured light systems typically employ a digital light processing projector (DLP) to project specific light patterns or coded patterns onto the surface of the object under examination. This reliance on projectors limits the miniaturization potential of such structured light systems, thereby hindering their suitability for industrial applications. The main contributions of the work in this paper include: 1) We introduce a novel and practical depth-aware miniature solution for smart terminals that employs a diffractive optical element (DOE) instead of a digital projector to project coded patterns. 2) We propose a one-dimensional SL pattern generation method that is successfully etched onto a DOE. 3) In contrast to traditional image processing techniques, all crucial steps in the pattern decoding process, such as corner detection and block recognition, are executed using deep learning methods, ensuring heightened robustness in real-world applications. The experimental results verify the effectiveness of the proposed method.","PeriodicalId":505134,"journal":{"name":"2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"22 1","pages":"1-6"},"PeriodicalIF":0.0000,"publicationDate":"2023-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"DOE-based Structured Light For Robust 3D Reconstruction\",\"authors\":\"Bohuai Su, Feifei Gu, Hubing Du, Zhan Song\",\"doi\":\"10.1109/ROBIO58561.2023.10354776\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Spatial structured light (SL) enables three-dimensional measurements in a single shot by projecting patterns with coded information. However, conventional structured light systems typically employ a digital light processing projector (DLP) to project specific light patterns or coded patterns onto the surface of the object under examination. This reliance on projectors limits the miniaturization potential of such structured light systems, thereby hindering their suitability for industrial applications. The main contributions of the work in this paper include: 1) We introduce a novel and practical depth-aware miniature solution for smart terminals that employs a diffractive optical element (DOE) instead of a digital projector to project coded patterns. 2) We propose a one-dimensional SL pattern generation method that is successfully etched onto a DOE. 3) In contrast to traditional image processing techniques, all crucial steps in the pattern decoding process, such as corner detection and block recognition, are executed using deep learning methods, ensuring heightened robustness in real-world applications. The experimental results verify the effectiveness of the proposed method.\",\"PeriodicalId\":505134,\"journal\":{\"name\":\"2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)\",\"volume\":\"22 1\",\"pages\":\"1-6\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-12-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ROBIO58561.2023.10354776\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ROBIO58561.2023.10354776","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
空间结构光(SL)通过投射带有编码信息的图案,可在一次拍摄中实现三维测量。然而,传统的结构光系统通常采用数字光处理投影仪(DLP)将特定的光图案或编码图案投射到被测物体表面。对投影仪的依赖限制了此类结构光系统的微型化潜力,从而阻碍了它们在工业应用中的适用性。本文工作的主要贡献包括1) 我们为智能终端引入了一种新颖实用的深度感知微型解决方案,它采用衍射光学元件(DOE)而不是数字投影仪来投射编码图案。2) 我们提出了一种成功蚀刻到 DOE 上的一维 SL 图案生成方法。3) 与传统的图像处理技术相比,图案解码过程中的所有关键步骤,如角检测和块识别,均采用深度学习方法来执行,从而确保在实际应用中具有更高的鲁棒性。实验结果验证了所提方法的有效性。
DOE-based Structured Light For Robust 3D Reconstruction
Spatial structured light (SL) enables three-dimensional measurements in a single shot by projecting patterns with coded information. However, conventional structured light systems typically employ a digital light processing projector (DLP) to project specific light patterns or coded patterns onto the surface of the object under examination. This reliance on projectors limits the miniaturization potential of such structured light systems, thereby hindering their suitability for industrial applications. The main contributions of the work in this paper include: 1) We introduce a novel and practical depth-aware miniature solution for smart terminals that employs a diffractive optical element (DOE) instead of a digital projector to project coded patterns. 2) We propose a one-dimensional SL pattern generation method that is successfully etched onto a DOE. 3) In contrast to traditional image processing techniques, all crucial steps in the pattern decoding process, such as corner detection and block recognition, are executed using deep learning methods, ensuring heightened robustness in real-world applications. The experimental results verify the effectiveness of the proposed method.