Yichen Fu;Junfeng Fan;Yunkai Ma;Fengshui Jing;Min Tan
{"title":"基于自适应亮度控制网络的高效高动态范围结构光三维测量系统","authors":"Yichen Fu;Junfeng Fan;Yunkai Ma;Fengshui Jing;Min Tan","doi":"10.1109/TMECH.2024.3455377","DOIUrl":null,"url":null,"abstract":"Point clouds of reflective objects are often incomplete in fringe projection structured light 3-D measurement. Traditional solutions are always computationally inefficient, whereas the speedy forward propagation of neural networks can overcome this drawback. So, in this article, we propose a novel deep learning method capable of adaptively controlling the projection brightness in specific regions with a high dynamic range for complete point cloud acquisition. First, we describe the structured light system (SLS) and the physical model used. Second, we construct a convolutional neural network (CNN) incorporating physical prior knowledge, which enables full-process high-resolution multichannel image feature extraction and directly outputs pixel-level optimal projection brightness. Meanwhile, we propose a simulated dataset generation method based on stochastic reflectivity together with a network training approach to solve network training difficulties. Further, the robust fringe encoding and decoding methods are presented. Sufficient comparative experiments show that our CNN-based SLS can achieve more accurate brightness adjustment with fewer projections, higher computational efficiency, and applicability.","PeriodicalId":13372,"journal":{"name":"IEEE/ASME Transactions on Mechatronics","volume":"30 4","pages":"2676-2687"},"PeriodicalIF":7.3000,"publicationDate":"2024-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An Efficient High Dynamic Range Structured Light 3-D Measurement System Based on Adaptive Brightness Control Network\",\"authors\":\"Yichen Fu;Junfeng Fan;Yunkai Ma;Fengshui Jing;Min Tan\",\"doi\":\"10.1109/TMECH.2024.3455377\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Point clouds of reflective objects are often incomplete in fringe projection structured light 3-D measurement. Traditional solutions are always computationally inefficient, whereas the speedy forward propagation of neural networks can overcome this drawback. So, in this article, we propose a novel deep learning method capable of adaptively controlling the projection brightness in specific regions with a high dynamic range for complete point cloud acquisition. First, we describe the structured light system (SLS) and the physical model used. Second, we construct a convolutional neural network (CNN) incorporating physical prior knowledge, which enables full-process high-resolution multichannel image feature extraction and directly outputs pixel-level optimal projection brightness. Meanwhile, we propose a simulated dataset generation method based on stochastic reflectivity together with a network training approach to solve network training difficulties. Further, the robust fringe encoding and decoding methods are presented. Sufficient comparative experiments show that our CNN-based SLS can achieve more accurate brightness adjustment with fewer projections, higher computational efficiency, and applicability.\",\"PeriodicalId\":13372,\"journal\":{\"name\":\"IEEE/ASME Transactions on Mechatronics\",\"volume\":\"30 4\",\"pages\":\"2676-2687\"},\"PeriodicalIF\":7.3000,\"publicationDate\":\"2024-09-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE/ASME Transactions on Mechatronics\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10684420/\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE/ASME Transactions on Mechatronics","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10684420/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
An Efficient High Dynamic Range Structured Light 3-D Measurement System Based on Adaptive Brightness Control Network
Point clouds of reflective objects are often incomplete in fringe projection structured light 3-D measurement. Traditional solutions are always computationally inefficient, whereas the speedy forward propagation of neural networks can overcome this drawback. So, in this article, we propose a novel deep learning method capable of adaptively controlling the projection brightness in specific regions with a high dynamic range for complete point cloud acquisition. First, we describe the structured light system (SLS) and the physical model used. Second, we construct a convolutional neural network (CNN) incorporating physical prior knowledge, which enables full-process high-resolution multichannel image feature extraction and directly outputs pixel-level optimal projection brightness. Meanwhile, we propose a simulated dataset generation method based on stochastic reflectivity together with a network training approach to solve network training difficulties. Further, the robust fringe encoding and decoding methods are presented. Sufficient comparative experiments show that our CNN-based SLS can achieve more accurate brightness adjustment with fewer projections, higher computational efficiency, and applicability.
期刊介绍:
IEEE/ASME Transactions on Mechatronics publishes high quality technical papers on technological advances in mechatronics. A primary purpose of the IEEE/ASME Transactions on Mechatronics is to have an archival publication which encompasses both theory and practice. Papers published in the IEEE/ASME Transactions on Mechatronics disclose significant new knowledge needed to implement intelligent mechatronics systems, from analysis and design through simulation and hardware and software implementation. The Transactions also contains a letters section dedicated to rapid publication of short correspondence items concerning new research results.