Yichen Fu;Junfeng Fan;Yunkai Ma;Fengshui Jing;Min Tan
{"title":"An Efficient High Dynamic Range Structured Light 3-D Measurement System Based on Adaptive Brightness Control Network","authors":"Yichen Fu;Junfeng Fan;Yunkai Ma;Fengshui Jing;Min Tan","doi":"10.1109/TMECH.2024.3455377","DOIUrl":null,"url":null,"abstract":"Point clouds of reflective objects are often incomplete in fringe projection structured light 3-D measurement. Traditional solutions are always computationally inefficient, whereas the speedy forward propagation of neural networks can overcome this drawback. So, in this article, we propose a novel deep learning method capable of adaptively controlling the projection brightness in specific regions with a high dynamic range for complete point cloud acquisition. First, we describe the structured light system (SLS) and the physical model used. Second, we construct a convolutional neural network (CNN) incorporating physical prior knowledge, which enables full-process high-resolution multichannel image feature extraction and directly outputs pixel-level optimal projection brightness. Meanwhile, we propose a simulated dataset generation method based on stochastic reflectivity together with a network training approach to solve network training difficulties. Further, the robust fringe encoding and decoding methods are presented. Sufficient comparative experiments show that our CNN-based SLS can achieve more accurate brightness adjustment with fewer projections, higher computational efficiency, and applicability.","PeriodicalId":13372,"journal":{"name":"IEEE/ASME Transactions on Mechatronics","volume":"30 4","pages":"2676-2687"},"PeriodicalIF":7.3000,"publicationDate":"2024-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE/ASME Transactions on Mechatronics","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10684420/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Point clouds of reflective objects are often incomplete in fringe projection structured light 3-D measurement. Traditional solutions are always computationally inefficient, whereas the speedy forward propagation of neural networks can overcome this drawback. So, in this article, we propose a novel deep learning method capable of adaptively controlling the projection brightness in specific regions with a high dynamic range for complete point cloud acquisition. First, we describe the structured light system (SLS) and the physical model used. Second, we construct a convolutional neural network (CNN) incorporating physical prior knowledge, which enables full-process high-resolution multichannel image feature extraction and directly outputs pixel-level optimal projection brightness. Meanwhile, we propose a simulated dataset generation method based on stochastic reflectivity together with a network training approach to solve network training difficulties. Further, the robust fringe encoding and decoding methods are presented. Sufficient comparative experiments show that our CNN-based SLS can achieve more accurate brightness adjustment with fewer projections, higher computational efficiency, and applicability.
期刊介绍:
IEEE/ASME Transactions on Mechatronics publishes high quality technical papers on technological advances in mechatronics. A primary purpose of the IEEE/ASME Transactions on Mechatronics is to have an archival publication which encompasses both theory and practice. Papers published in the IEEE/ASME Transactions on Mechatronics disclose significant new knowledge needed to implement intelligent mechatronics systems, from analysis and design through simulation and hardware and software implementation. The Transactions also contains a letters section dedicated to rapid publication of short correspondence items concerning new research results.