An Efficient High Dynamic Range Structured Light 3-D Measurement System Based on Adaptive Brightness Control Network

IF 7.3 1区 工程技术 Q1 AUTOMATION & CONTROL SYSTEMS IEEE/ASME Transactions on Mechatronics Pub Date : 2024-09-19 DOI:10.1109/TMECH.2024.3455377
Yichen Fu;Junfeng Fan;Yunkai Ma;Fengshui Jing;Min Tan
{"title":"An Efficient High Dynamic Range Structured Light 3-D Measurement System Based on Adaptive Brightness Control Network","authors":"Yichen Fu;Junfeng Fan;Yunkai Ma;Fengshui Jing;Min Tan","doi":"10.1109/TMECH.2024.3455377","DOIUrl":null,"url":null,"abstract":"Point clouds of reflective objects are often incomplete in fringe projection structured light 3-D measurement. Traditional solutions are always computationally inefficient, whereas the speedy forward propagation of neural networks can overcome this drawback. So, in this article, we propose a novel deep learning method capable of adaptively controlling the projection brightness in specific regions with a high dynamic range for complete point cloud acquisition. First, we describe the structured light system (SLS) and the physical model used. Second, we construct a convolutional neural network (CNN) incorporating physical prior knowledge, which enables full-process high-resolution multichannel image feature extraction and directly outputs pixel-level optimal projection brightness. Meanwhile, we propose a simulated dataset generation method based on stochastic reflectivity together with a network training approach to solve network training difficulties. Further, the robust fringe encoding and decoding methods are presented. Sufficient comparative experiments show that our CNN-based SLS can achieve more accurate brightness adjustment with fewer projections, higher computational efficiency, and applicability.","PeriodicalId":13372,"journal":{"name":"IEEE/ASME Transactions on Mechatronics","volume":"30 4","pages":"2676-2687"},"PeriodicalIF":7.3000,"publicationDate":"2024-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE/ASME Transactions on Mechatronics","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10684420/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

Point clouds of reflective objects are often incomplete in fringe projection structured light 3-D measurement. Traditional solutions are always computationally inefficient, whereas the speedy forward propagation of neural networks can overcome this drawback. So, in this article, we propose a novel deep learning method capable of adaptively controlling the projection brightness in specific regions with a high dynamic range for complete point cloud acquisition. First, we describe the structured light system (SLS) and the physical model used. Second, we construct a convolutional neural network (CNN) incorporating physical prior knowledge, which enables full-process high-resolution multichannel image feature extraction and directly outputs pixel-level optimal projection brightness. Meanwhile, we propose a simulated dataset generation method based on stochastic reflectivity together with a network training approach to solve network training difficulties. Further, the robust fringe encoding and decoding methods are presented. Sufficient comparative experiments show that our CNN-based SLS can achieve more accurate brightness adjustment with fewer projections, higher computational efficiency, and applicability.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于自适应亮度控制网络的高效高动态范围结构光三维测量系统
在条纹投影结构光三维测量中,反射物的点云往往是不完整的。传统的解决方案总是计算效率低下,而神经网络的快速前向传播可以克服这一缺点。因此,在本文中,我们提出了一种新的深度学习方法,能够自适应地控制特定区域的投影亮度,具有高动态范围,以完成点云的获取。首先,我们描述了结构光系统(SLS)和使用的物理模型。其次,我们构建了一个包含物理先验知识的卷积神经网络(CNN),该网络可以实现全过程高分辨率多通道图像特征提取,并直接输出像素级最佳投影亮度。同时,我们提出了一种基于随机反射率的模拟数据集生成方法,并结合网络训练方法来解决网络训练困难。在此基础上,提出了鲁棒条纹编码和解码方法。充分的对比实验表明,基于cnn的SLS可以用更少的投影实现更精确的亮度调节,计算效率更高,适用性更强。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
IEEE/ASME Transactions on Mechatronics
IEEE/ASME Transactions on Mechatronics 工程技术-工程:电子与电气
CiteScore
11.60
自引率
18.80%
发文量
527
审稿时长
7.8 months
期刊介绍: IEEE/ASME Transactions on Mechatronics publishes high quality technical papers on technological advances in mechatronics. A primary purpose of the IEEE/ASME Transactions on Mechatronics is to have an archival publication which encompasses both theory and practice. Papers published in the IEEE/ASME Transactions on Mechatronics disclose significant new knowledge needed to implement intelligent mechatronics systems, from analysis and design through simulation and hardware and software implementation. The Transactions also contains a letters section dedicated to rapid publication of short correspondence items concerning new research results.
期刊最新文献
A Tool Posture Path Optimization Method for Robot-Turntable Surface Milling Process Based on 7-DOF Constant Tool-Tip-Stiffness Radar and Event Camera Fusion for Agile Robot Ego-Motion Estimation An Adaptive Sensor for Detecting Hybrid Defects on Steel Plate With Unknown Thickness Four-in-Three-Out Coupling Serial Spherical Photoelectric Stabilization Platform and Its Adaptive Antidisturbance Control Online Magnetorheological Damping Modulation of a Robotic Tuna for Enhanced Speed and Efficiency
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1