利用监督和强化学习方法在再制造视觉检测中进行视图规划

IF 4.6 2区 工程技术 Q2 ENGINEERING, MANUFACTURING CIRP Journal of Manufacturing Science and Technology Pub Date : 2024-07-31 DOI:10.1016/j.cirpj.2024.07.006
Jan-Philipp Kaiser , Dominik Koch , Jonas Gäbele , Marvin Carl May , Gisela Lanza
{"title":"利用监督和强化学习方法在再制造视觉检测中进行视图规划","authors":"Jan-Philipp Kaiser ,&nbsp;Dominik Koch ,&nbsp;Jonas Gäbele ,&nbsp;Marvin Carl May ,&nbsp;Gisela Lanza","doi":"10.1016/j.cirpj.2024.07.006","DOIUrl":null,"url":null,"abstract":"<div><p>Visual inspection in remanufacturing, despite technological progress, is still mainly performed by humans. A rough assessment of the product’s general condition and the dedicated inspection of individual product features or defects is necessary to identify the typically unknown product variant and assess the reusability of a used product and its components. Therefore, a system for automated visual inspection must be flexible and runtime-adaptive, as defects to be inspected in detail may occur anywhere on the product. In the present work, this problem is framed as a view planning problem solved by means of supervised learning and reinforcement learning using a specially developed simulation environment. Three variants of neural networks (PointNet, PointNet++, and Point Completion Network) are compared in the supervised learning case, whereas a deep learning SAC algorithm using the Point Completion Network as network structure is evaluated in the reinforcement learning case. Considering the specific boundary conditions prevailing in remanufacturing, the results are obtained from the use case of electric starter motor remanufacturing. The results show that supervised learning and reinforcement learning are suitable for determining the poses of an acquisition system at system runtime to react to an initially unknown inspection task. Our proposed framework is available open source under the following: <span><span>https://github.com/Jarrypho/View-Planning-Simulation</span><svg><path></path></svg></span>.</p></div>","PeriodicalId":56011,"journal":{"name":"CIRP Journal of Manufacturing Science and Technology","volume":"53 ","pages":"Pages 128-138"},"PeriodicalIF":4.6000,"publicationDate":"2024-07-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1755581724001159/pdfft?md5=148540d1b66984095ee9873d38d8afae&pid=1-s2.0-S1755581724001159-main.pdf","citationCount":"0","resultStr":"{\"title\":\"View planning in the visual inspection for remanufacturing using supervised- and reinforcement learning approaches\",\"authors\":\"Jan-Philipp Kaiser ,&nbsp;Dominik Koch ,&nbsp;Jonas Gäbele ,&nbsp;Marvin Carl May ,&nbsp;Gisela Lanza\",\"doi\":\"10.1016/j.cirpj.2024.07.006\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Visual inspection in remanufacturing, despite technological progress, is still mainly performed by humans. A rough assessment of the product’s general condition and the dedicated inspection of individual product features or defects is necessary to identify the typically unknown product variant and assess the reusability of a used product and its components. Therefore, a system for automated visual inspection must be flexible and runtime-adaptive, as defects to be inspected in detail may occur anywhere on the product. In the present work, this problem is framed as a view planning problem solved by means of supervised learning and reinforcement learning using a specially developed simulation environment. Three variants of neural networks (PointNet, PointNet++, and Point Completion Network) are compared in the supervised learning case, whereas a deep learning SAC algorithm using the Point Completion Network as network structure is evaluated in the reinforcement learning case. Considering the specific boundary conditions prevailing in remanufacturing, the results are obtained from the use case of electric starter motor remanufacturing. The results show that supervised learning and reinforcement learning are suitable for determining the poses of an acquisition system at system runtime to react to an initially unknown inspection task. Our proposed framework is available open source under the following: <span><span>https://github.com/Jarrypho/View-Planning-Simulation</span><svg><path></path></svg></span>.</p></div>\",\"PeriodicalId\":56011,\"journal\":{\"name\":\"CIRP Journal of Manufacturing Science and Technology\",\"volume\":\"53 \",\"pages\":\"Pages 128-138\"},\"PeriodicalIF\":4.6000,\"publicationDate\":\"2024-07-31\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S1755581724001159/pdfft?md5=148540d1b66984095ee9873d38d8afae&pid=1-s2.0-S1755581724001159-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"CIRP Journal of Manufacturing Science and Technology\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1755581724001159\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, MANUFACTURING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"CIRP Journal of Manufacturing Science and Technology","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1755581724001159","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, MANUFACTURING","Score":null,"Total":0}
引用次数: 0

摘要

尽管技术不断进步,但再制造中的目视检测仍主要由人工完成。对产品的总体状况进行粗略评估,并对个别产品特征或缺陷进行专门检查,这对于识别通常未知的产品变体和评估废旧产品及其部件的可再利用性是非常必要的。因此,自动视觉检测系统必须具有灵活性和运行时间适应性,因为需要详细检测的缺陷可能出现在产品的任何位置。在本研究中,这一问题被视为一个视图规划问题,通过使用专门开发的模拟环境进行监督学习和强化学习来解决。在监督学习案例中,对神经网络的三种变体(PointNet、PointNet++ 和 Point Completion Network)进行了比较,而在强化学习案例中,对使用 Point Completion Network 作为网络结构的深度学习 SAC 算法进行了评估。考虑到再制造过程中普遍存在的特定边界条件,研究结果来自起动机再制造的使用案例。结果表明,监督学习和强化学习适用于在系统运行时确定采集系统的姿势,以便对最初未知的检测任务做出反应。我们提出的框架开源如下:https://github.com/Jarrypho/View-Planning-Simulation.
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
View planning in the visual inspection for remanufacturing using supervised- and reinforcement learning approaches

Visual inspection in remanufacturing, despite technological progress, is still mainly performed by humans. A rough assessment of the product’s general condition and the dedicated inspection of individual product features or defects is necessary to identify the typically unknown product variant and assess the reusability of a used product and its components. Therefore, a system for automated visual inspection must be flexible and runtime-adaptive, as defects to be inspected in detail may occur anywhere on the product. In the present work, this problem is framed as a view planning problem solved by means of supervised learning and reinforcement learning using a specially developed simulation environment. Three variants of neural networks (PointNet, PointNet++, and Point Completion Network) are compared in the supervised learning case, whereas a deep learning SAC algorithm using the Point Completion Network as network structure is evaluated in the reinforcement learning case. Considering the specific boundary conditions prevailing in remanufacturing, the results are obtained from the use case of electric starter motor remanufacturing. The results show that supervised learning and reinforcement learning are suitable for determining the poses of an acquisition system at system runtime to react to an initially unknown inspection task. Our proposed framework is available open source under the following: https://github.com/Jarrypho/View-Planning-Simulation.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CIRP Journal of Manufacturing Science and Technology
CIRP Journal of Manufacturing Science and Technology Engineering-Industrial and Manufacturing Engineering
CiteScore
9.10
自引率
6.20%
发文量
166
审稿时长
63 days
期刊介绍: The CIRP Journal of Manufacturing Science and Technology (CIRP-JMST) publishes fundamental papers on manufacturing processes, production equipment and automation, product design, manufacturing systems and production organisations up to the level of the production networks, including all the related technical, human and economic factors. Preference is given to contributions describing research results whose feasibility has been demonstrated either in a laboratory or in the industrial praxis. Case studies and review papers on specific issues in manufacturing science and technology are equally encouraged.
期刊最新文献
Resilience compass navigation through manufacturing organization uncertainty – A dynamic capabilities approach using mixed methods A structured digital twinning approach to improve decision-making in manufacturing SMEs Numerical simulation of molten pool flow behavior in ultrasonic vibration-assisted gas tungsten arc welding of low-alloy high-strength steel Hybrid FE-ML model for turning of 42CrMo4 steel Study on the effect of variable laser power on residual stress distribution in laser directed energy deposition of Ti6Al4V
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1