Jan-Philipp Kaiser , Dominik Koch , Jonas Gäbele , Marvin Carl May , Gisela Lanza
{"title":"利用监督和强化学习方法在再制造视觉检测中进行视图规划","authors":"Jan-Philipp Kaiser , Dominik Koch , Jonas Gäbele , Marvin Carl May , Gisela Lanza","doi":"10.1016/j.cirpj.2024.07.006","DOIUrl":null,"url":null,"abstract":"<div><p>Visual inspection in remanufacturing, despite technological progress, is still mainly performed by humans. A rough assessment of the product’s general condition and the dedicated inspection of individual product features or defects is necessary to identify the typically unknown product variant and assess the reusability of a used product and its components. Therefore, a system for automated visual inspection must be flexible and runtime-adaptive, as defects to be inspected in detail may occur anywhere on the product. In the present work, this problem is framed as a view planning problem solved by means of supervised learning and reinforcement learning using a specially developed simulation environment. Three variants of neural networks (PointNet, PointNet++, and Point Completion Network) are compared in the supervised learning case, whereas a deep learning SAC algorithm using the Point Completion Network as network structure is evaluated in the reinforcement learning case. Considering the specific boundary conditions prevailing in remanufacturing, the results are obtained from the use case of electric starter motor remanufacturing. The results show that supervised learning and reinforcement learning are suitable for determining the poses of an acquisition system at system runtime to react to an initially unknown inspection task. Our proposed framework is available open source under the following: <span><span>https://github.com/Jarrypho/View-Planning-Simulation</span><svg><path></path></svg></span>.</p></div>","PeriodicalId":56011,"journal":{"name":"CIRP Journal of Manufacturing Science and Technology","volume":"53 ","pages":"Pages 128-138"},"PeriodicalIF":4.6000,"publicationDate":"2024-07-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1755581724001159/pdfft?md5=148540d1b66984095ee9873d38d8afae&pid=1-s2.0-S1755581724001159-main.pdf","citationCount":"0","resultStr":"{\"title\":\"View planning in the visual inspection for remanufacturing using supervised- and reinforcement learning approaches\",\"authors\":\"Jan-Philipp Kaiser , Dominik Koch , Jonas Gäbele , Marvin Carl May , Gisela Lanza\",\"doi\":\"10.1016/j.cirpj.2024.07.006\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Visual inspection in remanufacturing, despite technological progress, is still mainly performed by humans. A rough assessment of the product’s general condition and the dedicated inspection of individual product features or defects is necessary to identify the typically unknown product variant and assess the reusability of a used product and its components. Therefore, a system for automated visual inspection must be flexible and runtime-adaptive, as defects to be inspected in detail may occur anywhere on the product. In the present work, this problem is framed as a view planning problem solved by means of supervised learning and reinforcement learning using a specially developed simulation environment. Three variants of neural networks (PointNet, PointNet++, and Point Completion Network) are compared in the supervised learning case, whereas a deep learning SAC algorithm using the Point Completion Network as network structure is evaluated in the reinforcement learning case. Considering the specific boundary conditions prevailing in remanufacturing, the results are obtained from the use case of electric starter motor remanufacturing. The results show that supervised learning and reinforcement learning are suitable for determining the poses of an acquisition system at system runtime to react to an initially unknown inspection task. Our proposed framework is available open source under the following: <span><span>https://github.com/Jarrypho/View-Planning-Simulation</span><svg><path></path></svg></span>.</p></div>\",\"PeriodicalId\":56011,\"journal\":{\"name\":\"CIRP Journal of Manufacturing Science and Technology\",\"volume\":\"53 \",\"pages\":\"Pages 128-138\"},\"PeriodicalIF\":4.6000,\"publicationDate\":\"2024-07-31\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S1755581724001159/pdfft?md5=148540d1b66984095ee9873d38d8afae&pid=1-s2.0-S1755581724001159-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"CIRP Journal of Manufacturing Science and Technology\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1755581724001159\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, MANUFACTURING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"CIRP Journal of Manufacturing Science and Technology","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1755581724001159","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, MANUFACTURING","Score":null,"Total":0}
引用次数: 0
摘要
尽管技术不断进步,但再制造中的目视检测仍主要由人工完成。对产品的总体状况进行粗略评估,并对个别产品特征或缺陷进行专门检查,这对于识别通常未知的产品变体和评估废旧产品及其部件的可再利用性是非常必要的。因此,自动视觉检测系统必须具有灵活性和运行时间适应性,因为需要详细检测的缺陷可能出现在产品的任何位置。在本研究中,这一问题被视为一个视图规划问题,通过使用专门开发的模拟环境进行监督学习和强化学习来解决。在监督学习案例中,对神经网络的三种变体(PointNet、PointNet++ 和 Point Completion Network)进行了比较,而在强化学习案例中,对使用 Point Completion Network 作为网络结构的深度学习 SAC 算法进行了评估。考虑到再制造过程中普遍存在的特定边界条件,研究结果来自起动机再制造的使用案例。结果表明,监督学习和强化学习适用于在系统运行时确定采集系统的姿势,以便对最初未知的检测任务做出反应。我们提出的框架开源如下:https://github.com/Jarrypho/View-Planning-Simulation.
View planning in the visual inspection for remanufacturing using supervised- and reinforcement learning approaches
Visual inspection in remanufacturing, despite technological progress, is still mainly performed by humans. A rough assessment of the product’s general condition and the dedicated inspection of individual product features or defects is necessary to identify the typically unknown product variant and assess the reusability of a used product and its components. Therefore, a system for automated visual inspection must be flexible and runtime-adaptive, as defects to be inspected in detail may occur anywhere on the product. In the present work, this problem is framed as a view planning problem solved by means of supervised learning and reinforcement learning using a specially developed simulation environment. Three variants of neural networks (PointNet, PointNet++, and Point Completion Network) are compared in the supervised learning case, whereas a deep learning SAC algorithm using the Point Completion Network as network structure is evaluated in the reinforcement learning case. Considering the specific boundary conditions prevailing in remanufacturing, the results are obtained from the use case of electric starter motor remanufacturing. The results show that supervised learning and reinforcement learning are suitable for determining the poses of an acquisition system at system runtime to react to an initially unknown inspection task. Our proposed framework is available open source under the following: https://github.com/Jarrypho/View-Planning-Simulation.
期刊介绍:
The CIRP Journal of Manufacturing Science and Technology (CIRP-JMST) publishes fundamental papers on manufacturing processes, production equipment and automation, product design, manufacturing systems and production organisations up to the level of the production networks, including all the related technical, human and economic factors. Preference is given to contributions describing research results whose feasibility has been demonstrated either in a laboratory or in the industrial praxis. Case studies and review papers on specific issues in manufacturing science and technology are equally encouraged.