{"title":"基于深度强化学习的多工位装配系统物体形状误差校正","authors":"S. Sinha, P. Franciosa, D. Ceglarek","doi":"10.1109/INDIN45523.2021.9557359","DOIUrl":null,"url":null,"abstract":"The paper proposes a novel approach, Object Shape Error Correction (OSEC), to determine corrective action in order to mitigate root cause(s) (RCs) of dimensional and geometric product shape errors. It leverages Deep Deterministic Policy Gradient (DDPG) algorithm to learn optimal process parameters update policies based on high dimensional state estimates of multi-station assembly systems (MAS). These policies can be interpreted in engineering terms as sequential corrective adjustments of process parameters that are necessary to mitigate RCs of product shape errors. The approach has the capability to estimate adjustments of process parameters related to fixturing and joining while simultaneously accounting for (i) RC uncertainty estimation, (ii) Key Performance Indicator (KPI) improvement, (iii) MAS design architecture; and, (iv) MAS inherent stochasticity. In addition, the OSEC methodology leverages a reward function parameterized by user interpretable functional coefficients for optimal tradeoff involving various corrections requirements. Benchmarking using an industrial, automotive cross-member assembly system demonstrates a 40% increase in the effectiveness of corrective actions when compared to current approaches.","PeriodicalId":370921,"journal":{"name":"2021 IEEE 19th International Conference on Industrial Informatics (INDIN)","volume":"15 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-07-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Object Shape Error Correction using Deep Reinforcement Learning for Multi-Station Assembly Systems\",\"authors\":\"S. Sinha, P. Franciosa, D. Ceglarek\",\"doi\":\"10.1109/INDIN45523.2021.9557359\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The paper proposes a novel approach, Object Shape Error Correction (OSEC), to determine corrective action in order to mitigate root cause(s) (RCs) of dimensional and geometric product shape errors. It leverages Deep Deterministic Policy Gradient (DDPG) algorithm to learn optimal process parameters update policies based on high dimensional state estimates of multi-station assembly systems (MAS). These policies can be interpreted in engineering terms as sequential corrective adjustments of process parameters that are necessary to mitigate RCs of product shape errors. The approach has the capability to estimate adjustments of process parameters related to fixturing and joining while simultaneously accounting for (i) RC uncertainty estimation, (ii) Key Performance Indicator (KPI) improvement, (iii) MAS design architecture; and, (iv) MAS inherent stochasticity. In addition, the OSEC methodology leverages a reward function parameterized by user interpretable functional coefficients for optimal tradeoff involving various corrections requirements. Benchmarking using an industrial, automotive cross-member assembly system demonstrates a 40% increase in the effectiveness of corrective actions when compared to current approaches.\",\"PeriodicalId\":370921,\"journal\":{\"name\":\"2021 IEEE 19th International Conference on Industrial Informatics (INDIN)\",\"volume\":\"15 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-07-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 IEEE 19th International Conference on Industrial Informatics (INDIN)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/INDIN45523.2021.9557359\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE 19th International Conference on Industrial Informatics (INDIN)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/INDIN45523.2021.9557359","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Object Shape Error Correction using Deep Reinforcement Learning for Multi-Station Assembly Systems
The paper proposes a novel approach, Object Shape Error Correction (OSEC), to determine corrective action in order to mitigate root cause(s) (RCs) of dimensional and geometric product shape errors. It leverages Deep Deterministic Policy Gradient (DDPG) algorithm to learn optimal process parameters update policies based on high dimensional state estimates of multi-station assembly systems (MAS). These policies can be interpreted in engineering terms as sequential corrective adjustments of process parameters that are necessary to mitigate RCs of product shape errors. The approach has the capability to estimate adjustments of process parameters related to fixturing and joining while simultaneously accounting for (i) RC uncertainty estimation, (ii) Key Performance Indicator (KPI) improvement, (iii) MAS design architecture; and, (iv) MAS inherent stochasticity. In addition, the OSEC methodology leverages a reward function parameterized by user interpretable functional coefficients for optimal tradeoff involving various corrections requirements. Benchmarking using an industrial, automotive cross-member assembly system demonstrates a 40% increase in the effectiveness of corrective actions when compared to current approaches.