首页 > 最新文献

Journal of Manufacturing Systems最新文献

英文 中文
A multivariate fusion collision detection method for dynamic operations of human-robot collaboration systems 用于人机协作系统动态运行的多元融合碰撞检测方法
IF 12.2 1区 工程技术 Q1 ENGINEERING, INDUSTRIAL Pub Date : 2024-11-23 DOI: 10.1016/j.jmsy.2024.11.007
Shukai Fang , Shuguang Liu , Xuewen Wang , Jiapeng Zhang , Jingquan Liu , Qiang Ni
Real-time human-robot collision detection is crucial for ensuring the safety of operators during human-robot collaboration(HRC) and for improving the efficiency of such collaboration. It plays an important role in promoting the development of intelligent manufacturing. To address this issue, our team developed a multi-faceted collision detection system using eXtended Reality (XR) technology, specifically designed for complex and dynamic human-robot collaborative operations. The system integrates three different methods: a Virtual Reality (VR) detection method that enables robots to better perceive and detect human operators. An Augmented Reality (AR) detection method that enhances the operator’s perception of the robot. And a fusion detection and evaluation method. This detection and evaluation method assesses the effectiveness of collaboration by analyzing key performance indicators, such as real-time distance between human and robot, changes in the operator’s Heart Rate(HR), and overall task completion time. Through empirical research on the human-robot collaborative assembly task of T-series spiral bevel gear reducers, the effectiveness of the innovative method is verified. The research results show that this method significantly improves safety and operational efficiency, providing a novel solution detection in industrial manufacturing environments.
实时人机碰撞检测对于确保人机协作过程中操作人员的安全以及提高人机协作的效率至关重要。它在促进智能制造的发展方面发挥着重要作用。为了解决这个问题,我们的团队利用扩展现实(XR)技术开发了一种多方位碰撞检测系统,专门用于复杂和动态的人机协作操作。该系统集成了三种不同的方法:一种虚拟现实(VR)检测方法,可使机器人更好地感知和检测人类操作员。增强现实(AR)检测方法,可增强操作员对机器人的感知。以及一种融合检测和评估方法。这种检测和评估方法通过分析关键性能指标来评估协作的有效性,例如人与机器人之间的实时距离、操作员的心率变化以及总体任务完成时间。通过对 T 系列螺旋锥齿轮减速器的人机协作装配任务进行实证研究,验证了创新方法的有效性。研究结果表明,该方法显著提高了安全性和操作效率,为工业制造环境中的检测提供了新颖的解决方案。
{"title":"A multivariate fusion collision detection method for dynamic operations of human-robot collaboration systems","authors":"Shukai Fang ,&nbsp;Shuguang Liu ,&nbsp;Xuewen Wang ,&nbsp;Jiapeng Zhang ,&nbsp;Jingquan Liu ,&nbsp;Qiang Ni","doi":"10.1016/j.jmsy.2024.11.007","DOIUrl":"10.1016/j.jmsy.2024.11.007","url":null,"abstract":"<div><div>Real-time human-robot collision detection is crucial for ensuring the safety of operators during human-robot collaboration(HRC) and for improving the efficiency of such collaboration. It plays an important role in promoting the development of intelligent manufacturing. To address this issue, our team developed a multi-faceted collision detection system using eXtended Reality (XR) technology, specifically designed for complex and dynamic human-robot collaborative operations. The system integrates three different methods: a Virtual Reality (VR) detection method that enables robots to better perceive and detect human operators. An Augmented Reality (AR) detection method that enhances the operator’s perception of the robot. And a fusion detection and evaluation method. This detection and evaluation method assesses the effectiveness of collaboration by analyzing key performance indicators, such as real-time distance between human and robot, changes in the operator’s Heart Rate(HR), and overall task completion time. Through empirical research on the human-robot collaborative assembly task of <em>T</em>-series spiral bevel gear reducers, the effectiveness of the innovative method is verified. The research results show that this method significantly improves safety and operational efficiency, providing a novel solution detection in industrial manufacturing environments.</div></div>","PeriodicalId":16227,"journal":{"name":"Journal of Manufacturing Systems","volume":"78 ","pages":"Pages 26-45"},"PeriodicalIF":12.2,"publicationDate":"2024-11-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142699247","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
From caged robots to high-fives in robotics: Exploring the paradigm shift from human–robot interaction to human–robot teaming in human–machine interfaces 从笼式机器人到机器人击掌:探索人机界面中从人机互动到人机协作的范式转变
IF 12.2 1区 工程技术 Q1 ENGINEERING, INDUSTRIAL Pub Date : 2024-11-23 DOI: 10.1016/j.jmsy.2024.10.015
Filippo Sanfilippo , Muhammad Hamza Zafar , Timothy Wiley , Fabio Zambetta
Multi-modal human–machine interfaces have recently undergone a remarkable transformation, progressing from simple human–robot interaction (HRI) to more advanced human–robot collaboration (HRC) and, ultimately, evolving into the concept of human–robot teaming (HRT). The aim of this work is to delineate a progressive path in this evolving transition. A structured, position-oriented review is proposed. Rather than aiming for an exhaustive survey, our objective is to propose a structured approach in a field that has seen diverse and sometimes divergent definitions of HRI/C/T in the literature. This conceptual review seeks to establish a unified and systematic framework for understanding these paradigms, offering clarity and coherence amidst their evolving complexities. We focus on integrating multiple sensory modalities — such as visual, aural, and tactile inputs — within human–machine interfaces. Central to our approach is a running use case of a warehouse workflow, which illustrates key aspects including modelling, control, communication, and technological integration. Additionally, we investigate recent advancements in machine learning and sensing technologies, emphasising robot perception, human intention recognition, and collaborative task engagement. Current challenges and future directions, including ethical considerations, user acceptance, and the need for explainable systems, are also addressed. By providing a structured pathway from HRI to HRT, this work aims to foster a deeper understanding and facilitate further advancements in human–machine interaction paradigms.
多模式人机界面最近经历了一场引人注目的变革,从简单的人机交互(HRI)发展到更先进的人机协作(HRC),并最终演变成人机协同(HRT)的概念。这项工作的目的是在这一不断发展的转变过程中勾勒出一条渐进的路径。我们提出了一种结构化的、以立场为导向的审查方法。我们的目标不是进行详尽无遗的调查,而是在这个文献中对 HRI/C/T 的定义多种多样、有时甚至是众说纷纭的领域提出一种结构化的方法。本概念综述旨在建立一个统一、系统的框架来理解这些范式,在其不断演变的复杂性中提供清晰性和一致性。我们的重点是在人机界面中整合多种感官模式,如视觉、听觉和触觉输入。我们的方法的核心是一个仓库工作流程的运行用例,它说明了建模、控制、通信和技术集成等关键方面。此外,我们还研究了机器学习和传感技术的最新进展,强调了机器人感知、人类意图识别和协作任务参与。我们还探讨了当前的挑战和未来的发展方向,包括伦理考虑、用户接受度以及对可解释系统的需求。通过提供从人机交互到人机交互技术的结构化途径,这项工作旨在促进对人机交互范例的深入理解,并推动人机交互范例的进一步发展。
{"title":"From caged robots to high-fives in robotics: Exploring the paradigm shift from human–robot interaction to human–robot teaming in human–machine interfaces","authors":"Filippo Sanfilippo ,&nbsp;Muhammad Hamza Zafar ,&nbsp;Timothy Wiley ,&nbsp;Fabio Zambetta","doi":"10.1016/j.jmsy.2024.10.015","DOIUrl":"10.1016/j.jmsy.2024.10.015","url":null,"abstract":"<div><div>Multi-modal human–machine interfaces have recently undergone a remarkable transformation, progressing from simple human–robot interaction (HRI) to more advanced human–robot collaboration (HRC) and, ultimately, evolving into the concept of human–robot teaming (HRT). The aim of this work is to delineate a progressive path in this evolving transition. A structured, position-oriented review is proposed. Rather than aiming for an exhaustive survey, our objective is to propose a structured approach in a field that has seen diverse and sometimes divergent definitions of HRI/C/T in the literature. This conceptual review seeks to establish a unified and systematic framework for understanding these paradigms, offering clarity and coherence amidst their evolving complexities. We focus on integrating multiple sensory modalities — such as visual, aural, and tactile inputs — within human–machine interfaces. Central to our approach is a running use case of a warehouse workflow, which illustrates key aspects including modelling, control, communication, and technological integration. Additionally, we investigate recent advancements in machine learning and sensing technologies, emphasising robot perception, human intention recognition, and collaborative task engagement. Current challenges and future directions, including ethical considerations, user acceptance, and the need for explainable systems, are also addressed. By providing a structured pathway from HRI to HRT, this work aims to foster a deeper understanding and facilitate further advancements in human–machine interaction paradigms.</div></div>","PeriodicalId":16227,"journal":{"name":"Journal of Manufacturing Systems","volume":"78 ","pages":"Pages 1-25"},"PeriodicalIF":12.2,"publicationDate":"2024-11-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142699297","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Handling features in assembly: Integrating manufacturing considerations early in design discussions 在装配中处理特征:在设计讨论中尽早考虑制造因素
IF 12.2 1区 工程技术 Q1 ENGINEERING, INDUSTRIAL Pub Date : 2024-11-22 DOI: 10.1016/j.jmsy.2024.11.012
Nathaly Rea Minango , Mikael Hedlind , Antonio Maffei
The early stages of product design are critical for incorporating manufacturing perspectives. Recognizing the significance of assembly in discrete product manufacturing, the study emphasizes the need to consider the intricacies of assembly early in the design stages. While existing research has addressed assembly features, especially for insertion, this study focuses on handling features, seeking to bridge the gap in their comprehensive representation within the product model. Based on a relational analysis, product characteristics relevant for handling were identified and represented by using a modelling strategy that facilitates their timely addition to the product model. A case study was developed to demonstrate its application. The main contributions of this work comprise an extensive list of product characteristics related to handling processes, a proposal for integrating these characteristics into the product model, and a collaborative way to define product features during product design. Future research directions point to the establishment of a model-based definition for assembly processes, paving the way for enhanced cross-disciplinary communication in the fields of product design and assembly planning.
产品设计的早期阶段对于纳入制造视角至关重要。由于认识到装配在离散产品制造中的重要性,本研究强调有必要在设计阶段尽早考虑装配的复杂性。虽然现有研究已涉及装配功能,特别是插入功能,但本研究侧重于处理功能,力图弥补在产品模型中全面呈现这些功能方面的差距。在关系分析的基础上,确定了与搬运相关的产品特征,并通过建模策略将其及时添加到产品模型中。开发了一个案例研究来演示其应用。这项工作的主要贡献包括:列出了与搬运过程相关的大量产品特征,提出了将这些特征整合到产品模型中的建议,以及在产品设计过程中定义产品特征的协作方式。未来的研究方向是建立基于模型的装配工艺定义,为加强产品设计和装配规划领域的跨学科交流铺平道路。
{"title":"Handling features in assembly: Integrating manufacturing considerations early in design discussions","authors":"Nathaly Rea Minango ,&nbsp;Mikael Hedlind ,&nbsp;Antonio Maffei","doi":"10.1016/j.jmsy.2024.11.012","DOIUrl":"10.1016/j.jmsy.2024.11.012","url":null,"abstract":"<div><div>The early stages of product design are critical for incorporating manufacturing perspectives. Recognizing the significance of assembly in discrete product manufacturing, the study emphasizes the need to consider the intricacies of assembly early in the design stages. While existing research has addressed assembly features, especially for insertion, this study focuses on handling features, seeking to bridge the gap in their comprehensive representation within the product model. Based on a relational analysis, product characteristics relevant for handling were identified and represented by using a modelling strategy that facilitates their timely addition to the product model. A case study was developed to demonstrate its application. The main contributions of this work comprise an extensive list of product characteristics related to handling processes, a proposal for integrating these characteristics into the product model, and a collaborative way to define product features during product design. Future research directions point to the establishment of a model-based definition for assembly processes, paving the way for enhanced cross-disciplinary communication in the fields of product design and assembly planning.</div></div>","PeriodicalId":16227,"journal":{"name":"Journal of Manufacturing Systems","volume":"77 ","pages":"Pages 1077-1100"},"PeriodicalIF":12.2,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142707068","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A new proposal for energy efficiency in industrial manufacturing systems based on machine learning techniques 基于机器学习技术的工业制造系统能效新提案
IF 12.2 1区 工程技术 Q1 ENGINEERING, INDUSTRIAL Pub Date : 2024-11-21 DOI: 10.1016/j.jmsy.2024.10.025
Rômulo César Cunha Lima , Leonardo Adriano Vasconcelos de Oliveira , Suane Pires Pinheiro da Silva , José Daniel de Alencar Santos , Rebeca Gomes Dantas Caetano , Francisco Nélio Costa Freitas , Venício Soares de Oliveira , Andreyson de Freitas Bonifácio , Pedro Pedrosa Rebouças Filho
This research presents a novel methodology for enhancing energy efficiency in industrial manufacturing systems through machine learning techniques. Specifically, the study focuses on the automatic classification of five steel types — ABNT SAE 1020, 1045, 4140, 4340, and VC — based on electrical and mechanical characteristics observed during turning operations. The methodology includes the prediction of energy consumption for these steel types, applying regression models, under various machining conditions, including different rotation speeds and feed rates. To the best of the authors’ knowledge, this study is the first to address this issue using this specific approach. The proposed method was validated through computational experiments using multiple machine learning algorithms, with the Multilayer Perceptron (MLP) neural network achieving the highest classification accuracy of 95.52%. In terms of energy consumption prediction, MLP models demonstrated superior performance in 13 out of 15 turning scenarios. The regression analysis further confirmed the effectiveness of these models, achieving low Root Mean Squared Error (RMSE) values across different configurations. The results indicate that integrating machine learning into machining processes can significantly improve energy efficiency, leading to more sustainable industrial practices.
本研究提出了一种通过机器学习技术提高工业制造系统能效的新方法。具体来说,研究重点是根据车削操作过程中观察到的电气和机械特性,对 ABNT SAE 1020、1045、4140、4340 和 VC 五种钢材类型进行自动分类。该方法包括在各种加工条件(包括不同的转速和进给率)下,应用回归模型对这些钢种的能耗进行预测。据作者所知,这项研究是首次使用这种特定方法来解决这一问题。通过使用多种机器学习算法进行计算实验,验证了所提出的方法,其中多层感知器(MLP)神经网络的分类准确率最高,达到 95.52%。在能耗预测方面,MLP 模型在 15 个转弯场景中的 13 个场景中表现优异。回归分析进一步证实了这些模型的有效性,不同配置下的均方根误差(RMSE)值都很低。结果表明,将机器学习集成到加工过程中可以显著提高能效,从而实现更可持续的工业实践。
{"title":"A new proposal for energy efficiency in industrial manufacturing systems based on machine learning techniques","authors":"Rômulo César Cunha Lima ,&nbsp;Leonardo Adriano Vasconcelos de Oliveira ,&nbsp;Suane Pires Pinheiro da Silva ,&nbsp;José Daniel de Alencar Santos ,&nbsp;Rebeca Gomes Dantas Caetano ,&nbsp;Francisco Nélio Costa Freitas ,&nbsp;Venício Soares de Oliveira ,&nbsp;Andreyson de Freitas Bonifácio ,&nbsp;Pedro Pedrosa Rebouças Filho","doi":"10.1016/j.jmsy.2024.10.025","DOIUrl":"10.1016/j.jmsy.2024.10.025","url":null,"abstract":"<div><div>This research presents a novel methodology for enhancing energy efficiency in industrial manufacturing systems through machine learning techniques. Specifically, the study focuses on the automatic classification of five steel types — ABNT SAE 1020, 1045, 4140, 4340, and VC — based on electrical and mechanical characteristics observed during turning operations. The methodology includes the prediction of energy consumption for these steel types, applying regression models, under various machining conditions, including different rotation speeds and feed rates. To the best of the authors’ knowledge, this study is the first to address this issue using this specific approach. The proposed method was validated through computational experiments using multiple machine learning algorithms, with the Multilayer Perceptron (MLP) neural network achieving the highest classification accuracy of 95.52%. In terms of energy consumption prediction, MLP models demonstrated superior performance in 13 out of 15 turning scenarios. The regression analysis further confirmed the effectiveness of these models, achieving low Root Mean Squared Error (RMSE) values across different configurations. The results indicate that integrating machine learning into machining processes can significantly improve energy efficiency, leading to more sustainable industrial practices.</div></div>","PeriodicalId":16227,"journal":{"name":"Journal of Manufacturing Systems","volume":"77 ","pages":"Pages 1062-1076"},"PeriodicalIF":12.2,"publicationDate":"2024-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142707067","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Digital twin based photogrammetry field-of-view evaluation and 3D layout optimisation for reconfigurable manufacturing systems 基于数字孪生的摄影测量视场评估和可重构制造系统的三维布局优化
IF 12.2 1区 工程技术 Q1 ENGINEERING, INDUSTRIAL Pub Date : 2024-11-20 DOI: 10.1016/j.jmsy.2024.11.001
Zi Wang , Likun Wang , Giovanna Martínez-Arellano , Joseph Griffin , David Sanderson , Svetan Ratchev
Photogrammetry is extensively used in manufacturing processes due to its non-contact nature and rapid data acquisition. Positioning photogrammetry cameras requires knowledge of the manufacturing process and time in manual field-of-view (FoV) adjustment. Such a lengthy and labour-intensive process is not suitable for modern manufacturing systems, where automation, robotics and dynamic reconfigurable layout are used to shorten production time and adapt to demand changes. Hence, there exists the need for a fast layout planning approach ensuring manufacturing process feasibility and maximising camera FoV effectiveness. This paper introduces a digital twin based FoV evaluation method and a computationally efficient 3D layout optimisation framework for reconfigurable manufacturing systems. The framework computes optimal layout for photogrammetry cameras and the object of interest (OOI). The automated nature of the proposed framework can speed up planning processes and shorten dynamic system commissioning time. At a technical level, the framework takes advantage of a 3D digital twin, and uses point clouds to represent the camera FoV. Iterative Closest Point (ICP) registration and K-Dimensional Tree (KDTree) intersection techniques are applied to calculate OOI visibility and target coverage ratio. Experimental validation attested to a digital-physical similarity exceeding 93%, indicating a high level of fidelity and the feasibility of station-level 3D layout design in digital twin environments. Feeding into the 3D layout planning, the optimisation framework considers robot reachability, FoV effectiveness, and estimated uncertainty. Given characteristics of the objective function, genetic algorithm, simulated annealing, and Bayesian optimisation were evaluated within a computational budget (100 function calls). The optimised results are compared against a baseline best obtained through brute force grid search. All tested algorithms achieved results within 98% of the grid search’s best solution within 5 min. Genetic algorithm and simulated annealing outperformed the baseline best by 0.16% and 0.25% respectively for OOI visibility, and Bayesian optimisation exceeded the baseline best by 0.12% for target coverage. These findings emphasise the feasibility of the proposed approach and the efficiency of the overall framework, highlighting its applicability across various development stages from design to execution in a dynamic manufacturing environment.
由于摄影测量具有非接触性和快速数据采集的特点,因此在制造过程中得到了广泛应用。摄影测量相机的定位需要了解制造流程并花费时间进行手动视场(FoV)调整。这种冗长的劳动密集型流程不适合现代制造系统,因为现代制造系统采用自动化、机器人和动态可重构布局来缩短生产时间和适应需求变化。因此,我们需要一种快速的布局规划方法,以确保制造流程的可行性,并最大限度地提高相机的 FoV 效能。本文介绍了一种基于数字孪生的 FoV 评估方法,以及一种用于可重构制造系统的计算高效的 3D 布局优化框架。该框架可计算摄影测量相机和关注对象(OOI)的最佳布局。拟议框架的自动化特性可加快规划流程,缩短动态系统调试时间。在技术层面上,该框架利用了三维数字孪生的优势,并使用点云来表示相机的视场角(FoV)。应用迭代最邻近点(ICP)注册和 K 维树(KDTree)交叉技术来计算 OOI 可见度和目标覆盖率。实验验证证明,数字-物理相似度超过 93%,表明在数字孪生环境中进行车站级三维布局设计具有很高的保真度和可行性。在三维布局规划中,优化框架考虑了机器人可达性、FoV 有效性和估计的不确定性。考虑到目标函数的特点,在计算预算(100 次函数调用)范围内对遗传算法、模拟退火和贝叶斯优化进行了评估。优化结果与通过蛮力网格搜索获得的基准最佳结果进行了比较。所有测试算法都在 5 分钟内获得了网格搜索最佳解决方案的 98% 以内的结果。在 OOI 可见度方面,遗传算法和模拟退火分别比基准最佳方案高出 0.16% 和 0.25%;在目标覆盖范围方面,贝叶斯优化比基准最佳方案高出 0.12%。这些发现强调了建议方法的可行性和整体框架的效率,突出了其在动态制造环境中从设计到执行的各个开发阶段的适用性。
{"title":"Digital twin based photogrammetry field-of-view evaluation and 3D layout optimisation for reconfigurable manufacturing systems","authors":"Zi Wang ,&nbsp;Likun Wang ,&nbsp;Giovanna Martínez-Arellano ,&nbsp;Joseph Griffin ,&nbsp;David Sanderson ,&nbsp;Svetan Ratchev","doi":"10.1016/j.jmsy.2024.11.001","DOIUrl":"10.1016/j.jmsy.2024.11.001","url":null,"abstract":"<div><div>Photogrammetry is extensively used in manufacturing processes due to its non-contact nature and rapid data acquisition. Positioning photogrammetry cameras requires knowledge of the manufacturing process and time in manual field-of-view (FoV) adjustment. Such a lengthy and labour-intensive process is not suitable for modern manufacturing systems, where automation, robotics and dynamic reconfigurable layout are used to shorten production time and adapt to demand changes. Hence, there exists the need for a fast layout planning approach ensuring manufacturing process feasibility and maximising camera FoV effectiveness. This paper introduces a digital twin based FoV evaluation method and a computationally efficient 3D layout optimisation framework for reconfigurable manufacturing systems. The framework computes optimal layout for photogrammetry cameras and the object of interest (OOI). The automated nature of the proposed framework can speed up planning processes and shorten dynamic system commissioning time. At a technical level, the framework takes advantage of a 3D digital twin, and uses point clouds to represent the camera FoV. Iterative Closest Point (ICP) registration and K-Dimensional Tree (KDTree) intersection techniques are applied to calculate OOI visibility and target coverage ratio. Experimental validation attested to a digital-physical similarity exceeding 93%, indicating a high level of fidelity and the feasibility of station-level 3D layout design in digital twin environments. Feeding into the 3D layout planning, the optimisation framework considers robot reachability, FoV effectiveness, and estimated uncertainty. Given characteristics of the objective function, genetic algorithm, simulated annealing, and Bayesian optimisation were evaluated within a computational budget (100 function calls). The optimised results are compared against a baseline best obtained through brute force grid search. All tested algorithms achieved results within 98% of the grid search’s best solution within 5 min. Genetic algorithm and simulated annealing outperformed the baseline best by 0.16% and 0.25% respectively for OOI visibility, and Bayesian optimisation exceeded the baseline best by 0.12% for target coverage. These findings emphasise the feasibility of the proposed approach and the efficiency of the overall framework, highlighting its applicability across various development stages from design to execution in a dynamic manufacturing environment.</div></div>","PeriodicalId":16227,"journal":{"name":"Journal of Manufacturing Systems","volume":"77 ","pages":"Pages 1045-1061"},"PeriodicalIF":12.2,"publicationDate":"2024-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142707066","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Ontology and production rules-based dynamic knowledge base construction methodology for machining process 基于本体和生产规则的机械加工工艺动态知识库构建方法
IF 12.2 1区 工程技术 Q1 ENGINEERING, INDUSTRIAL Pub Date : 2024-11-19 DOI: 10.1016/j.jmsy.2024.11.006
Longxue Guo , Tianliang Hu , Lili Dong , Songhua Ma
With advancements in manufacturing, knowledge engineering has become important in supporting intelligent decision-making within manufacturing systems. However, existing process knowledge bases, integral to knowledge engineering, and essential for machining efficiency, product cost, and production cycles by integrating multi-source knowledge, are limited to generality, scalability, and adaptability to real production environments. These constraints undermine the application and reliability of process knowledge bases in decision-making. To overcome these challenges, an approach to constructing a dynamic machining process knowledge base (DMPKB) utilizing ontology and production rules is proposed. Firstly, a machining process knowledge model is developed by reorganizing concepts and relations to restructure process cases and experiences, thereby building a comprehensive knowledge base. Secondly, different update strategies are devised to fulfill the requirements of various components within the knowledge base. Finally, the effectiveness is validated by constructing a DMPKB for CNC boring machine bearing seats. Meanwhile, application verification is performed by generating process plans for a CNC boring machine bearing seat, showcasing the feasibility and utility of the developed knowledge base.
随着制造业的发展,知识工程已成为支持制造系统内智能决策的重要手段。然而,现有的工艺知识库在通用性、可扩展性和对实际生产环境的适应性方面受到限制,而工艺知识库是知识工程不可或缺的一部分,并且通过整合多源知识对加工效率、产品成本和生产周期至关重要。这些限制削弱了工艺知识库在决策中的应用和可靠性。为了克服这些挑战,本文提出了一种利用本体和生产规则构建动态机械加工工艺知识库(DMPKB)的方法。首先,通过重组概念和关系来建立机械加工工艺知识模型,重组工艺案例和经验,从而建立一个全面的知识库。其次,设计了不同的更新策略,以满足知识库中各个组成部分的要求。最后,通过构建数控镗床轴承座的 DMPKB 验证了其有效性。同时,通过生成数控镗床轴承座的工艺计划进行了应用验证,展示了所开发知识库的可行性和实用性。
{"title":"Ontology and production rules-based dynamic knowledge base construction methodology for machining process","authors":"Longxue Guo ,&nbsp;Tianliang Hu ,&nbsp;Lili Dong ,&nbsp;Songhua Ma","doi":"10.1016/j.jmsy.2024.11.006","DOIUrl":"10.1016/j.jmsy.2024.11.006","url":null,"abstract":"<div><div>With advancements in manufacturing, knowledge engineering has become important in supporting intelligent decision-making within manufacturing systems. However, existing process knowledge bases, integral to knowledge engineering, and essential for machining efficiency, product cost, and production cycles by integrating multi-source knowledge, are limited to generality, scalability, and adaptability to real production environments. These constraints undermine the application and reliability of process knowledge bases in decision-making. To overcome these challenges, an approach to constructing a dynamic machining process knowledge base (DMPKB) utilizing ontology and production rules is proposed. Firstly, a machining process knowledge model is developed by reorganizing concepts and relations to restructure process cases and experiences, thereby building a comprehensive knowledge base. Secondly, different update strategies are devised to fulfill the requirements of various components within the knowledge base. Finally, the effectiveness is validated by constructing a DMPKB for CNC boring machine bearing seats. Meanwhile, application verification is performed by generating process plans for a CNC boring machine bearing seat, showcasing the feasibility and utility of the developed knowledge base.</div></div>","PeriodicalId":16227,"journal":{"name":"Journal of Manufacturing Systems","volume":"77 ","pages":"Pages 1027-1044"},"PeriodicalIF":12.2,"publicationDate":"2024-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142707065","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
AdaBoost-inspired co-evolution differential evolution for reconfigurable flexible job shop scheduling considering order splitting 考虑订单分割的可重构灵活作业车间调度的 AdaBoost启发协同进化差分进化论
IF 12.2 1区 工程技术 Q1 ENGINEERING, INDUSTRIAL Pub Date : 2024-11-16 DOI: 10.1016/j.jmsy.2024.11.003
Lixin Cheng , Shujun Yu , Qiuhua Tang , Liping Zhang , Zikai Zhang
With the increasing demand for personalized and diversified products, manufacturing industries are in urgent need of taking measures to reduce the differences among products and enhance flexibility and reconfigurability so as to accommodate these personalized and diversified products. Consequently, this research focuses on the reconfigurable flexible job shop scheduling problem with order splitting taken into consideration. A mixed-integer linear programming model is proposed with the aim of minimizing tardiness costs, reconfiguration costs and energy costs. To solve this problem efficiently, a co-evolution differential evolution algorithm is developed, which is enhanced by an AdaBoost-inspired multiple mutation strategies ensemble mechanism (AMMSE), an AdaBoost-inspired adaptive crossover mechanism (AAC), rule-based initialization, and variable neighborhood search. Among them, AMMSE can effectively ensemble the advantages of different mutation strategies by adaptively selecting a proper number of chromosomes to train mutation strategies with different performance weights. AAC can adaptively control the crossover rate of each gene by evaluating the average importance score of each gene based on the performance weight distribution of chromosomes. Experimental results demonstrate that combining the above improvements can significantly boost the performance of the differential evolution algorithm. As a result, the enhanced algorithm outperforms other state-of-the-art algorithms by a large margin. By using the enhanced algorithm to solve the studied problem, nearly 1.1 times of production costs can be saved.
随着个性化和多样化产品需求的不断增加,制造业迫切需要采取措施减少产品之间的差异,提高灵活性和可重构性,以适应这些个性化和多样化产品的需求。因此,本研究将重点放在考虑订单分割的可重构柔性作业车间调度问题上。本文提出了一个混合整数线性规划模型,目的是最大限度地降低延迟成本、重新配置成本和能源成本。为有效解决该问题,开发了一种协同进化差分进化算法,并通过 AdaBoost 启发的多重突变策略集合机制(AMMSE)、AdaBoost 启发的自适应交叉机制(AAC)、基于规则的初始化和变量邻域搜索对该算法进行了增强。其中,AMMSE 可通过自适应选择适当数量的染色体来训练具有不同性能权重的突变策略,从而有效集合不同突变策略的优势。AAC 可以根据染色体的性能权重分布,通过评估每个基因的平均重要性得分,自适应地控制每个基因的交叉率。实验结果表明,结合上述改进措施可以显著提高差分进化算法的性能。因此,增强算法的性能大大优于其他最先进的算法。使用增强算法解决所研究的问题,可节省近 1.1 倍的生产成本。
{"title":"AdaBoost-inspired co-evolution differential evolution for reconfigurable flexible job shop scheduling considering order splitting","authors":"Lixin Cheng ,&nbsp;Shujun Yu ,&nbsp;Qiuhua Tang ,&nbsp;Liping Zhang ,&nbsp;Zikai Zhang","doi":"10.1016/j.jmsy.2024.11.003","DOIUrl":"10.1016/j.jmsy.2024.11.003","url":null,"abstract":"<div><div>With the increasing demand for personalized and diversified products, manufacturing industries are in urgent need of taking measures to reduce the differences among products and enhance flexibility and reconfigurability so as to accommodate these personalized and diversified products. Consequently, this research focuses on the reconfigurable flexible job shop scheduling problem with order splitting taken into consideration. A mixed-integer linear programming model is proposed with the aim of minimizing tardiness costs, reconfiguration costs and energy costs. To solve this problem efficiently, a co-evolution differential evolution algorithm is developed, which is enhanced by an AdaBoost-inspired multiple mutation strategies ensemble mechanism (AMMSE), an AdaBoost-inspired adaptive crossover mechanism (AAC), rule-based initialization, and variable neighborhood search. Among them, AMMSE can effectively ensemble the advantages of different mutation strategies by adaptively selecting a proper number of chromosomes to train mutation strategies with different performance weights. AAC can adaptively control the crossover rate of each gene by evaluating the average importance score of each gene based on the performance weight distribution of chromosomes. Experimental results demonstrate that combining the above improvements can significantly boost the performance of the differential evolution algorithm. As a result, the enhanced algorithm outperforms other state-of-the-art algorithms by a large margin. By using the enhanced algorithm to solve the studied problem, nearly 1.1 times of production costs can be saved.</div></div>","PeriodicalId":16227,"journal":{"name":"Journal of Manufacturing Systems","volume":"77 ","pages":"Pages 1009-1026"},"PeriodicalIF":12.2,"publicationDate":"2024-11-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142663843","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An improved non-dominated sorting genetic algorithm II for distributed heterogeneous hybrid flow-shop scheduling with blocking constraints 用于具有阻塞约束的分布式异构混合流-车间调度的改进型非支配排序遗传算法 II
IF 12.2 1区 工程技术 Q1 ENGINEERING, INDUSTRIAL Pub Date : 2024-11-14 DOI: 10.1016/j.jmsy.2024.10.018
Xueyan Sun , Weiming Shen , Jiaxin Fan , Birgit Vogel-Heuser , Chunjiang Zhang
Distributed manufacturing is a new trend to accommodate the economic globalization, which means multiple geographically-distributed factories can collaborate to meet urgent delivery requirements. However, such factories may vary due to layout adjustments and equipment aging, thus the production efficiency greatly depends on the allocation of orders. This scenario is frequently found in energy-intensive process industries, e.g., chemical and pharmaceutical and industries, where the lack of buffers usually results in extra non-blocking constraints and makes the production scheduling even harder. Therefore, this paper investigates a distributed heterogeneous hybrid blocking flow-shop scheduling problem (DHHBFSP) for minimizing the makespan and total energy consumption simultaneously, and proposes an improved non-dominated sorting genetic algorithm II (INSGA-II) to address the problem. First, two heuristic algorithms, i.e., bi-objective considered heuristic (BCH) and similarity heuristic (SH), are developed for the population initialization. Then, to speed-up the local search, a comparison method for non-dominated solutions is proposed to reserve more solutions that are likely to be further improved. Afterwards, a probabilistic model is developed to eliminate unnecessary operations during local search processes. Finally, the proposed INSGA-II is tested on benchmark instances and a real-world case for the validation. Numerical experiments suggest that the SH can generates high-quality solutions within a very short period of time, and the BCH has significantly improved average IGD and HV values for the initial population. Besides, the probabilistic model saves considerable computational time for the local search without compromising the solution quality. With the help of these strategies, the proposed INSGA-II improves average IGD and HV values by 68 % and 57 % for the basic NSGA-II respectively, and obtains better Pareto fronts compared to existing multi-objective algorithms on the majority of test instances. Moreover, the industrial case study shows that the proposed INSGA-II is capable of providing solid scheduling plans for a pharmaceutical enterprise with large-scale orders.
分布式生产是适应经济全球化的新趋势,这意味着多个地理位置分散的工厂可以协同合作,满足紧急交货要求。然而,这些工厂可能会因布局调整和设备老化而各不相同,因此生产效率在很大程度上取决于订单的分配。这种情况经常出现在能源密集型流程工业中,例如化工、制药和工业,在这些行业中,缓冲区的缺乏通常会导致额外的非阻塞约束,使生产调度变得更加困难。因此,本文研究了分布式异构混合阻塞流车间调度问题(DHHBFSP),以同时最小化生产进度和总能耗,并提出了一种改进的非支配排序遗传算法 II(INSGA-II)来解决该问题。首先,为种群初始化开发了两种启发式算法,即双目标考虑启发式(BCH)和相似性启发式(SH)。然后,为了加速局部搜索,提出了一种非主导解的比较方法,以保留更多可能进一步改进的解。然后,开发了一个概率模型,以消除局部搜索过程中不必要的操作。最后,提出的 INSGA-II 在基准实例和实际案例中进行了验证测试。数值实验表明,SH 可以在很短的时间内生成高质量的解,而 BCH 则显著提高了初始群体的平均 IGD 值和 HV 值。此外,概率模型还能在不影响解质量的前提下为局部搜索节省大量计算时间。在这些策略的帮助下,所提出的 INSGA-II 与基本 NSGA-II 相比,平均 IGD 值和 HV 值分别提高了 68% 和 57%,与现有的多目标算法相比,在大多数测试实例上都能获得更好的帕累托前沿。此外,工业案例研究表明,所提出的 INSGA-II 能够为具有大规模订单的制药企业提供可靠的调度计划。
{"title":"An improved non-dominated sorting genetic algorithm II for distributed heterogeneous hybrid flow-shop scheduling with blocking constraints","authors":"Xueyan Sun ,&nbsp;Weiming Shen ,&nbsp;Jiaxin Fan ,&nbsp;Birgit Vogel-Heuser ,&nbsp;Chunjiang Zhang","doi":"10.1016/j.jmsy.2024.10.018","DOIUrl":"10.1016/j.jmsy.2024.10.018","url":null,"abstract":"<div><div>Distributed manufacturing is a new trend to accommodate the economic globalization, which means multiple geographically-distributed factories can collaborate to meet urgent delivery requirements. However, such factories may vary due to layout adjustments and equipment aging, thus the production efficiency greatly depends on the allocation of orders. This scenario is frequently found in energy-intensive process industries, e.g., chemical and pharmaceutical and industries, where the lack of buffers usually results in extra non-blocking constraints and makes the production scheduling even harder. Therefore, this paper investigates a distributed heterogeneous hybrid blocking flow-shop scheduling problem (DHHBFSP) for minimizing the makespan and total energy consumption simultaneously, and proposes an improved non-dominated sorting genetic algorithm II (INSGA-II) to address the problem. First, two heuristic algorithms, i.e., bi-objective considered heuristic (BCH) and similarity heuristic (SH), are developed for the population initialization. Then, to speed-up the local search, a comparison method for non-dominated solutions is proposed to reserve more solutions that are likely to be further improved. Afterwards, a probabilistic model is developed to eliminate unnecessary operations during local search processes. Finally, the proposed INSGA-II is tested on benchmark instances and a real-world case for the validation. Numerical experiments suggest that the SH can generates high-quality solutions within a very short period of time, and the BCH has significantly improved average IGD and HV values for the initial population. Besides, the probabilistic model saves considerable computational time for the local search without compromising the solution quality. With the help of these strategies, the proposed INSGA-II improves average IGD and HV values by 68 % and 57 % for the basic NSGA-II respectively, and obtains better Pareto fronts compared to existing multi-objective algorithms on the majority of test instances. Moreover, the industrial case study shows that the proposed INSGA-II is capable of providing solid scheduling plans for a pharmaceutical enterprise with large-scale orders.</div></div>","PeriodicalId":16227,"journal":{"name":"Journal of Manufacturing Systems","volume":"77 ","pages":"Pages 990-1008"},"PeriodicalIF":12.2,"publicationDate":"2024-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142663844","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Deep reinforcement learning-based dynamic scheduling for resilient and sustainable manufacturing: A systematic review 基于深度强化学习的动态调度,实现弹性和可持续制造:系统综述
IF 12.2 1区 工程技术 Q1 ENGINEERING, INDUSTRIAL Pub Date : 2024-11-13 DOI: 10.1016/j.jmsy.2024.10.026
Chao Zhang , Max Juraschek , Christoph Herrmann
Dynamic scheduling plays a pivotal role in smart manufacturing by enabling real-time adjustments to production schedules, thereby enhancing system resilience and promoting sustainability. By efficiently responding to disruptions, dynamic scheduling maintains productivity and stability, while also reducing resource consumption and environmental impact through optimized operations and the potential integration of renewable energy. Deep Reinforcement Learning (DRL), a cutting-edge artificial intelligence technique, shows promise in tackling the complexities of production scheduling, particularly in solving NP-hard combinatorial optimization problems. Despite its potential, a comprehensive study of DRL's impact on dynamic scheduling, especially regarding system resilience and sustainability, has been lacking. This paper addresses this gap by presenting a systematic review of DRL-based dynamic scheduling focusing on resilience and sustainability. Through an analysis of two decades of literature, key application scenarios of DRL in dynamic scheduling are examined, and specific indicators are defined to assess the resilience and sustainability of these systems. The findings demonstrate DRL's effectiveness across various production domains, surpassing traditional rule-based and metaheuristic algorithms, particularly in enhancing resilience. However, a significant gap remains in addressing sustainability aspects such as energy flexibility, resource utilization, and human-centric social impacts. This paper also explores current technical challenges, including multi-objective and multi-agent optimization, and proposes future research directions to better integrate resilience and sustainability in DRL-based dynamic scheduling, with an emphasis on real-world application.
动态调度在智能制造中发挥着关键作用,它能够对生产计划进行实时调整,从而增强系统的弹性并促进可持续发展。通过对中断做出有效响应,动态调度可以保持生产率和稳定性,同时还能通过优化操作和潜在的可再生能源整合来减少资源消耗和环境影响。深度强化学习(DRL)是一种前沿的人工智能技术,有望解决生产调度的复杂性,尤其是在解决 NP 难度的组合优化问题方面。尽管 DRL 潜力巨大,但对 DRL 对动态调度的影响,尤其是对系统弹性和可持续性的影响,一直缺乏全面的研究。本文针对这一空白,对基于 DRL 的动态调度进行了系统性综述,重点关注其弹性和可持续性。通过分析二十年来的文献,研究了 DRL 在动态调度中的主要应用场景,并定义了评估这些系统的弹性和可持续性的具体指标。研究结果表明,DRL 在各种生产领域都很有效,超越了传统的基于规则的算法和元启发式算法,尤其是在增强复原力方面。然而,在解决能源灵活性、资源利用和以人为本的社会影响等可持续性问题方面仍存在巨大差距。本文还探讨了当前的技术挑战,包括多目标和多代理优化,并提出了未来的研究方向,以便在基于 DRL 的动态调度中更好地整合复原力和可持续性,重点关注现实世界的应用。
{"title":"Deep reinforcement learning-based dynamic scheduling for resilient and sustainable manufacturing: A systematic review","authors":"Chao Zhang ,&nbsp;Max Juraschek ,&nbsp;Christoph Herrmann","doi":"10.1016/j.jmsy.2024.10.026","DOIUrl":"10.1016/j.jmsy.2024.10.026","url":null,"abstract":"<div><div>Dynamic scheduling plays a pivotal role in smart manufacturing by enabling real-time adjustments to production schedules, thereby enhancing system resilience and promoting sustainability. By efficiently responding to disruptions, dynamic scheduling maintains productivity and stability, while also reducing resource consumption and environmental impact through optimized operations and the potential integration of renewable energy. Deep Reinforcement Learning (DRL), a cutting-edge artificial intelligence technique, shows promise in tackling the complexities of production scheduling, particularly in solving NP-hard combinatorial optimization problems. Despite its potential, a comprehensive study of DRL's impact on dynamic scheduling, especially regarding system resilience and sustainability, has been lacking. This paper addresses this gap by presenting a systematic review of DRL-based dynamic scheduling focusing on resilience and sustainability. Through an analysis of two decades of literature, key application scenarios of DRL in dynamic scheduling are examined, and specific indicators are defined to assess the resilience and sustainability of these systems. The findings demonstrate DRL's effectiveness across various production domains, surpassing traditional rule-based and metaheuristic algorithms, particularly in enhancing resilience. However, a significant gap remains in addressing sustainability aspects such as energy flexibility, resource utilization, and human-centric social impacts. This paper also explores current technical challenges, including multi-objective and multi-agent optimization, and proposes future research directions to better integrate resilience and sustainability in DRL-based dynamic scheduling, with an emphasis on real-world application.</div></div>","PeriodicalId":16227,"journal":{"name":"Journal of Manufacturing Systems","volume":"77 ","pages":"Pages 962-989"},"PeriodicalIF":12.2,"publicationDate":"2024-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142663811","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Generative deep reinforcement learning method for dynamic parallel machines scheduling with adaptive maintenance activities 针对具有自适应维护活动的动态并行机器调度的生成性深度强化学习方法
IF 12.2 1区 工程技术 Q1 ENGINEERING, INDUSTRIAL Pub Date : 2024-11-12 DOI: 10.1016/j.jmsy.2024.11.004
Ming Wang , Jie Zhang , Peng Zhang , Wenbin Xiang , Mengyu Jin , Hongsen Li
In the process industries, where orders arrive at irregular intervals, inappropriate maintenance frequency often leads to unplanned shutdowns of high-speed parallel machines, resulting in unnecessary material consumption and a significant decline in the performance of the dynamic parallel machines scheduling. To address this issue, this paper proposes a generative deep reinforcement learning method that investigates the dynamic parallel machines scheduling problems with adaptive maintenance activities. Specifically, an enhanced Double DQN algorithm is proposed to schedule the dynamically arriving orders and maintenance activities, aiming to maximize average reliability while minimize the production costs. Additionally, a global exploration strategy is incorporated to enhance the scheduling and maintenance agent's global exploration capability, particularly in complex solution spaces with conflicting objectives. Furthermore, recognizing the difficulty of accurately capturing crucial scheduling and maintenance attributes within a predefined state space in a time-varying production environment, a guided Actor-Critic algorithm is introduced to autonomously generate the state space. Moreover, to tackle the unstable learning process caused by sparse rewards, a self-imitation learning is employed to guide the state space generation agent toward achieving rapid learning and convergence. Finally, simulation experiments validate that the proposed method not only autonomously enables state space generation but also exhibits superior performance for the investigated problem.
在订单不定时到达的流程工业中,不恰当的维护频率往往会导致高速并联机器的意外停机,从而造成不必要的材料消耗和动态并联机器调度性能的显著下降。针对这一问题,本文提出了一种生成式深度强化学习方法,用于研究具有自适应维护活动的动态并行机调度问题。具体来说,本文提出了一种增强型双 DQN 算法来调度动态到达的订单和维护活动,旨在最大化平均可靠性,同时最小化生产成本。此外,该算法还采用了全局探索策略,以增强调度和维护代理的全局探索能力,尤其是在目标相互冲突的复杂求解空间中。此外,考虑到在时变的生产环境中很难在预定义的状态空间内准确捕捉到关键的调度和维护属性,因此引入了一种引导式行动者批判算法来自主生成状态空间。此外,为了解决奖励稀疏导致学习过程不稳定的问题,还采用了自我模仿学习法来引导状态空间生成代理实现快速学习和收敛。最后,模拟实验验证了所提出的方法不仅能自主生成状态空间,而且在所研究的问题上表现出卓越的性能。
{"title":"Generative deep reinforcement learning method for dynamic parallel machines scheduling with adaptive maintenance activities","authors":"Ming Wang ,&nbsp;Jie Zhang ,&nbsp;Peng Zhang ,&nbsp;Wenbin Xiang ,&nbsp;Mengyu Jin ,&nbsp;Hongsen Li","doi":"10.1016/j.jmsy.2024.11.004","DOIUrl":"10.1016/j.jmsy.2024.11.004","url":null,"abstract":"<div><div>In the process industries, where orders arrive at irregular intervals, inappropriate maintenance frequency often leads to unplanned shutdowns of high-speed parallel machines, resulting in unnecessary material consumption and a significant decline in the performance of the dynamic parallel machines scheduling. To address this issue, this paper proposes a generative deep reinforcement learning method that investigates the dynamic parallel machines scheduling problems with adaptive maintenance activities. Specifically, an enhanced Double DQN algorithm is proposed to schedule the dynamically arriving orders and maintenance activities, aiming to maximize average reliability while minimize the production costs. Additionally, a global exploration strategy is incorporated to enhance the scheduling and maintenance agent's global exploration capability, particularly in complex solution spaces with conflicting objectives. Furthermore, recognizing the difficulty of accurately capturing crucial scheduling and maintenance attributes within a predefined state space in a time-varying production environment, a guided Actor-Critic algorithm is introduced to autonomously generate the state space. Moreover, to tackle the unstable learning process caused by sparse rewards, a self-imitation learning is employed to guide the state space generation agent toward achieving rapid learning and convergence. Finally, simulation experiments validate that the proposed method not only autonomously enables state space generation but also exhibits superior performance for the investigated problem.</div></div>","PeriodicalId":16227,"journal":{"name":"Journal of Manufacturing Systems","volume":"77 ","pages":"Pages 946-961"},"PeriodicalIF":12.2,"publicationDate":"2024-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142663842","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of Manufacturing Systems
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1