Background: Intelligent monitoring of human action in production is an important step to help standardize production processes and construct a digital twin shop-floor rapidly. Human action has a significant impact on the production safety and efficiency of a shop-floor, however, because of the high individual initiative of humans, it is difficult to realize real-time action detection in a digital twin shop-floor. Methods: We proposed a real-time detection approach for shop-floor production action. This approach used the sequence data of continuous human skeleton joints sequences as the input. We then reconstructed the Joint Classification-Regression Recurrent Neural Networks (JCR-RNN) based on Temporal Convolution Network (TCN) and Graph Convolution Network (GCN). We called this approach the Temporal Action Detection Net (TAD-Net), which realized real-time shop-floor production action detection. Results: The results of the verification experiment showed that our approach has achieved a high temporal positioning score, recognition speed, and accuracy when applied to the existing Online Action Detection (OAD) dataset and the Nanjing University of Science and Technology 3 Dimensions (NJUST3D) dataset. TAD-Net can meet the actual needs of the digital twin shop-floor. Conclusions: Our method has higher recognition accuracy, temporal positioning accuracy, and faster running speed than other mainstream network models, it can better meet actual application requirements, and has important research value and practical significance for standardizing shop-floor production processes, reducing production security risks, and contributing to the understanding of real-time production action.
{"title":"TAD-Net: An approach for real-time action detection based on temporal convolution network and graph convolution network in digital twin shop-floor","authors":"Qing Hong, Yifeng Sun, Tingyu Liu, Liang Fu, Yunfeng Xie","doi":"10.12688/digitaltwin.17408.1","DOIUrl":"https://doi.org/10.12688/digitaltwin.17408.1","url":null,"abstract":"Background: Intelligent monitoring of human action in production is an important step to help standardize production processes and construct a digital twin shop-floor rapidly. Human action has a significant impact on the production safety and efficiency of a shop-floor, however, because of the high individual initiative of humans, it is difficult to realize real-time action detection in a digital twin shop-floor. Methods: We proposed a real-time detection approach for shop-floor production action. This approach used the sequence data of continuous human skeleton joints sequences as the input. We then reconstructed the Joint Classification-Regression Recurrent Neural Networks (JCR-RNN) based on Temporal Convolution Network (TCN) and Graph Convolution Network (GCN). We called this approach the Temporal Action Detection Net (TAD-Net), which realized real-time shop-floor production action detection. Results: The results of the verification experiment showed that our approach has achieved a high temporal positioning score, recognition speed, and accuracy when applied to the existing Online Action Detection (OAD) dataset and the Nanjing University of Science and Technology 3 Dimensions (NJUST3D) dataset. TAD-Net can meet the actual needs of the digital twin shop-floor. Conclusions: Our method has higher recognition accuracy, temporal positioning accuracy, and faster running speed than other mainstream network models, it can better meet actual application requirements, and has important research value and practical significance for standardizing shop-floor production processes, reducing production security risks, and contributing to the understanding of real-time production action.","PeriodicalId":29831,"journal":{"name":"Digital Twin","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41681844","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-11-11DOI: 10.12688/digitaltwin.17489.1
Yuchen Wang, Xingzhi Wang, F. Tao, Ang Liu
Complexity management is one of the most crucial and challenging issues in manufacturing. As an emerging technology, digital twin provides an innovative approach to manage complexity in a more autonomous, analytical and comprehensive manner. This paper proposes an innovative framework of digital twin-driven complexity management in intelligent manufacturing. The framework will cover three sources of manufacturing complexity, including product design, production lines and supply chains. Digital twin provides three services to manage complexity: (1) real-time monitors and data collections; (2) identifications, diagnoses and predictions of manufacturing complexity; (3) fortification of human-machine interaction. A case study of airplane manufacturing is presented to illustrate the proposed framework.
{"title":"Digital twin-driven complexity management in intelligent manufacturing","authors":"Yuchen Wang, Xingzhi Wang, F. Tao, Ang Liu","doi":"10.12688/digitaltwin.17489.1","DOIUrl":"https://doi.org/10.12688/digitaltwin.17489.1","url":null,"abstract":"Complexity management is one of the most crucial and challenging issues in manufacturing. As an emerging technology, digital twin provides an innovative approach to manage complexity in a more autonomous, analytical and comprehensive manner. This paper proposes an innovative framework of digital twin-driven complexity management in intelligent manufacturing. The framework will cover three sources of manufacturing complexity, including product design, production lines and supply chains. Digital twin provides three services to manage complexity: (1) real-time monitors and data collections; (2) identifications, diagnoses and predictions of manufacturing complexity; (3) fortification of human-machine interaction. A case study of airplane manufacturing is presented to illustrate the proposed framework.","PeriodicalId":29831,"journal":{"name":"Digital Twin","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46462286","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Background: With significant advancement and demand for digital transformation, the digital twin has been gaining increasing attention as it is capable of establishing real-time mapping between physical space and virtual space. In this work, a shape-performance integrated digital twin solution is presented to predict the real-time biomechanics of the lumbar spine during human movement. Methods: A finite element model (FEM) of the lumbar spine was firstly developed using computed tomography (CT) and constrained by the body movement which was calculated by the inverse kinematics algorithm. The Gaussian process regression was utilized to train the predicted results and create the digital twin of the lumbar spine in real-time. Finally, a three-dimensional virtual reality system was developed using Unity3D to display and record the real-time biomechanics performance of the lumbar spine during body movement. Results: The evaluation results presented an agreement (R-squared > 0.8) between the real-time prediction from digital twin and offline FEM prediction. Conclusions: This approach provides an effective method of real-time planning and warning in spine rehabilitation.
{"title":"Towards a shape-performance integrated digital twin for lumbar spine analysis","authors":"Xiwang He, Yiming Qiu, Xiaonan Lai, Zhonghai Li, Liming Shu, Wei Sun, Xueguan Song","doi":"10.12688/digitaltwin.17478.1","DOIUrl":"https://doi.org/10.12688/digitaltwin.17478.1","url":null,"abstract":"Background: With significant advancement and demand for digital transformation, the digital twin has been gaining increasing attention as it is capable of establishing real-time mapping between physical space and virtual space. In this work, a shape-performance integrated digital twin solution is presented to predict the real-time biomechanics of the lumbar spine during human movement. Methods: A finite element model (FEM) of the lumbar spine was firstly developed using computed tomography (CT) and constrained by the body movement which was calculated by the inverse kinematics algorithm. The Gaussian process regression was utilized to train the predicted results and create the digital twin of the lumbar spine in real-time. Finally, a three-dimensional virtual reality system was developed using Unity3D to display and record the real-time biomechanics performance of the lumbar spine during body movement. Results: The evaluation results presented an agreement (R-squared > 0.8) between the real-time prediction from digital twin and offline FEM prediction. Conclusions: This approach provides an effective method of real-time planning and warning in spine rehabilitation.","PeriodicalId":29831,"journal":{"name":"Digital Twin","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-11-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49532284","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-10-21DOI: 10.12688/digitaltwin.17475.1
Rahatara Fardousi, Fedwa Laamarti, M. A. Hossain, Chunsheng Yang, A. El Saddik
Digital twin (DT) has gained success in various industries, and it is now getting attention in the healthcare industry in the form of well-being digital twin (WDT). In this paper, we present an overview of WDT to understand its potential scope, architecture and impact. We then discuss the definition and the benefits of WDT. After that, we present the evolution of DT frameworks. Subsequently we discuss the challenges, the different types, the drawbacks, and potential application areas of WDT. Finally we present the requirements for a WDT framework extracted from the literature.
{"title":"Digital twins for well-being: an overview","authors":"Rahatara Fardousi, Fedwa Laamarti, M. A. Hossain, Chunsheng Yang, A. El Saddik","doi":"10.12688/digitaltwin.17475.1","DOIUrl":"https://doi.org/10.12688/digitaltwin.17475.1","url":null,"abstract":"Digital twin (DT) has gained success in various industries, and it is now getting attention in the healthcare industry in the form of well-being digital twin (WDT). In this paper, we present an overview of WDT to understand its potential scope, architecture and impact. We then discuss the definition and the benefits of WDT. After that, we present the evolution of DT frameworks. Subsequently we discuss the challenges, the different types, the drawbacks, and potential application areas of WDT. Finally we present the requirements for a WDT framework extracted from the literature.","PeriodicalId":29831,"journal":{"name":"Digital Twin","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43290741","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-09-28DOI: 10.12688/digitaltwin.17448.1
Xiaowen Sun, Cheng Zhou, Xiaodong Duan, Tao Sun
With the gradual development of the 5G industry network and applications, each industry application has various network performance requirements, while customers hope to upgrade their industrial structures by leveraging 5G technologies. The guarantee of service level agreement (SLA) requirements is becoming more and more important, especially SLA performance indicators, such as delay, jitter, bandwidth, etc. For network operators to fulfill customer’s requirements, emerging network technologies such as time-sensitive networking (TSN), edge computing (EC) and network slicing are introduced into the mobile network to improve network performance, which increase the complexity of the network operation and maintenance (O&M), as well as the network cost. As a result, operators urgently need new solutions to achieve low-cost and high-efficiency network SLA management. In this paper, a digital twin network (DTN) solution is innovatively proposed to achieve the mapping and full lifecycle management of the end-to-end physical network. All the network operation policies such as configuration and modification can be generated and verified inside the digital twin network first to make sure that the SLA requirements can be fulfilled without affecting the related network environment and the performance of the other network services, making network operation and maintenance more effective and accurate.
{"title":"A digital twin network solution for end-to-end network service level agreement (SLA) assurance","authors":"Xiaowen Sun, Cheng Zhou, Xiaodong Duan, Tao Sun","doi":"10.12688/digitaltwin.17448.1","DOIUrl":"https://doi.org/10.12688/digitaltwin.17448.1","url":null,"abstract":"With the gradual development of the 5G industry network and applications, each industry application has various network performance requirements, while customers hope to upgrade their industrial structures by leveraging 5G technologies. The guarantee of service level agreement (SLA) requirements is becoming more and more important, especially SLA performance indicators, such as delay, jitter, bandwidth, etc. For network operators to fulfill customer’s requirements, emerging network technologies such as time-sensitive networking (TSN), edge computing (EC) and network slicing are introduced into the mobile network to improve network performance, which increase the complexity of the network operation and maintenance (O&M), as well as the network cost. As a result, operators urgently need new solutions to achieve low-cost and high-efficiency network SLA management. In this paper, a digital twin network (DTN) solution is innovatively proposed to achieve the mapping and full lifecycle management of the end-to-end physical network. All the network operation policies such as configuration and modification can be generated and verified inside the digital twin network first to make sure that the SLA requirements can be fulfilled without affecting the related network environment and the performance of the other network services, making network operation and maintenance more effective and accurate.","PeriodicalId":29831,"journal":{"name":"Digital Twin","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41447876","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-09-22DOI: 10.12688/digitaltwin.17471.1
Fei Tao, Qinglin Qi, Ang Liu
Professor Fei Tao from Beihang University initiated Digital Twin (ISSN 2752-5783), the first open research publishing platform dedicated to digital twin technologies and applications. It is published by F1000, part of the Taylor & Francis Group and sponsored by Beihang University. Digital Twin has been set up to accommodate the outputs of scientific research and engineering applications that are related to digital twin.
{"title":"Inaugural Editorial - Digital Twin","authors":"Fei Tao, Qinglin Qi, Ang Liu","doi":"10.12688/digitaltwin.17471.1","DOIUrl":"https://doi.org/10.12688/digitaltwin.17471.1","url":null,"abstract":"Professor Fei Tao from Beihang University initiated Digital Twin (ISSN 2752-5783), the first open research publishing platform dedicated to digital twin technologies and applications. It is published by F1000, part of the Taylor & Francis Group and sponsored by Beihang University. Digital Twin has been set up to accommodate the outputs of scientific research and engineering applications that are related to digital twin.","PeriodicalId":29831,"journal":{"name":"Digital Twin","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44567459","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-09-22DOI: 10.12688/digitaltwin.17467.1
Meng Zhang, F. Tao, Biqing Huang, Ang Liu, Lihui Wang, N. Anwer, A. Nee
As a promising technology to converge the traditional industry with the digital economy, digital twin (DT) is being investigated by researchers and practitioners across many different fields. The importance of data to DT cannot be overstated. Data plays critical roles in constructing virtual models, building cyber-physical connections, and executing intelligent operations. The unique characteristics of DT put forward a set of new requirements on data. Against this background, this paper discusses the emerging requirements on DT-related data with respect to data gathering, mining, fusion, interaction, iterative optimization, universality, and on-demand usage. A new notion, namely digital twin data (DTD), is introduced. This paper explores some basic principles and methods for DTD gathering, storage, interaction, association, fusion, evolution and servitization, as well as the key enabling technologies. Based on the theoretical underpinning provided in this paper, it is expected that more DT researchers and practitioners can incorporate DTD into their DT development process.
{"title":"Digital twin data: methods and key technologies","authors":"Meng Zhang, F. Tao, Biqing Huang, Ang Liu, Lihui Wang, N. Anwer, A. Nee","doi":"10.12688/digitaltwin.17467.1","DOIUrl":"https://doi.org/10.12688/digitaltwin.17467.1","url":null,"abstract":"As a promising technology to converge the traditional industry with the digital economy, digital twin (DT) is being investigated by researchers and practitioners across many different fields. The importance of data to DT cannot be overstated. Data plays critical roles in constructing virtual models, building cyber-physical connections, and executing intelligent operations. The unique characteristics of DT put forward a set of new requirements on data. Against this background, this paper discusses the emerging requirements on DT-related data with respect to data gathering, mining, fusion, interaction, iterative optimization, universality, and on-demand usage. A new notion, namely digital twin data (DTD), is introduced. This paper explores some basic principles and methods for DTD gathering, storage, interaction, association, fusion, evolution and servitization, as well as the key enabling technologies. Based on the theoretical underpinning provided in this paper, it is expected that more DT researchers and practitioners can incorporate DTD into their DT development process.","PeriodicalId":29831,"journal":{"name":"Digital Twin","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44544664","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-09-22DOI: 10.12688/digitaltwin.17440.1
David Jones
The digital twin is often presented as the solution to Industry 4.0 and, while there are many areas where this may be the case, there is a risk that a reliance on existing machine learning methods will not be able to deliver the high level cognitive capabilities such as adaptability, cause and effect, and planning that Industry 4.0 requires. As the limitations of machine learning are beginning to be understood, the paradigm of strong artificial intelligence is emerging. The field of artificial cognitive systems is part of the strong artificial intelligence paradigm and is aimed at generating computational systems capable of mimicking biological systems in learning and interacting with the world. This paper presents an argument that artificial cognitive systems offer solutions to the higher level cognitive challenges of Industry 4.0 and that digital twin research should be driven in the direction of artificial cognition accordingly. This argument is based on the inherent similarities between the digital twin and artificial cognitive systems, and the insights that can already be seen in aligning the two approaches.
{"title":"Artificial cognitive systems: the next generation of the digital twin. An opinion.","authors":"David Jones","doi":"10.12688/digitaltwin.17440.1","DOIUrl":"https://doi.org/10.12688/digitaltwin.17440.1","url":null,"abstract":"The digital twin is often presented as the solution to Industry 4.0 and, while there are many areas where this may be the case, there is a risk that a reliance on existing machine learning methods will not be able to deliver the high level cognitive capabilities such as adaptability, cause and effect, and planning that Industry 4.0 requires. As the limitations of machine learning are beginning to be understood, the paradigm of strong artificial intelligence is emerging. The field of artificial cognitive systems is part of the strong artificial intelligence paradigm and is aimed at generating computational systems capable of mimicking biological systems in learning and interacting with the world. This paper presents an argument that artificial cognitive systems offer solutions to the higher level cognitive challenges of Industry 4.0 and that digital twin research should be driven in the direction of artificial cognition accordingly. This argument is based on the inherent similarities between the digital twin and artificial cognitive systems, and the insights that can already be seen in aligning the two approaches.","PeriodicalId":29831,"journal":{"name":"Digital Twin","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44736225","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-09-22DOI: 10.12688/digitaltwin.17435.1
P. Palensky, M. Cvetković, D. Gusain, Arun Joseph
The electric power sector is one of the later sectors in adopting digital twins and models in the loop for its operations. This article firstly reviews the history, the fundamental properties, and the variants of such digital twins and how they relate to the power system. Secondly, first applications of the digital twin concept in the power and energy business are explained. It is shown that the trans-disciplinarity, the different time scales, and the heterogeneity of the required models are the main challenges in this process and that co-simulation and co-modeling can help. This article will help power system professionals to enter the field of digital twins and to learn how they can be used in their business.
{"title":"Digital twins and their use in future power systems","authors":"P. Palensky, M. Cvetković, D. Gusain, Arun Joseph","doi":"10.12688/digitaltwin.17435.1","DOIUrl":"https://doi.org/10.12688/digitaltwin.17435.1","url":null,"abstract":"The electric power sector is one of the later sectors in adopting digital twins and models in the loop for its operations. This article firstly reviews the history, the fundamental properties, and the variants of such digital twins and how they relate to the power system. Secondly, first applications of the digital twin concept in the power and energy business are explained. It is shown that the trans-disciplinarity, the different time scales, and the heterogeneity of the required models are the main challenges in this process and that co-simulation and co-modeling can help. This article will help power system professionals to enter the field of digital twins and to learn how they can be used in their business.","PeriodicalId":29831,"journal":{"name":"Digital Twin","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43926836","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-01-01DOI: 10.12688/digitaltwin.17441.1
Hao Li, Gengdai Liu, Haoqi Wang, Xiaoyu Wen, G. Xie, Guofu Luo, Shuai Zhang, Miying Yang
Background: Digital twin requires virtual reality mapping and optimization iteration between physical devices and virtual models. The mechanical movement data collection of physical equipment is essential for the implementation of accurate virtual and physical synchronization in a digital twin environment. However, the traditional approach relying on PLC (programmable logic control) fails to collect various mechanical motion state data. Additionally, few investigations have used machine visions for the virtual and physical synchronization of equipment. Thus, this paper presents a mechanical movement data acquisition method based on multilayer neural networks and machine vision. Methods: Firstly, various visual marks with different colors and shapes are designed for marking physical devices. Secondly, a recognition method based on the Hough transform and histogram feature is proposed to realize the recognition of shape and color features respectively. Then, the multilayer neural network model is introduced in the visual mark location. The neural network is trained by the dropout algorithm to realize the tracking and location of the visual mark. To test the proposed method, 1000 samples were selected. Results: The experiment results shows that when the size of the visual mark is larger than 6mm, the recognition success rate of the recognition algorithm can reach more than 95%. In the actual operation environment with multiple cameras, the identification points can be located more accurately. Moreover, the camera calibration process of binocular and multi-eye vision can be simplified by the multilayer neural networks. Conclusions: This study proposes an effective method in the collection of mechanical motion data of physical equipment in a digital twin environment. Further studies are needed to perceive posture and shape data of physical entities under the multi-camera redundant shooting.
{"title":"Mechanical movement data acquisition method based on the multilayer neural networks and machine vision in a digital twin environment","authors":"Hao Li, Gengdai Liu, Haoqi Wang, Xiaoyu Wen, G. Xie, Guofu Luo, Shuai Zhang, Miying Yang","doi":"10.12688/digitaltwin.17441.1","DOIUrl":"https://doi.org/10.12688/digitaltwin.17441.1","url":null,"abstract":"Background: Digital twin requires virtual reality mapping and optimization iteration between physical devices and virtual models. The mechanical movement data collection of physical equipment is essential for the implementation of accurate virtual and physical synchronization in a digital twin environment. However, the traditional approach relying on PLC (programmable logic control) fails to collect various mechanical motion state data. Additionally, few investigations have used machine visions for the virtual and physical synchronization of equipment. Thus, this paper presents a mechanical movement data acquisition method based on multilayer neural networks and machine vision. Methods: Firstly, various visual marks with different colors and shapes are designed for marking physical devices. Secondly, a recognition method based on the Hough transform and histogram feature is proposed to realize the recognition of shape and color features respectively. Then, the multilayer neural network model is introduced in the visual mark location. The neural network is trained by the dropout algorithm to realize the tracking and location of the visual mark. To test the proposed method, 1000 samples were selected. Results: The experiment results shows that when the size of the visual mark is larger than 6mm, the recognition success rate of the recognition algorithm can reach more than 95%. In the actual operation environment with multiple cameras, the identification points can be located more accurately. Moreover, the camera calibration process of binocular and multi-eye vision can be simplified by the multilayer neural networks. Conclusions: This study proposes an effective method in the collection of mechanical motion data of physical equipment in a digital twin environment. Further studies are needed to perceive posture and shape data of physical entities under the multi-camera redundant shooting.","PeriodicalId":29831,"journal":{"name":"Digital Twin","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"66400040","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：