Wei Yang , Yuan Yang , Wei Xiang , Lei Yuan , Kan Yu , Álvaro Hernández Alonso , Jesús Ureña Ureña , Zhibo Pang
{"title":"工业物联网中支持联合学习的自适应优化数字双胞胎","authors":"Wei Yang , Yuan Yang , Wei Xiang , Lei Yuan , Kan Yu , Álvaro Hernández Alonso , Jesús Ureña Ureña , Zhibo Pang","doi":"10.1016/j.jii.2024.100645","DOIUrl":null,"url":null,"abstract":"<div><p>The Industrial Internet of Things (IIoT) plays a pivotal role in steering enterprises towards comprehensive digital transformation and fostering intelligent production, which serves as a critical pillar of Industry 4.0. Digital twin (DT) emerges as a highly promising technology, enabling the digital transformation of the IIoT by seamlessly bridging physical systems with digital spaces. However, the overall service quality of the IIoT is severely impacted by the resource-limited devices and the massive, heterogeneous and sensitive data in the IIoT. As an innovative distributed machine learning paradigm, federated learning (FL) inherently possesses advantages in handling private and heterogeneous data. In this paper, we propose a novel framework integrating <strong>F</strong>L with <strong>D</strong>T-<strong>e</strong>nabled <strong>I</strong>IoT, termed FDEI, which combines the merits of both to improve service quality while maintaining trustworthiness. To enhance the modeling efficiency, we develop FedOA, an <strong>a</strong>daptive <strong>o</strong>ptimization <strong>F</strong>L method that dynamically adjusts the local update coefficient and model compression rate in resource-limited IIoT scenarios, to construct the FDEI model. Specifically, leveraging the interdependence between the two variables, we conduct a theoretical analysis of the model convergence rate and derive the associated convergence bounds. Building upon the theoretical analysis, we further propose a joint adaptive adjustment strategy by optimizing the two variables across various clients to minimize runtime differences and accelerate the convergence rate. Numerical results demonstrate that our proposed approach achieves an approximate 68% improvement in convergence speed and a reduction of approximately 66% in traffic consumption compared to the benchmarks (e.g., FedAvg, AFL, and CSFL).</p></div>","PeriodicalId":55975,"journal":{"name":"Journal of Industrial Information Integration","volume":"41 ","pages":"Article 100645"},"PeriodicalIF":10.4000,"publicationDate":"2024-06-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Adaptive optimization federated learning enabled digital twins in industrial IoT\",\"authors\":\"Wei Yang , Yuan Yang , Wei Xiang , Lei Yuan , Kan Yu , Álvaro Hernández Alonso , Jesús Ureña Ureña , Zhibo Pang\",\"doi\":\"10.1016/j.jii.2024.100645\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>The Industrial Internet of Things (IIoT) plays a pivotal role in steering enterprises towards comprehensive digital transformation and fostering intelligent production, which serves as a critical pillar of Industry 4.0. Digital twin (DT) emerges as a highly promising technology, enabling the digital transformation of the IIoT by seamlessly bridging physical systems with digital spaces. However, the overall service quality of the IIoT is severely impacted by the resource-limited devices and the massive, heterogeneous and sensitive data in the IIoT. As an innovative distributed machine learning paradigm, federated learning (FL) inherently possesses advantages in handling private and heterogeneous data. In this paper, we propose a novel framework integrating <strong>F</strong>L with <strong>D</strong>T-<strong>e</strong>nabled <strong>I</strong>IoT, termed FDEI, which combines the merits of both to improve service quality while maintaining trustworthiness. To enhance the modeling efficiency, we develop FedOA, an <strong>a</strong>daptive <strong>o</strong>ptimization <strong>F</strong>L method that dynamically adjusts the local update coefficient and model compression rate in resource-limited IIoT scenarios, to construct the FDEI model. Specifically, leveraging the interdependence between the two variables, we conduct a theoretical analysis of the model convergence rate and derive the associated convergence bounds. Building upon the theoretical analysis, we further propose a joint adaptive adjustment strategy by optimizing the two variables across various clients to minimize runtime differences and accelerate the convergence rate. Numerical results demonstrate that our proposed approach achieves an approximate 68% improvement in convergence speed and a reduction of approximately 66% in traffic consumption compared to the benchmarks (e.g., FedAvg, AFL, and CSFL).</p></div>\",\"PeriodicalId\":55975,\"journal\":{\"name\":\"Journal of Industrial Information Integration\",\"volume\":\"41 \",\"pages\":\"Article 100645\"},\"PeriodicalIF\":10.4000,\"publicationDate\":\"2024-06-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Industrial Information Integration\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2452414X2400089X\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Industrial Information Integration","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2452414X2400089X","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
Adaptive optimization federated learning enabled digital twins in industrial IoT
The Industrial Internet of Things (IIoT) plays a pivotal role in steering enterprises towards comprehensive digital transformation and fostering intelligent production, which serves as a critical pillar of Industry 4.0. Digital twin (DT) emerges as a highly promising technology, enabling the digital transformation of the IIoT by seamlessly bridging physical systems with digital spaces. However, the overall service quality of the IIoT is severely impacted by the resource-limited devices and the massive, heterogeneous and sensitive data in the IIoT. As an innovative distributed machine learning paradigm, federated learning (FL) inherently possesses advantages in handling private and heterogeneous data. In this paper, we propose a novel framework integrating FL with DT-enabled IIoT, termed FDEI, which combines the merits of both to improve service quality while maintaining trustworthiness. To enhance the modeling efficiency, we develop FedOA, an adaptive optimization FL method that dynamically adjusts the local update coefficient and model compression rate in resource-limited IIoT scenarios, to construct the FDEI model. Specifically, leveraging the interdependence between the two variables, we conduct a theoretical analysis of the model convergence rate and derive the associated convergence bounds. Building upon the theoretical analysis, we further propose a joint adaptive adjustment strategy by optimizing the two variables across various clients to minimize runtime differences and accelerate the convergence rate. Numerical results demonstrate that our proposed approach achieves an approximate 68% improvement in convergence speed and a reduction of approximately 66% in traffic consumption compared to the benchmarks (e.g., FedAvg, AFL, and CSFL).
期刊介绍:
The Journal of Industrial Information Integration focuses on the industry's transition towards industrial integration and informatization, covering not only hardware and software but also information integration. It serves as a platform for promoting advances in industrial information integration, addressing challenges, issues, and solutions in an interdisciplinary forum for researchers, practitioners, and policy makers.
The Journal of Industrial Information Integration welcomes papers on foundational, technical, and practical aspects of industrial information integration, emphasizing the complex and cross-disciplinary topics that arise in industrial integration. Techniques from mathematical science, computer science, computer engineering, electrical and electronic engineering, manufacturing engineering, and engineering management are crucial in this context.