Adaptive optimization federated learning enabled digital twins in industrial IoT

IF 10.4 1区 计算机科学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Journal of Industrial Information Integration Pub Date : 2024-06-19 DOI:10.1016/j.jii.2024.100645
Wei Yang , Yuan Yang , Wei Xiang , Lei Yuan , Kan Yu , Álvaro Hernández Alonso , Jesús Ureña Ureña , Zhibo Pang
{"title":"Adaptive optimization federated learning enabled digital twins in industrial IoT","authors":"Wei Yang ,&nbsp;Yuan Yang ,&nbsp;Wei Xiang ,&nbsp;Lei Yuan ,&nbsp;Kan Yu ,&nbsp;Álvaro Hernández Alonso ,&nbsp;Jesús Ureña Ureña ,&nbsp;Zhibo Pang","doi":"10.1016/j.jii.2024.100645","DOIUrl":null,"url":null,"abstract":"<div><p>The Industrial Internet of Things (IIoT) plays a pivotal role in steering enterprises towards comprehensive digital transformation and fostering intelligent production, which serves as a critical pillar of Industry 4.0. Digital twin (DT) emerges as a highly promising technology, enabling the digital transformation of the IIoT by seamlessly bridging physical systems with digital spaces. However, the overall service quality of the IIoT is severely impacted by the resource-limited devices and the massive, heterogeneous and sensitive data in the IIoT. As an innovative distributed machine learning paradigm, federated learning (FL) inherently possesses advantages in handling private and heterogeneous data. In this paper, we propose a novel framework integrating <strong>F</strong>L with <strong>D</strong>T-<strong>e</strong>nabled <strong>I</strong>IoT, termed FDEI, which combines the merits of both to improve service quality while maintaining trustworthiness. To enhance the modeling efficiency, we develop FedOA, an <strong>a</strong>daptive <strong>o</strong>ptimization <strong>F</strong>L method that dynamically adjusts the local update coefficient and model compression rate in resource-limited IIoT scenarios, to construct the FDEI model. Specifically, leveraging the interdependence between the two variables, we conduct a theoretical analysis of the model convergence rate and derive the associated convergence bounds. Building upon the theoretical analysis, we further propose a joint adaptive adjustment strategy by optimizing the two variables across various clients to minimize runtime differences and accelerate the convergence rate. Numerical results demonstrate that our proposed approach achieves an approximate 68% improvement in convergence speed and a reduction of approximately 66% in traffic consumption compared to the benchmarks (e.g., FedAvg, AFL, and CSFL).</p></div>","PeriodicalId":55975,"journal":{"name":"Journal of Industrial Information Integration","volume":"41 ","pages":"Article 100645"},"PeriodicalIF":10.4000,"publicationDate":"2024-06-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Industrial Information Integration","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2452414X2400089X","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0

Abstract

The Industrial Internet of Things (IIoT) plays a pivotal role in steering enterprises towards comprehensive digital transformation and fostering intelligent production, which serves as a critical pillar of Industry 4.0. Digital twin (DT) emerges as a highly promising technology, enabling the digital transformation of the IIoT by seamlessly bridging physical systems with digital spaces. However, the overall service quality of the IIoT is severely impacted by the resource-limited devices and the massive, heterogeneous and sensitive data in the IIoT. As an innovative distributed machine learning paradigm, federated learning (FL) inherently possesses advantages in handling private and heterogeneous data. In this paper, we propose a novel framework integrating FL with DT-enabled IIoT, termed FDEI, which combines the merits of both to improve service quality while maintaining trustworthiness. To enhance the modeling efficiency, we develop FedOA, an adaptive optimization FL method that dynamically adjusts the local update coefficient and model compression rate in resource-limited IIoT scenarios, to construct the FDEI model. Specifically, leveraging the interdependence between the two variables, we conduct a theoretical analysis of the model convergence rate and derive the associated convergence bounds. Building upon the theoretical analysis, we further propose a joint adaptive adjustment strategy by optimizing the two variables across various clients to minimize runtime differences and accelerate the convergence rate. Numerical results demonstrate that our proposed approach achieves an approximate 68% improvement in convergence speed and a reduction of approximately 66% in traffic consumption compared to the benchmarks (e.g., FedAvg, AFL, and CSFL).

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
工业物联网中支持联合学习的自适应优化数字双胞胎
工业物联网(IIoT)在引导企业实现全面数字化转型和促进智能生产方面发挥着举足轻重的作用,是工业 4.0 的重要支柱。数字孪生(DT)作为一种极具前景的技术,通过将物理系统与数字空间无缝连接,实现了 IIoT 的数字化转型。然而,IIoT 中资源有限的设备和大量异构敏感数据严重影响了 IIoT 的整体服务质量。作为一种创新的分布式机器学习范例,联合学习(FL)在处理私有数据和异构数据方面具有与生俱来的优势。在本文中,我们提出了一种新型框架,将联合学习与支持 DT 的物联网集成在一起,称为 FDEI,它结合了两者的优点,在提高服务质量的同时保持了可信度。为了提高建模效率,我们开发了一种自适应优化 FL 方法 FedOA,该方法可在资源有限的 IIoT 场景中动态调整局部更新系数和模型压缩率,从而构建 FDEI 模型。具体而言,利用两个变量之间的相互依存关系,我们对模型收敛率进行了理论分析,并推导出了相关的收敛边界。在理论分析的基础上,我们进一步提出了一种联合自适应调整策略,通过优化不同客户端的两个变量,最大限度地减少运行时差异,加快收敛速度。数值结果表明,与基准(如 FedAvg、AFL 和 CSFL)相比,我们提出的方法提高了约 68% 的收敛速度,减少了约 66% 的流量消耗。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Journal of Industrial Information Integration
Journal of Industrial Information Integration Decision Sciences-Information Systems and Management
CiteScore
22.30
自引率
13.40%
发文量
100
期刊介绍: The Journal of Industrial Information Integration focuses on the industry's transition towards industrial integration and informatization, covering not only hardware and software but also information integration. It serves as a platform for promoting advances in industrial information integration, addressing challenges, issues, and solutions in an interdisciplinary forum for researchers, practitioners, and policy makers. The Journal of Industrial Information Integration welcomes papers on foundational, technical, and practical aspects of industrial information integration, emphasizing the complex and cross-disciplinary topics that arise in industrial integration. Techniques from mathematical science, computer science, computer engineering, electrical and electronic engineering, manufacturing engineering, and engineering management are crucial in this context.
期刊最新文献
Enhancing mixed gas discrimination in e-nose system: Sparse recurrent neural networks using transient current fluctuation of SMO array sensor An effective farmer-centred mobile intelligence solution using lightweight deep learning for integrated wheat pest management TRIPLE: A blockchain-based digital twin framework for cyber–physical systems security Industrial information integration in deep space exploration and exploitation: Architecture and technology Interoperability levels and challenges of digital twins in cyber–physical systems
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1