Toward Multimodal Graph Sequence Generation: A Denoising Diffusion Approach for Wheeled Robot Fault Diagnosis

IF 8.9 1区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS IEEE Internet of Things Journal Pub Date : 2025-02-12 DOI:10.1109/JIOT.2025.3541337
Tianyi Ye;Haolin Cao;Jianjie Liu;Bao Pang;Qingyang Xu;Yong Song;Xianfeng Yuan
{"title":"Toward Multimodal Graph Sequence Generation: A Denoising Diffusion Approach for Wheeled Robot Fault Diagnosis","authors":"Tianyi Ye;Haolin Cao;Jianjie Liu;Bao Pang;Qingyang Xu;Yong Song;Xianfeng Yuan","doi":"10.1109/JIOT.2025.3541337","DOIUrl":null,"url":null,"abstract":"Wheeled robots play a crucial role in Industrial Internet of Things (IIoT)-enabled manufacturing environments, and ensuring their reliable operation is essential for production efficiency and safety. However, their inherent complexity makes them prone to faults, while limited fault data results in imbalanced datasets, posing challenges for deep-learning-based fault diagnosis models. Existing denoising diffusion probabilistic model (DDPM)-based fault diagnosis methods tend to address single-channel scenarios, ignoring the graph relationships inherent in multichannel sensor data. Furthermore, current graph-based DDPM models also struggle in wheeled robot scenarios due to its multimodal nature. To address these challenges, we propose an enhanced DDPM-based method for imbalanced fault diagnosis of wheeled robots. Our method integrates graph operations into the noise prediction network of the DDPM framework, enabling efficient modeling of the complex spatial–temporal relations in multimodal graphical sequence data via a newly designed spatial–temporal graph U-Net (STGU-Net). Additionally, we present a dynamic degradation mechanism for the prior graph, simulating gradual structural changes during the diffusion process. Extensive experiments on a real-world wheeled robot platform demonstrate the superiority of the proposed model over state-of-the-art methods from multiple perspectives, showcasing its effectiveness in generating high-quality data and mitigating the imbalance problem in wheeled robot fault diagnosis.","PeriodicalId":54347,"journal":{"name":"IEEE Internet of Things Journal","volume":"12 12","pages":"19605-19614"},"PeriodicalIF":8.9000,"publicationDate":"2025-02-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Internet of Things Journal","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10883041/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

Wheeled robots play a crucial role in Industrial Internet of Things (IIoT)-enabled manufacturing environments, and ensuring their reliable operation is essential for production efficiency and safety. However, their inherent complexity makes them prone to faults, while limited fault data results in imbalanced datasets, posing challenges for deep-learning-based fault diagnosis models. Existing denoising diffusion probabilistic model (DDPM)-based fault diagnosis methods tend to address single-channel scenarios, ignoring the graph relationships inherent in multichannel sensor data. Furthermore, current graph-based DDPM models also struggle in wheeled robot scenarios due to its multimodal nature. To address these challenges, we propose an enhanced DDPM-based method for imbalanced fault diagnosis of wheeled robots. Our method integrates graph operations into the noise prediction network of the DDPM framework, enabling efficient modeling of the complex spatial–temporal relations in multimodal graphical sequence data via a newly designed spatial–temporal graph U-Net (STGU-Net). Additionally, we present a dynamic degradation mechanism for the prior graph, simulating gradual structural changes during the diffusion process. Extensive experiments on a real-world wheeled robot platform demonstrate the superiority of the proposed model over state-of-the-art methods from multiple perspectives, showcasing its effectiveness in generating high-quality data and mitigating the imbalance problem in wheeled robot fault diagnosis.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
面向多模态图序列生成:轮式机器人故障诊断的去噪扩散方法
轮式机器人在支持工业物联网(IIoT)的制造环境中发挥着至关重要的作用,确保其可靠运行对于生产效率和安全至关重要。然而,它们固有的复杂性使得它们容易出现故障,而有限的故障数据导致数据集不平衡,这给基于深度学习的故障诊断模型带来了挑战。现有的基于扩散概率模型(DDPM)的降噪故障诊断方法倾向于处理单通道故障,忽略了多通道传感器数据中固有的图关系。此外,目前基于图的DDPM模型由于其多模态特性,在轮式机器人场景中也存在问题。为了解决这些问题,我们提出了一种改进的基于ddpm的轮式机器人不平衡故障诊断方法。该方法将图运算集成到DDPM框架的噪声预测网络中,通过新设计的时空图U-Net (STGU-Net)实现了多模态图序列数据中复杂时空关系的高效建模。此外,我们提出了先验图的动态退化机制,模拟扩散过程中逐渐的结构变化。在实际轮式机器人平台上进行的大量实验从多个角度证明了该模型相对于现有方法的优越性,证明了该模型在生成高质量数据和缓解轮式机器人故障诊断中的不平衡问题方面的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
IEEE Internet of Things Journal
IEEE Internet of Things Journal Computer Science-Information Systems
CiteScore
17.60
自引率
13.20%
发文量
1982
期刊介绍: The EEE Internet of Things (IoT) Journal publishes articles and review articles covering various aspects of IoT, including IoT system architecture, IoT enabling technologies, IoT communication and networking protocols such as network coding, and IoT services and applications. Topics encompass IoT's impacts on sensor technologies, big data management, and future internet design for applications like smart cities and smart homes. Fields of interest include IoT architecture such as things-centric, data-centric, service-oriented IoT architecture; IoT enabling technologies and systematic integration such as sensor technologies, big sensor data management, and future Internet design for IoT; IoT services, applications, and test-beds such as IoT service middleware, IoT application programming interface (API), IoT application design, and IoT trials/experiments; IoT standardization activities and technology development in different standard development organizations (SDO) such as IEEE, IETF, ITU, 3GPP, ETSI, etc.
期刊最新文献
Scheduling Schemes for Mission-Critical IoT Healthcare Applications: A Systematic Review Physical Layer Security of Coupled Phase Shifts STAR-RIS-Aided NOMA System under Hybrid Far- and Near-Field Scenarios Feature Importance-Aware Deep Joint Source-Channel Coding for Computationally Efficient and Adjustable Image Transmission Blind Radio Map Construction via Topology Guided Manifold Learning Toward Robust IoT Device Authentication: Cross-Day Specific Emitter Identification via Domain Adaptation
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1