{"title":"Toward Multimodal Graph Sequence Generation: A Denoising Diffusion Approach for Wheeled Robot Fault Diagnosis","authors":"Tianyi Ye;Haolin Cao;Jianjie Liu;Bao Pang;Qingyang Xu;Yong Song;Xianfeng Yuan","doi":"10.1109/JIOT.2025.3541337","DOIUrl":null,"url":null,"abstract":"Wheeled robots play a crucial role in Industrial Internet of Things (IIoT)-enabled manufacturing environments, and ensuring their reliable operation is essential for production efficiency and safety. However, their inherent complexity makes them prone to faults, while limited fault data results in imbalanced datasets, posing challenges for deep-learning-based fault diagnosis models. Existing denoising diffusion probabilistic model (DDPM)-based fault diagnosis methods tend to address single-channel scenarios, ignoring the graph relationships inherent in multichannel sensor data. Furthermore, current graph-based DDPM models also struggle in wheeled robot scenarios due to its multimodal nature. To address these challenges, we propose an enhanced DDPM-based method for imbalanced fault diagnosis of wheeled robots. Our method integrates graph operations into the noise prediction network of the DDPM framework, enabling efficient modeling of the complex spatial–temporal relations in multimodal graphical sequence data via a newly designed spatial–temporal graph U-Net (STGU-Net). Additionally, we present a dynamic degradation mechanism for the prior graph, simulating gradual structural changes during the diffusion process. Extensive experiments on a real-world wheeled robot platform demonstrate the superiority of the proposed model over state-of-the-art methods from multiple perspectives, showcasing its effectiveness in generating high-quality data and mitigating the imbalance problem in wheeled robot fault diagnosis.","PeriodicalId":54347,"journal":{"name":"IEEE Internet of Things Journal","volume":"12 12","pages":"19605-19614"},"PeriodicalIF":8.9000,"publicationDate":"2025-02-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Internet of Things Journal","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10883041/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Wheeled robots play a crucial role in Industrial Internet of Things (IIoT)-enabled manufacturing environments, and ensuring their reliable operation is essential for production efficiency and safety. However, their inherent complexity makes them prone to faults, while limited fault data results in imbalanced datasets, posing challenges for deep-learning-based fault diagnosis models. Existing denoising diffusion probabilistic model (DDPM)-based fault diagnosis methods tend to address single-channel scenarios, ignoring the graph relationships inherent in multichannel sensor data. Furthermore, current graph-based DDPM models also struggle in wheeled robot scenarios due to its multimodal nature. To address these challenges, we propose an enhanced DDPM-based method for imbalanced fault diagnosis of wheeled robots. Our method integrates graph operations into the noise prediction network of the DDPM framework, enabling efficient modeling of the complex spatial–temporal relations in multimodal graphical sequence data via a newly designed spatial–temporal graph U-Net (STGU-Net). Additionally, we present a dynamic degradation mechanism for the prior graph, simulating gradual structural changes during the diffusion process. Extensive experiments on a real-world wheeled robot platform demonstrate the superiority of the proposed model over state-of-the-art methods from multiple perspectives, showcasing its effectiveness in generating high-quality data and mitigating the imbalance problem in wheeled robot fault diagnosis.
期刊介绍:
The EEE Internet of Things (IoT) Journal publishes articles and review articles covering various aspects of IoT, including IoT system architecture, IoT enabling technologies, IoT communication and networking protocols such as network coding, and IoT services and applications. Topics encompass IoT's impacts on sensor technologies, big data management, and future internet design for applications like smart cities and smart homes. Fields of interest include IoT architecture such as things-centric, data-centric, service-oriented IoT architecture; IoT enabling technologies and systematic integration such as sensor technologies, big sensor data management, and future Internet design for IoT; IoT services, applications, and test-beds such as IoT service middleware, IoT application programming interface (API), IoT application design, and IoT trials/experiments; IoT standardization activities and technology development in different standard development organizations (SDO) such as IEEE, IETF, ITU, 3GPP, ETSI, etc.