Diff-MTS: Temporal-Augmented Conditional Diffusion-Based AIGC for Industrial Time Series Toward the Large Model Era

IF 10.5 1区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS IEEE Transactions on Cybernetics Pub Date : 2024-09-27 DOI:10.1109/TCYB.2024.3462500
Lei Ren;Haiteng Wang;Yuanjun Laili
{"title":"Diff-MTS: Temporal-Augmented Conditional Diffusion-Based AIGC for Industrial Time Series Toward the Large Model Era","authors":"Lei Ren;Haiteng Wang;Yuanjun Laili","doi":"10.1109/TCYB.2024.3462500","DOIUrl":null,"url":null,"abstract":"Industrial multivariate time series (MTS) is a critical view of the industrial field for people to understand the state of machines. However, due to data collection difficulty and privacy concerns, available data for building industrial intelligence and industrial large models is far from sufficient. Therefore, industrial time series data generation is of great importance. Existing research usually applies generative adversarial networks (GANs) to generate MTS. However, GANs suffer from the unstable training process due to the joint training of the generator and discriminator. This article proposes a temporal-augmented conditional adaptive diffusion model, termed Diff-MTS, for MTS generation. It aims to better handle the complex temporal dependencies and dynamics of MTS data. Specifically, a conditional adaptive maximum-mean discrepancy (Ada-MMD) method has been proposed for the controlled generation of MTS, which does not require a classifier to control the generation. It improves the condition consistency of the diffusion model. Moreover, a temporal decomposition reconstruction UNet (TDR-UNet) is established to capture complex temporal patterns and further improve the quality of the synthetic time series. Comprehensive experiments on the C-MAPSS and FEMTO datasets demonstrate that the proposed Diff-MTS performs substantially better in terms of diversity, fidelity, and utility compared with the GAN-based methods. These results show that Diff-MTS facilitates the generation of industrial data, contributing to intelligent maintenance and the construction of industrial large models.","PeriodicalId":13112,"journal":{"name":"IEEE Transactions on Cybernetics","volume":"54 12","pages":"7187-7197"},"PeriodicalIF":10.5000,"publicationDate":"2024-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10697287","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Cybernetics","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10697287/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

Industrial multivariate time series (MTS) is a critical view of the industrial field for people to understand the state of machines. However, due to data collection difficulty and privacy concerns, available data for building industrial intelligence and industrial large models is far from sufficient. Therefore, industrial time series data generation is of great importance. Existing research usually applies generative adversarial networks (GANs) to generate MTS. However, GANs suffer from the unstable training process due to the joint training of the generator and discriminator. This article proposes a temporal-augmented conditional adaptive diffusion model, termed Diff-MTS, for MTS generation. It aims to better handle the complex temporal dependencies and dynamics of MTS data. Specifically, a conditional adaptive maximum-mean discrepancy (Ada-MMD) method has been proposed for the controlled generation of MTS, which does not require a classifier to control the generation. It improves the condition consistency of the diffusion model. Moreover, a temporal decomposition reconstruction UNet (TDR-UNet) is established to capture complex temporal patterns and further improve the quality of the synthetic time series. Comprehensive experiments on the C-MAPSS and FEMTO datasets demonstrate that the proposed Diff-MTS performs substantially better in terms of diversity, fidelity, and utility compared with the GAN-based methods. These results show that Diff-MTS facilitates the generation of industrial data, contributing to intelligent maintenance and the construction of industrial large models.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Diff-MTS:迈向大型模型时代的基于时间增强条件扩散的工业时间序列 AIGC
工业多变量时间序列(MTS)是人们了解工业领域机器状态的重要视角。然而,由于数据收集困难和隐私问题,可用于构建工业智能和工业大模型的数据远远不够。因此,工业时间序列数据的生成具有重要意义。现有研究通常采用生成式对抗网络(generative adversarial networks, GANs)来生成MTS,但由于生成器和判别器的联合训练,使得GANs的训练过程不稳定。本文提出了一种时间增强条件自适应扩散模型,称为diffm -MTS,用于MTS的生成。它旨在更好地处理MTS数据的复杂时间依赖性和动态性。具体而言,提出了一种条件自适应最大均值差异(Ada-MMD)方法用于MTS的受控生成,该方法不需要分类器来控制生成。它提高了扩散模型的条件一致性。建立时序分解重构UNet (TDR-UNet),捕捉复杂的时序模式,进一步提高合成时间序列的质量。在C-MAPSS和FEMTO数据集上的综合实验表明,与基于gan的方法相比,所提出的diffm - mts在多样性、保真度和实用性方面表现得更好。这些结果表明,Diff-MTS有助于工业数据的生成,有助于智能维护和工业大模型的构建。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
IEEE Transactions on Cybernetics
IEEE Transactions on Cybernetics COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE-COMPUTER SCIENCE, CYBERNETICS
CiteScore
25.40
自引率
11.00%
发文量
1869
期刊介绍: The scope of the IEEE Transactions on Cybernetics includes computational approaches to the field of cybernetics. Specifically, the transactions welcomes papers on communication and control across machines or machine, human, and organizations. The scope includes such areas as computational intelligence, computer vision, neural networks, genetic algorithms, machine learning, fuzzy systems, cognitive systems, decision making, and robotics, to the extent that they contribute to the theme of cybernetics or demonstrate an application of cybernetics principles.
期刊最新文献
Output Consensus of a Class of Multiple Heterogeneous-Dimensional Switched Nonlinear Systems Controllability Robustness of Simplicial Complexes Aleatoric-Epistemic Joint Uncertainty Modeling for Cross-Modal Retrieval A Novel Approach for Accurate SOC Estimation of Lithium-Ion Electric Vehicle Batteries Using a (Q, S, R)-γ-Based Dissipativity Observer. Adjustable-Error-Based Adaptive Neural Network Tracking Control for Uncertain Nonlinear Systems.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1