首页 > 最新文献

ISA transactions最新文献

英文 中文
A bimodal framework for nonstationary process monitoring via collaborative contrastive and adversarial unsupervised learning. 通过协作对比和对抗无监督学习的非平稳过程监测的双峰框架。
IF 6.5 Pub Date : 2025-12-05 DOI: 10.1016/j.isatra.2025.12.006
Jian Huang, Hang Ruan, Jianbo Yu, Qingchao Jiang, Xiaofeng Yang

Recognizing nonstationarity is pivotal for trustworthy industrial process monitoring. Existing methods address this issue from a unimodal perspective, which struggles to capture intrinsic heterogeneity. To resolve this, we introduce a novel unsupervised multimodal nonstationary monitoring framework (UMNMF), integrating a bimodal paradigm with contrastive and adversarial schemes. Initially, the knowledge labeling unit (KLU) is established to generate pseudo-labels augmented with prior knowledge for semantic guidance. Subsequently, the dynamic alignment and encoding unit (DAEU) exploits contrastive language-image pre-training (CLIP) and the Vision Transformer (ViT) for modality-aware alignment through a pseudo-supervised contrastive mechanism. Furthermore, the association alignment and distillation unit (AADU) is devised to achieve decoupling through self-adversarial distribution regularization within a variational graph autoencoder (VGAE). The superior performance is substantiated by extensive experiments on three industrial processes, where the UMNMF attains an average fault detection rate exceeding 94 % and maintains a false alarm rate below 2.5 %. Additional ablation studies further confirm the contribution of each module to overall performance improvement.

识别非平稳性是可靠的工业过程监控的关键。现有的方法从单模态的角度来解决这个问题,它努力捕捉内在的异质性。为了解决这个问题,我们引入了一种新的无监督多模态非平稳监测框架(UMNMF),将双峰模式与对比和对抗方案相结合。首先,建立知识标注单元(KLU),生成与先验知识增强的伪标签,用于语义引导。随后,动态对齐和编码单元(DAEU)利用对比语言图像预训练(CLIP)和视觉转换(ViT),通过伪监督对比机制实现模态感知对齐。此外,在变分图自编码器(VGAE)中设计了关联对齐和蒸馏单元(AADU),通过自对抗分布正则化实现解耦。在三个工业过程中进行了广泛的实验,证明了该方法的优异性能,其中UMNMF的平均故障检测率超过94%,并保持在2.5%以下的虚警率。额外的烧蚀研究进一步证实了每个模块对整体性能改进的贡献。
{"title":"A bimodal framework for nonstationary process monitoring via collaborative contrastive and adversarial unsupervised learning.","authors":"Jian Huang, Hang Ruan, Jianbo Yu, Qingchao Jiang, Xiaofeng Yang","doi":"10.1016/j.isatra.2025.12.006","DOIUrl":"https://doi.org/10.1016/j.isatra.2025.12.006","url":null,"abstract":"<p><p>Recognizing nonstationarity is pivotal for trustworthy industrial process monitoring. Existing methods address this issue from a unimodal perspective, which struggles to capture intrinsic heterogeneity. To resolve this, we introduce a novel unsupervised multimodal nonstationary monitoring framework (UMNMF), integrating a bimodal paradigm with contrastive and adversarial schemes. Initially, the knowledge labeling unit (KLU) is established to generate pseudo-labels augmented with prior knowledge for semantic guidance. Subsequently, the dynamic alignment and encoding unit (DAEU) exploits contrastive language-image pre-training (CLIP) and the Vision Transformer (ViT) for modality-aware alignment through a pseudo-supervised contrastive mechanism. Furthermore, the association alignment and distillation unit (AADU) is devised to achieve decoupling through self-adversarial distribution regularization within a variational graph autoencoder (VGAE). The superior performance is substantiated by extensive experiments on three industrial processes, where the UMNMF attains an average fault detection rate exceeding 94 % and maintains a false alarm rate below 2.5 %. Additional ablation studies further confirm the contribution of each module to overall performance improvement.</p>","PeriodicalId":94059,"journal":{"name":"ISA transactions","volume":" ","pages":""},"PeriodicalIF":6.5,"publicationDate":"2025-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145727941","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An uncertainty-aware prototype learning framework with structural constraints for open-world semi-supervised fault diagnosis. 开放世界半监督故障诊断中具有结构约束的不确定性感知原型学习框架。
IF 6.5 Pub Date : 2025-12-04 DOI: 10.1016/j.isatra.2025.12.001
Lei Chen, Haoyan Dong, Shuaijie Chen, Kuangrong Hao

Real-world industrial fault diagnosis faces challenges from unknown fault types and limited labeled data, where existing methods often suffer from prototype collapse and unreliable clustering. This paper proposes an uncertainty-aware prototype learning framework with structural constraints for open-world semi-supervised fault diagnosis (OpenUPS). It introduces prototypes based on simplex equiangular tight frame to enforce uniformly distributed and maximally separated class centers, effectively preventing collapse under limited supervision. To address the varying reliability of unlabeled data, an uncertainty-aware contrastive strategy adaptively selects informative pairs, enabling robust alignment of seen classes and progressive clustering of novel faults. Experiments on the Tennessee Eastman process and a real-world polyester esterification process demonstrate that OpenUPS outperforms existing methods, achieving strong generalization and adaptability for open-world industrial fault diagnosis.

现实工业故障诊断面临着未知故障类型和有限标记数据的挑战,现有方法往往存在原型崩溃和不可靠聚类的问题。提出了一种具有结构约束的不确定性感知原型学习框架,用于开放世界半监督故障诊断(OpenUPS)。引入了基于单纯形等角紧框架的原型,实现了类中心的均匀分布和最大分离,有效防止了有限监督下的崩溃。为了解决未标记数据的不同可靠性,一种不确定性感知的对比策略自适应地选择信息对,实现已见类的鲁棒对齐和新故障的渐进聚类。在田纳西伊斯曼过程和实际聚酯酯化过程中进行的实验表明,OpenUPS优于现有方法,对开放世界工业故障诊断具有很强的通用性和适应性。
{"title":"An uncertainty-aware prototype learning framework with structural constraints for open-world semi-supervised fault diagnosis.","authors":"Lei Chen, Haoyan Dong, Shuaijie Chen, Kuangrong Hao","doi":"10.1016/j.isatra.2025.12.001","DOIUrl":"https://doi.org/10.1016/j.isatra.2025.12.001","url":null,"abstract":"<p><p>Real-world industrial fault diagnosis faces challenges from unknown fault types and limited labeled data, where existing methods often suffer from prototype collapse and unreliable clustering. This paper proposes an uncertainty-aware prototype learning framework with structural constraints for open-world semi-supervised fault diagnosis (OpenUPS). It introduces prototypes based on simplex equiangular tight frame to enforce uniformly distributed and maximally separated class centers, effectively preventing collapse under limited supervision. To address the varying reliability of unlabeled data, an uncertainty-aware contrastive strategy adaptively selects informative pairs, enabling robust alignment of seen classes and progressive clustering of novel faults. Experiments on the Tennessee Eastman process and a real-world polyester esterification process demonstrate that OpenUPS outperforms existing methods, achieving strong generalization and adaptability for open-world industrial fault diagnosis.</p>","PeriodicalId":94059,"journal":{"name":"ISA transactions","volume":" ","pages":""},"PeriodicalIF":6.5,"publicationDate":"2025-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145770549","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Multi-step prediction of blast furnace permeability index based on multi-time-scale analysis. 基于多时间尺度分析的高炉渗透率指数多步预测。
IF 6.5 Pub Date : 2025-11-27 DOI: 10.1016/j.isatra.2025.11.036
Qifu Chen, Zhuang Li, Weijun Li, Yunpeng Guo, Jianqi An, Jinhua She

The permeability index (PI) of a blast furnace (BF) is a key indicator of furnace performance, as it reflects the extent of indirect reduction, energy consumption, molten iron quality, and overall production efficiency. Accurate prediction of the PI is essential for ensuring stable and efficient BF performance. Due to the complex multi-time-scale characteristics of different operational parameters, this paper presents a multi-step prediction model based on multi-time-scale analysis to capture their long-term evolution trends. First, the multi-time-scale characteristics of BF operation are analyzed from both the smelting mechanism and data-driven perspectives. According to the characteristics, this paper constructs a single-step prediction model of PI on the long-time-scale, medium-time-scale, and short-time-scale, respectively, and introduces an iterative compensation strategy to extend each single-step model into a multi-step prediction framework, and then fuses the prediction results under the multi-time-scale to obtain the results of the future PI. Finally, the performance evaluation is shown based on actual industrial data, which verifies the significant advantages of the proposed multi-step prediction method based on iterative compensation in terms of accuracy and stability.

高炉的渗透系数(PI)反映了高炉的间接还原程度、能耗、铁水质量和整体生产效率,是高炉性能的关键指标。准确的PI预测是保证高炉稳定高效运行的关键。针对不同运行参数复杂的多时间尺度特征,提出了一种基于多时间尺度分析的多步预测模型,以捕捉其长期演变趋势。首先,从冶炼机理和数据驱动两方面分析了高炉运行的多时间尺度特征。根据其特点,分别构建了长时间尺度、中时间尺度和短时间尺度的PI单步预测模型,并引入迭代补偿策略,将每个单步模型扩展到多步预测框架中,然后融合多时间尺度下的预测结果,得到未来PI的预测结果。最后,基于实际工业数据进行了性能评价,验证了所提出的基于迭代补偿的多步预测方法在精度和稳定性方面的显著优势。
{"title":"Multi-step prediction of blast furnace permeability index based on multi-time-scale analysis.","authors":"Qifu Chen, Zhuang Li, Weijun Li, Yunpeng Guo, Jianqi An, Jinhua She","doi":"10.1016/j.isatra.2025.11.036","DOIUrl":"https://doi.org/10.1016/j.isatra.2025.11.036","url":null,"abstract":"<p><p>The permeability index (PI) of a blast furnace (BF) is a key indicator of furnace performance, as it reflects the extent of indirect reduction, energy consumption, molten iron quality, and overall production efficiency. Accurate prediction of the PI is essential for ensuring stable and efficient BF performance. Due to the complex multi-time-scale characteristics of different operational parameters, this paper presents a multi-step prediction model based on multi-time-scale analysis to capture their long-term evolution trends. First, the multi-time-scale characteristics of BF operation are analyzed from both the smelting mechanism and data-driven perspectives. According to the characteristics, this paper constructs a single-step prediction model of PI on the long-time-scale, medium-time-scale, and short-time-scale, respectively, and introduces an iterative compensation strategy to extend each single-step model into a multi-step prediction framework, and then fuses the prediction results under the multi-time-scale to obtain the results of the future PI. Finally, the performance evaluation is shown based on actual industrial data, which verifies the significant advantages of the proposed multi-step prediction method based on iterative compensation in terms of accuracy and stability.</p>","PeriodicalId":94059,"journal":{"name":"ISA transactions","volume":" ","pages":""},"PeriodicalIF":6.5,"publicationDate":"2025-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145673194","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Soft sensors for industrial fault detection using multi-scale fusion temporal convolutional autoencoders. 基于多尺度融合时间卷积自编码器的工业故障检测软传感器。
IF 6.5 Pub Date : 2025-11-26 DOI: 10.1016/j.isatra.2025.11.020
Huanqi Sun, Weili Xiong, Zhongmei Li, Wenxin Sun, Yiyang Chen, Hongtian Chen

With the widespread deployment of intelligent sensors and advances in data storage, large volumes of process data are continuously collected, providing a foundation for developing soft sensors for multi-scale monitoring in complex industrial processes. This paper proposes an enhanced autoencoder-based temporal convolutional soft sensor model for industrial process monitoring, aiming to effectively capture multi-scale features and the dynamic evolution of process data. The proposed filter temporal convolutional network incorporates adaptive filter-response normalization, thereby enhancing multi-scale feature extraction and improving model generalization. Then, a multi-layer filter temporal convolutional autoencoder is developed to enable efficient multi-scale feature extraction and accurate process data reconstruction. Moreover, a multi-scale feature fusion module with a channel attention mechanism is designed to adaptively integrate temporal features and significantly enhance model robustness. Finally, a statistical metric based on reconstruction errors is established, and the Kullback-Leibler divergence is employed to determine control limits for fault detection. The superiority and effectiveness of the proposed method are validated through applications to the wastewater treatment process and the multiphase flow process.

随着智能传感器的广泛部署和数据存储技术的进步,大量的过程数据被不断采集,为开发用于复杂工业过程多尺度监控的软传感器提供了基础。本文提出了一种基于自编码器的增强时间卷积软测量模型,用于工业过程监测,旨在有效地捕捉过程数据的多尺度特征和动态演化。该滤波时间卷积网络结合了自适应滤波响应归一化,增强了多尺度特征提取能力,提高了模型泛化能力。然后,开发了一种多层滤波时间卷积自编码器,实现了高效的多尺度特征提取和准确的过程数据重建。此外,设计了具有通道注意机制的多尺度特征融合模块,自适应融合时间特征,显著增强了模型的鲁棒性。最后,建立了基于重构误差的统计度量,并利用Kullback-Leibler散度确定故障检测的控制限。通过对污水处理过程和多相流过程的应用,验证了该方法的优越性和有效性。
{"title":"Soft sensors for industrial fault detection using multi-scale fusion temporal convolutional autoencoders.","authors":"Huanqi Sun, Weili Xiong, Zhongmei Li, Wenxin Sun, Yiyang Chen, Hongtian Chen","doi":"10.1016/j.isatra.2025.11.020","DOIUrl":"https://doi.org/10.1016/j.isatra.2025.11.020","url":null,"abstract":"<p><p>With the widespread deployment of intelligent sensors and advances in data storage, large volumes of process data are continuously collected, providing a foundation for developing soft sensors for multi-scale monitoring in complex industrial processes. This paper proposes an enhanced autoencoder-based temporal convolutional soft sensor model for industrial process monitoring, aiming to effectively capture multi-scale features and the dynamic evolution of process data. The proposed filter temporal convolutional network incorporates adaptive filter-response normalization, thereby enhancing multi-scale feature extraction and improving model generalization. Then, a multi-layer filter temporal convolutional autoencoder is developed to enable efficient multi-scale feature extraction and accurate process data reconstruction. Moreover, a multi-scale feature fusion module with a channel attention mechanism is designed to adaptively integrate temporal features and significantly enhance model robustness. Finally, a statistical metric based on reconstruction errors is established, and the Kullback-Leibler divergence is employed to determine control limits for fault detection. The superiority and effectiveness of the proposed method are validated through applications to the wastewater treatment process and the multiphase flow process.</p>","PeriodicalId":94059,"journal":{"name":"ISA transactions","volume":" ","pages":""},"PeriodicalIF":6.5,"publicationDate":"2025-11-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145835753","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Soft sensor for nonuniform sampling nonlinear dynamic process using irregular-time-interval latent probabilistic predictability embedding supervised deep network. 非均匀采样非线性动态过程软测量采用不规则时间间隔潜在概率可预测性嵌入监督深度网络。
IF 6.5 Pub Date : 2025-11-08 DOI: 10.1016/j.isatra.2025.11.001
Zhengxuan Zhang, Xu Yang, Yuri A W Shardt, Jingjing Gao, Jiarui Cui

Dynamic latent variable (DLV) models have been widely applied in industrial soft sensing due to their ability to extract features and capture dynamic behavior. However, conventional DLV models are limited to linear feature extraction and perform poorly with nonuniformly sampled data. Thus, this paper proposes a soft sensor for a nonuniform sampling nonlinear dynamic process using irregular-time-interval latent probabilistic predictability embedding supervised deep network (ILPPSDN). First, a prediction regularization term is added to the decoding loss of the target-related autoencoder to model latent temporal dependencies and enhance feature predictability. Furthermore, the internal state derivative in the proposed irregular-time-interval variational recurrent neural network is parameterized by an ordinary differential equation network, integrating hidden-state evolution with state updates. In addition, all network components are jointly optimized through unified training. Then, an ILPPSDN-based soft sensor is developed for nonuniformly sampled nonlinear dynamic processes via pre-training and supervised fine-tuning. Finally, the results indicate that the proposed ILPPSDN can reduce the root mean square error by at least 26.1 %, 21.1 %, and 26.1 % at the uneven sampling ratios of 1/2, 2/3, and 3/4 in the debutanizer column. Correspondingly, in the sulfur recovery unit, these values are 21.1 %, 26.1 %, and 26.1 %. Additionally, in the ablation studies, the proposed method reduced the root mean square error by at least 5 % and 6 % in the two industrial cases, respectively.

动态潜变量(DLV)模型由于能够提取特征和捕捉动态行为,在工业软测量中得到了广泛的应用。然而,传统的DLV模型仅限于线性特征提取,并且在非均匀采样数据中表现不佳。因此,本文提出了一种基于不规则时间间隔潜在概率可预测性嵌入监督深度网络(ILPPSDN)的非均匀采样非线性动态过程软测量方法。首先,在目标相关自编码器的解码损失中加入预测正则化项,对潜在的时间依赖性进行建模,提高特征的可预测性。此外,将隐状态演化与状态更新相结合,利用常微分方程网络参数化了不规则时间间隔变分递归神经网络的内部状态导数。此外,所有网络组件通过统一培训进行联合优化。然后,通过预训练和监督微调,开发了一种基于ilppsdn的非均匀采样非线性动态过程软传感器。结果表明,在非均匀取样比为1/2、2/3和3/4时,ILPPSDN能将均方根误差分别降低26.1%、21.1%和26.1%。相应的,在硫回收装置中,这些值分别为21.1%、26.1%和26.1%。此外,在消融研究中,所提出的方法在两个工业案例中分别将均方根误差降低了至少5%和6%。
{"title":"Soft sensor for nonuniform sampling nonlinear dynamic process using irregular-time-interval latent probabilistic predictability embedding supervised deep network.","authors":"Zhengxuan Zhang, Xu Yang, Yuri A W Shardt, Jingjing Gao, Jiarui Cui","doi":"10.1016/j.isatra.2025.11.001","DOIUrl":"https://doi.org/10.1016/j.isatra.2025.11.001","url":null,"abstract":"<p><p>Dynamic latent variable (DLV) models have been widely applied in industrial soft sensing due to their ability to extract features and capture dynamic behavior. However, conventional DLV models are limited to linear feature extraction and perform poorly with nonuniformly sampled data. Thus, this paper proposes a soft sensor for a nonuniform sampling nonlinear dynamic process using irregular-time-interval latent probabilistic predictability embedding supervised deep network (ILPPSDN). First, a prediction regularization term is added to the decoding loss of the target-related autoencoder to model latent temporal dependencies and enhance feature predictability. Furthermore, the internal state derivative in the proposed irregular-time-interval variational recurrent neural network is parameterized by an ordinary differential equation network, integrating hidden-state evolution with state updates. In addition, all network components are jointly optimized through unified training. Then, an ILPPSDN-based soft sensor is developed for nonuniformly sampled nonlinear dynamic processes via pre-training and supervised fine-tuning. Finally, the results indicate that the proposed ILPPSDN can reduce the root mean square error by at least 26.1 %, 21.1 %, and 26.1 % at the uneven sampling ratios of 1/2, 2/3, and 3/4 in the debutanizer column. Correspondingly, in the sulfur recovery unit, these values are 21.1 %, 26.1 %, and 26.1 %. Additionally, in the ablation studies, the proposed method reduced the root mean square error by at least 5 % and 6 % in the two industrial cases, respectively.</p>","PeriodicalId":94059,"journal":{"name":"ISA transactions","volume":" ","pages":""},"PeriodicalIF":6.5,"publicationDate":"2025-11-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145524927","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Deep-PCA and MSPCA based fault diagnosis of high-speed train traction systems under missing data conditions. 缺失数据条件下基于深度pca和MSPCA的高速列车牵引系统故障诊断。
IF 6.5 Pub Date : 2025-11-04 DOI: 10.1016/j.isatra.2025.10.051
Yunkai Wu, Yu Tian, Yang Zhou, Xiangqian Liu

The high-speed train power traction system operates for extended periods of time in complex environments with high temperatures and vibrations, making the system susceptible to various types of incipient faults. In addition, coupled with missing sensor data under complex operating conditions, the diagnosis of incipient faults under practical conditions becomes even more challenging. To address the aforementioned issues, this paper proposes an innovative data imputation method that combines kernel functions with the modified Akima (Makima) interpolation algorithm. This method can effectively address the scenario of a large number of sensor signals continuously missing in high-speed train traction systems. Expanding on this, a real-time incipient fault diagnosis framework is proposed, which combines Deep-Principal Component Analysis (Deep-PCA) with Multi-scale Principal Component Analysis (MSPCA). This framework enhances the capability to extract fault features from both horizontal and vertical perspectives, thereby improving the accuracy of fault detection. Furthermore, the continuous wavelet transform (CWT) is employed to amplify fault-related information within the dataset. This enhanced dataset, combined with a fault isolation criterion based on the reconstructed cumulative contribution rate, enables the achievement of precise fault isolation.

高速列车动力牵引系统在高温、振动等复杂环境下长时间运行,易受各种早期故障的影响。此外,再加上复杂工况下传感器数据的缺失,使得实际工况下的早期故障诊断变得更加困难。针对上述问题,本文提出了一种将核函数与改进的Akima (Makima)插值算法相结合的创新数据插补方法。该方法可以有效地解决高速列车牵引系统中连续丢失大量传感器信号的情况。在此基础上,提出了一种结合深度主成分分析(Deep-PCA)和多尺度主成分分析(MSPCA)的实时早期故障诊断框架。该框架增强了从水平和垂直两个角度提取故障特征的能力,从而提高了故障检测的准确性。在此基础上,利用连续小波变换(CWT)对数据集中的故障相关信息进行放大。该增强数据集与基于重构累积贡献率的故障隔离准则相结合,能够实现精确的故障隔离。
{"title":"Deep-PCA and MSPCA based fault diagnosis of high-speed train traction systems under missing data conditions.","authors":"Yunkai Wu, Yu Tian, Yang Zhou, Xiangqian Liu","doi":"10.1016/j.isatra.2025.10.051","DOIUrl":"https://doi.org/10.1016/j.isatra.2025.10.051","url":null,"abstract":"<p><p>The high-speed train power traction system operates for extended periods of time in complex environments with high temperatures and vibrations, making the system susceptible to various types of incipient faults. In addition, coupled with missing sensor data under complex operating conditions, the diagnosis of incipient faults under practical conditions becomes even more challenging. To address the aforementioned issues, this paper proposes an innovative data imputation method that combines kernel functions with the modified Akima (Makima) interpolation algorithm. This method can effectively address the scenario of a large number of sensor signals continuously missing in high-speed train traction systems. Expanding on this, a real-time incipient fault diagnosis framework is proposed, which combines Deep-Principal Component Analysis (Deep-PCA) with Multi-scale Principal Component Analysis (MSPCA). This framework enhances the capability to extract fault features from both horizontal and vertical perspectives, thereby improving the accuracy of fault detection. Furthermore, the continuous wavelet transform (CWT) is employed to amplify fault-related information within the dataset. This enhanced dataset, combined with a fault isolation criterion based on the reconstructed cumulative contribution rate, enables the achievement of precise fault isolation.</p>","PeriodicalId":94059,"journal":{"name":"ISA transactions","volume":" ","pages":""},"PeriodicalIF":6.5,"publicationDate":"2025-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145515063","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Lightweight transformer-based generative adversarial network for acoustic anomaly detection in converter valves. 基于轻量变压器的生成对抗网络在换流阀声学异常检测中的应用。
IF 6.5 Pub Date : 2025-10-31 DOI: 10.1016/j.isatra.2025.10.049
Mingzhu Tang, Chen Yin, Haijun Hu, Zhihong Wang, Fuqiang Xiong, Ying Wei, Zhiwen Chen

Anomaly detection of converter valves via acoustic analysis has been a hot topic in the high-voltage direct current research field. However, several factors have significantly hindered the practical deployment of such acoustic anomaly detection methods, including the infrequency of valve anomalies leading to imbalanced distributions of acoustic samples, limitations in computational resources, and inherent class imbalance in acoustic signals. To address these challenges, this paper proposes a novel unsupervised anomaly detection framework, named lightweight transformer-based generative adversarial networks (LT-GAN). It introduces two lightweight modules, MobileNet V2 and D-MobileNet V2, to perform downsampling and upsampling of Mel-spectrograms derived from acoustic signals. Furthermore, it incorporates a K-ViT block to enhance global representation learning of spectral images and reduce network parameters. Experiments on real-world acoustic datasets show the superiority of the proposed LT-GAN, which achieves an AUC of 0.9806 on the ROC curve, significantly outperforming baseline methods. In the low false-positive regions [0, 0.1], [0, 0.2], and [0, 0.3], the p-AUCs reach 0.9295, 0.9122, and 0.9559, respectively. Moreover, LT-GAN exhibits exceptional lightweight characteristics, with model complexity metrics of 9.626 million parameters, 0.506 GFLOPs, and a model size of 37.48 MB. These results validate the effectiveness of the proposed approach in terms of anomaly detection performance and resource efficiency.

基于声学分析的换流阀异常检测一直是高压直流领域的研究热点。然而,有几个因素严重阻碍了这种声学异常检测方法的实际部署,包括阀门异常的不频繁导致声学样本分布不平衡,计算资源的限制以及声学信号固有的类别不平衡。为了解决这些挑战,本文提出了一种新的无监督异常检测框架,称为基于轻量级变压器的生成对抗网络(LT-GAN)。它引入了两个轻量级模块,MobileNet V2和D-MobileNet V2,用于对声学信号衍生的mel谱图进行下采样和上采样。此外,该算法还引入了K-ViT块,增强了光谱图像的全局表示学习,减少了网络参数。在真实声学数据集上的实验表明,该算法在ROC曲线上的AUC为0.9806,显著优于基线方法。在低假阳性区域[0,0.1]、[0,0.2]和[0,0.3],p- auc分别达到0.9295、0.9122和0.9559。此外,LT-GAN表现出优异的轻量级特征,模型复杂度指标为962.6万个参数,0.506 GFLOPs,模型大小为37.48 MB。这些结果验证了该方法在异常检测性能和资源效率方面的有效性。
{"title":"Lightweight transformer-based generative adversarial network for acoustic anomaly detection in converter valves.","authors":"Mingzhu Tang, Chen Yin, Haijun Hu, Zhihong Wang, Fuqiang Xiong, Ying Wei, Zhiwen Chen","doi":"10.1016/j.isatra.2025.10.049","DOIUrl":"https://doi.org/10.1016/j.isatra.2025.10.049","url":null,"abstract":"<p><p>Anomaly detection of converter valves via acoustic analysis has been a hot topic in the high-voltage direct current research field. However, several factors have significantly hindered the practical deployment of such acoustic anomaly detection methods, including the infrequency of valve anomalies leading to imbalanced distributions of acoustic samples, limitations in computational resources, and inherent class imbalance in acoustic signals. To address these challenges, this paper proposes a novel unsupervised anomaly detection framework, named lightweight transformer-based generative adversarial networks (LT-GAN). It introduces two lightweight modules, MobileNet V2 and D-MobileNet V2, to perform downsampling and upsampling of Mel-spectrograms derived from acoustic signals. Furthermore, it incorporates a K-ViT block to enhance global representation learning of spectral images and reduce network parameters. Experiments on real-world acoustic datasets show the superiority of the proposed LT-GAN, which achieves an AUC of 0.9806 on the ROC curve, significantly outperforming baseline methods. In the low false-positive regions [0, 0.1], [0, 0.2], and [0, 0.3], the p-AUCs reach 0.9295, 0.9122, and 0.9559, respectively. Moreover, LT-GAN exhibits exceptional lightweight characteristics, with model complexity metrics of 9.626 million parameters, 0.506 GFLOPs, and a model size of 37.48 MB. These results validate the effectiveness of the proposed approach in terms of anomaly detection performance and resource efficiency.</p>","PeriodicalId":94059,"journal":{"name":"ISA transactions","volume":" ","pages":""},"PeriodicalIF":6.5,"publicationDate":"2025-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145515142","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Resformer: Time-token transformer with residual compensation for quality prediction in industrial processes. 变压器:用于工业过程质量预测的带有剩余补偿的时间标记变压器。
IF 6.5 Pub Date : 2025-10-31 DOI: 10.1016/j.isatra.2025.10.048
Qiluo Xiong, Yanhui Ren, Fan Yang, Andrei Torgashov

In recent years, deep learning techniques have been increasingly adopted in soft sensor modeling, with the transformer architecture demonstrating notable advantages not only in natural language processing and image analysis but also in time-series modeling. Autoencoders, known for their ability to learn compact representations of process data, have also been widely applied for feature extraction in soft sensors. However, when dealing with multivariate process data, conventional autoencoder-based models often suffer from underfitting due to persistent reconstruction errors or overfitting when the reconstruction loss converges prematurely. These issues hinder effective feature learning and limit the model's generalization capability in real-world applications. To address these challenges, this paper proposes Resformer, a novel transformer-based architecture that incorporates residual feature compensation. Resformer employs a two-stage autoencoding structure to extract both primary and secondary features and fuses them via a cross-attention mechanism to enhance representation completeness. Time tokens are used as the basic modeling units to capture spatiotemporal dependencies among process variables, which are then mapped to the target quality variable through a dedicated decoding structure. Experimental results on the Tennessee Eastman (TE) process and an industrial alkylation process dataset demonstrate that Resformer, with residual compensation and spatiotemporal feature learning, significantly outperforms recent transformer-based variants while maintaining comparable architectural complexity suitable for practical deployment.

近年来,深度学习技术越来越多地应用于软传感器建模,变压器结构不仅在自然语言处理和图像分析方面具有显著优势,而且在时间序列建模方面也具有显著优势。自编码器以其学习过程数据的紧凑表示的能力而闻名,也被广泛应用于软传感器的特征提取。然而,当处理多变量过程数据时,传统的基于自编码器的模型往往由于持续的重构误差或重构损失过早收敛时的过拟合而遭受欠拟合。这些问题阻碍了有效的特征学习,限制了模型在实际应用中的泛化能力。为了解决这些问题,本文提出了一种新的基于变压器的结构,它包含了残差特征补偿。reformer采用两阶段自动编码结构提取主次特征,并通过交叉注意机制进行融合,提高表征的完整性。时间标记被用作基本的建模单元来捕获过程变量之间的时空依赖关系,然后通过专用的解码结构将其映射到目标质量变量。在田纳西伊士曼(TE)过程和工业烷基化过程数据集上的实验结果表明,具有剩余补偿和时空特征学习的Resformer在保持适合实际部署的相当架构复杂性的同时,显著优于最近基于变压器的变体。
{"title":"Resformer: Time-token transformer with residual compensation for quality prediction in industrial processes.","authors":"Qiluo Xiong, Yanhui Ren, Fan Yang, Andrei Torgashov","doi":"10.1016/j.isatra.2025.10.048","DOIUrl":"https://doi.org/10.1016/j.isatra.2025.10.048","url":null,"abstract":"<p><p>In recent years, deep learning techniques have been increasingly adopted in soft sensor modeling, with the transformer architecture demonstrating notable advantages not only in natural language processing and image analysis but also in time-series modeling. Autoencoders, known for their ability to learn compact representations of process data, have also been widely applied for feature extraction in soft sensors. However, when dealing with multivariate process data, conventional autoencoder-based models often suffer from underfitting due to persistent reconstruction errors or overfitting when the reconstruction loss converges prematurely. These issues hinder effective feature learning and limit the model's generalization capability in real-world applications. To address these challenges, this paper proposes Resformer, a novel transformer-based architecture that incorporates residual feature compensation. Resformer employs a two-stage autoencoding structure to extract both primary and secondary features and fuses them via a cross-attention mechanism to enhance representation completeness. Time tokens are used as the basic modeling units to capture spatiotemporal dependencies among process variables, which are then mapped to the target quality variable through a dedicated decoding structure. Experimental results on the Tennessee Eastman (TE) process and an industrial alkylation process dataset demonstrate that Resformer, with residual compensation and spatiotemporal feature learning, significantly outperforms recent transformer-based variants while maintaining comparable architectural complexity suitable for practical deployment.</p>","PeriodicalId":94059,"journal":{"name":"ISA transactions","volume":" ","pages":""},"PeriodicalIF":6.5,"publicationDate":"2025-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145477339","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
FAST: A battery data recovery method for missing information due to delayed telemetry. FAST:由于遥测延迟而丢失信息的电池数据恢复方法。
IF 6.5 Pub Date : 2025-10-30 DOI: 10.1016/j.isatra.2025.10.050
Yixin Nie, Wanxu Cai, Anqi Wang, Fan Yang, Tao Zhang

Satellites are vital for communication and navigation, yet delayed or incomplete telemetry data hinder the evaluation of degradation processes and system reliability. As the core of satellite power systems, lithium batteries ensure operational stability. This study focuses on lithium batteries in low Earth orbit satellites and addresses telemetry delay-induced data loss. A data recovery method, termed the FAST Model, based on feature acquisition and short-sequence prediction, is proposed. The method effectively captures degradation trends and capacity fluctuations, including regeneration effects, with minimal data. In the satellite battery dataset with approximately 70 % missing data, the proposed model reduces recovery errors by more than 50 % compared with existing methods. Furthermore, the data recovered by the FAST Model enables more accurate estimation of the remaining useful life of batteries. Under the same prediction framework, the use of FAST-recovered data leads to a reduction of prediction errors by about 5 %-30 %, as evaluated by metrics such as MAE and RMSE, compared with other recovery approaches.

卫星对通信和导航至关重要,但延迟或不完整的遥测数据阻碍了对退化过程和系统可靠性的评估。锂电池作为卫星动力系统的核心,保证了卫星运行的稳定性。本研究的重点是在低地球轨道卫星的锂电池和解决遥测延迟引起的数据丢失。提出了一种基于特征获取和短序列预测的数据恢复方法FAST模型。该方法以最少的数据有效地捕捉退化趋势和容量波动,包括再生效应。在丢失数据约70% %的卫星电池数据集中,与现有方法相比,该模型将恢复误差降低了50% %以上。此外,FAST模型恢复的数据可以更准确地估计电池的剩余使用寿命。在相同的预测框架下,使用快速恢复的数据与其他恢复方法相比,通过MAE和RMSE等指标评估,预测误差减少了约5 %-30 %。
{"title":"FAST: A battery data recovery method for missing information due to delayed telemetry.","authors":"Yixin Nie, Wanxu Cai, Anqi Wang, Fan Yang, Tao Zhang","doi":"10.1016/j.isatra.2025.10.050","DOIUrl":"https://doi.org/10.1016/j.isatra.2025.10.050","url":null,"abstract":"<p><p>Satellites are vital for communication and navigation, yet delayed or incomplete telemetry data hinder the evaluation of degradation processes and system reliability. As the core of satellite power systems, lithium batteries ensure operational stability. This study focuses on lithium batteries in low Earth orbit satellites and addresses telemetry delay-induced data loss. A data recovery method, termed the FAST Model, based on feature acquisition and short-sequence prediction, is proposed. The method effectively captures degradation trends and capacity fluctuations, including regeneration effects, with minimal data. In the satellite battery dataset with approximately 70 % missing data, the proposed model reduces recovery errors by more than 50 % compared with existing methods. Furthermore, the data recovered by the FAST Model enables more accurate estimation of the remaining useful life of batteries. Under the same prediction framework, the use of FAST-recovered data leads to a reduction of prediction errors by about 5 %-30 %, as evaluated by metrics such as MAE and RMSE, compared with other recovery approaches.</p>","PeriodicalId":94059,"journal":{"name":"ISA transactions","volume":" ","pages":""},"PeriodicalIF":6.5,"publicationDate":"2025-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145446968","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Physics-informed dynamic hybrid modeling for real-time renewable CO2 tracking in refinery co-processing. 炼油厂协同加工中可再生二氧化碳实时跟踪的物理信息动态混合建模。
IF 6.5 Pub Date : 2025-10-30 DOI: 10.1016/j.isatra.2025.10.035
Liang Cao, Yang Liu, Jing Liu, Jianping Su

Climate change mitigation necessitates significant reductions in carbon emissions from traditional refining industries. However, accurately attributing renewable bio-feedstock contributions to CO2 emissions in refinery co-processing remains challenging due to dynamic feedstock variability and complex nonlinear process interactions. Existing static and linear methodologies inadequately address these real-time adaptive demands and intricate nonlinearities. To overcome these shortcomings, we propose a hybrid adaptive modeling framework integrating constrained Recursive Least Squares (RLS) with sparse Generalized Additive Models (GAM), complemented by conformal prediction for uncertainty quantification. Our method adaptively tracks feedstock contributions, ensures physical interpretability through non-negativity constraints. Validated on an industrial dataset of over 86,000 samples, the proposed framework achieves superior predictive accuracy (RMSE: 345.4, R2: 0.950), outperforming 15 baseline methods. More importantly, it delivers interpretable and uncertainty-aware estimates of renewable CO2 emissions in real time, establishing a practical pathway for transparent and data-driven refinery decarbonization.

减缓气候变化需要大量减少传统炼油工业的碳排放。然而,由于原料的动态变化和复杂的非线性过程相互作用,准确地将可再生生物原料对炼油厂协同加工中二氧化碳排放的贡献归因于可再生生物原料仍然具有挑战性。现有的静态和线性方法不足以解决这些实时自适应需求和复杂的非线性问题。为了克服这些缺点,我们提出了一种混合自适应建模框架,将约束递归最小二乘(RLS)与稀疏广义可加模型(GAM)相结合,并辅之以保形预测,用于不确定性量化。我们的方法自适应地跟踪原料贡献,通过非负性约束确保物理可解释性。在超过86,000个样本的工业数据集上进行验证,所提出的框架具有优越的预测精度(RMSE: 345.4, R2: 0.950),优于15种基线方法。更重要的是,它提供了可解释和不确定性的可再生二氧化碳排放实时估计,为透明和数据驱动的炼油厂脱碳建立了切实可行的途径。
{"title":"Physics-informed dynamic hybrid modeling for real-time renewable CO<sub>2</sub> tracking in refinery co-processing.","authors":"Liang Cao, Yang Liu, Jing Liu, Jianping Su","doi":"10.1016/j.isatra.2025.10.035","DOIUrl":"https://doi.org/10.1016/j.isatra.2025.10.035","url":null,"abstract":"<p><p>Climate change mitigation necessitates significant reductions in carbon emissions from traditional refining industries. However, accurately attributing renewable bio-feedstock contributions to CO<sub>2</sub> emissions in refinery co-processing remains challenging due to dynamic feedstock variability and complex nonlinear process interactions. Existing static and linear methodologies inadequately address these real-time adaptive demands and intricate nonlinearities. To overcome these shortcomings, we propose a hybrid adaptive modeling framework integrating constrained Recursive Least Squares (RLS) with sparse Generalized Additive Models (GAM), complemented by conformal prediction for uncertainty quantification. Our method adaptively tracks feedstock contributions, ensures physical interpretability through non-negativity constraints. Validated on an industrial dataset of over 86,000 samples, the proposed framework achieves superior predictive accuracy (RMSE: 345.4, R<sup>2</sup>: 0.950), outperforming 15 baseline methods. More importantly, it delivers interpretable and uncertainty-aware estimates of renewable CO<sub>2</sub> emissions in real time, establishing a practical pathway for transparent and data-driven refinery decarbonization.</p>","PeriodicalId":94059,"journal":{"name":"ISA transactions","volume":" ","pages":""},"PeriodicalIF":6.5,"publicationDate":"2025-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145472552","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
ISA transactions
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1