Ali Eftekhari Milani, Donatella Zappalá, Simon J. Watson
{"title":"A hybrid Convolutional Autoencoder training algorithm for unsupervised bearing health indicator construction","authors":"Ali Eftekhari Milani, Donatella Zappalá, Simon J. Watson","doi":"10.1016/j.engappai.2024.109477","DOIUrl":null,"url":null,"abstract":"<div><div>Conventional Deep Learning (DL) methods for bearing health indicator (HI) adopt supervised approaches, requiring expert knowledge of the component degradation trend. Since bearings experience various failure modes, assuming a particular degradation trend for HI is suboptimal. Unsupervised DL methods are scarce in this domain. They generally maximise the HI monotonicity built in the middle layer of an Autoencoder (AE) trained to reconstruct the run-to-failure signals. The backpropagation (BP) training algorithm is unable to perform this maximisation since the monotonicity of HI subsections corresponding to input sample batches does not guarantee the monotonicity of the whole HI. Therefore, existing methods achieve this by searching AE hyperparameters so that its BP training to minimise the reconstruction error also leads to a highly monotonic HI in its middle layer. This is done using expensive search algorithms where the AE is trained numerous times using various hyperparameter settings, rendering them impractical for large datasets. To address this limitation, a small Convolutional Autoencoder (CAE) architecture and a hybrid training algorithm combining Particle Swarm Optimisation and BP are proposed in this work to enable simultaneous maximisation of the HI monotonicity and minimisation of the reconstruction error. As a result, the HI is built by training the CAE only once. The results from three case studies demonstrate this method’s lower computational burden compared to other unsupervised DL methods. Furthermore, the CAE-based HIs outperform the indicators built by equivalent and significantly larger models trained with a BP-based supervised approach, leading to 85% lower remaining useful life prediction errors.</div></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":null,"pages":null},"PeriodicalIF":7.5000,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S095219762401635X","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Conventional Deep Learning (DL) methods for bearing health indicator (HI) adopt supervised approaches, requiring expert knowledge of the component degradation trend. Since bearings experience various failure modes, assuming a particular degradation trend for HI is suboptimal. Unsupervised DL methods are scarce in this domain. They generally maximise the HI monotonicity built in the middle layer of an Autoencoder (AE) trained to reconstruct the run-to-failure signals. The backpropagation (BP) training algorithm is unable to perform this maximisation since the monotonicity of HI subsections corresponding to input sample batches does not guarantee the monotonicity of the whole HI. Therefore, existing methods achieve this by searching AE hyperparameters so that its BP training to minimise the reconstruction error also leads to a highly monotonic HI in its middle layer. This is done using expensive search algorithms where the AE is trained numerous times using various hyperparameter settings, rendering them impractical for large datasets. To address this limitation, a small Convolutional Autoencoder (CAE) architecture and a hybrid training algorithm combining Particle Swarm Optimisation and BP are proposed in this work to enable simultaneous maximisation of the HI monotonicity and minimisation of the reconstruction error. As a result, the HI is built by training the CAE only once. The results from three case studies demonstrate this method’s lower computational burden compared to other unsupervised DL methods. Furthermore, the CAE-based HIs outperform the indicators built by equivalent and significantly larger models trained with a BP-based supervised approach, leading to 85% lower remaining useful life prediction errors.
用于轴承健康指标(HI)的传统深度学习(DL)方法采用监督式方法,需要有关部件退化趋势的专家知识。由于轴承的失效模式多种多样,因此假设特定的退化趋势对轴承健康指标来说是次优的。在这一领域,无监督 DL 方法很少见。这些方法通常最大化自动编码器(AE)中间层的 HI 单调性,该自动编码器经过训练,可重建运行至故障信号。反向传播(BP)训练算法无法实现这种最大化,因为与输入样本批次相对应的 HI 子部分的单调性并不能保证整个 HI 的单调性。因此,现有的方法通过搜索 AE 超参数来实现这一目标,以便通过 BP 训练使重建误差最小化,从而在中间层获得高度单调的 HI。要做到这一点,需要使用昂贵的搜索算法,使用各种超参数设置对 AE 进行无数次训练,因此对于大型数据集来说并不实用。为了解决这一局限性,本研究提出了一种小型卷积自动编码器(CAE)架构和一种结合了粒子群优化和 BP 的混合训练算法,以同时实现 HI 单调性最大化和重建误差最小化。因此,只需对 CAE 进行一次训练即可建立 HI。三个案例研究的结果表明,与其他无监督 DL 方法相比,这种方法的计算负担更低。此外,基于 CAE 的 HI 优于通过基于 BP 的监督方法训练的同等且更大的模型所建立的指标,从而将剩余使用寿命预测误差降低了 85%。
期刊介绍:
Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.