Research on intelligent fault diagnosis for railway point machines using deep reinforcement learning

IF 4.7 Q2 MATERIALS SCIENCE, BIOMATERIALS ACS Applied Bio Materials Pub Date : 2024-03-21 DOI:10.1093/tse/tdae007
Shuai Xiao, Qingsheng Feng, Hong Li, Xue Li
{"title":"Research on intelligent fault diagnosis for railway point machines using deep reinforcement learning","authors":"Shuai Xiao, Qingsheng Feng, Hong Li, Xue Li","doi":"10.1093/tse/tdae007","DOIUrl":null,"url":null,"abstract":"\n The advanced diagnosis of faults in railway point machines is momentous to ensure the efficient and stable operation of the turnout conversion system. Numerous mature deep learning methods have been extensively applied in this domain. While robust perception has yielded excellent diagnostic outcomes, the deficiency in decision-making capability has led to a lack of overall intelligence. To deal with this, this study proposes an end-to-end deep reinforcement learning (DRL) framework for diagnosing faults in railway point machines. Firstly, a one-dimensional convolutional neural network (1DCNN) is used for the automatic extraction of features from the current signal. Subsequently, the deep Q network (DQN) algorithm is introduced as the core of the diagnostic framework. This involves designing an interactive environment for fault classification and optimizing the agent training network. Finally, leveraging fault data, the agent and the environment engage in continuous interactive learning to produce the ideal classification policy. Multiple comparative experiments are conducted to validate the proposed method. The results demonstrate that the diagnostic accuracy reaches 98.41%, and the average accuracy after many iterations is as high as 99.12%. Notably, this research introduces a creative application of DRL to address the challenge of diagnosing faults in railway point machines. The incorporation of decision thought effectively enhances the intelligence of fault diagnosis.","PeriodicalId":2,"journal":{"name":"ACS Applied Bio Materials","volume":" 31","pages":""},"PeriodicalIF":4.7000,"publicationDate":"2024-03-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Applied Bio Materials","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1093/tse/tdae007","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATERIALS SCIENCE, BIOMATERIALS","Score":null,"Total":0}
引用次数: 0

Abstract

The advanced diagnosis of faults in railway point machines is momentous to ensure the efficient and stable operation of the turnout conversion system. Numerous mature deep learning methods have been extensively applied in this domain. While robust perception has yielded excellent diagnostic outcomes, the deficiency in decision-making capability has led to a lack of overall intelligence. To deal with this, this study proposes an end-to-end deep reinforcement learning (DRL) framework for diagnosing faults in railway point machines. Firstly, a one-dimensional convolutional neural network (1DCNN) is used for the automatic extraction of features from the current signal. Subsequently, the deep Q network (DQN) algorithm is introduced as the core of the diagnostic framework. This involves designing an interactive environment for fault classification and optimizing the agent training network. Finally, leveraging fault data, the agent and the environment engage in continuous interactive learning to produce the ideal classification policy. Multiple comparative experiments are conducted to validate the proposed method. The results demonstrate that the diagnostic accuracy reaches 98.41%, and the average accuracy after many iterations is as high as 99.12%. Notably, this research introduces a creative application of DRL to address the challenge of diagnosing faults in railway point machines. The incorporation of decision thought effectively enhances the intelligence of fault diagnosis.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
利用深度强化学习的铁路点机械智能故障诊断研究
要确保道岔转换系统的高效稳定运行,先进的铁路点机故障诊断至关重要。许多成熟的深度学习方法已被广泛应用于这一领域。虽然鲁棒感知取得了很好的诊断效果,但决策能力的不足导致了整体智能的缺失。针对这一问题,本研究提出了一种端到端的深度强化学习(DRL)框架,用于诊断铁路点动车组的故障。首先,使用一维卷积神经网络(1DCNN)从当前信号中自动提取特征。随后,引入深度 Q 网络(DQN)算法作为诊断框架的核心。这包括设计故障分类的交互式环境和优化代理训练网络。最后,利用故障数据,代理和环境进行持续互动学习,以产生理想的分类策略。为了验证所提出的方法,我们进行了多项对比实验。结果表明,诊断准确率达到 98.41%,多次迭代后的平均准确率高达 99.12%。值得注意的是,这项研究创造性地将 DRL 应用于解决铁路点检机的故障诊断难题。决策思想的融入有效提升了故障诊断的智能化水平。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
ACS Applied Bio Materials
ACS Applied Bio Materials Chemistry-Chemistry (all)
CiteScore
9.40
自引率
2.10%
发文量
464
期刊介绍: ACS Applied Bio Materials is an interdisciplinary journal publishing original research covering all aspects of biomaterials and biointerfaces including and beyond the traditional biosensing, biomedical and therapeutic applications. The journal is devoted to reports of new and original experimental and theoretical research of an applied nature that integrates knowledge in the areas of materials, engineering, physics, bioscience, and chemistry into important bio applications. The journal is specifically interested in work that addresses the relationship between structure and function and assesses the stability and degradation of materials under relevant environmental and biological conditions.
期刊最新文献
Synergistically Enhanced Peroxidase-like Activity of FeSe2/rGO Nanohybrids: Kinetic, Mechanistic, and Molecular Docking Studies. Magnetically Recyclable Core-Shell Ag@Fe3O4 Nanoparticles for Waterborne Pathogen Inactivation and Medical Biofilm Eradication. Engineering a Bioactive PMMA-Silica Hybrid Scaffold for Enhanced Bone Regeneration. Issue Publication Information Issue Editorial Masthead
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1