Research on intelligent fault diagnosis for railway point machines using deep reinforcement learning

IF 2.7 4区 工程技术 Q2 TRANSPORTATION SCIENCE & TECHNOLOGY Transportation Safety and Environment Pub Date : 2024-03-21 DOI:10.1093/tse/tdae007
Shuai Xiao, Qingsheng Feng, Hong Li, Xue Li
{"title":"Research on intelligent fault diagnosis for railway point machines using deep reinforcement learning","authors":"Shuai Xiao, Qingsheng Feng, Hong Li, Xue Li","doi":"10.1093/tse/tdae007","DOIUrl":null,"url":null,"abstract":"\n The advanced diagnosis of faults in railway point machines is momentous to ensure the efficient and stable operation of the turnout conversion system. Numerous mature deep learning methods have been extensively applied in this domain. While robust perception has yielded excellent diagnostic outcomes, the deficiency in decision-making capability has led to a lack of overall intelligence. To deal with this, this study proposes an end-to-end deep reinforcement learning (DRL) framework for diagnosing faults in railway point machines. Firstly, a one-dimensional convolutional neural network (1DCNN) is used for the automatic extraction of features from the current signal. Subsequently, the deep Q network (DQN) algorithm is introduced as the core of the diagnostic framework. This involves designing an interactive environment for fault classification and optimizing the agent training network. Finally, leveraging fault data, the agent and the environment engage in continuous interactive learning to produce the ideal classification policy. Multiple comparative experiments are conducted to validate the proposed method. The results demonstrate that the diagnostic accuracy reaches 98.41%, and the average accuracy after many iterations is as high as 99.12%. Notably, this research introduces a creative application of DRL to address the challenge of diagnosing faults in railway point machines. The incorporation of decision thought effectively enhances the intelligence of fault diagnosis.","PeriodicalId":52804,"journal":{"name":"Transportation Safety and Environment","volume":null,"pages":null},"PeriodicalIF":2.7000,"publicationDate":"2024-03-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Transportation Safety and Environment","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1093/tse/tdae007","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"TRANSPORTATION SCIENCE & TECHNOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

The advanced diagnosis of faults in railway point machines is momentous to ensure the efficient and stable operation of the turnout conversion system. Numerous mature deep learning methods have been extensively applied in this domain. While robust perception has yielded excellent diagnostic outcomes, the deficiency in decision-making capability has led to a lack of overall intelligence. To deal with this, this study proposes an end-to-end deep reinforcement learning (DRL) framework for diagnosing faults in railway point machines. Firstly, a one-dimensional convolutional neural network (1DCNN) is used for the automatic extraction of features from the current signal. Subsequently, the deep Q network (DQN) algorithm is introduced as the core of the diagnostic framework. This involves designing an interactive environment for fault classification and optimizing the agent training network. Finally, leveraging fault data, the agent and the environment engage in continuous interactive learning to produce the ideal classification policy. Multiple comparative experiments are conducted to validate the proposed method. The results demonstrate that the diagnostic accuracy reaches 98.41%, and the average accuracy after many iterations is as high as 99.12%. Notably, this research introduces a creative application of DRL to address the challenge of diagnosing faults in railway point machines. The incorporation of decision thought effectively enhances the intelligence of fault diagnosis.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
利用深度强化学习的铁路点机械智能故障诊断研究
要确保道岔转换系统的高效稳定运行,先进的铁路点机故障诊断至关重要。许多成熟的深度学习方法已被广泛应用于这一领域。虽然鲁棒感知取得了很好的诊断效果,但决策能力的不足导致了整体智能的缺失。针对这一问题,本研究提出了一种端到端的深度强化学习(DRL)框架,用于诊断铁路点动车组的故障。首先,使用一维卷积神经网络(1DCNN)从当前信号中自动提取特征。随后,引入深度 Q 网络(DQN)算法作为诊断框架的核心。这包括设计故障分类的交互式环境和优化代理训练网络。最后,利用故障数据,代理和环境进行持续互动学习,以产生理想的分类策略。为了验证所提出的方法,我们进行了多项对比实验。结果表明,诊断准确率达到 98.41%,多次迭代后的平均准确率高达 99.12%。值得注意的是,这项研究创造性地将 DRL 应用于解决铁路点检机的故障诊断难题。决策思想的融入有效提升了故障诊断的智能化水平。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Transportation Safety and Environment
Transportation Safety and Environment TRANSPORTATION SCIENCE & TECHNOLOGY-
CiteScore
3.90
自引率
13.60%
发文量
32
审稿时长
10 weeks
期刊最新文献
A maneuver indicator and ensemble learning-based risky driver recognition approach for highway merging areas Unraveling the veil of traffic safety: A comprehensive analysis of factors influencing crash frequency across U.S. States An investigation of ADAS testing scenarios based on vehicle-to-powered two-wheeler accidents occurring in a county-level district in Hunan province Research on intelligent fault diagnosis for railway point machines using deep reinforcement learning A variable time headway model for mixed car-following process considering multiple front vehicles information in foggy weather
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1