针对具有非对称约束条件的不确定 CSTR 系统的强化学习增强型事件触发可靠性控制

IF 5 2区 计算机科学 Q1 COMPUTER SCIENCE, HARDWARE & ARCHITECTURE IEEE Transactions on Reliability Pub Date : 2024-06-05 DOI:10.1109/TR.2024.3407090
Jian Liu;Jiachen Ke;Jinliang Liu;Xiangpeng Xie;Engang Tian
{"title":"针对具有非对称约束条件的不确定 CSTR 系统的强化学习增强型事件触发可靠性控制","authors":"Jian Liu;Jiachen Ke;Jinliang Liu;Xiangpeng Xie;Engang Tian","doi":"10.1109/TR.2024.3407090","DOIUrl":null,"url":null,"abstract":"From the perspective of industrial production reliability, a robust event-triggered (ET) control strategy is presented for uncertain continuous stirred tank reactor (CSTR) system with asymmetric input constraints. To begin with, we propose a nonquadratic performance function to transform the robust control issue by constructing the relevant auxiliary dynamics. For effectively mitigating the pressure of data transmission and controller execution, a dynamic ET scheme (DETS) with an adjustable threshold function is adopted. Subsequently, we formulate the DETS-based Hamilton–Jacobi–Bellman (DET-HJB) equation according to optimality theory. In addition, a DETS-assisted reinforcement learning algorithm with a unique critic neural network can efficiently tackle the derived DET-HJB equation. Meanwhile, the corresponding critic weight is regulated on the basis of gradient descent technique and experience replay approach. By presenting a rigorous analysis under two situations, the uniform ultimate boundedness of auxiliary dynamics and weight approximation error can be ensured. Eventually, the feasibility of the proposed algorithm is demonstrated by experimental results of CSTR system.","PeriodicalId":56305,"journal":{"name":"IEEE Transactions on Reliability","volume":"74 1","pages":"2069-2081"},"PeriodicalIF":5.0000,"publicationDate":"2024-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Reinforcement Learning-Boosted Event-Triggered Reliability Control for Uncertain CSTR System With Asymmetric Constraints\",\"authors\":\"Jian Liu;Jiachen Ke;Jinliang Liu;Xiangpeng Xie;Engang Tian\",\"doi\":\"10.1109/TR.2024.3407090\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"From the perspective of industrial production reliability, a robust event-triggered (ET) control strategy is presented for uncertain continuous stirred tank reactor (CSTR) system with asymmetric input constraints. To begin with, we propose a nonquadratic performance function to transform the robust control issue by constructing the relevant auxiliary dynamics. For effectively mitigating the pressure of data transmission and controller execution, a dynamic ET scheme (DETS) with an adjustable threshold function is adopted. Subsequently, we formulate the DETS-based Hamilton–Jacobi–Bellman (DET-HJB) equation according to optimality theory. In addition, a DETS-assisted reinforcement learning algorithm with a unique critic neural network can efficiently tackle the derived DET-HJB equation. Meanwhile, the corresponding critic weight is regulated on the basis of gradient descent technique and experience replay approach. By presenting a rigorous analysis under two situations, the uniform ultimate boundedness of auxiliary dynamics and weight approximation error can be ensured. Eventually, the feasibility of the proposed algorithm is demonstrated by experimental results of CSTR system.\",\"PeriodicalId\":56305,\"journal\":{\"name\":\"IEEE Transactions on Reliability\",\"volume\":\"74 1\",\"pages\":\"2069-2081\"},\"PeriodicalIF\":5.0000,\"publicationDate\":\"2024-06-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Reliability\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10549520/\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Reliability","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10549520/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE","Score":null,"Total":0}
引用次数: 0
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Reinforcement Learning-Boosted Event-Triggered Reliability Control for Uncertain CSTR System With Asymmetric Constraints
From the perspective of industrial production reliability, a robust event-triggered (ET) control strategy is presented for uncertain continuous stirred tank reactor (CSTR) system with asymmetric input constraints. To begin with, we propose a nonquadratic performance function to transform the robust control issue by constructing the relevant auxiliary dynamics. For effectively mitigating the pressure of data transmission and controller execution, a dynamic ET scheme (DETS) with an adjustable threshold function is adopted. Subsequently, we formulate the DETS-based Hamilton–Jacobi–Bellman (DET-HJB) equation according to optimality theory. In addition, a DETS-assisted reinforcement learning algorithm with a unique critic neural network can efficiently tackle the derived DET-HJB equation. Meanwhile, the corresponding critic weight is regulated on the basis of gradient descent technique and experience replay approach. By presenting a rigorous analysis under two situations, the uniform ultimate boundedness of auxiliary dynamics and weight approximation error can be ensured. Eventually, the feasibility of the proposed algorithm is demonstrated by experimental results of CSTR system.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Transactions on Reliability
IEEE Transactions on Reliability 工程技术-工程:电子与电气
CiteScore
12.20
自引率
8.50%
发文量
153
审稿时长
7.5 months
期刊介绍: IEEE Transactions on Reliability is a refereed journal for the reliability and allied disciplines including, but not limited to, maintainability, physics of failure, life testing, prognostics, design and manufacture for reliability, reliability for systems of systems, network availability, mission success, warranty, safety, and various measures of effectiveness. Topics eligible for publication range from hardware to software, from materials to systems, from consumer and industrial devices to manufacturing plants, from individual items to networks, from techniques for making things better to ways of predicting and measuring behavior in the field. As an engineering subject that supports new and existing technologies, we constantly expand into new areas of the assurance sciences.
期刊最新文献
Table of Contents IEEE Reliability Society Information Editorial: Applied AI for Reliability and Cybersecurity 2024 Index IEEE Transactions on Reliability Vol. 73 Table of Contents
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1