{"title":"Reinforcement Learning-Boosted Event-Triggered Reliability Control for Uncertain CSTR System With Asymmetric Constraints","authors":"Jian Liu;Jiachen Ke;Jinliang Liu;Xiangpeng Xie;Engang Tian","doi":"10.1109/TR.2024.3407090","DOIUrl":null,"url":null,"abstract":"From the perspective of industrial production reliability, a robust event-triggered (ET) control strategy is presented for uncertain continuous stirred tank reactor (CSTR) system with asymmetric input constraints. To begin with, we propose a nonquadratic performance function to transform the robust control issue by constructing the relevant auxiliary dynamics. For effectively mitigating the pressure of data transmission and controller execution, a dynamic ET scheme (DETS) with an adjustable threshold function is adopted. Subsequently, we formulate the DETS-based Hamilton–Jacobi–Bellman (DET-HJB) equation according to optimality theory. In addition, a DETS-assisted reinforcement learning algorithm with a unique critic neural network can efficiently tackle the derived DET-HJB equation. Meanwhile, the corresponding critic weight is regulated on the basis of gradient descent technique and experience replay approach. By presenting a rigorous analysis under two situations, the uniform ultimate boundedness of auxiliary dynamics and weight approximation error can be ensured. Eventually, the feasibility of the proposed algorithm is demonstrated by experimental results of CSTR system.","PeriodicalId":56305,"journal":{"name":"IEEE Transactions on Reliability","volume":"74 1","pages":"2069-2081"},"PeriodicalIF":5.0000,"publicationDate":"2024-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Reliability","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10549520/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE","Score":null,"Total":0}
引用次数: 0
Abstract
From the perspective of industrial production reliability, a robust event-triggered (ET) control strategy is presented for uncertain continuous stirred tank reactor (CSTR) system with asymmetric input constraints. To begin with, we propose a nonquadratic performance function to transform the robust control issue by constructing the relevant auxiliary dynamics. For effectively mitigating the pressure of data transmission and controller execution, a dynamic ET scheme (DETS) with an adjustable threshold function is adopted. Subsequently, we formulate the DETS-based Hamilton–Jacobi–Bellman (DET-HJB) equation according to optimality theory. In addition, a DETS-assisted reinforcement learning algorithm with a unique critic neural network can efficiently tackle the derived DET-HJB equation. Meanwhile, the corresponding critic weight is regulated on the basis of gradient descent technique and experience replay approach. By presenting a rigorous analysis under two situations, the uniform ultimate boundedness of auxiliary dynamics and weight approximation error can be ensured. Eventually, the feasibility of the proposed algorithm is demonstrated by experimental results of CSTR system.
期刊介绍:
IEEE Transactions on Reliability is a refereed journal for the reliability and allied disciplines including, but not limited to, maintainability, physics of failure, life testing, prognostics, design and manufacture for reliability, reliability for systems of systems, network availability, mission success, warranty, safety, and various measures of effectiveness. Topics eligible for publication range from hardware to software, from materials to systems, from consumer and industrial devices to manufacturing plants, from individual items to networks, from techniques for making things better to ways of predicting and measuring behavior in the field. As an engineering subject that supports new and existing technologies, we constantly expand into new areas of the assurance sciences.