Yuguang Zhang, Juan Wang, Shaobao Li, Xiaoyuan Luo, Xinping Guan
{"title":"基于非策略强化学习的容错 H∞ 控制,用于具有时变不确定性的顶部分离系统。","authors":"Yuguang Zhang, Juan Wang, Shaobao Li, Xiaoyuan Luo, Xinping Guan","doi":"10.1016/j.isatra.2024.11.002","DOIUrl":null,"url":null,"abstract":"<p><p>The topside separation system plays a pivotal role in the treatment of produced water within offshore oil and gas production operations. Due to high-humidity and salt-infested marine environments, topside separation systems are susceptible to dynamic model variations and valve faults. In this work, fault-tolerant control (FTC) of topside separation systems subject to structural uncertainties and slugging disturbances is studied. The system is configured as a cascade structure, comprising a water level control subsystem and a pressure-drop-ratio (PDR) control subsystem. A fault-tolerant H<sub>∞</sub> control framework is developed to cope with actuator faults and slugging disturbances. To enhance control performance in the presence of actuator faults and model uncertainties while reducing sensitivity to slugging disturbances, the fault-tolerant H<sub>∞</sub> control problem for the topside separation system is established as the two-player differential game problem. In addition, a Nash equilibrium solution for the fault-tolerant H<sub>∞</sub> control problem is achieved through the solution of the game algebraic Riccati equation (GARE). A model-free approach is presented to implement the proposed fault-tolerant H<sub>∞</sub> control method using off-policy reinforcement learning (RL). Simulation studies demonstrate the effectiveness of the solution.</p>","PeriodicalId":94059,"journal":{"name":"ISA transactions","volume":" ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Off-policy reinforcement-learning-based fault-tolerant H<sub>∞</sub> control for topside separation systems with time-varying uncertainties.\",\"authors\":\"Yuguang Zhang, Juan Wang, Shaobao Li, Xiaoyuan Luo, Xinping Guan\",\"doi\":\"10.1016/j.isatra.2024.11.002\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>The topside separation system plays a pivotal role in the treatment of produced water within offshore oil and gas production operations. Due to high-humidity and salt-infested marine environments, topside separation systems are susceptible to dynamic model variations and valve faults. In this work, fault-tolerant control (FTC) of topside separation systems subject to structural uncertainties and slugging disturbances is studied. The system is configured as a cascade structure, comprising a water level control subsystem and a pressure-drop-ratio (PDR) control subsystem. A fault-tolerant H<sub>∞</sub> control framework is developed to cope with actuator faults and slugging disturbances. To enhance control performance in the presence of actuator faults and model uncertainties while reducing sensitivity to slugging disturbances, the fault-tolerant H<sub>∞</sub> control problem for the topside separation system is established as the two-player differential game problem. In addition, a Nash equilibrium solution for the fault-tolerant H<sub>∞</sub> control problem is achieved through the solution of the game algebraic Riccati equation (GARE). A model-free approach is presented to implement the proposed fault-tolerant H<sub>∞</sub> control method using off-policy reinforcement learning (RL). Simulation studies demonstrate the effectiveness of the solution.</p>\",\"PeriodicalId\":94059,\"journal\":{\"name\":\"ISA transactions\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-11-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ISA transactions\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1016/j.isatra.2024.11.002\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ISA transactions","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1016/j.isatra.2024.11.002","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Off-policy reinforcement-learning-based fault-tolerant H∞ control for topside separation systems with time-varying uncertainties.
The topside separation system plays a pivotal role in the treatment of produced water within offshore oil and gas production operations. Due to high-humidity and salt-infested marine environments, topside separation systems are susceptible to dynamic model variations and valve faults. In this work, fault-tolerant control (FTC) of topside separation systems subject to structural uncertainties and slugging disturbances is studied. The system is configured as a cascade structure, comprising a water level control subsystem and a pressure-drop-ratio (PDR) control subsystem. A fault-tolerant H∞ control framework is developed to cope with actuator faults and slugging disturbances. To enhance control performance in the presence of actuator faults and model uncertainties while reducing sensitivity to slugging disturbances, the fault-tolerant H∞ control problem for the topside separation system is established as the two-player differential game problem. In addition, a Nash equilibrium solution for the fault-tolerant H∞ control problem is achieved through the solution of the game algebraic Riccati equation (GARE). A model-free approach is presented to implement the proposed fault-tolerant H∞ control method using off-policy reinforcement learning (RL). Simulation studies demonstrate the effectiveness of the solution.