{"title":"基于输出反馈强化学习的上层分离系统容错H∞控制","authors":"Yuguang Zhang;Xiaoyuan Luo;Shaobao Li;Juan Wang;Zhenyu Yang;Xinping Guan","doi":"10.1109/TSMC.2024.3523904","DOIUrl":null,"url":null,"abstract":"The topside separation system is an important device installed on offshore oil exploration platforms for the treatment of produced water. Due to its operation in high-moisture and salt-infested environments, the system is susceptible to valve malfunctions. Additionally, the presence of strong couplings and slugging disturbances in the system further complicate the development of fault-tolerant control (FTC). To achieve this, this article investigates the fault-tolerant <inline-formula> <tex-math>$ H_{\\infty } $ </tex-math></inline-formula> control problem in the topside separation system. To recover control performance against actuator faults while reducing disturbance sensitivity, the fault-tolerant <inline-formula> <tex-math>$ H_{\\infty } $ </tex-math></inline-formula> control problem is formulated for the topside separation system and is expressed as a two-player differential game problem. A Nash equilibrium solution to the fault-tolerant <inline-formula> <tex-math>$ H_{\\infty } $ </tex-math></inline-formula> control problem is derived by solving the game algebraic Riccati equation (GARE). Considering the tailor-made property and difficulty in full-state sensing in industry, an output feedback reinforcement learning (RL) algorithm is proposed to implement the fault-tolerant <inline-formula> <tex-math>$ H_{\\infty } $ </tex-math></inline-formula> control method without the need for system dynamics. Simulation studies are performed to verify the effectiveness of the proposed algorithm.","PeriodicalId":48915,"journal":{"name":"IEEE Transactions on Systems Man Cybernetics-Systems","volume":"55 4","pages":"2795-2805"},"PeriodicalIF":8.7000,"publicationDate":"2025-01-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Fault-Tolerant H ∞ Control for Topside Separation Systems via Output-Feedback Reinforcement Learning\",\"authors\":\"Yuguang Zhang;Xiaoyuan Luo;Shaobao Li;Juan Wang;Zhenyu Yang;Xinping Guan\",\"doi\":\"10.1109/TSMC.2024.3523904\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The topside separation system is an important device installed on offshore oil exploration platforms for the treatment of produced water. Due to its operation in high-moisture and salt-infested environments, the system is susceptible to valve malfunctions. Additionally, the presence of strong couplings and slugging disturbances in the system further complicate the development of fault-tolerant control (FTC). To achieve this, this article investigates the fault-tolerant <inline-formula> <tex-math>$ H_{\\\\infty } $ </tex-math></inline-formula> control problem in the topside separation system. To recover control performance against actuator faults while reducing disturbance sensitivity, the fault-tolerant <inline-formula> <tex-math>$ H_{\\\\infty } $ </tex-math></inline-formula> control problem is formulated for the topside separation system and is expressed as a two-player differential game problem. A Nash equilibrium solution to the fault-tolerant <inline-formula> <tex-math>$ H_{\\\\infty } $ </tex-math></inline-formula> control problem is derived by solving the game algebraic Riccati equation (GARE). Considering the tailor-made property and difficulty in full-state sensing in industry, an output feedback reinforcement learning (RL) algorithm is proposed to implement the fault-tolerant <inline-formula> <tex-math>$ H_{\\\\infty } $ </tex-math></inline-formula> control method without the need for system dynamics. Simulation studies are performed to verify the effectiveness of the proposed algorithm.\",\"PeriodicalId\":48915,\"journal\":{\"name\":\"IEEE Transactions on Systems Man Cybernetics-Systems\",\"volume\":\"55 4\",\"pages\":\"2795-2805\"},\"PeriodicalIF\":8.7000,\"publicationDate\":\"2025-01-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Systems Man Cybernetics-Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10850489/\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Systems Man Cybernetics-Systems","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10850489/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
Fault-Tolerant H ∞ Control for Topside Separation Systems via Output-Feedback Reinforcement Learning
The topside separation system is an important device installed on offshore oil exploration platforms for the treatment of produced water. Due to its operation in high-moisture and salt-infested environments, the system is susceptible to valve malfunctions. Additionally, the presence of strong couplings and slugging disturbances in the system further complicate the development of fault-tolerant control (FTC). To achieve this, this article investigates the fault-tolerant $ H_{\infty } $ control problem in the topside separation system. To recover control performance against actuator faults while reducing disturbance sensitivity, the fault-tolerant $ H_{\infty } $ control problem is formulated for the topside separation system and is expressed as a two-player differential game problem. A Nash equilibrium solution to the fault-tolerant $ H_{\infty } $ control problem is derived by solving the game algebraic Riccati equation (GARE). Considering the tailor-made property and difficulty in full-state sensing in industry, an output feedback reinforcement learning (RL) algorithm is proposed to implement the fault-tolerant $ H_{\infty } $ control method without the need for system dynamics. Simulation studies are performed to verify the effectiveness of the proposed algorithm.
期刊介绍:
The IEEE Transactions on Systems, Man, and Cybernetics: Systems encompasses the fields of systems engineering, covering issue formulation, analysis, and modeling throughout the systems engineering lifecycle phases. It addresses decision-making, issue interpretation, systems management, processes, and various methods such as optimization, modeling, and simulation in the development and deployment of large systems.