{"title":"基于分布式学习的大型系统多近似MPC协调","authors":"Rui Ren, Shaoyuan Li","doi":"10.1016/j.cherd.2024.12.028","DOIUrl":null,"url":null,"abstract":"<div><div>In the field of process control, there exists a category of large-scale systems composed of multiple interrelated subsystems. Model Predictive Control (MPC) provides an effective control framework for these systems; however, it still faces challenges in handling larger-scale systems and reducing online computation costs. To address these issues, this paper innovatively proposes a distributed learning and approximate control scheme. Firstly, for each subsystem, we obtain a neural network-based approximate MPC controller by utilizing local information for offline training. Subsequently, we design a distributed reinforcement learning method, where the local approximate controllers make coordinated decisions by sharing information with their neighbors. This strategy not only focuses on the performance of the subsystems themselves but also takes into account the performance of neighboring subsystems, thereby effectively enhancing the overall performance of the approximate controllers. Additionally, we adopt a strategy that combines online learning and offline training to cope with changes in system characteristics during the process. The proposed scheme demonstrates good tracking performance, robustness and adaptability, illustrated through an example of a typical chemical process.</div></div>","PeriodicalId":10019,"journal":{"name":"Chemical Engineering Research & Design","volume":"214 ","pages":"Pages 114-124"},"PeriodicalIF":3.9000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Enhanced distributed learning-based coordination of multiple approximate MPC for large-scale systems\",\"authors\":\"Rui Ren, Shaoyuan Li\",\"doi\":\"10.1016/j.cherd.2024.12.028\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>In the field of process control, there exists a category of large-scale systems composed of multiple interrelated subsystems. Model Predictive Control (MPC) provides an effective control framework for these systems; however, it still faces challenges in handling larger-scale systems and reducing online computation costs. To address these issues, this paper innovatively proposes a distributed learning and approximate control scheme. Firstly, for each subsystem, we obtain a neural network-based approximate MPC controller by utilizing local information for offline training. Subsequently, we design a distributed reinforcement learning method, where the local approximate controllers make coordinated decisions by sharing information with their neighbors. This strategy not only focuses on the performance of the subsystems themselves but also takes into account the performance of neighboring subsystems, thereby effectively enhancing the overall performance of the approximate controllers. Additionally, we adopt a strategy that combines online learning and offline training to cope with changes in system characteristics during the process. The proposed scheme demonstrates good tracking performance, robustness and adaptability, illustrated through an example of a typical chemical process.</div></div>\",\"PeriodicalId\":10019,\"journal\":{\"name\":\"Chemical Engineering Research & Design\",\"volume\":\"214 \",\"pages\":\"Pages 114-124\"},\"PeriodicalIF\":3.9000,\"publicationDate\":\"2025-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Chemical Engineering Research & Design\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0263876224007081\",\"RegionNum\":3,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/12/27 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, CHEMICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Chemical Engineering Research & Design","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0263876224007081","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/12/27 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"ENGINEERING, CHEMICAL","Score":null,"Total":0}
Enhanced distributed learning-based coordination of multiple approximate MPC for large-scale systems
In the field of process control, there exists a category of large-scale systems composed of multiple interrelated subsystems. Model Predictive Control (MPC) provides an effective control framework for these systems; however, it still faces challenges in handling larger-scale systems and reducing online computation costs. To address these issues, this paper innovatively proposes a distributed learning and approximate control scheme. Firstly, for each subsystem, we obtain a neural network-based approximate MPC controller by utilizing local information for offline training. Subsequently, we design a distributed reinforcement learning method, where the local approximate controllers make coordinated decisions by sharing information with their neighbors. This strategy not only focuses on the performance of the subsystems themselves but also takes into account the performance of neighboring subsystems, thereby effectively enhancing the overall performance of the approximate controllers. Additionally, we adopt a strategy that combines online learning and offline training to cope with changes in system characteristics during the process. The proposed scheme demonstrates good tracking performance, robustness and adaptability, illustrated through an example of a typical chemical process.
期刊介绍:
ChERD aims to be the principal international journal for publication of high quality, original papers in chemical engineering.
Papers showing how research results can be used in chemical engineering design, and accounts of experimental or theoretical research work bringing new perspectives to established principles, highlighting unsolved problems or indicating directions for future research, are particularly welcome. Contributions that deal with new developments in plant or processes and that can be given quantitative expression are encouraged. The journal is especially interested in papers that extend the boundaries of traditional chemical engineering.