{"title":"基于强化学习的拉格朗日松弛算法求解钢铁企业多能量分配问题","authors":"Miao Chang , Shengnan Zhao , Lixin Tang , Jiyin Liu , Yanyan Zhang","doi":"10.1016/j.compchemeng.2024.108948","DOIUrl":null,"url":null,"abstract":"<div><div>The integrated iron and steel enterprises are typically characterized by the presence of multiple energy media that are highly coupled, frequent start-stop cycles of energy conversion equipment, and fluctuations in energy supply and demand. In this paper, we address the problem of byproduct gas-steam-electricity scheduling in iron and steel enterprises to achieve optimal energy distribution and conversion and reduce the energy cost. This optimization problem for the multi-period full energy chain is formulated as a mathematical programming model that considers equipment start-stop cycles, with the objective of minimizing energy system operating cost. A Lagrangian relaxation framework is employed to decouple the energy management model into several independent single schedules. To further improve the algorithm performance, a novel reinforcement learning-based Lagrangian relaxation algorithm (RL-LR) is proposed, which can dynamically set step size coefficients during the iteration process. Numerical results are presented demonstrating that the RL-LR algorithm can achieve higher optimization efficiency.</div></div>","PeriodicalId":286,"journal":{"name":"Computers & Chemical Engineering","volume":"194 ","pages":"Article 108948"},"PeriodicalIF":3.9000,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A reinforcement learning based Lagrangian relaxation algorithm for multi-energy allocation problem in steel enterprise\",\"authors\":\"Miao Chang , Shengnan Zhao , Lixin Tang , Jiyin Liu , Yanyan Zhang\",\"doi\":\"10.1016/j.compchemeng.2024.108948\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The integrated iron and steel enterprises are typically characterized by the presence of multiple energy media that are highly coupled, frequent start-stop cycles of energy conversion equipment, and fluctuations in energy supply and demand. In this paper, we address the problem of byproduct gas-steam-electricity scheduling in iron and steel enterprises to achieve optimal energy distribution and conversion and reduce the energy cost. This optimization problem for the multi-period full energy chain is formulated as a mathematical programming model that considers equipment start-stop cycles, with the objective of minimizing energy system operating cost. A Lagrangian relaxation framework is employed to decouple the energy management model into several independent single schedules. To further improve the algorithm performance, a novel reinforcement learning-based Lagrangian relaxation algorithm (RL-LR) is proposed, which can dynamically set step size coefficients during the iteration process. Numerical results are presented demonstrating that the RL-LR algorithm can achieve higher optimization efficiency.</div></div>\",\"PeriodicalId\":286,\"journal\":{\"name\":\"Computers & Chemical Engineering\",\"volume\":\"194 \",\"pages\":\"Article 108948\"},\"PeriodicalIF\":3.9000,\"publicationDate\":\"2025-03-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computers & Chemical Engineering\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0098135424003661\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/11/28 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers & Chemical Engineering","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0098135424003661","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/11/28 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
A reinforcement learning based Lagrangian relaxation algorithm for multi-energy allocation problem in steel enterprise
The integrated iron and steel enterprises are typically characterized by the presence of multiple energy media that are highly coupled, frequent start-stop cycles of energy conversion equipment, and fluctuations in energy supply and demand. In this paper, we address the problem of byproduct gas-steam-electricity scheduling in iron and steel enterprises to achieve optimal energy distribution and conversion and reduce the energy cost. This optimization problem for the multi-period full energy chain is formulated as a mathematical programming model that considers equipment start-stop cycles, with the objective of minimizing energy system operating cost. A Lagrangian relaxation framework is employed to decouple the energy management model into several independent single schedules. To further improve the algorithm performance, a novel reinforcement learning-based Lagrangian relaxation algorithm (RL-LR) is proposed, which can dynamically set step size coefficients during the iteration process. Numerical results are presented demonstrating that the RL-LR algorithm can achieve higher optimization efficiency.
期刊介绍:
Computers & Chemical Engineering is primarily a journal of record for new developments in the application of computing and systems technology to chemical engineering problems.