{"title":"基于自注意力的卷积并行网络:用于高碳转炉炼钢终点预测的高效多输入深度学习模型","authors":"Tian-yi Xie, Fei Zhang, Yi-ren Li, Quan Zhang, Yan-wei Wang, Hao Shang","doi":"10.1007/s11663-024-03204-0","DOIUrl":null,"url":null,"abstract":"<p>In this work, a data-driven model for endpoint prediction of basic oxygen furnace (BOF) steelmaking based on both tabular features (information about hot metal, scrap, additives, blowing practices) and time series (curves of off-gas profiles, sonar slagging, and blowing practices) was developed and implemented. The model was designed with the following distinctive artificial intelligence (AI) characteristics: convolutional neural networks, patching embedding, wavelet decomposition, a parallel structure, a self-attention mechanism, a collaborative attention mechanism, and so on. The model presented in this work is named the self-attention-based convolutional parallel network (SabCP) and was applied to high-carbon steelmaking scenarios. SabCP predicts the endpoint of molten steel temperature (Temp) and chemistry (contents of carbon (C), phosphorus (P), and sulfur (S)). For training, validation, and testing, historical data from 13,656 heats were collected. The testing results show that the mean absolute errors (MAEs) of SabCP for temperature and the contents of carbon, phosphorus, and sulfur are 6.374 °C, 7.192 × 10<sup>−3</sup>, 2.390 × 10<sup>−3</sup>, and 2.224 × 10<sup>−3</sup> pct, respectively, while the mean square errors (MSEs) are 67.345, 1.132 × 10<sup>−4</sup>, 1.306 × 10<sup>−5</sup>, and 1.298 × 10<sup>−5</sup>, respectively, which are lower than those of other published models with same dataset. Relevant importance analyses for tabular features, time series time steps, and channels are also performed. SabCP has been implemented in a prediction module, and the practical results show its strong robustness and generalizability. This model provides significant feasibility for fully eliminating the conventional physical temperature, sampling, and oxygen test (TSO test), which may greatly decrease the cost of BOF steelmaking.</p>","PeriodicalId":18613,"journal":{"name":"Metallurgical and Materials Transactions B","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-08-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Self-Attention-Based Convolutional Parallel Network: An Efficient Multi-Input Deep Learning Model for Endpoint Prediction of High-Carbon BOF Steelmaking\",\"authors\":\"Tian-yi Xie, Fei Zhang, Yi-ren Li, Quan Zhang, Yan-wei Wang, Hao Shang\",\"doi\":\"10.1007/s11663-024-03204-0\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>In this work, a data-driven model for endpoint prediction of basic oxygen furnace (BOF) steelmaking based on both tabular features (information about hot metal, scrap, additives, blowing practices) and time series (curves of off-gas profiles, sonar slagging, and blowing practices) was developed and implemented. The model was designed with the following distinctive artificial intelligence (AI) characteristics: convolutional neural networks, patching embedding, wavelet decomposition, a parallel structure, a self-attention mechanism, a collaborative attention mechanism, and so on. The model presented in this work is named the self-attention-based convolutional parallel network (SabCP) and was applied to high-carbon steelmaking scenarios. SabCP predicts the endpoint of molten steel temperature (Temp) and chemistry (contents of carbon (C), phosphorus (P), and sulfur (S)). For training, validation, and testing, historical data from 13,656 heats were collected. The testing results show that the mean absolute errors (MAEs) of SabCP for temperature and the contents of carbon, phosphorus, and sulfur are 6.374 °C, 7.192 × 10<sup>−3</sup>, 2.390 × 10<sup>−3</sup>, and 2.224 × 10<sup>−3</sup> pct, respectively, while the mean square errors (MSEs) are 67.345, 1.132 × 10<sup>−4</sup>, 1.306 × 10<sup>−5</sup>, and 1.298 × 10<sup>−5</sup>, respectively, which are lower than those of other published models with same dataset. Relevant importance analyses for tabular features, time series time steps, and channels are also performed. SabCP has been implemented in a prediction module, and the practical results show its strong robustness and generalizability. This model provides significant feasibility for fully eliminating the conventional physical temperature, sampling, and oxygen test (TSO test), which may greatly decrease the cost of BOF steelmaking.</p>\",\"PeriodicalId\":18613,\"journal\":{\"name\":\"Metallurgical and Materials Transactions B\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-08-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Metallurgical and Materials Transactions B\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1007/s11663-024-03204-0\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Metallurgical and Materials Transactions B","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/s11663-024-03204-0","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Self-Attention-Based Convolutional Parallel Network: An Efficient Multi-Input Deep Learning Model for Endpoint Prediction of High-Carbon BOF Steelmaking
In this work, a data-driven model for endpoint prediction of basic oxygen furnace (BOF) steelmaking based on both tabular features (information about hot metal, scrap, additives, blowing practices) and time series (curves of off-gas profiles, sonar slagging, and blowing practices) was developed and implemented. The model was designed with the following distinctive artificial intelligence (AI) characteristics: convolutional neural networks, patching embedding, wavelet decomposition, a parallel structure, a self-attention mechanism, a collaborative attention mechanism, and so on. The model presented in this work is named the self-attention-based convolutional parallel network (SabCP) and was applied to high-carbon steelmaking scenarios. SabCP predicts the endpoint of molten steel temperature (Temp) and chemistry (contents of carbon (C), phosphorus (P), and sulfur (S)). For training, validation, and testing, historical data from 13,656 heats were collected. The testing results show that the mean absolute errors (MAEs) of SabCP for temperature and the contents of carbon, phosphorus, and sulfur are 6.374 °C, 7.192 × 10−3, 2.390 × 10−3, and 2.224 × 10−3 pct, respectively, while the mean square errors (MSEs) are 67.345, 1.132 × 10−4, 1.306 × 10−5, and 1.298 × 10−5, respectively, which are lower than those of other published models with same dataset. Relevant importance analyses for tabular features, time series time steps, and channels are also performed. SabCP has been implemented in a prediction module, and the practical results show its strong robustness and generalizability. This model provides significant feasibility for fully eliminating the conventional physical temperature, sampling, and oxygen test (TSO test), which may greatly decrease the cost of BOF steelmaking.