Changqing Yuan, Yongfang Xie, Shiwen Xie, Jie Wang
{"title":"用于工业过程质量变量预测的剪枝树状结构时空卷积网络","authors":"Changqing Yuan, Yongfang Xie, Shiwen Xie, Jie Wang","doi":"10.1016/j.jprocont.2024.103312","DOIUrl":null,"url":null,"abstract":"<div><p>In real industrial processes, the rapid and accurate acquisition of quality variables is essential. Therefore, this paper proposes a pruned tree-structured temporal convolutional network (PT-TCN) for efficient and accurate variables prediction. First, a novel tree network is developed, utilizing dilated causal convolution blocks as nodes to avoid the loss of local information. Each node extracts distinct local information, and by concatenating all tree nodes, the network can capture a comprehensive range of temporal scales. Then, to avoid the increased complexity caused by the tree structure, we design an online two-stage pruning strategy to compress the tree network without introducing additional computations. During the training process, blocks are initially pruned based on the correlation assessment between quality variables and tree nodes. Subsequently, weight normalization layers are employed to evaluate the importance of output channels in blocks, thereby enabling intra-block channel pruning. The effectiveness of PT-TCN is verified on Tennessee Eastman benchmark process. In addition, experiments on the real zinc flotation process demonstrate that the proposed PT-TCN improves in <span><math><msup><mrow><mi>R</mi></mrow><mrow><mn>2</mn></mrow></msup></math></span> and MAE by 1.32% and 1.26% respectively in predicting quality variables, and it can reduce 91.8% parameters of the initial tree-structured TCN without sacrificing accuracy.</p></div>","PeriodicalId":50079,"journal":{"name":"Journal of Process Control","volume":"143 ","pages":"Article 103312"},"PeriodicalIF":3.3000,"publicationDate":"2024-09-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Pruned tree-structured temporal convolutional networks for quality variable prediction of industrial process\",\"authors\":\"Changqing Yuan, Yongfang Xie, Shiwen Xie, Jie Wang\",\"doi\":\"10.1016/j.jprocont.2024.103312\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>In real industrial processes, the rapid and accurate acquisition of quality variables is essential. Therefore, this paper proposes a pruned tree-structured temporal convolutional network (PT-TCN) for efficient and accurate variables prediction. First, a novel tree network is developed, utilizing dilated causal convolution blocks as nodes to avoid the loss of local information. Each node extracts distinct local information, and by concatenating all tree nodes, the network can capture a comprehensive range of temporal scales. Then, to avoid the increased complexity caused by the tree structure, we design an online two-stage pruning strategy to compress the tree network without introducing additional computations. During the training process, blocks are initially pruned based on the correlation assessment between quality variables and tree nodes. Subsequently, weight normalization layers are employed to evaluate the importance of output channels in blocks, thereby enabling intra-block channel pruning. The effectiveness of PT-TCN is verified on Tennessee Eastman benchmark process. In addition, experiments on the real zinc flotation process demonstrate that the proposed PT-TCN improves in <span><math><msup><mrow><mi>R</mi></mrow><mrow><mn>2</mn></mrow></msup></math></span> and MAE by 1.32% and 1.26% respectively in predicting quality variables, and it can reduce 91.8% parameters of the initial tree-structured TCN without sacrificing accuracy.</p></div>\",\"PeriodicalId\":50079,\"journal\":{\"name\":\"Journal of Process Control\",\"volume\":\"143 \",\"pages\":\"Article 103312\"},\"PeriodicalIF\":3.3000,\"publicationDate\":\"2024-09-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Process Control\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0959152424001525\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Process Control","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0959152424001525","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
Pruned tree-structured temporal convolutional networks for quality variable prediction of industrial process
In real industrial processes, the rapid and accurate acquisition of quality variables is essential. Therefore, this paper proposes a pruned tree-structured temporal convolutional network (PT-TCN) for efficient and accurate variables prediction. First, a novel tree network is developed, utilizing dilated causal convolution blocks as nodes to avoid the loss of local information. Each node extracts distinct local information, and by concatenating all tree nodes, the network can capture a comprehensive range of temporal scales. Then, to avoid the increased complexity caused by the tree structure, we design an online two-stage pruning strategy to compress the tree network without introducing additional computations. During the training process, blocks are initially pruned based on the correlation assessment between quality variables and tree nodes. Subsequently, weight normalization layers are employed to evaluate the importance of output channels in blocks, thereby enabling intra-block channel pruning. The effectiveness of PT-TCN is verified on Tennessee Eastman benchmark process. In addition, experiments on the real zinc flotation process demonstrate that the proposed PT-TCN improves in and MAE by 1.32% and 1.26% respectively in predicting quality variables, and it can reduce 91.8% parameters of the initial tree-structured TCN without sacrificing accuracy.
期刊介绍:
This international journal covers the application of control theory, operations research, computer science and engineering principles to the solution of process control problems. In addition to the traditional chemical processing and manufacturing applications, the scope of process control problems involves a wide range of applications that includes energy processes, nano-technology, systems biology, bio-medical engineering, pharmaceutical processing technology, energy storage and conversion, smart grid, and data analytics among others.
Papers on the theory in these areas will also be accepted provided the theoretical contribution is aimed at the application and the development of process control techniques.
Topics covered include:
• Control applications• Process monitoring• Plant-wide control• Process control systems• Control techniques and algorithms• Process modelling and simulation• Design methods
Advanced design methods exclude well established and widely studied traditional design techniques such as PID tuning and its many variants. Applications in fields such as control of automotive engines, machinery and robotics are not deemed suitable unless a clear motivation for the relevance to process control is provided.