{"title":"SCL:面向智能制造边缘计算生态系统的可持续深度学习解决方案","authors":"Himanshu Gauttam , K.K. Pattanaik , Saumya Bhadauria , Garima Nain","doi":"10.1016/j.jii.2024.100703","DOIUrl":null,"url":null,"abstract":"<div><div>Edge computing empowered Deep Learning (DL) solutions have risen as the foremost facilitators of automation in a multitude of smart manufacturing applications. These models are implemented on edge devices with frozen learning capabilities to execute DL inference task(s). Nevertheless, the data they process is susceptible to intermittent alterations amidst the ever-changing landscape of dynamic smart manufacturing ecosystem. It sparks the demand for model maintenance solution(s) to address adaptability and dynamism issues to enhance the efficiency of smart manufacturing solutions. Moreover, additional issue(s), such as the non-availability of comprehensive data (or the availability of solely contemporary data), near-real-time execution of DL model maintenance task, etc., imposes daunting obstructions in devising an efficient DL model maintenance strategy. This work proposes a novel approach that encompasses the merits of Continual Learning (CL) and Split Learning (SL) driven by edge intelligence, amalgamating them into a hybrid solution aptly named <em>Split-based Continual Learning (SCL)</em>. CL ensures the sustained performance of the DL model amidst constraints related to data availability. At the same time, SL empowers near-real-time execution at the edge to achieve improved efficiency. An extension of the <em>SCL</em> scheme, termed as <em>Extended SCL (ESCL)</em>, is implemented to addresses the interaction soundness aspects among the mobile edge devices in a collaborative execution environment. Evaluation of a vision-based product-quality inspection use case in an emulated hardware test-bed setup signifies that the performance of <em>SCL</em> and <em>ESCL</em> schemes have the potential to meet the needs of smart manufacturing. <em>SCL</em> attains an appreciable reduction in the model maintenance cost in the range of 21 to 48 and 12 to 29 percent compared to the ECN-only and basic-SL schemes. The <em>ESCL</em> scheme further improved the performance by 18 to 34 and 20 to 36 percent respectively over the basic-SL and <em>SCL</em>.</div></div>","PeriodicalId":55975,"journal":{"name":"Journal of Industrial Information Integration","volume":"42 ","pages":"Article 100703"},"PeriodicalIF":10.4000,"publicationDate":"2024-10-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"SCL: A sustainable deep learning solution for edge computing ecosystem in smart manufacturing\",\"authors\":\"Himanshu Gauttam , K.K. Pattanaik , Saumya Bhadauria , Garima Nain\",\"doi\":\"10.1016/j.jii.2024.100703\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Edge computing empowered Deep Learning (DL) solutions have risen as the foremost facilitators of automation in a multitude of smart manufacturing applications. These models are implemented on edge devices with frozen learning capabilities to execute DL inference task(s). Nevertheless, the data they process is susceptible to intermittent alterations amidst the ever-changing landscape of dynamic smart manufacturing ecosystem. It sparks the demand for model maintenance solution(s) to address adaptability and dynamism issues to enhance the efficiency of smart manufacturing solutions. Moreover, additional issue(s), such as the non-availability of comprehensive data (or the availability of solely contemporary data), near-real-time execution of DL model maintenance task, etc., imposes daunting obstructions in devising an efficient DL model maintenance strategy. This work proposes a novel approach that encompasses the merits of Continual Learning (CL) and Split Learning (SL) driven by edge intelligence, amalgamating them into a hybrid solution aptly named <em>Split-based Continual Learning (SCL)</em>. CL ensures the sustained performance of the DL model amidst constraints related to data availability. At the same time, SL empowers near-real-time execution at the edge to achieve improved efficiency. An extension of the <em>SCL</em> scheme, termed as <em>Extended SCL (ESCL)</em>, is implemented to addresses the interaction soundness aspects among the mobile edge devices in a collaborative execution environment. Evaluation of a vision-based product-quality inspection use case in an emulated hardware test-bed setup signifies that the performance of <em>SCL</em> and <em>ESCL</em> schemes have the potential to meet the needs of smart manufacturing. <em>SCL</em> attains an appreciable reduction in the model maintenance cost in the range of 21 to 48 and 12 to 29 percent compared to the ECN-only and basic-SL schemes. The <em>ESCL</em> scheme further improved the performance by 18 to 34 and 20 to 36 percent respectively over the basic-SL and <em>SCL</em>.</div></div>\",\"PeriodicalId\":55975,\"journal\":{\"name\":\"Journal of Industrial Information Integration\",\"volume\":\"42 \",\"pages\":\"Article 100703\"},\"PeriodicalIF\":10.4000,\"publicationDate\":\"2024-10-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Industrial Information Integration\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2452414X24001468\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Industrial Information Integration","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2452414X24001468","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
SCL: A sustainable deep learning solution for edge computing ecosystem in smart manufacturing
Edge computing empowered Deep Learning (DL) solutions have risen as the foremost facilitators of automation in a multitude of smart manufacturing applications. These models are implemented on edge devices with frozen learning capabilities to execute DL inference task(s). Nevertheless, the data they process is susceptible to intermittent alterations amidst the ever-changing landscape of dynamic smart manufacturing ecosystem. It sparks the demand for model maintenance solution(s) to address adaptability and dynamism issues to enhance the efficiency of smart manufacturing solutions. Moreover, additional issue(s), such as the non-availability of comprehensive data (or the availability of solely contemporary data), near-real-time execution of DL model maintenance task, etc., imposes daunting obstructions in devising an efficient DL model maintenance strategy. This work proposes a novel approach that encompasses the merits of Continual Learning (CL) and Split Learning (SL) driven by edge intelligence, amalgamating them into a hybrid solution aptly named Split-based Continual Learning (SCL). CL ensures the sustained performance of the DL model amidst constraints related to data availability. At the same time, SL empowers near-real-time execution at the edge to achieve improved efficiency. An extension of the SCL scheme, termed as Extended SCL (ESCL), is implemented to addresses the interaction soundness aspects among the mobile edge devices in a collaborative execution environment. Evaluation of a vision-based product-quality inspection use case in an emulated hardware test-bed setup signifies that the performance of SCL and ESCL schemes have the potential to meet the needs of smart manufacturing. SCL attains an appreciable reduction in the model maintenance cost in the range of 21 to 48 and 12 to 29 percent compared to the ECN-only and basic-SL schemes. The ESCL scheme further improved the performance by 18 to 34 and 20 to 36 percent respectively over the basic-SL and SCL.
期刊介绍:
The Journal of Industrial Information Integration focuses on the industry's transition towards industrial integration and informatization, covering not only hardware and software but also information integration. It serves as a platform for promoting advances in industrial information integration, addressing challenges, issues, and solutions in an interdisciplinary forum for researchers, practitioners, and policy makers.
The Journal of Industrial Information Integration welcomes papers on foundational, technical, and practical aspects of industrial information integration, emphasizing the complex and cross-disciplinary topics that arise in industrial integration. Techniques from mathematical science, computer science, computer engineering, electrical and electronic engineering, manufacturing engineering, and engineering management are crucial in this context.