{"title":"AI-Generated Content-Based Edge Learning for Fast and Efficient Few-Shot Defect Detection in IIoT","authors":"Siyuan Li;Xi Lin;Wenchao Xu;Jianhua Li","doi":"10.1109/TSC.2024.3433529","DOIUrl":null,"url":null,"abstract":"Generative AI has garnered substantial attention due to the limited defect samples in the industrial Internet of Things (IIoT). However, addressing the challenge of few-shot defect detection in industrial edge networks remains a key issue. In this paper, we propose ABEL, a novel AI-generated content (AIGC)-based edge learning framework for fast and efficient few-shot defect detection. This framework facilitates fast few-shot defect detection by harnessing the capabilities of realistic sample synthesis and edge-based AIGC task execution. Specifically, we propose an energy-based model (EBM)-guided Langevin Markov chain Monte Carlo (L-MCMC) image generation algorithm, synthesizing high-resolution industrial defect samples for efficient few-shot defect detection. Then, we formulate a large-scale mixed cooperative-competitive AIGC computation offloading problem and propose an attention and memory-based multi-agent reinforcement learning (AMMARL) algorithm to ensure fast edge execution of heterogeneous defect samples generative tasks. Particularly, the challenges of partial observability and high-dimensional state space are addressed by introducing multi-head attention mechanisms and long-term memory modules. Comprehensive synthesis experiments are conducted utilizing real-world industrial datasets NEU-CLS and DeepPCB. The experimental results demonstrate the effectiveness of our framework and algorithm's effectiveness in efficiently synthesizing realistic industrial defect images and optimizing edge-based AIGC task execution.","PeriodicalId":13255,"journal":{"name":"IEEE Transactions on Services Computing","volume":"17 6","pages":"3140-3153"},"PeriodicalIF":5.8000,"publicationDate":"2024-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Services Computing","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10609561/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Generative AI has garnered substantial attention due to the limited defect samples in the industrial Internet of Things (IIoT). However, addressing the challenge of few-shot defect detection in industrial edge networks remains a key issue. In this paper, we propose ABEL, a novel AI-generated content (AIGC)-based edge learning framework for fast and efficient few-shot defect detection. This framework facilitates fast few-shot defect detection by harnessing the capabilities of realistic sample synthesis and edge-based AIGC task execution. Specifically, we propose an energy-based model (EBM)-guided Langevin Markov chain Monte Carlo (L-MCMC) image generation algorithm, synthesizing high-resolution industrial defect samples for efficient few-shot defect detection. Then, we formulate a large-scale mixed cooperative-competitive AIGC computation offloading problem and propose an attention and memory-based multi-agent reinforcement learning (AMMARL) algorithm to ensure fast edge execution of heterogeneous defect samples generative tasks. Particularly, the challenges of partial observability and high-dimensional state space are addressed by introducing multi-head attention mechanisms and long-term memory modules. Comprehensive synthesis experiments are conducted utilizing real-world industrial datasets NEU-CLS and DeepPCB. The experimental results demonstrate the effectiveness of our framework and algorithm's effectiveness in efficiently synthesizing realistic industrial defect images and optimizing edge-based AIGC task execution.
由于工业物联网(IIoT)中缺陷样本有限,生成人工智能受到了广泛关注。然而,解决工业边缘网络中缺陷检测的挑战仍然是一个关键问题。在本文中,我们提出了一种新的基于ai生成内容(AIGC)的边缘学习框架ABEL,用于快速有效的少镜头缺陷检测。该框架通过利用真实样品合成和基于边缘的AIGC任务执行的能力,促进了快速的少量缺陷检测。具体而言,我们提出了一种基于能量模型(EBM)引导的Langevin Markov chain Monte Carlo (L-MCMC)图像生成算法,合成高分辨率工业缺陷样本,实现高效的少射缺陷检测。在此基础上,提出了一种大规模混合合作-竞争AIGC计算卸载问题,并提出了一种基于注意力和记忆的多智能体强化学习(AMMARL)算法,以保证异构缺陷样本生成任务的快速边缘执行。特别是,通过引入多头注意机制和长期记忆模块,解决了部分可观察性和高维状态空间的挑战。利用真实工业数据集NEU-CLS和DeepPCB进行综合实验。实验结果证明了该框架和算法在高效合成逼真工业缺陷图像和优化基于边缘的AIGC任务执行方面的有效性。
期刊介绍:
IEEE Transactions on Services Computing encompasses the computing and software aspects of the science and technology of services innovation research and development. It places emphasis on algorithmic, mathematical, statistical, and computational methods central to services computing. Topics covered include Service Oriented Architecture, Web Services, Business Process Integration, Solution Performance Management, and Services Operations and Management. The transactions address mathematical foundations, security, privacy, agreement, contract, discovery, negotiation, collaboration, and quality of service for web services. It also covers areas like composite web service creation, business and scientific applications, standards, utility models, business process modeling, integration, collaboration, and more in the realm of Services Computing.