A novel FuseDecode Autoencoder for industrial visual inspection: Incremental anomaly detection improvement with gradual transition from unsupervised to mixed-supervision learning with reduced human effort
{"title":"A novel FuseDecode Autoencoder for industrial visual inspection: Incremental anomaly detection improvement with gradual transition from unsupervised to mixed-supervision learning with reduced human effort","authors":"Nejc Kozamernik, Drago Bračun","doi":"10.1016/j.compind.2024.104198","DOIUrl":null,"url":null,"abstract":"<div><div>The industrial implementation of automated visual inspection leveraging deep learning is limited due to the labor-intensive labeling of datasets and the lack of datasets containing images of defects, which is especially the case in high-volume manufacturing with zero defect constraints. In this study, we present the FuseDecode Autoencoder (FuseDecode AE), a novel reconstruction-based anomaly detection model featuring incremental learning. Initially, the FuseDecode AE operates in an unsupervised manner on noisy data containing predominantly normal images and a small number of anomalous images. The predictions generated assist experts in distinguishing between normal and anomalous samples. Later, it adapts to weakly labeled datasets by retraining in a semi-supervised manner on normal data augmented with synthetic anomalies. As more real anomalous samples become available, the model further refines its capabilities through mixed-supervision learning on both normal and anomalous samples. Evaluation on a real industrial dataset of coating defects shows the effectiveness of the incremental learning approach. Furthermore, validation on the publicly accessible MVTec AD dataset demonstrates the FuseDecode AE's superiority over other state-of-the-art reconstruction-based models. These findings underscore its generalizability and effectiveness in automated visual inspection tasks, particularly in industrial settings.</div></div>","PeriodicalId":55219,"journal":{"name":"Computers in Industry","volume":"164 ","pages":"Article 104198"},"PeriodicalIF":8.2000,"publicationDate":"2024-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers in Industry","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S016636152400126X","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0
Abstract
The industrial implementation of automated visual inspection leveraging deep learning is limited due to the labor-intensive labeling of datasets and the lack of datasets containing images of defects, which is especially the case in high-volume manufacturing with zero defect constraints. In this study, we present the FuseDecode Autoencoder (FuseDecode AE), a novel reconstruction-based anomaly detection model featuring incremental learning. Initially, the FuseDecode AE operates in an unsupervised manner on noisy data containing predominantly normal images and a small number of anomalous images. The predictions generated assist experts in distinguishing between normal and anomalous samples. Later, it adapts to weakly labeled datasets by retraining in a semi-supervised manner on normal data augmented with synthetic anomalies. As more real anomalous samples become available, the model further refines its capabilities through mixed-supervision learning on both normal and anomalous samples. Evaluation on a real industrial dataset of coating defects shows the effectiveness of the incremental learning approach. Furthermore, validation on the publicly accessible MVTec AD dataset demonstrates the FuseDecode AE's superiority over other state-of-the-art reconstruction-based models. These findings underscore its generalizability and effectiveness in automated visual inspection tasks, particularly in industrial settings.
期刊介绍:
The objective of Computers in Industry is to present original, high-quality, application-oriented research papers that:
• Illuminate emerging trends and possibilities in the utilization of Information and Communication Technology in industry;
• Establish connections or integrations across various technology domains within the expansive realm of computer applications for industry;
• Foster connections or integrations across diverse application areas of ICT in industry.