Rongxiang Wang, Zhi Li, Long Zheng, Weidong Wang, Shuyun Li
{"title":"Deep feature clustering for multi-class industrial image anomaly detection","authors":"Rongxiang Wang, Zhi Li, Long Zheng, Weidong Wang, Shuyun Li","doi":"10.1016/j.knosys.2025.113134","DOIUrl":null,"url":null,"abstract":"<div><div>Existing unsupervised multi-class anomaly detection algorithms usually train unified reconstruction networks to capture the distribution of all classes simultaneously. However, under such a challenging setting, popular reconstruction networks need to be elaborately designed to avoid the “identical shortcut”. In addition, the distribution of each category is different, which may mean different requests for expression ability. To solve these problems, built on the intuitive “classification-then-detection” idea, we utilize clustering algorithm to expose the category information hidden in the pre-trained deep features, then propose a simple and application-friendly approach for multi-class anomaly detection. The proposed approach consists of Category Anchor Construction (CAC), Category Information Mining (CIM) and Local Feature Routing (LFR). Firstly, CAC is proposed to extract the corresponding pre-trained features from a small subset of training images to construct category anchors, preserving the valuable category information provided by the training set. Then, CIM is introduced to mine category information embedded in pre-trained features by category anchors voting and acquires the category labels. Finally, to achieve multi-class anomaly detection, we propose LFR, splitting multi-class distribution into multiple single-class distributions according to category labels so that separate single-class anomaly detection heads can be trained to express them. In spite of simplicity, the proposed method outperforms state-of-the-art algorithms in terms of accuracy and stability on the widely used MVTec-AD, VisA, MVTec-LOCO, MPDD and BTAD datasets.</div></div>","PeriodicalId":49939,"journal":{"name":"Knowledge-Based Systems","volume":"311 ","pages":"Article 113134"},"PeriodicalIF":7.2000,"publicationDate":"2025-02-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Knowledge-Based Systems","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0950705125001819","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Existing unsupervised multi-class anomaly detection algorithms usually train unified reconstruction networks to capture the distribution of all classes simultaneously. However, under such a challenging setting, popular reconstruction networks need to be elaborately designed to avoid the “identical shortcut”. In addition, the distribution of each category is different, which may mean different requests for expression ability. To solve these problems, built on the intuitive “classification-then-detection” idea, we utilize clustering algorithm to expose the category information hidden in the pre-trained deep features, then propose a simple and application-friendly approach for multi-class anomaly detection. The proposed approach consists of Category Anchor Construction (CAC), Category Information Mining (CIM) and Local Feature Routing (LFR). Firstly, CAC is proposed to extract the corresponding pre-trained features from a small subset of training images to construct category anchors, preserving the valuable category information provided by the training set. Then, CIM is introduced to mine category information embedded in pre-trained features by category anchors voting and acquires the category labels. Finally, to achieve multi-class anomaly detection, we propose LFR, splitting multi-class distribution into multiple single-class distributions according to category labels so that separate single-class anomaly detection heads can be trained to express them. In spite of simplicity, the proposed method outperforms state-of-the-art algorithms in terms of accuracy and stability on the widely used MVTec-AD, VisA, MVTec-LOCO, MPDD and BTAD datasets.
期刊介绍:
Knowledge-Based Systems, an international and interdisciplinary journal in artificial intelligence, publishes original, innovative, and creative research results in the field. It focuses on knowledge-based and other artificial intelligence techniques-based systems. The journal aims to support human prediction and decision-making through data science and computation techniques, provide a balanced coverage of theory and practical study, and encourage the development and implementation of knowledge-based intelligence models, methods, systems, and software tools. Applications in business, government, education, engineering, and healthcare are emphasized.