Deep feature clustering for multi-class industrial image anomaly detection

IF 7.6 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Knowledge-Based Systems Pub Date : 2025-02-28 Epub Date: 2025-02-11 DOI:10.1016/j.knosys.2025.113134
Rongxiang Wang, Zhi Li, Long Zheng, Weidong Wang, Shuyun Li
{"title":"Deep feature clustering for multi-class industrial image anomaly detection","authors":"Rongxiang Wang,&nbsp;Zhi Li,&nbsp;Long Zheng,&nbsp;Weidong Wang,&nbsp;Shuyun Li","doi":"10.1016/j.knosys.2025.113134","DOIUrl":null,"url":null,"abstract":"<div><div>Existing unsupervised multi-class anomaly detection algorithms usually train unified reconstruction networks to capture the distribution of all classes simultaneously. However, under such a challenging setting, popular reconstruction networks need to be elaborately designed to avoid the “identical shortcut”. In addition, the distribution of each category is different, which may mean different requests for expression ability. To solve these problems, built on the intuitive “classification-then-detection” idea, we utilize clustering algorithm to expose the category information hidden in the pre-trained deep features, then propose a simple and application-friendly approach for multi-class anomaly detection. The proposed approach consists of Category Anchor Construction (CAC), Category Information Mining (CIM) and Local Feature Routing (LFR). Firstly, CAC is proposed to extract the corresponding pre-trained features from a small subset of training images to construct category anchors, preserving the valuable category information provided by the training set. Then, CIM is introduced to mine category information embedded in pre-trained features by category anchors voting and acquires the category labels. Finally, to achieve multi-class anomaly detection, we propose LFR, splitting multi-class distribution into multiple single-class distributions according to category labels so that separate single-class anomaly detection heads can be trained to express them. In spite of simplicity, the proposed method outperforms state-of-the-art algorithms in terms of accuracy and stability on the widely used MVTec-AD, VisA, MVTec-LOCO, MPDD and BTAD datasets.</div></div>","PeriodicalId":49939,"journal":{"name":"Knowledge-Based Systems","volume":"311 ","pages":"Article 113134"},"PeriodicalIF":7.6000,"publicationDate":"2025-02-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Knowledge-Based Systems","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0950705125001819","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/2/11 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Existing unsupervised multi-class anomaly detection algorithms usually train unified reconstruction networks to capture the distribution of all classes simultaneously. However, under such a challenging setting, popular reconstruction networks need to be elaborately designed to avoid the “identical shortcut”. In addition, the distribution of each category is different, which may mean different requests for expression ability. To solve these problems, built on the intuitive “classification-then-detection” idea, we utilize clustering algorithm to expose the category information hidden in the pre-trained deep features, then propose a simple and application-friendly approach for multi-class anomaly detection. The proposed approach consists of Category Anchor Construction (CAC), Category Information Mining (CIM) and Local Feature Routing (LFR). Firstly, CAC is proposed to extract the corresponding pre-trained features from a small subset of training images to construct category anchors, preserving the valuable category information provided by the training set. Then, CIM is introduced to mine category information embedded in pre-trained features by category anchors voting and acquires the category labels. Finally, to achieve multi-class anomaly detection, we propose LFR, splitting multi-class distribution into multiple single-class distributions according to category labels so that separate single-class anomaly detection heads can be trained to express them. In spite of simplicity, the proposed method outperforms state-of-the-art algorithms in terms of accuracy and stability on the widely used MVTec-AD, VisA, MVTec-LOCO, MPDD and BTAD datasets.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于深度特征聚类的多类工业图像异常检测
现有的无监督多类异常检测算法通常训练统一的重构网络来同时捕获所有类的分布。然而,在这样一个具有挑战性的背景下,流行的重建网络需要精心设计,以避免“相同的捷径”。此外,每个类别的分布不同,这可能意味着对表达能力的要求不同。为了解决这些问题,我们基于直观的“分类-检测”思想,利用聚类算法将隐藏在预训练深度特征中的类别信息暴露出来,然后提出一种简单且应用友好的多类异常检测方法。该方法包括类别锚点构建(CAC)、类别信息挖掘(CIM)和局部特征路由(LFR)。首先,提出CAC算法,从一小部分训练图像中提取相应的预训练特征来构建类别锚点,保留训练集提供的有价值的类别信息;然后,引入CIM,通过类别锚点投票挖掘嵌入在预训练特征中的类别信息,获取类别标签;最后,为了实现多类异常检测,我们提出了LFR,根据类别标签将多类分布拆分为多个单类分布,从而训练单独的单类异常检测头来表达它们。尽管简单,但在广泛使用的MVTec-AD、VisA、MVTec-LOCO、MPDD和BTAD数据集上,所提出的方法在准确性和稳定性方面优于最先进的算法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Knowledge-Based Systems
Knowledge-Based Systems 工程技术-计算机:人工智能
CiteScore
14.80
自引率
12.50%
发文量
1245
审稿时长
7.8 months
期刊介绍: Knowledge-Based Systems, an international and interdisciplinary journal in artificial intelligence, publishes original, innovative, and creative research results in the field. It focuses on knowledge-based and other artificial intelligence techniques-based systems. The journal aims to support human prediction and decision-making through data science and computation techniques, provide a balanced coverage of theory and practical study, and encourage the development and implementation of knowledge-based intelligence models, methods, systems, and software tools. Applications in business, government, education, engineering, and healthcare are emphasized.
期刊最新文献
Revisiting the role of linguistic knowledge in large language models through prompting ACO–PAL: A prior-Aware learning framework for local path planning in complex environments LLM-enabled universal traffic signal control across different intersections and traffic flows Multi-view semi-supervised classification via innovative graph construction and smoothness-aware graph convolution Galio: Defending ownership of AI-generated images against content-preserving tampering
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1