{"title":"DAUP:通过密度感知点云上采样增强三维工业异常检测的点云均匀性","authors":"","doi":"10.1016/j.aei.2024.102823","DOIUrl":null,"url":null,"abstract":"<div><p>The use of 3D information in industrial anomaly detection tasks has been shown to enhance performance by uncovering unseen abnormal patterns in the RGB modality. Despite the focus on detection pipeline design and multimodal fusion schemes in previous approaches, explorations of dataset characteristics were often overlooked. In contrast to RGB images where pixels form regular grids, point clouds intrinsically lack order and exhibit inhomogeneous densities across regions, thereby adversely affecting the feature extraction process. In this work, we propose a learning-based density-aware point cloud upsampling module (DAUP) to address the inhomogeneous problem. A learning-based neural shape function is developed to generate a local representation of the surface for point upsampling purposes. Utilizing the points generated by the neural shape function, we devise a density-aware resampling mechanism aimed at selecting a diverse number of points from varied regions to facilitate adaptive upsampling within regions of varying densities. DAUP can substantially reducing the misclassification rate for off-the-shelf anomaly detection pipelines. Extensive experiments confirm the effectiveness of our upsampling method on the benchmark dataset MVTec 3D-AD. Notably, our method surpasses previous state-of-the-art methods in terms of image-level AUROC based on the feature bank-based anomaly detection pipeline.</p></div>","PeriodicalId":50941,"journal":{"name":"Advanced Engineering Informatics","volume":null,"pages":null},"PeriodicalIF":8.0000,"publicationDate":"2024-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"DAUP: Enhancing point cloud homogeneity for 3D industrial anomaly detection via density-aware point cloud upsampling\",\"authors\":\"\",\"doi\":\"10.1016/j.aei.2024.102823\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>The use of 3D information in industrial anomaly detection tasks has been shown to enhance performance by uncovering unseen abnormal patterns in the RGB modality. Despite the focus on detection pipeline design and multimodal fusion schemes in previous approaches, explorations of dataset characteristics were often overlooked. In contrast to RGB images where pixels form regular grids, point clouds intrinsically lack order and exhibit inhomogeneous densities across regions, thereby adversely affecting the feature extraction process. In this work, we propose a learning-based density-aware point cloud upsampling module (DAUP) to address the inhomogeneous problem. A learning-based neural shape function is developed to generate a local representation of the surface for point upsampling purposes. Utilizing the points generated by the neural shape function, we devise a density-aware resampling mechanism aimed at selecting a diverse number of points from varied regions to facilitate adaptive upsampling within regions of varying densities. DAUP can substantially reducing the misclassification rate for off-the-shelf anomaly detection pipelines. Extensive experiments confirm the effectiveness of our upsampling method on the benchmark dataset MVTec 3D-AD. Notably, our method surpasses previous state-of-the-art methods in terms of image-level AUROC based on the feature bank-based anomaly detection pipeline.</p></div>\",\"PeriodicalId\":50941,\"journal\":{\"name\":\"Advanced Engineering Informatics\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":8.0000,\"publicationDate\":\"2024-09-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Advanced Engineering Informatics\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1474034624004713\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Engineering Informatics","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1474034624004713","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
DAUP: Enhancing point cloud homogeneity for 3D industrial anomaly detection via density-aware point cloud upsampling
The use of 3D information in industrial anomaly detection tasks has been shown to enhance performance by uncovering unseen abnormal patterns in the RGB modality. Despite the focus on detection pipeline design and multimodal fusion schemes in previous approaches, explorations of dataset characteristics were often overlooked. In contrast to RGB images where pixels form regular grids, point clouds intrinsically lack order and exhibit inhomogeneous densities across regions, thereby adversely affecting the feature extraction process. In this work, we propose a learning-based density-aware point cloud upsampling module (DAUP) to address the inhomogeneous problem. A learning-based neural shape function is developed to generate a local representation of the surface for point upsampling purposes. Utilizing the points generated by the neural shape function, we devise a density-aware resampling mechanism aimed at selecting a diverse number of points from varied regions to facilitate adaptive upsampling within regions of varying densities. DAUP can substantially reducing the misclassification rate for off-the-shelf anomaly detection pipelines. Extensive experiments confirm the effectiveness of our upsampling method on the benchmark dataset MVTec 3D-AD. Notably, our method surpasses previous state-of-the-art methods in terms of image-level AUROC based on the feature bank-based anomaly detection pipeline.
期刊介绍:
Advanced Engineering Informatics is an international Journal that solicits research papers with an emphasis on 'knowledge' and 'engineering applications'. The Journal seeks original papers that report progress in applying methods of engineering informatics. These papers should have engineering relevance and help provide a scientific base for more reliable, spontaneous, and creative engineering decision-making. Additionally, papers should demonstrate the science of supporting knowledge-intensive engineering tasks and validate the generality, power, and scalability of new methods through rigorous evaluation, preferably both qualitatively and quantitatively. Abstracting and indexing for Advanced Engineering Informatics include Science Citation Index Expanded, Scopus and INSPEC.