{"title":"Investigating the effects of data and image enhancement techniques on crack detection accuracy in FMPI","authors":"Qiang Wu , Xunpeng Qin , Xiaochen Xiong","doi":"10.1016/j.aei.2025.103169","DOIUrl":null,"url":null,"abstract":"<div><div>Fluorescent magnetic particle inspection (FMPI) is a vital non-destructive testing technique for detecting surface defects in ferromagnetic materials. However, existing research on FMPI crack detection using deep learning models has been hindered by the limited availability of high-quality and diverse training data. This study addresses this challenge by proposing an approach to synthesize and enhance FMPI crack images, enabling comprehensive exploration of data augmentation strategies and their impact on model performance. A large-scale dataset of high-quality FMPI crack images is generated through a stepwise image synthesis method combining a diffusion model and Poisson image blending. Leveraging the synthesized dataset, the effects of various spatial and pixel-level transformations on crack detection accuracy are systematically investigated, leading to the identification of optimal data augmentation strategies tailored to the unique characteristics of FMPI crack images. A ToneCurve mapping method is developed for image enhancement, enhancing the contrast between crack indications and backgrounds, further improving model performance. The proposed image synthesis and enhancement methods significantly boost crack detection precision on a small-sample FMPI dataset, achieving a 35.2% and 17.6% improvement in mean Average Precision ([email protected], YOLOv5s), and a 27.6% and 8.3% improvement ([email protected], YOLOv8s), compared to non-enhancement and conventional enhancement methods, respectively, demonstrating their practical applicability. The findings underscore the importance of data augmentation strategies and the effectiveness of the proposed methods in enhancing FMPI crack detection accuracy, particularly in scenarios with limited training data. The synthesized dataset is open-sourced (<span><span>https://drive.google.com/drive/folders/1ES47PcW1y6CobrOVr29jGmU6kMdeECJl?usp=sharing</span><svg><path></path></svg></span>) to facilitate further research in this field.</div></div>","PeriodicalId":50941,"journal":{"name":"Advanced Engineering Informatics","volume":"65 ","pages":"Article 103169"},"PeriodicalIF":8.0000,"publicationDate":"2025-02-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Engineering Informatics","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S147403462500062X","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Fluorescent magnetic particle inspection (FMPI) is a vital non-destructive testing technique for detecting surface defects in ferromagnetic materials. However, existing research on FMPI crack detection using deep learning models has been hindered by the limited availability of high-quality and diverse training data. This study addresses this challenge by proposing an approach to synthesize and enhance FMPI crack images, enabling comprehensive exploration of data augmentation strategies and their impact on model performance. A large-scale dataset of high-quality FMPI crack images is generated through a stepwise image synthesis method combining a diffusion model and Poisson image blending. Leveraging the synthesized dataset, the effects of various spatial and pixel-level transformations on crack detection accuracy are systematically investigated, leading to the identification of optimal data augmentation strategies tailored to the unique characteristics of FMPI crack images. A ToneCurve mapping method is developed for image enhancement, enhancing the contrast between crack indications and backgrounds, further improving model performance. The proposed image synthesis and enhancement methods significantly boost crack detection precision on a small-sample FMPI dataset, achieving a 35.2% and 17.6% improvement in mean Average Precision ([email protected], YOLOv5s), and a 27.6% and 8.3% improvement ([email protected], YOLOv8s), compared to non-enhancement and conventional enhancement methods, respectively, demonstrating their practical applicability. The findings underscore the importance of data augmentation strategies and the effectiveness of the proposed methods in enhancing FMPI crack detection accuracy, particularly in scenarios with limited training data. The synthesized dataset is open-sourced (https://drive.google.com/drive/folders/1ES47PcW1y6CobrOVr29jGmU6kMdeECJl?usp=sharing) to facilitate further research in this field.
期刊介绍:
Advanced Engineering Informatics is an international Journal that solicits research papers with an emphasis on 'knowledge' and 'engineering applications'. The Journal seeks original papers that report progress in applying methods of engineering informatics. These papers should have engineering relevance and help provide a scientific base for more reliable, spontaneous, and creative engineering decision-making. Additionally, papers should demonstrate the science of supporting knowledge-intensive engineering tasks and validate the generality, power, and scalability of new methods through rigorous evaluation, preferably both qualitatively and quantitatively. Abstracting and indexing for Advanced Engineering Informatics include Science Citation Index Expanded, Scopus and INSPEC.