SmallNet: A Small Defects Detection Network for Magnetic Chips Based on Context-Weighted Aggregation and Feature Multiscale Loop Fusion

IF 6.4 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS IEEE Transactions on Automation Science and Engineering Pub Date : 2024-12-20 DOI:10.1109/TASE.2024.3517537
Weijian Liang;Yaoru Sun;Siyu Zhang;Lizhi Bai;Jun Yang
{"title":"SmallNet: A Small Defects Detection Network for Magnetic Chips Based on Context-Weighted Aggregation and Feature Multiscale Loop Fusion","authors":"Weijian Liang;Yaoru Sun;Siyu Zhang;Lizhi Bai;Jun Yang","doi":"10.1109/TASE.2024.3517537","DOIUrl":null,"url":null,"abstract":"Accurate detection of surface defects on magnetic chips is a necessary and difficult task, especially for small defects, which lack discriminative and robust features due to their small size and weak characteristics. At present, the low accuracy of small defect detection seriously restricts the development of automated visual inspection and needs to be solved urgently. Thus, we propose a novel small defects detection network based on context-weighted aggregation and feature multiscale loop fusion. First, a context-weighted aggregation module (CAM) that enriches feature representations by combining context and attention mechanisms is proposed. We believe that any further improvements will be futile if robust feature representations cannot be obtained. Second, inspired by the mechanism of looking and thinking twice, we aggregate left-right feedback connections into feature pyramids and creatively propose a loop-shaped feature pyramid network (Loop-FPN), enabling multiscale features to be fused up and down and connected left and right. This loop-shaped structure makes the connection of each layer more direct and allows the features at each scale to be fully integrated, which improves the utilization of multiscale features and facilitates the detection of small defects. Finally, we apply the proposed network to practical detection and the results show that our network achieves 97.57% precision, 91.91% recall, and 98.39% AP, which are 0.13%, 1.43%, and 0.99% higher than the current best-performing comparative methods, respectively. Note to Practitioners—Current vision inspection technology has low accuracy and poor stability in small defect detection, which cannot meet the industrial inspection requirements. Small defect detection has become the biggest challenge in the field of visual inspection and has seriously restricted its development. Our proposed network can solve this problem well by mining small defect context, fusing multiscale features and utilizing attention mechanisms, and has been successfully applied in magnetic chip production line. Furthermore, we developed an image acquisition system that can capture defects on all surfaces with high accuracy and without dead space, allowing our network to not only detect small defects on magnetic chips of varying sizes and irregular shapes, but also to adapt to changes in lighting conditions, backgrounds, and viewpoints. Our work provides an effective, reliable, and convenient quality control solution for magnetic chip production.","PeriodicalId":51060,"journal":{"name":"IEEE Transactions on Automation Science and Engineering","volume":"22 ","pages":"10095-10106"},"PeriodicalIF":6.4000,"publicationDate":"2024-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Automation Science and Engineering","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10810667/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

Accurate detection of surface defects on magnetic chips is a necessary and difficult task, especially for small defects, which lack discriminative and robust features due to their small size and weak characteristics. At present, the low accuracy of small defect detection seriously restricts the development of automated visual inspection and needs to be solved urgently. Thus, we propose a novel small defects detection network based on context-weighted aggregation and feature multiscale loop fusion. First, a context-weighted aggregation module (CAM) that enriches feature representations by combining context and attention mechanisms is proposed. We believe that any further improvements will be futile if robust feature representations cannot be obtained. Second, inspired by the mechanism of looking and thinking twice, we aggregate left-right feedback connections into feature pyramids and creatively propose a loop-shaped feature pyramid network (Loop-FPN), enabling multiscale features to be fused up and down and connected left and right. This loop-shaped structure makes the connection of each layer more direct and allows the features at each scale to be fully integrated, which improves the utilization of multiscale features and facilitates the detection of small defects. Finally, we apply the proposed network to practical detection and the results show that our network achieves 97.57% precision, 91.91% recall, and 98.39% AP, which are 0.13%, 1.43%, and 0.99% higher than the current best-performing comparative methods, respectively. Note to Practitioners—Current vision inspection technology has low accuracy and poor stability in small defect detection, which cannot meet the industrial inspection requirements. Small defect detection has become the biggest challenge in the field of visual inspection and has seriously restricted its development. Our proposed network can solve this problem well by mining small defect context, fusing multiscale features and utilizing attention mechanisms, and has been successfully applied in magnetic chip production line. Furthermore, we developed an image acquisition system that can capture defects on all surfaces with high accuracy and without dead space, allowing our network to not only detect small defects on magnetic chips of varying sizes and irregular shapes, but also to adapt to changes in lighting conditions, backgrounds, and viewpoints. Our work provides an effective, reliable, and convenient quality control solution for magnetic chip production.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于上下文加权聚合和特征多尺度环路融合的磁性芯片小缺陷检测网络SmallNet
磁芯片表面缺陷的精确检测是一项必要且困难的任务,特别是对于小缺陷,由于其体积小,特性弱,缺乏判别性和鲁棒性。目前,小缺陷检测精度低的问题严重制约了自动化视觉检测的发展,亟待解决。为此,我们提出了一种基于上下文加权聚合和特征多尺度环路融合的小缺陷检测网络。首先,提出了一种上下文加权聚合模块(CAM),该模块通过结合上下文和注意机制来丰富特征表示。我们认为,如果不能获得稳健的特征表示,任何进一步的改进都将是徒劳的。其次,受二次观察和二次思考机制的启发,我们将左右反馈连接聚合成特征金字塔,创造性地提出了一种环形特征金字塔网络(Loop-FPN),实现了多尺度特征的上下融合和左右连接。这种环形结构使得每一层的连接更加直接,使得每一尺度的特征得到充分的整合,提高了多尺度特征的利用率,便于小缺陷的检测。最后,我们将所提出的网络应用于实际检测,结果表明,我们的网络达到了97.57%的准确率、91.91%的召回率和98.39%的AP,分别比目前性能最好的比较方法提高了0.13%、1.43%和0.99%。从业人员注意:目前的视觉检测技术在小缺陷检测中精度低、稳定性差,不能满足工业检测要求。小缺陷检测已成为视觉检测领域面临的最大挑战,严重制约了视觉检测的发展。该网络通过挖掘小缺陷上下文、融合多尺度特征和利用注意机制,很好地解决了这一问题,并已成功应用于磁片生产线。此外,我们开发了一种图像采集系统,可以高精度地捕获所有表面上的缺陷,并且没有死区,使我们的网络不仅可以检测不同尺寸和不规则形状的磁性芯片上的小缺陷,还可以适应光照条件,背景和视点的变化。我们的工作为磁片生产提供了有效、可靠、方便的质量控制解决方案。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
IEEE Transactions on Automation Science and Engineering
IEEE Transactions on Automation Science and Engineering 工程技术-自动化与控制系统
CiteScore
12.50
自引率
14.30%
发文量
404
审稿时长
3.0 months
期刊介绍: The IEEE Transactions on Automation Science and Engineering (T-ASE) publishes fundamental papers on Automation, emphasizing scientific results that advance efficiency, quality, productivity, and reliability. T-ASE encourages interdisciplinary approaches from computer science, control systems, electrical engineering, mathematics, mechanical engineering, operations research, and other fields. T-ASE welcomes results relevant to industries such as agriculture, biotechnology, healthcare, home automation, maintenance, manufacturing, pharmaceuticals, retail, security, service, supply chains, and transportation. T-ASE addresses a research community willing to integrate knowledge across disciplines and industries. For this purpose, each paper includes a Note to Practitioners that summarizes how its results can be applied or how they might be extended to apply in practice.
期刊最新文献
Adaptive Delayed Implementation of Derivative-dependent Control for Nonlinear Systems with Biased Measurements Adaptive Nash Equilibria Seeking in Directed Networks with Application to Energy Allocation Adaptive Predefined-Time Distance Regulation Control for 2-D Vehicle Platoon with Actuator Faults and Saturation Active Fault-tolerant Platooning Control for Intelligent and Connected Vehicles under Random Switching Topologies Implicit Point-to-Voxel LiDAR-IMU SLAM
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1