Image defect classification of surface mount technology welding based on the improved ResNet model

IF 0.9 4区 工程技术 Q3 ENGINEERING, MULTIDISCIPLINARY Journal of Engineering Research Pub Date : 2024-06-01 DOI:10.1016/j.jer.2024.02.007
Qiang Zhang , Kaiyun Zhang , Kailin Pan , Wei Huang
{"title":"Image defect classification of surface mount technology welding based on the improved ResNet model","authors":"Qiang Zhang ,&nbsp;Kaiyun Zhang ,&nbsp;Kailin Pan ,&nbsp;Wei Huang","doi":"10.1016/j.jer.2024.02.007","DOIUrl":null,"url":null,"abstract":"<div><p>In mass production, welding flaw detection in existing surface mount technology (SMT) has certain constraints, including its high costs, heavy workloads, and time-consuming processes. However, image classification technology using computer vision demonstrates high detection speeds and considerably reduced detection costs in flaw detection. Nevertheless, the increased integration of chip components on printed circuit boards (PCBs) and reduced component sizes pose challenges for flaw detection technology. Therefore, in this paper, an SMT welding image flaw classification model—that is, the ResNet-34-ECA model—based on an improved ResNet model, is proposed. Initially, the dataset is amplified using data amplification methods, such as stochastic rotation, increased data diversity, and enhanced model robustness. The ResNet34 model is then optimized using the light quantization efficient channel attention (ECA) module, resulting in higher classification accuracy. The experimental data in this study were collected using automated optical inspection (AOI) equipment, following the manual creation and amplification of the dataset. The experimental results showed that the baseline model accuracy increased by 0.22 in the augmented dataset, reaching 97.2%. Moreover, the ResNet-34-ECA model proposed in this paper could realize the classification of SMT welding image defects successfully; the overall classification accuracy of the improved ResNet image classification model was 0.01 higher than that of the baseline model, reaching 98.2%. Consequently, the proposed model proves to be better than other models in defect classification on this dataset, providing an accurate classification of SMT welding image defects.</p></div>","PeriodicalId":48803,"journal":{"name":"Journal of Engineering Research","volume":null,"pages":null},"PeriodicalIF":0.9000,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2307187724000348/pdfft?md5=823a5a69e8235bc17344b77ed83a4382&pid=1-s2.0-S2307187724000348-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Engineering Research","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2307187724000348","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

Abstract

In mass production, welding flaw detection in existing surface mount technology (SMT) has certain constraints, including its high costs, heavy workloads, and time-consuming processes. However, image classification technology using computer vision demonstrates high detection speeds and considerably reduced detection costs in flaw detection. Nevertheless, the increased integration of chip components on printed circuit boards (PCBs) and reduced component sizes pose challenges for flaw detection technology. Therefore, in this paper, an SMT welding image flaw classification model—that is, the ResNet-34-ECA model—based on an improved ResNet model, is proposed. Initially, the dataset is amplified using data amplification methods, such as stochastic rotation, increased data diversity, and enhanced model robustness. The ResNet34 model is then optimized using the light quantization efficient channel attention (ECA) module, resulting in higher classification accuracy. The experimental data in this study were collected using automated optical inspection (AOI) equipment, following the manual creation and amplification of the dataset. The experimental results showed that the baseline model accuracy increased by 0.22 in the augmented dataset, reaching 97.2%. Moreover, the ResNet-34-ECA model proposed in this paper could realize the classification of SMT welding image defects successfully; the overall classification accuracy of the improved ResNet image classification model was 0.01 higher than that of the baseline model, reaching 98.2%. Consequently, the proposed model proves to be better than other models in defect classification on this dataset, providing an accurate classification of SMT welding image defects.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于改进的 ResNet 模型的表面贴装技术焊接图像缺陷分类
在批量生产中,现有表面贴装技术(SMT)的焊接探伤存在一定的局限性,包括成本高、工作量大、耗时长等。然而,利用计算机视觉的图像分类技术在探伤方面表现出较高的检测速度,并大大降低了检测成本。然而,印刷电路板(PCB)上芯片元件集成度的提高和元件尺寸的缩小给探伤技术带来了挑战。因此,本文基于改进的 ResNet 模型,提出了一种 SMT 焊接图像缺陷分类模型,即 ResNet-34-ECA 模型。首先,使用随机旋转、增加数据多样性和增强模型鲁棒性等数据放大方法对数据集进行放大。然后使用光量子化高效通道关注(ECA)模块优化 ResNet34 模型,从而提高分类准确率。本研究的实验数据是在手动创建和放大数据集之后,使用自动光学检测(AOI)设备收集的。实验结果表明,在增强数据集中,基线模型的准确率提高了 0.22,达到了 97.2%。此外,本文提出的 ResNet-34-ECA 模型也成功实现了对 SMT 焊接图像缺陷的分类;改进后的 ResNet 图像分类模型的整体分类准确率比基线模型高 0.01,达到 98.2%。因此,在该数据集上,本文提出的模型在缺陷分类方面优于其他模型,为 SMT 焊接图像缺陷提供了准确的分类。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Journal of Engineering Research
Journal of Engineering Research ENGINEERING, MULTIDISCIPLINARY-
CiteScore
1.60
自引率
10.00%
发文量
181
审稿时长
20 weeks
期刊介绍: Journal of Engineering Research (JER) is a international, peer reviewed journal which publishes full length original research papers, reviews, case studies related to all areas of Engineering such as: Civil, Mechanical, Industrial, Electrical, Computer, Chemical, Petroleum, Aerospace, Architectural, Biomedical, Coastal, Environmental, Marine & Ocean, Metallurgical & Materials, software, Surveying, Systems and Manufacturing Engineering. In particular, JER focuses on innovative approaches and methods that contribute to solving the environmental and manufacturing problems, which exist primarily in the Arabian Gulf region and the Middle East countries. Kuwait University used to publish the Journal "Kuwait Journal of Science and Engineering" (ISSN: 1024-8684), which included Science and Engineering articles since 1974. In 2011 the decision was taken to split KJSE into two independent Journals - "Journal of Engineering Research "(JER) and "Kuwait Journal of Science" (KJS).
期刊最新文献
The influence of the pre-addition of semi-dry and dry slaked lime during the purification of flue gas on the subsequent chelation and solidification treatment of MSWI fly ash A study of appropriate wave energy technology for sustainable development in Australia An Experimental Study on Determination of Optimal Tilt and Orientation Angles in Photovoltaic Systems AI Approach on Identifying Change in Public Sentiment for Major Events: Dubai Expo 2020 Investigating Low Velocity Impact and Compssression After Impact Behaviors of Carbon Fiber/Epoxy Composites Reinforced with Helical Multiwalled Carbon Nanotubes
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1