{"title":"Research on ZYNQ neural network acceleration method for aluminum surface microdefects","authors":"Dongxue Zhao, Shenbo Liu, Zhigang Zhang, Zhao Zhang, Lijun Tang","doi":"10.1016/j.dsp.2024.104900","DOIUrl":null,"url":null,"abstract":"<div><div>Convolutional Neural Networks (CNN) are an important means of detection of microdefects on the aluminum surface, and the high complexity and computing power requirements of the CNN model lead to difficulties in deploying them on edge computing platforms as the detection accuracy continues to improve. We have studied a lightweight acceleration method for detecting microdefects on aluminum surfaces on the Zynq-7000 All Programmable SoC (ZYNQ) platform. A lightweight aluminum surface defect detection network (LADFastDet) and high-performance accelerators based on ZYNQ are designed to meet the requirements of precision and speed under limited resources. In the LADFastDet structure, a lightweight inverted residual block is designed by combining depthwise convolution, inverted residual block, and inverted bottleneck. A multiscale feature fusion structure is designed to effectively improve the detection accuracy of LADFastDet, especially small target defects. We design accelerators on ZYNQ through optimization methods such as loop optimization strategy, ping-pong buffering, and multichannel and multiple interfaces data reading and writing to reduce data access latency and thus improve the computing speed. The experimental results show that the LADFastDet model has a mAP of 97.51%, the inference time of the accelerators for a single image is 42.57 ms, and a power consumption of 2.15 W, which achieves a throughput of 24.9 GOPS and an energy efficiency of 11.58 GOPS/W.</div></div>","PeriodicalId":51011,"journal":{"name":"Digital Signal Processing","volume":"157 ","pages":"Article 104900"},"PeriodicalIF":2.9000,"publicationDate":"2024-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Digital Signal Processing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1051200424005244","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Convolutional Neural Networks (CNN) are an important means of detection of microdefects on the aluminum surface, and the high complexity and computing power requirements of the CNN model lead to difficulties in deploying them on edge computing platforms as the detection accuracy continues to improve. We have studied a lightweight acceleration method for detecting microdefects on aluminum surfaces on the Zynq-7000 All Programmable SoC (ZYNQ) platform. A lightweight aluminum surface defect detection network (LADFastDet) and high-performance accelerators based on ZYNQ are designed to meet the requirements of precision and speed under limited resources. In the LADFastDet structure, a lightweight inverted residual block is designed by combining depthwise convolution, inverted residual block, and inverted bottleneck. A multiscale feature fusion structure is designed to effectively improve the detection accuracy of LADFastDet, especially small target defects. We design accelerators on ZYNQ through optimization methods such as loop optimization strategy, ping-pong buffering, and multichannel and multiple interfaces data reading and writing to reduce data access latency and thus improve the computing speed. The experimental results show that the LADFastDet model has a mAP of 97.51%, the inference time of the accelerators for a single image is 42.57 ms, and a power consumption of 2.15 W, which achieves a throughput of 24.9 GOPS and an energy efficiency of 11.58 GOPS/W.
期刊介绍:
Digital Signal Processing: A Review Journal is one of the oldest and most established journals in the field of signal processing yet it aims to be the most innovative. The Journal invites top quality research articles at the frontiers of research in all aspects of signal processing. Our objective is to provide a platform for the publication of ground-breaking research in signal processing with both academic and industrial appeal.
The journal has a special emphasis on statistical signal processing methodology such as Bayesian signal processing, and encourages articles on emerging applications of signal processing such as:
• big data• machine learning• internet of things• information security• systems biology and computational biology,• financial time series analysis,• autonomous vehicles,• quantum computing,• neuromorphic engineering,• human-computer interaction and intelligent user interfaces,• environmental signal processing,• geophysical signal processing including seismic signal processing,• chemioinformatics and bioinformatics,• audio, visual and performance arts,• disaster management and prevention,• renewable energy,