Junpeng Wu, Jiajun Zeng, Yibo Zhou, Ye Zhang, Yiwen Zhang
{"title":"基于改进的两级微调方法的少镜头电气设备图像识别方法","authors":"Junpeng Wu, Jiajun Zeng, Yibo Zhou, Ye Zhang, Yiwen Zhang","doi":"10.1049/tje2.12313","DOIUrl":null,"url":null,"abstract":"Abstract In the process of electrical equipment detection based on deep learning, insufficient image samples of the target equipment will lead to detection failure. To solve this problem, an object detection network and two‐stage fine‐tuning approach based on You Only Look Once (YOLO)v4 is proposed in this paper to achieve image recognition of electrical equipment under the condition of small samples. Using the two‐stage and dual‐network method as the training strategy, the data‐rich base class samples are used to train the sample classifier based on the modified cosine similarity in the base class training stage, and the fine‐tuning is carried out in the small sample new class training stage. In the training part, the improved Retinanet network is used for coarse detection and the YOLOv4 network with Convolutional Block Attention Module (CBAM) attentional mechanism module is inserted for fine detection. The experimental results show that the average accuracy of the proposed method under the settings of 5‐shot, 10‐shot, and 30‐shot is 31.6%, 34.3%, and 52.8%, respectively, which greatly improves the ability of electrical equipment identification under the condition of few‐shot.","PeriodicalId":22858,"journal":{"name":"The Journal of Engineering","volume":"2012 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Few‐shot electrical equipment image recognition method based on an improved two‐stage fine‐tuning approach\",\"authors\":\"Junpeng Wu, Jiajun Zeng, Yibo Zhou, Ye Zhang, Yiwen Zhang\",\"doi\":\"10.1049/tje2.12313\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Abstract In the process of electrical equipment detection based on deep learning, insufficient image samples of the target equipment will lead to detection failure. To solve this problem, an object detection network and two‐stage fine‐tuning approach based on You Only Look Once (YOLO)v4 is proposed in this paper to achieve image recognition of electrical equipment under the condition of small samples. Using the two‐stage and dual‐network method as the training strategy, the data‐rich base class samples are used to train the sample classifier based on the modified cosine similarity in the base class training stage, and the fine‐tuning is carried out in the small sample new class training stage. In the training part, the improved Retinanet network is used for coarse detection and the YOLOv4 network with Convolutional Block Attention Module (CBAM) attentional mechanism module is inserted for fine detection. The experimental results show that the average accuracy of the proposed method under the settings of 5‐shot, 10‐shot, and 30‐shot is 31.6%, 34.3%, and 52.8%, respectively, which greatly improves the ability of electrical equipment identification under the condition of few‐shot.\",\"PeriodicalId\":22858,\"journal\":{\"name\":\"The Journal of Engineering\",\"volume\":\"2012 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-09-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"The Journal of Engineering\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1049/tje2.12313\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"The Journal of Engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1049/tje2.12313","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
摘要在基于深度学习的电气设备检测过程中,目标设备的图像样本不足会导致检测失败。为了解决这一问题,本文提出了一种基于youonly Look Once (YOLO)v4的目标检测网络和两阶段微调方法,实现了小样本条件下电气设备的图像识别。采用两阶段和双网络方法作为训练策略,在基类训练阶段使用数据丰富的基类样本基于修正余弦相似度训练样本分类器,在小样本新类训练阶段进行微调。在训练部分,使用改进的Retinanet网络进行粗检测,并插入带有卷积块注意模块(Convolutional Block Attention Module, CBAM)注意机制模块的YOLOv4网络进行精细检测。实验结果表明,该方法在5‐shot、10‐shot和30‐shot设置下的平均准确率分别为31.6%、34.3%和52.8%,大大提高了在少‐shot条件下的电气设备识别能力。
Few‐shot electrical equipment image recognition method based on an improved two‐stage fine‐tuning approach
Abstract In the process of electrical equipment detection based on deep learning, insufficient image samples of the target equipment will lead to detection failure. To solve this problem, an object detection network and two‐stage fine‐tuning approach based on You Only Look Once (YOLO)v4 is proposed in this paper to achieve image recognition of electrical equipment under the condition of small samples. Using the two‐stage and dual‐network method as the training strategy, the data‐rich base class samples are used to train the sample classifier based on the modified cosine similarity in the base class training stage, and the fine‐tuning is carried out in the small sample new class training stage. In the training part, the improved Retinanet network is used for coarse detection and the YOLOv4 network with Convolutional Block Attention Module (CBAM) attentional mechanism module is inserted for fine detection. The experimental results show that the average accuracy of the proposed method under the settings of 5‐shot, 10‐shot, and 30‐shot is 31.6%, 34.3%, and 52.8%, respectively, which greatly improves the ability of electrical equipment identification under the condition of few‐shot.