利用基于深度学习的机器视觉系统开发新的鹌鹑蛋分级系统

IF 7.7 1区 农林科学 Q1 AGRICULTURE, MULTIDISCIPLINARY Computers and Electronics in Agriculture Pub Date : 2024-09-09 DOI:10.1016/j.compag.2024.109433
{"title":"利用基于深度学习的机器视觉系统开发新的鹌鹑蛋分级系统","authors":"","doi":"10.1016/j.compag.2024.109433","DOIUrl":null,"url":null,"abstract":"<div><p>Quail egg size varies due to differences in age, nutrition, and genotype of birds. The grading of eggs is significant, particularly for quail breeding farms, as it facilitates pairing similar phenotypic features for selecting optimal genetic strains. However, this process currently requires skilled manpower and complex equipment. In this work, we introduce a new system to grade quail eggs according to their size using a deep learning-based machine vision approach. The prototype was able to classify and segregate eggs into up to 4 classes: small, medium, large, and extra large. The new system was divided into two modules: the classification module and the sorting module. In the first module, each egg was tracked by the deep SORT algorithm and graded proportionally to the bounding box sizes using the deep learning-based computer vision models; in the second module, a pneumatic system was developed along with a damage prevention designed conveyor belt for sorting the egg classes. The classification accuracy rate found from comparing real classes and machine vision predictions showed that 4 or 3 classes were reliable in sorting out egg sizes with higher confidence, proving to be useful at a feasible implementation cost to support farmers. Three object detection algorithms were compared: EfficientDet, CenterNet, and YOLOv7. The models were scaled into 2 network sizes, 512 × 512 and 1024 × 1024, and the results were compared in terms of egg class prediction accuracy and real-time inference speed. In terms of class prediction accuracy, the best results for grading quail eggs into 4 classes were achieved by the EfficientDet-1024, CenterNet-512, and YOLOv7-1024 models, which correctly classified 78 %, 77.5 % and 72 %, respectively. While classifying the eggs into 3 classes, again, the best model was observed from EfficientDet-1024 (86 %), followed by CenterNet-512 (84 %) and YOLOv7-1024 (80 %). Regarding the trade-off between real-time inference speed and grading accuracy, YOLOv7 outperformed the compared models by inferencing at 40.38 % faster than CenterNet-512, which was the second fastest and most accurate grader. As result, the best compared model was estimated to grade at pace of 797 quail eggs per hour. The proposed combined machine vision-based system can be further scaled up either in small-scale farming or industrial anticipation for consumer satisfaction and to ensure safe production traceability.</p></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":null,"pages":null},"PeriodicalIF":7.7000,"publicationDate":"2024-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Development of a new grading system for quail eggs using a deep learning-based machine vision system\",\"authors\":\"\",\"doi\":\"10.1016/j.compag.2024.109433\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Quail egg size varies due to differences in age, nutrition, and genotype of birds. The grading of eggs is significant, particularly for quail breeding farms, as it facilitates pairing similar phenotypic features for selecting optimal genetic strains. However, this process currently requires skilled manpower and complex equipment. In this work, we introduce a new system to grade quail eggs according to their size using a deep learning-based machine vision approach. The prototype was able to classify and segregate eggs into up to 4 classes: small, medium, large, and extra large. The new system was divided into two modules: the classification module and the sorting module. In the first module, each egg was tracked by the deep SORT algorithm and graded proportionally to the bounding box sizes using the deep learning-based computer vision models; in the second module, a pneumatic system was developed along with a damage prevention designed conveyor belt for sorting the egg classes. The classification accuracy rate found from comparing real classes and machine vision predictions showed that 4 or 3 classes were reliable in sorting out egg sizes with higher confidence, proving to be useful at a feasible implementation cost to support farmers. Three object detection algorithms were compared: EfficientDet, CenterNet, and YOLOv7. The models were scaled into 2 network sizes, 512 × 512 and 1024 × 1024, and the results were compared in terms of egg class prediction accuracy and real-time inference speed. In terms of class prediction accuracy, the best results for grading quail eggs into 4 classes were achieved by the EfficientDet-1024, CenterNet-512, and YOLOv7-1024 models, which correctly classified 78 %, 77.5 % and 72 %, respectively. While classifying the eggs into 3 classes, again, the best model was observed from EfficientDet-1024 (86 %), followed by CenterNet-512 (84 %) and YOLOv7-1024 (80 %). Regarding the trade-off between real-time inference speed and grading accuracy, YOLOv7 outperformed the compared models by inferencing at 40.38 % faster than CenterNet-512, which was the second fastest and most accurate grader. As result, the best compared model was estimated to grade at pace of 797 quail eggs per hour. The proposed combined machine vision-based system can be further scaled up either in small-scale farming or industrial anticipation for consumer satisfaction and to ensure safe production traceability.</p></div>\",\"PeriodicalId\":50627,\"journal\":{\"name\":\"Computers and Electronics in Agriculture\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":7.7000,\"publicationDate\":\"2024-09-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computers and Electronics in Agriculture\",\"FirstCategoryId\":\"97\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S016816992400824X\",\"RegionNum\":1,\"RegionCategory\":\"农林科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AGRICULTURE, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers and Electronics in Agriculture","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S016816992400824X","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

摘要

鹌鹑蛋的大小因鸡龄、营养和基因型的差异而不同。鹌鹑蛋的分级意义重大,尤其是对鹌鹑育种场而言,因为这有助于将相似的表型特征进行配对,以选择最佳的基因品系。然而,目前这一过程需要熟练的人力和复杂的设备。在这项工作中,我们采用基于深度学习的机器视觉方法,推出了一种根据鹌鹑蛋大小进行分级的新系统。原型系统能够将鹌鹑蛋分为多达 4 个等级:小型、中型、大型和特大型。新系统分为两个模块:分类模块和分拣模块。在第一个模块中,利用基于深度学习的计算机视觉模型,通过深度 SORT 算法跟踪每个鸡蛋,并根据边界框的大小按比例进行分级;在第二个模块中,开发了一个气动系统和一个防损坏设计的传送带,用于对鸡蛋进行分类。通过比较真实类别和机器视觉预测的分类准确率发现,4 或 3 个类别在分类鸡蛋大小方面具有较高的可信度,这证明以可行的实施成本支持农民是有用的。对三种物体检测算法进行了比较:EfficientDet、CenterNet 和 YOLOv7。这些模型分别按 512 × 512 和 1024 × 1024 两种网络大小进行了扩展,并在鸡蛋类别预测准确性和实时推理速度方面对结果进行了比较。在类别预测准确度方面,EfficientDet-1024、CenterNet-512 和 YOLOv7-1024 模型将鹌鹑蛋分为 4 类的结果最好,正确率分别为 78%、77.5% 和 72%。在将鸡蛋分为 3 类时,EfficientDet-1024 模型的正确率也是最高的(86%),其次是 CenterNet-512(84%)和 YOLOv7-1024(80%)。在实时推理速度和分级准确性之间的权衡方面,YOLOv7 的推理速度比 CenterNet-512 快 40.38%,优于比较过的模型,后者是速度第二快、准确性最高的分级器。因此,最佳比较模型的分级速度估计为每小时 797 枚鹌鹑蛋。所提出的基于机器视觉的组合系统可在小规模养殖或工业生产中进一步推广,以满足消费者的需求,并确保安全生产的可追溯性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Development of a new grading system for quail eggs using a deep learning-based machine vision system

Quail egg size varies due to differences in age, nutrition, and genotype of birds. The grading of eggs is significant, particularly for quail breeding farms, as it facilitates pairing similar phenotypic features for selecting optimal genetic strains. However, this process currently requires skilled manpower and complex equipment. In this work, we introduce a new system to grade quail eggs according to their size using a deep learning-based machine vision approach. The prototype was able to classify and segregate eggs into up to 4 classes: small, medium, large, and extra large. The new system was divided into two modules: the classification module and the sorting module. In the first module, each egg was tracked by the deep SORT algorithm and graded proportionally to the bounding box sizes using the deep learning-based computer vision models; in the second module, a pneumatic system was developed along with a damage prevention designed conveyor belt for sorting the egg classes. The classification accuracy rate found from comparing real classes and machine vision predictions showed that 4 or 3 classes were reliable in sorting out egg sizes with higher confidence, proving to be useful at a feasible implementation cost to support farmers. Three object detection algorithms were compared: EfficientDet, CenterNet, and YOLOv7. The models were scaled into 2 network sizes, 512 × 512 and 1024 × 1024, and the results were compared in terms of egg class prediction accuracy and real-time inference speed. In terms of class prediction accuracy, the best results for grading quail eggs into 4 classes were achieved by the EfficientDet-1024, CenterNet-512, and YOLOv7-1024 models, which correctly classified 78 %, 77.5 % and 72 %, respectively. While classifying the eggs into 3 classes, again, the best model was observed from EfficientDet-1024 (86 %), followed by CenterNet-512 (84 %) and YOLOv7-1024 (80 %). Regarding the trade-off between real-time inference speed and grading accuracy, YOLOv7 outperformed the compared models by inferencing at 40.38 % faster than CenterNet-512, which was the second fastest and most accurate grader. As result, the best compared model was estimated to grade at pace of 797 quail eggs per hour. The proposed combined machine vision-based system can be further scaled up either in small-scale farming or industrial anticipation for consumer satisfaction and to ensure safe production traceability.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Computers and Electronics in Agriculture
Computers and Electronics in Agriculture 工程技术-计算机:跨学科应用
CiteScore
15.30
自引率
14.50%
发文量
800
审稿时长
62 days
期刊介绍: Computers and Electronics in Agriculture provides international coverage of advancements in computer hardware, software, electronic instrumentation, and control systems applied to agricultural challenges. Encompassing agronomy, horticulture, forestry, aquaculture, and animal farming, the journal publishes original papers, reviews, and applications notes. It explores the use of computers and electronics in plant or animal agricultural production, covering topics like agricultural soils, water, pests, controlled environments, and waste. The scope extends to on-farm post-harvest operations and relevant technologies, including artificial intelligence, sensors, machine vision, robotics, networking, and simulation modeling. Its companion journal, Smart Agricultural Technology, continues the focus on smart applications in production agriculture.
期刊最新文献
Autonomous net inspection and cleaning in sea-based fish farms: A review A review of unmanned aerial vehicle based remote sensing and machine learning for cotton crop growth monitoring High-throughput phenotypic traits estimation of faba bean based on machine learning and drone-based multimodal data Image quality safety model for the safety of the intended functionality in highly automated agricultural machines A general image classification model for agricultural machinery trajectory mode recognition
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1