{"title":"利用基于深度学习的机器视觉系统开发新的鹌鹑蛋分级系统","authors":"","doi":"10.1016/j.compag.2024.109433","DOIUrl":null,"url":null,"abstract":"<div><p>Quail egg size varies due to differences in age, nutrition, and genotype of birds. The grading of eggs is significant, particularly for quail breeding farms, as it facilitates pairing similar phenotypic features for selecting optimal genetic strains. However, this process currently requires skilled manpower and complex equipment. In this work, we introduce a new system to grade quail eggs according to their size using a deep learning-based machine vision approach. The prototype was able to classify and segregate eggs into up to 4 classes: small, medium, large, and extra large. The new system was divided into two modules: the classification module and the sorting module. In the first module, each egg was tracked by the deep SORT algorithm and graded proportionally to the bounding box sizes using the deep learning-based computer vision models; in the second module, a pneumatic system was developed along with a damage prevention designed conveyor belt for sorting the egg classes. The classification accuracy rate found from comparing real classes and machine vision predictions showed that 4 or 3 classes were reliable in sorting out egg sizes with higher confidence, proving to be useful at a feasible implementation cost to support farmers. Three object detection algorithms were compared: EfficientDet, CenterNet, and YOLOv7. The models were scaled into 2 network sizes, 512 × 512 and 1024 × 1024, and the results were compared in terms of egg class prediction accuracy and real-time inference speed. In terms of class prediction accuracy, the best results for grading quail eggs into 4 classes were achieved by the EfficientDet-1024, CenterNet-512, and YOLOv7-1024 models, which correctly classified 78 %, 77.5 % and 72 %, respectively. While classifying the eggs into 3 classes, again, the best model was observed from EfficientDet-1024 (86 %), followed by CenterNet-512 (84 %) and YOLOv7-1024 (80 %). Regarding the trade-off between real-time inference speed and grading accuracy, YOLOv7 outperformed the compared models by inferencing at 40.38 % faster than CenterNet-512, which was the second fastest and most accurate grader. As result, the best compared model was estimated to grade at pace of 797 quail eggs per hour. The proposed combined machine vision-based system can be further scaled up either in small-scale farming or industrial anticipation for consumer satisfaction and to ensure safe production traceability.</p></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":null,"pages":null},"PeriodicalIF":7.7000,"publicationDate":"2024-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Development of a new grading system for quail eggs using a deep learning-based machine vision system\",\"authors\":\"\",\"doi\":\"10.1016/j.compag.2024.109433\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Quail egg size varies due to differences in age, nutrition, and genotype of birds. The grading of eggs is significant, particularly for quail breeding farms, as it facilitates pairing similar phenotypic features for selecting optimal genetic strains. However, this process currently requires skilled manpower and complex equipment. In this work, we introduce a new system to grade quail eggs according to their size using a deep learning-based machine vision approach. The prototype was able to classify and segregate eggs into up to 4 classes: small, medium, large, and extra large. The new system was divided into two modules: the classification module and the sorting module. In the first module, each egg was tracked by the deep SORT algorithm and graded proportionally to the bounding box sizes using the deep learning-based computer vision models; in the second module, a pneumatic system was developed along with a damage prevention designed conveyor belt for sorting the egg classes. The classification accuracy rate found from comparing real classes and machine vision predictions showed that 4 or 3 classes were reliable in sorting out egg sizes with higher confidence, proving to be useful at a feasible implementation cost to support farmers. Three object detection algorithms were compared: EfficientDet, CenterNet, and YOLOv7. The models were scaled into 2 network sizes, 512 × 512 and 1024 × 1024, and the results were compared in terms of egg class prediction accuracy and real-time inference speed. In terms of class prediction accuracy, the best results for grading quail eggs into 4 classes were achieved by the EfficientDet-1024, CenterNet-512, and YOLOv7-1024 models, which correctly classified 78 %, 77.5 % and 72 %, respectively. While classifying the eggs into 3 classes, again, the best model was observed from EfficientDet-1024 (86 %), followed by CenterNet-512 (84 %) and YOLOv7-1024 (80 %). Regarding the trade-off between real-time inference speed and grading accuracy, YOLOv7 outperformed the compared models by inferencing at 40.38 % faster than CenterNet-512, which was the second fastest and most accurate grader. As result, the best compared model was estimated to grade at pace of 797 quail eggs per hour. The proposed combined machine vision-based system can be further scaled up either in small-scale farming or industrial anticipation for consumer satisfaction and to ensure safe production traceability.</p></div>\",\"PeriodicalId\":50627,\"journal\":{\"name\":\"Computers and Electronics in Agriculture\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":7.7000,\"publicationDate\":\"2024-09-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computers and Electronics in Agriculture\",\"FirstCategoryId\":\"97\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S016816992400824X\",\"RegionNum\":1,\"RegionCategory\":\"农林科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AGRICULTURE, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers and Electronics in Agriculture","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S016816992400824X","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
Development of a new grading system for quail eggs using a deep learning-based machine vision system
Quail egg size varies due to differences in age, nutrition, and genotype of birds. The grading of eggs is significant, particularly for quail breeding farms, as it facilitates pairing similar phenotypic features for selecting optimal genetic strains. However, this process currently requires skilled manpower and complex equipment. In this work, we introduce a new system to grade quail eggs according to their size using a deep learning-based machine vision approach. The prototype was able to classify and segregate eggs into up to 4 classes: small, medium, large, and extra large. The new system was divided into two modules: the classification module and the sorting module. In the first module, each egg was tracked by the deep SORT algorithm and graded proportionally to the bounding box sizes using the deep learning-based computer vision models; in the second module, a pneumatic system was developed along with a damage prevention designed conveyor belt for sorting the egg classes. The classification accuracy rate found from comparing real classes and machine vision predictions showed that 4 or 3 classes were reliable in sorting out egg sizes with higher confidence, proving to be useful at a feasible implementation cost to support farmers. Three object detection algorithms were compared: EfficientDet, CenterNet, and YOLOv7. The models were scaled into 2 network sizes, 512 × 512 and 1024 × 1024, and the results were compared in terms of egg class prediction accuracy and real-time inference speed. In terms of class prediction accuracy, the best results for grading quail eggs into 4 classes were achieved by the EfficientDet-1024, CenterNet-512, and YOLOv7-1024 models, which correctly classified 78 %, 77.5 % and 72 %, respectively. While classifying the eggs into 3 classes, again, the best model was observed from EfficientDet-1024 (86 %), followed by CenterNet-512 (84 %) and YOLOv7-1024 (80 %). Regarding the trade-off between real-time inference speed and grading accuracy, YOLOv7 outperformed the compared models by inferencing at 40.38 % faster than CenterNet-512, which was the second fastest and most accurate grader. As result, the best compared model was estimated to grade at pace of 797 quail eggs per hour. The proposed combined machine vision-based system can be further scaled up either in small-scale farming or industrial anticipation for consumer satisfaction and to ensure safe production traceability.
期刊介绍:
Computers and Electronics in Agriculture provides international coverage of advancements in computer hardware, software, electronic instrumentation, and control systems applied to agricultural challenges. Encompassing agronomy, horticulture, forestry, aquaculture, and animal farming, the journal publishes original papers, reviews, and applications notes. It explores the use of computers and electronics in plant or animal agricultural production, covering topics like agricultural soils, water, pests, controlled environments, and waste. The scope extends to on-farm post-harvest operations and relevant technologies, including artificial intelligence, sensors, machine vision, robotics, networking, and simulation modeling. Its companion journal, Smart Agricultural Technology, continues the focus on smart applications in production agriculture.