Zeyu Jiao , Kai Huang , Qun Wang , Zhenyu Zhong , Yingjie Cai
{"title":"在复杂果园环境中实时检测荔枝:一种便携式、低能耗的边缘计算方法,用于增强自动采摘功能","authors":"Zeyu Jiao , Kai Huang , Qun Wang , Zhenyu Zhong , Yingjie Cai","doi":"10.1016/j.aiia.2023.12.002","DOIUrl":null,"url":null,"abstract":"<div><p>Litchi, a succulent and perishable fruit, presents a narrow annual harvest window of under two weeks. The advent of smart agriculture has driven the adoption of visually-guided, automated litchi harvesting techniques. However, conventional approaches typically rely on laboratory-based, high-performance computing equipment, which presents challenges in terms of size, energy consumption, and practical application within litchi orchards. To address these limitations, we propose a real-time litchi detection methodology for complex environments, utilizing portable, low-energy edge computing devices. Initially, the litchi orchard imagery is collected to enhance data generalization. Subsequently, a convolutional neural network (CNN)-based single-stage detector, YOLOx, is constructed to accurately pinpoint litchi fruit locations within the images. To facilitate deployment on portable, low-energy edge devices, we employed channel pruning and layer pruning algorithms to compress the trained model, reducing its size and parameters. Additionally, the knowledge distillation technique is harnessed to fine-tune the network. Experimental findings demonstrated that our proposed method achieved a 97.1% compression rate, yielding a compact litchi detection model of a mere 6.9 MB, while maintaining 94.9% average precision and 97.2% average recall. Processing 99 frames per second (FPS), the method exhibited a 1.8-fold increase in speed compared to the unprocessed model. Consequently, our approach can be readily integrated into portable, low-computational automatic harvesting equipment, ensuring real-time, precise litchi detection within orchard settings.</p></div>","PeriodicalId":52814,"journal":{"name":"Artificial Intelligence in Agriculture","volume":"11 ","pages":"Pages 13-22"},"PeriodicalIF":8.2000,"publicationDate":"2023-12-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S258972172300051X/pdfft?md5=184c6e07ee017be8224834a9e8f6c30d&pid=1-s2.0-S258972172300051X-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Real-time litchi detection in complex orchard environments: A portable, low-energy edge computing approach for enhanced automated harvesting\",\"authors\":\"Zeyu Jiao , Kai Huang , Qun Wang , Zhenyu Zhong , Yingjie Cai\",\"doi\":\"10.1016/j.aiia.2023.12.002\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Litchi, a succulent and perishable fruit, presents a narrow annual harvest window of under two weeks. The advent of smart agriculture has driven the adoption of visually-guided, automated litchi harvesting techniques. However, conventional approaches typically rely on laboratory-based, high-performance computing equipment, which presents challenges in terms of size, energy consumption, and practical application within litchi orchards. To address these limitations, we propose a real-time litchi detection methodology for complex environments, utilizing portable, low-energy edge computing devices. Initially, the litchi orchard imagery is collected to enhance data generalization. Subsequently, a convolutional neural network (CNN)-based single-stage detector, YOLOx, is constructed to accurately pinpoint litchi fruit locations within the images. To facilitate deployment on portable, low-energy edge devices, we employed channel pruning and layer pruning algorithms to compress the trained model, reducing its size and parameters. Additionally, the knowledge distillation technique is harnessed to fine-tune the network. Experimental findings demonstrated that our proposed method achieved a 97.1% compression rate, yielding a compact litchi detection model of a mere 6.9 MB, while maintaining 94.9% average precision and 97.2% average recall. Processing 99 frames per second (FPS), the method exhibited a 1.8-fold increase in speed compared to the unprocessed model. Consequently, our approach can be readily integrated into portable, low-computational automatic harvesting equipment, ensuring real-time, precise litchi detection within orchard settings.</p></div>\",\"PeriodicalId\":52814,\"journal\":{\"name\":\"Artificial Intelligence in Agriculture\",\"volume\":\"11 \",\"pages\":\"Pages 13-22\"},\"PeriodicalIF\":8.2000,\"publicationDate\":\"2023-12-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S258972172300051X/pdfft?md5=184c6e07ee017be8224834a9e8f6c30d&pid=1-s2.0-S258972172300051X-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Artificial Intelligence in Agriculture\",\"FirstCategoryId\":\"1087\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S258972172300051X\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AGRICULTURE, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Artificial Intelligence in Agriculture","FirstCategoryId":"1087","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S258972172300051X","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
Real-time litchi detection in complex orchard environments: A portable, low-energy edge computing approach for enhanced automated harvesting
Litchi, a succulent and perishable fruit, presents a narrow annual harvest window of under two weeks. The advent of smart agriculture has driven the adoption of visually-guided, automated litchi harvesting techniques. However, conventional approaches typically rely on laboratory-based, high-performance computing equipment, which presents challenges in terms of size, energy consumption, and practical application within litchi orchards. To address these limitations, we propose a real-time litchi detection methodology for complex environments, utilizing portable, low-energy edge computing devices. Initially, the litchi orchard imagery is collected to enhance data generalization. Subsequently, a convolutional neural network (CNN)-based single-stage detector, YOLOx, is constructed to accurately pinpoint litchi fruit locations within the images. To facilitate deployment on portable, low-energy edge devices, we employed channel pruning and layer pruning algorithms to compress the trained model, reducing its size and parameters. Additionally, the knowledge distillation technique is harnessed to fine-tune the network. Experimental findings demonstrated that our proposed method achieved a 97.1% compression rate, yielding a compact litchi detection model of a mere 6.9 MB, while maintaining 94.9% average precision and 97.2% average recall. Processing 99 frames per second (FPS), the method exhibited a 1.8-fold increase in speed compared to the unprocessed model. Consequently, our approach can be readily integrated into portable, low-computational automatic harvesting equipment, ensuring real-time, precise litchi detection within orchard settings.