基于目标水果识别的柑橘采摘机器人灵活手爪采摘法

Q2 Agricultural and Biological Sciences Agriculture Pub Date : 2024-07-25 DOI:10.3390/agriculture14081227
Xu Xiao, Yaonan Wang, Bing Zhou, Yiming Jiang
{"title":"基于目标水果识别的柑橘采摘机器人灵活手爪采摘法","authors":"Xu Xiao, Yaonan Wang, Bing Zhou, Yiming Jiang","doi":"10.3390/agriculture14081227","DOIUrl":null,"url":null,"abstract":"In order to meet the demand of the intelligent and efficient picking of fresh citrus fruit in a natural environment, a flexible and independent picking method of fresh citrus fruit based on picking pattern recognition was proposed. The convolutional attention (CA) mechanism was added in the YOLOv7 network model. This makes the model pay more attention to the citrus fruit region, reduces the interference of some redundant information in the background and feature maps, effectively improves the recognition accuracy of the YOLOv7 network model, and reduces the detection error of the hand region. According to the physical parameters of the citrus fruit and stem, an end-effector suitable for picking citrus fruit was designed, which effectively reduced the damage during the picking of citrus fruit. According to the actual distribution of citrus fruits in the natural environment, a citrus fruit-picking task planning model was established, so that the adaptability of the flexible handle can make up for the inaccuracy of the deep learning method to a certain extent when the end-effector picks fruits independently. Finally, on the basis of integrating the key components of the picking robot, a production test was carried out in a standard citrus orchard. The experimental results show that the success rate of the citrus-picking robot arm is 87.15%, and the success rate of picking in the natural field environment is 82.4%, which is better than the success rate of 80% of the market picking robot. In the picking experiment, the main reason for the unsuccessful positioning of citrus fruits is that the position of citrus fruits is beyond the picking range of the end-effector, and the motion parameters of the robot arm joint will produce errors, affecting the motion accuracy of the robot arm, leading to the failure of picking. This study can provide technical support for the exploration and application of the intelligent fruit-picking mode.","PeriodicalId":7447,"journal":{"name":"Agriculture","volume":"42 6","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Flexible Hand Claw Picking Method for Citrus-Picking Robot Based on Target Fruit Recognition\",\"authors\":\"Xu Xiao, Yaonan Wang, Bing Zhou, Yiming Jiang\",\"doi\":\"10.3390/agriculture14081227\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In order to meet the demand of the intelligent and efficient picking of fresh citrus fruit in a natural environment, a flexible and independent picking method of fresh citrus fruit based on picking pattern recognition was proposed. The convolutional attention (CA) mechanism was added in the YOLOv7 network model. This makes the model pay more attention to the citrus fruit region, reduces the interference of some redundant information in the background and feature maps, effectively improves the recognition accuracy of the YOLOv7 network model, and reduces the detection error of the hand region. According to the physical parameters of the citrus fruit and stem, an end-effector suitable for picking citrus fruit was designed, which effectively reduced the damage during the picking of citrus fruit. According to the actual distribution of citrus fruits in the natural environment, a citrus fruit-picking task planning model was established, so that the adaptability of the flexible handle can make up for the inaccuracy of the deep learning method to a certain extent when the end-effector picks fruits independently. Finally, on the basis of integrating the key components of the picking robot, a production test was carried out in a standard citrus orchard. The experimental results show that the success rate of the citrus-picking robot arm is 87.15%, and the success rate of picking in the natural field environment is 82.4%, which is better than the success rate of 80% of the market picking robot. In the picking experiment, the main reason for the unsuccessful positioning of citrus fruits is that the position of citrus fruits is beyond the picking range of the end-effector, and the motion parameters of the robot arm joint will produce errors, affecting the motion accuracy of the robot arm, leading to the failure of picking. This study can provide technical support for the exploration and application of the intelligent fruit-picking mode.\",\"PeriodicalId\":7447,\"journal\":{\"name\":\"Agriculture\",\"volume\":\"42 6\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-07-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Agriculture\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.3390/agriculture14081227\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"Agricultural and Biological Sciences\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Agriculture","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3390/agriculture14081227","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"Agricultural and Biological Sciences","Score":null,"Total":0}
引用次数: 0

摘要

为了满足在自然环境中智能、高效采摘柑橘类鲜果的需求,提出了一种基于采摘模式识别的灵活、独立的柑橘类鲜果采摘方法。在 YOLOv7 网络模型中加入了卷积注意力(CA)机制。这使得模型更加关注柑橘类水果区域,减少了背景图和特征图中一些冗余信息的干扰,有效提高了 YOLOv7 网络模型的识别精度,降低了手部区域的检测误差。根据柑橘果实和茎干的物理参数,设计了适合柑橘果实采摘的末端执行器,有效降低了柑橘果实采摘过程中的损伤。根据柑橘类水果在自然环境中的实际分布情况,建立了柑橘类水果采摘任务规划模型,使柔性手柄的适应性在一定程度上弥补了深度学习方法在末端执行器独立采摘水果时的不准确性。最后,在集成采摘机器人关键部件的基础上,在标准柑橘园进行了生产试验。实验结果表明,柑橘采摘机械臂的采摘成功率为 87.15%,在田间自然环境下的采摘成功率为 82.4%,优于市场上采摘机器人 80% 的采摘成功率。在采摘实验中,柑橘果实定位不成功的主要原因是柑橘果实的位置超出了末端执行器的采摘范围,机械臂关节的运动参数会产生误差,影响机械臂的运动精度,导致采摘失败。本研究可为智能采果模式的探索与应用提供技术支持。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Flexible Hand Claw Picking Method for Citrus-Picking Robot Based on Target Fruit Recognition
In order to meet the demand of the intelligent and efficient picking of fresh citrus fruit in a natural environment, a flexible and independent picking method of fresh citrus fruit based on picking pattern recognition was proposed. The convolutional attention (CA) mechanism was added in the YOLOv7 network model. This makes the model pay more attention to the citrus fruit region, reduces the interference of some redundant information in the background and feature maps, effectively improves the recognition accuracy of the YOLOv7 network model, and reduces the detection error of the hand region. According to the physical parameters of the citrus fruit and stem, an end-effector suitable for picking citrus fruit was designed, which effectively reduced the damage during the picking of citrus fruit. According to the actual distribution of citrus fruits in the natural environment, a citrus fruit-picking task planning model was established, so that the adaptability of the flexible handle can make up for the inaccuracy of the deep learning method to a certain extent when the end-effector picks fruits independently. Finally, on the basis of integrating the key components of the picking robot, a production test was carried out in a standard citrus orchard. The experimental results show that the success rate of the citrus-picking robot arm is 87.15%, and the success rate of picking in the natural field environment is 82.4%, which is better than the success rate of 80% of the market picking robot. In the picking experiment, the main reason for the unsuccessful positioning of citrus fruits is that the position of citrus fruits is beyond the picking range of the end-effector, and the motion parameters of the robot arm joint will produce errors, affecting the motion accuracy of the robot arm, leading to the failure of picking. This study can provide technical support for the exploration and application of the intelligent fruit-picking mode.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Agriculture
Agriculture Agricultural and Biological Sciences-Horticulture
CiteScore
1.90
自引率
0.00%
发文量
4
审稿时长
11 weeks
期刊介绍: The Agriculture (Poľnohospodárstvo) is a peer-reviewed international journal that publishes mainly original research papers. The journal examines various aspects of research and is devoted to the publication of papers dealing with the following subjects: plant nutrition, protection, breeding, genetics and biotechnology, quality of plant products, grassland, mountain agriculture and environment, soil science and conservation, mechanization and economics of plant production and other spheres of plant science. Journal is published 4 times per year.
期刊最新文献
Effects of Abscisic Acid on Rice Seed Dormancy: Antioxidant Response and Accumulations of Melatonin, Phenolics and Momilactones Classification of Degradable Mulch Films and Their Promotional Effects and Limitations on Agricultural Production Deep Learning with a Multi-Task Convolutional Neural Network to Generate a National-Scale 3D Soil Data Product: The Particle Size Distribution of the German Agricultural Soil Landscape Enhanced Food-Production Efficiencies through Integrated Farming Systems in the Hau Giang Province in the Mekong Delta, Vietnam The Influence of Nitrogen and Sulfur Fertilization on Oil Quality and Seed Meal in Different Genotypes of Winter Oilseed Rape (Brassica napus L.)
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1