首页 > 最新文献

Computers and Electronics in Agriculture最新文献

英文 中文
Path planning and tracking control of orchard wheel mower based on BL-ACO and GO-SMC 基于 BL-ACO 和 GO-SMC 的果园轮式割草机路径规划和跟踪控制
IF 7.7 1区 农林科学 Q1 AGRICULTURE, MULTIDISCIPLINARY Pub Date : 2024-11-26 DOI: 10.1016/j.compag.2024.109696
Lixing Liu , Xu Wang , Jinyan Xie , Xiaosa Wang , Hongjie Liu , Jianping Li , Pengfei Wang , Xin Yang
This research proposes an improved ant colony algorithm (BL-ACO) path planning algorithm and a tracking controller based on global optimal sliding mode variable structure control (GO-SMC) for the problem of path planning and tracking control of lawn mowers in quadrilateral orchard environments. The novelty of this research lies in two aspects. On one hand, we analyze the operating scenarios of lawn mowers in standardized orchards, then transform the path planning problem into a traveling salesman problem, and mathematically model the U-shaped and T-shaped turning strategies based on the characteristics of the wheeled lawn mower. In order to make the ant colony algorithm suitable for orchard operation path optimization problems, we modified its pheromone update rules, heuristic functions, state transition probabilities, and other equations. In order to accelerate the convergence speed of the ant colony algorithm, we use the bilayer ant colony algorithm optimization strategy. On the other hand, we establish a kinematic model with the wheeled lawn mower as the control object, and design a control law using a hyperbolic tangent function to ensure the global stability of the trajectory tracking control system. Furthermore, we demonstrate through Lyapunov stability analysis that the GO-SMC controller can ensure the mower tracks the reference path accurately. The simulation experiments of path planning and tracking control show that BL-ACO and GO-SMC perform the best compared to similar algorithms. Field experiments shows that BL-ACO & GO-SMC, with a time reduction rate of 47.58 % and a fuel consumption rate reduction of 47.59 % compared to line by line & SMC.
本研究针对四边形果园环境中割草机的路径规划和跟踪控制问题,提出了一种改进的蚁群算法(BL-ACO)路径规划算法和基于全局最优滑模变结构控制(GO-SMC)的跟踪控制器。这项研究的新颖之处在于两个方面。一方面,我们分析了割草机在标准化果园中的作业场景,然后将路径规划问题转化为旅行推销员问题,并根据轮式割草机的特点建立了 U 形和 T 形转弯策略的数学模型。为了使蚁群算法适用于果园作业路径优化问题,我们修改了其信息素更新规则、启发式函数、状态转换概率等方程。为了加快蚁群算法的收敛速度,我们采用了双层蚁群算法优化策略。另一方面,我们建立了以轮式割草机为控制对象的运动学模型,并利用双曲正切函数设计了控制律,以确保轨迹跟踪控制系统的全局稳定性。此外,我们还通过 Lyapunov 稳定性分析证明,GO-SMC 控制器能确保割草机准确跟踪参考路径。路径规划和跟踪控制的仿真实验表明,与同类算法相比,BL-ACO 和 GO-SMC 的性能最佳。现场实验表明,与逐行& SMC相比,BL-ACO& GO-SMC的时间缩短率为47.58%,燃料消耗率为47.59%。
{"title":"Path planning and tracking control of orchard wheel mower based on BL-ACO and GO-SMC","authors":"Lixing Liu ,&nbsp;Xu Wang ,&nbsp;Jinyan Xie ,&nbsp;Xiaosa Wang ,&nbsp;Hongjie Liu ,&nbsp;Jianping Li ,&nbsp;Pengfei Wang ,&nbsp;Xin Yang","doi":"10.1016/j.compag.2024.109696","DOIUrl":"10.1016/j.compag.2024.109696","url":null,"abstract":"<div><div>This research proposes an improved ant colony algorithm (BL-ACO) path planning algorithm and a tracking controller based on global optimal sliding mode variable structure control (GO-SMC) for the problem of path planning and tracking control of lawn mowers in quadrilateral orchard environments. The novelty of this research lies in two aspects. On one hand, we analyze the operating scenarios of lawn mowers in standardized orchards, then transform the path planning problem into a traveling salesman problem, and mathematically model the U-shaped and T-shaped turning strategies based on the characteristics of the wheeled lawn mower. In order to make the ant colony algorithm suitable for orchard operation path optimization problems, we modified its pheromone update rules, heuristic functions, state transition probabilities, and other equations. In order to accelerate the convergence speed of the ant colony algorithm, we use the bilayer ant colony algorithm optimization strategy. On the other hand, we establish a kinematic model with the wheeled lawn mower as the control object, and design a control law using a hyperbolic tangent function to ensure the global stability of the trajectory tracking control system. Furthermore, we demonstrate through Lyapunov stability analysis that the GO-SMC controller can ensure the mower tracks the reference path accurately. The simulation experiments of path planning and tracking control show that BL-ACO and GO-SMC perform the best compared to similar algorithms. Field experiments shows that BL-ACO &amp; GO-SMC, with a time reduction rate of 47.58 % and a fuel consumption rate reduction of 47.59 % compared to line by line &amp; SMC.</div></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":"228 ","pages":"Article 109696"},"PeriodicalIF":7.7,"publicationDate":"2024-11-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142721376","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Single-view-based high-fidelity three-dimensional reconstruction of leaves 基于单视角的叶片高保真三维重建技术
IF 7.7 1区 农林科学 Q1 AGRICULTURE, MULTIDISCIPLINARY Pub Date : 2024-11-26 DOI: 10.1016/j.compag.2024.109682
Longfei Wang , Le Yang , Huiying Xu , Xinzhong Zhu , Wouladje Cabrel , Golden Tendekai Mumanikidzwa , Xinyu Liu , Weijian Jiang , Hao Chen , Wenhang Jiang
In modern agricultural science research, high-fidelity three-dimensional (3D) leaf models are crucial for crop growth analysis. However, reconstructing the complex morphology and texture of leaves from a single viewpoint under varying natural lighting conditions poses a significant challenge. To address the issues associated with this challenge, this paper presents a diffusion model-based method for single-view leaf reconstruction using potato leaves as the experimental subject. In the camera prediction process, the combination of an explicit point cloud generation technique and an implicit 3D Gaussian rendering technique enables the accurate prediction of camera parameters and the effective capture of leaf phenotypic features. In the synthesis of the 3D model of the leaf, a strategy for optimizing the coarse model UV texture is designed with the objective of achieving spatial consistency of texture details. Furthermore, the model was successfully applied to the reconstruction of other crop leaves and lamellar structural objects, and innovatively constructed a leaf reconstruction model with disease characteristics, aiming to provide a reference for the early 3D detection of crop diseases, as well as a reference for the 3D reconstruction and visualization of other lamellar objects. The results demonstrate that the method is effective in reconstructing the morphological structure and texture details of leaves, as well as thin sheet-like structured objects, achieving fast and high-fidelity single-view reconstruction.
在现代农业科学研究中,高保真三维(3D)叶片模型对作物生长分析至关重要。然而,在不同的自然光条件下,从单一视角重建复杂的叶片形态和纹理是一项重大挑战。为了解决与这一挑战相关的问题,本文以马铃薯叶片为实验对象,提出了一种基于扩散模型的单视角叶片重建方法。在相机预测过程中,显式点云生成技术与隐式三维高斯渲染技术相结合,实现了相机参数的准确预测和叶片表型特征的有效捕捉。在合成叶片的三维模型时,设计了一种优化粗模型 UV 纹理的策略,目的是实现纹理细节的空间一致性。此外,该模型还成功应用于其他作物叶片和叶片结构物体的重建,并创新性地构建了具有病害特征的叶片重建模型,旨在为作物病害的早期三维检测提供参考,并为其他叶片物体的三维重建和可视化提供参考。结果表明,该方法能有效重建叶片的形态结构和纹理细节,以及薄片状结构物体,实现了快速、高保真的单视角重建。
{"title":"Single-view-based high-fidelity three-dimensional reconstruction of leaves","authors":"Longfei Wang ,&nbsp;Le Yang ,&nbsp;Huiying Xu ,&nbsp;Xinzhong Zhu ,&nbsp;Wouladje Cabrel ,&nbsp;Golden Tendekai Mumanikidzwa ,&nbsp;Xinyu Liu ,&nbsp;Weijian Jiang ,&nbsp;Hao Chen ,&nbsp;Wenhang Jiang","doi":"10.1016/j.compag.2024.109682","DOIUrl":"10.1016/j.compag.2024.109682","url":null,"abstract":"<div><div>In modern agricultural science research, high-fidelity three-dimensional (3D) leaf models are crucial for crop growth analysis. However, reconstructing the complex morphology and texture of leaves from a single viewpoint under varying natural lighting conditions poses a significant challenge. To address the issues associated with this challenge, this paper presents a diffusion model-based method for single-view leaf reconstruction using potato leaves as the experimental subject. In the camera prediction process, the combination of an explicit point cloud generation technique and an implicit 3D Gaussian rendering technique enables the accurate prediction of camera parameters and the effective capture of leaf phenotypic features. In the synthesis of the 3D model of the leaf, a strategy for optimizing the coarse model UV texture is designed with the objective of achieving spatial consistency of texture details. Furthermore, the model was successfully applied to the reconstruction of other crop leaves and lamellar structural objects, and innovatively constructed a leaf reconstruction model with disease characteristics, aiming to provide a reference for the early 3D detection of crop diseases, as well as a reference for the 3D reconstruction and visualization of other lamellar objects. The results demonstrate that the method is effective in reconstructing the morphological structure and texture details of leaves, as well as thin sheet-like structured objects, achieving fast and high-fidelity single-view reconstruction.</div></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":"227 ","pages":"Article 109682"},"PeriodicalIF":7.7,"publicationDate":"2024-11-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142721693","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Design and evaluation of a robotic prototype for gerbera harvesting, performing actions at never-seen locations 设计和评估用于采摘非洲菊的机器人原型,在从未见过的位置进行操作
IF 7.7 1区 农林科学 Q1 AGRICULTURE, MULTIDISCIPLINARY Pub Date : 2024-11-26 DOI: 10.1016/j.compag.2024.109671
Menno Sytsma, Bart M. van Marrewijk, Toon Tielen, Arjan Vroegop, Jos Ruizendaal
The harvesting of gerbera flowers, like many horticultural products, is a labor-intensive task for which automated solutions are highly desirable. While robotic harvesting of gerbera flowers has previously been attempted, it has not been tested under commercial greenhouse conditions. This study presents a design process based on realistic requirements derived from detailed measurements of the crop. We introduce a specialized end-effector for gerbera flower harvesting that leverages passive components alongside specific plant characteristics to enable precise positioning and effective cutting. An integrated testing setup is also presented, combining the end-effector with a robust, high-speed sensing and processing pipeline for field trials. Performance evaluations of the complete system under real greenhouse conditions indicate an overall harvest success rate of 78%, with minimal flower collisions and reliable positioning and cutting actions by the end-effector.
像许多园艺产品一样,非洲菊花的采收是一项劳动密集型工作,因此非常需要自动化解决方案。虽然以前尝试过非洲菊花的机器人采收,但还没有在商业温室条件下进行过测试。本研究根据对作物的详细测量得出的实际要求,提出了一个设计过程。我们介绍了一种用于采摘非洲菊花的专用末端执行器,该执行器利用被动元件和特定的植物特性来实现精确定位和有效切割。我们还介绍了一种综合测试装置,它将末端执行器与用于现场试验的强大、高速传感和处理管道相结合。在实际温室条件下对整套系统进行的性能评估表明,总体收获成功率为 78%,花朵碰撞最小,终端执行器的定位和切割动作可靠。
{"title":"Design and evaluation of a robotic prototype for gerbera harvesting, performing actions at never-seen locations","authors":"Menno Sytsma,&nbsp;Bart M. van Marrewijk,&nbsp;Toon Tielen,&nbsp;Arjan Vroegop,&nbsp;Jos Ruizendaal","doi":"10.1016/j.compag.2024.109671","DOIUrl":"10.1016/j.compag.2024.109671","url":null,"abstract":"<div><div>The harvesting of gerbera flowers, like many horticultural products, is a labor-intensive task for which automated solutions are highly desirable. While robotic harvesting of gerbera flowers has previously been attempted, it has not been tested under commercial greenhouse conditions. This study presents a design process based on realistic requirements derived from detailed measurements of the crop. We introduce a specialized end-effector for gerbera flower harvesting that leverages passive components alongside specific plant characteristics to enable precise positioning and effective cutting. An integrated testing setup is also presented, combining the end-effector with a robust, high-speed sensing and processing pipeline for field trials. Performance evaluations of the complete system under real greenhouse conditions indicate an overall harvest success rate of 78%, with minimal flower collisions and reliable positioning and cutting actions by the end-effector.</div></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":"228 ","pages":"Article 109671"},"PeriodicalIF":7.7,"publicationDate":"2024-11-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142721630","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Study on the throwing device of residual film recycling machine for the plough layer 残膜回收机犁层抛掷装置研究
IF 7.7 1区 农林科学 Q1 AGRICULTURE, MULTIDISCIPLINARY Pub Date : 2024-11-26 DOI: 10.1016/j.compag.2024.109679
Wanyuan Huang, Haolin Wang, Wei Dai, Ming Zhang, Dezhi Ren, Wei Wang
An innovative residual film recycling machine for the plough layer (RFRMPL) is proposed in view of difficulty in picking up residual film and the easy missing out on picking up fine residual film. In this study, the soil throwing device is designed and optimized, as the soil throwing efficiency of the throwing device is essential for residual film separation efficiency of the RFRMPL. The soil throwing efficiency is selected as evaluation index, and a mechanical simulation model of throwing device based on Discrete Element Method (DEM) and Rocky is built up according to structure and working principle of the soil throwing device. The optimal combination of working parameters of the throwing device is obtained via theoretical calculations, single and multi-factorial simulation test. The results show that the optimal working parameters of rotation speed of the rotary tilling mechanism, speed of the soil elevating mechanism and the distance between the rotary tilling mechanism and soil elevating mechanism are 200 rpm, 320 rpm and 130 mm respectively. The field validation test is carried out based on the optimal combination parameters. The results show that soil throwing efficiency of the soil throwing device is 87.45 %. The error between the field validation test results and the simulation results (90.42 %) is 3.4 %, which proves the correctness of the simulation model. It can provide theoretical reference for the design and optimization of the RFRMPL.
针对犁层残膜拾取困难、细小残膜拾取容易遗漏的问题,提出了一种创新的犁层残膜回收机(RFRMPL)。本研究对抛土装置进行了设计和优化,因为抛土装置的抛土效率对于犁层残膜回收机的残膜分离效率至关重要。选取抛土效率作为评价指标,并根据抛土装置的结构和工作原理,建立了基于离散元法(DEM)和 Rocky 的抛土装置机械仿真模型。通过理论计算、单因素和多因素仿真试验,得出了抛土装置工作参数的最优组合。结果表明,旋耕机构转速、土壤提升机构转速以及旋耕机构与土壤提升机构间距的最佳工作参数分别为 200 rpm、320 rpm 和 130 mm。根据最佳组合参数进行了现场验证试验。结果表明,抛土装置的抛土效率为 87.45%。现场验证试验结果与仿真结果(90.42 %)的误差为 3.4 %,证明了仿真模型的正确性。它可以为 RFRMPL 的设计和优化提供理论参考。
{"title":"Study on the throwing device of residual film recycling machine for the plough layer","authors":"Wanyuan Huang,&nbsp;Haolin Wang,&nbsp;Wei Dai,&nbsp;Ming Zhang,&nbsp;Dezhi Ren,&nbsp;Wei Wang","doi":"10.1016/j.compag.2024.109679","DOIUrl":"10.1016/j.compag.2024.109679","url":null,"abstract":"<div><div>An innovative residual film recycling machine for the plough layer (RFRMPL) is proposed in view of difficulty in picking up residual film and the easy missing out on picking up fine residual film. In this study, the soil throwing device is designed and optimized, as the soil throwing efficiency of the throwing device is essential for residual film separation efficiency of the RFRMPL. The soil throwing efficiency is selected as evaluation index, and a mechanical simulation model of throwing device based on Discrete Element Method (DEM) and Rocky is built up according to structure and working principle of the soil throwing device. The optimal combination of working parameters of the throwing device is obtained via theoretical calculations, single and multi-factorial simulation test. The results show that the optimal working parameters of rotation speed of the rotary tilling mechanism, speed of the soil elevating mechanism and the distance between the rotary tilling mechanism and soil elevating mechanism are 200 rpm, 320 rpm and 130 mm respectively. The field validation test is carried out based on the optimal combination parameters. The results show that soil throwing efficiency of the soil throwing device is 87.45 %. The error between the field validation test results and the simulation results (90.42 %) is 3.4 %, which proves the correctness of the simulation model. It can provide theoretical reference for the design and optimization of the RFRMPL.</div></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":"227 ","pages":"Article 109679"},"PeriodicalIF":7.7,"publicationDate":"2024-11-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142700045","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Safflower picking points localization method during the full harvest period based on SBP-YOLOv8s-seg network 基于 SBP-YOLOv8s-seg 网络的全收获期红花采摘点定位方法
IF 7.7 1区 农林科学 Q1 AGRICULTURE, MULTIDISCIPLINARY Pub Date : 2024-11-25 DOI: 10.1016/j.compag.2024.109646
He Zhang, Yun Ge, Hao Xia, Chao Sun
Visual recognition is crucial for robotic harvesting of safflower filaments in field. However, accurate detection and localization is challenging due to complex backgrounds, leaves and branches shielding, and variable safflower morphology. This study proposes a safflower picking points localization method during the full harvest period based on SBP-YOLOv8s-seg network. The method enhanced the accuracy by improving the performance of the detection and segmentation network and implementing phased localization. Specifically, SBP-YOLOv8s-seg network based on self-calibration was constructed for precise segmentation of safflower filaments and fruit balls. Additionally, different morphological features of safflower during the full harvest period were analyzed. The segmented masks underwent Principal Component Analysis (PCA) computation, region of interest (ROI) extraction, and contour fitting to extract the principal eigenvectors that express information about the filaments. To address the issue of picking position being invisible due to the occlusion of safflower necking, the picking points were determined in conjunction with the positional relationship between filaments and fruit balls. Experimental results demonstrated that the segmentation performance of SBP-YOLOv8s-seg network was superior to other networks, achieving a significant improvement in mean average precision (mAP) compared to YOLOv5s-seg, YOLOv6s-seg, YOLOv7s-seg, and YOLOv8s-seg, with improvements of 5.1 %, 2.3 %, 4.1 %, and 1.3 % respectively. The precision, recall and mAP of SBP-YOLOv8s-seg network in the segmentation task increased from 87.9 %, 79 %, and 84.4 % of YOLOv8s-seg to 89.1 %, 79.7 %, and 85.7 %. The accuracy of blooming safflower and decaying safflower calculated by the proposed method were 93.0 % and 91.9 %, respectively. The overall localization accuracy of safflower picking points was 92.9 %. Field experiments showed that the picking success rate was 90.7 %. This study provides a theoretical basis and data support for visual localization of safflower picking robot in the future.
视觉识别对于田间红花花丝的机器人收割至关重要。然而,由于背景复杂、枝叶遮挡以及红花形态多变,准确检测和定位具有挑战性。本研究提出了一种基于 SBP-YOLOv8s-seg 网络的全收获期红花采摘点定位方法。该方法通过提高检测和分割网络的性能以及实施分阶段定位,提高了定位精度。具体而言,构建了基于自校准的 SBP-YOLOv8s-seg 网络,用于精确分割红花花丝和果球。此外,还分析了整个收获期红花的不同形态特征。分割后的掩膜经过主成分分析(PCA)计算、感兴趣区域(ROI)提取和轮廓拟合,以提取表达花丝信息的主特征向量。为了解决由于红花颈部遮挡导致采摘位置不可见的问题,采摘点是结合花丝和果球之间的位置关系确定的。实验结果表明,SBP-YOLOv8s-seg 网络的分割性能优于其他网络,与 YOLOv5s-seg、YOLOv6s-seg、YOLOv7s-seg 和 YOLOv8s-seg 相比,平均精确度(mAP)显著提高,分别提高了 5.1%、2.3%、4.1% 和 1.3%。在分割任务中,SBP-YOLOv8s-seg 网络的精确度、召回率和 mAP 分别从 YOLOv8s-seg 的 87.9 %、79 % 和 84.4 % 提高到 89.1 %、79.7 % 和 85.7 %。建议方法计算的盛开红花和衰落红花的准确率分别为 93.0 % 和 91.9 %。红花采摘点的总体定位精度为 92.9%。田间试验表明,采摘成功率为 90.7%。这项研究为今后红花采摘机器人的可视化定位提供了理论依据和数据支持。
{"title":"Safflower picking points localization method during the full harvest period based on SBP-YOLOv8s-seg network","authors":"He Zhang,&nbsp;Yun Ge,&nbsp;Hao Xia,&nbsp;Chao Sun","doi":"10.1016/j.compag.2024.109646","DOIUrl":"10.1016/j.compag.2024.109646","url":null,"abstract":"<div><div>Visual recognition is crucial for robotic harvesting of safflower filaments in field. However, accurate detection and localization is challenging due to complex backgrounds, leaves and branches shielding, and variable safflower morphology. This study proposes a safflower picking points localization method during the full harvest period based on SBP-YOLOv8s-seg network. The method enhanced the accuracy by improving the performance of the detection and segmentation network and implementing phased localization. Specifically, SBP-YOLOv8s-seg network based on self-calibration was constructed for precise segmentation of safflower filaments and fruit balls. Additionally, different morphological features of safflower during the full harvest period were analyzed. The segmented masks underwent Principal Component Analysis (PCA) computation, region of interest (ROI) extraction, and contour fitting to extract the principal eigenvectors that express information about the filaments. To address the issue of picking position being invisible due to the occlusion of safflower necking, the picking points were determined in conjunction with the positional relationship between filaments and fruit balls. Experimental results demonstrated that the segmentation performance of SBP-YOLOv8s-seg network was superior to other networks, achieving a significant improvement in mean average precision (mAP) compared to YOLOv5s-seg, YOLOv6s-seg, YOLOv7s-seg, and YOLOv8s-seg, with improvements of 5.1 %, 2.3 %, 4.1 %, and 1.3 % respectively. The precision, recall and mAP of SBP-YOLOv8s-seg network in the segmentation task increased from 87.9 %, 79 %, and 84.4 % of YOLOv8s-seg to 89.1 %, 79.7 %, and 85.7 %. The accuracy of blooming safflower and decaying safflower calculated by the proposed method were 93.0 % and 91.9 %, respectively. The overall localization accuracy of safflower picking points was 92.9 %. Field experiments showed that the picking success rate was 90.7 %. This study provides a theoretical basis and data support for visual localization of safflower picking robot in the future.</div></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":"227 ","pages":"Article 109646"},"PeriodicalIF":7.7,"publicationDate":"2024-11-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142699952","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A spatial machine-learning model for predicting crop water stress index for precision irrigation of vineyards 用于预测葡萄园精准灌溉作物水分胁迫指数的空间机器学习模型
IF 7.7 1区 农林科学 Q1 AGRICULTURE, MULTIDISCIPLINARY Pub Date : 2024-11-24 DOI: 10.1016/j.compag.2024.109578
Aviva Peeters , Yafit Cohen , Idan Bahat , Noa Ohana-Levi , Eitan Goldshtein , Yishai Netzer , Tomás R. Tenreiro , Victor Alchanatis , Alon Ben-Gal
Optimization of water inputs is possible through precision irrigation based on prescription maps. The crop water stress index (CWSI) is an indicator of spatial and dynamic changes in plant water status that can serve irrigation management decision-making. The driving hypothesis was that in-season CWSI maps based on combined static and spatial-dynamic variables could be used to delineate irrigation MZs. A primary incentive was to minimize thermal-imaging campaigns and to complement CWSI maps between campaigns with cost-effective multi-spectral imaging campaigns producing normalized difference vegetative index (NDVI) maps. A spatial machine-learning model based on a random-forest (RF) algorithm combined with spatial statistical methods was developed to predict the spatial and temporal variability in CWSI of single vines in a vineyard. Model criteria and objectives included the reduction of sample data and input variables to a minimum without impacting prediction accuracy, consideration of only variables readily available to farmers, and accounting for spatial location and spatial processes.
The model was developed and tested on data from a ‘Cabernet Sauvignon’ vineyard in Israel over two years. Prediction of CWSI was driven by terrain parameters, slope, aspect and topographical wetness index, soil apparent electrical conductivity (ECa), and NDVI.
Spatial models based on RF were found to support CWSI prediction. Adding a geospatial component significantly improved model performance and accuracy, particularly when raw data was represented as z-scores or when z-scores were used as weights. NDVI, followed by ECa, aspect, or slope, was the most important variable predicting CWSI in the non-spatial models. The stronger the variable importance of NDVI, the better the model performed. The weaker the effect of NDVI in predicting CWSI, the stronger the effect of terrain and soil variables. In the spatial models, based on z-transformed values or on weighted values, the most important variable in predicting CWSI was either NDVI or location.
The model, based on a limited and readily accessible number of variables, can serve as the basis for user-friendly decision support tools for precision irrigation. Additional research is needed to evaluate alternative prediction variables and to account for case studies in more geographical locations to address overfitting specific input data. Socio-economic and cost-benefit considerations should be integrated to examine whether precision irrigation management based on such models has the desired effects on water consumption and yield.
根据处方图进行精准灌溉可以优化水的投入。作物水分胁迫指数(CWSI)是植物水分状况空间和动态变化的指标,可用于灌溉管理决策。我们提出的假设是,基于静态和空间-动态综合变量的当季 CWSI 地图可用于划定灌溉分区。主要动机是最大限度地减少热成像活动,并在活动间隙利用成本效益高的多光谱成像活动生成归一化植被指数(NDVI)图,以补充 CWSI 图。我们开发了一个空间机器学习模型,该模型基于随机森林 (RF) 算法,并结合了空间统计方法,用于预测葡萄园中单株葡萄的 CWSI 的空间和时间变化。模型的标准和目标包括:在不影响预测准确性的前提下,将样本数据和输入变量减少到最低限度;只考虑农民容易获得的变量;考虑空间位置和空间过程。地形参数、坡度、坡向和地形湿润指数、土壤表观导电率(ECa)和 NDVI 驱动了 CWSI 的预测。添加地理空间组件可显著提高模型的性能和准确性,尤其是当原始数据以 z 值表示或以 z 值作为权重时。在非空间模型中,预测 CWSI 的最重要变量是 NDVI,其次是 ECa、纵向或横坡。NDVI 变量的重要性越强,模型的表现就越好。NDVI 对预测 CWSI 的作用越弱,地形和土壤变量的作用就越强。在基于 z 变形值或加权值的空间模型中,预测 CWSI 的最重要变量不是 NDVI 就是位置。还需要开展更多研究,以评估其他预测变量,并对更多地理位置进行案例研究,以解决特定输入数据的过度拟合问题。应综合考虑社会经济和成本效益因素,研究基于此类模型的精准灌溉管理是否能对耗水量和产量产生预期效果。
{"title":"A spatial machine-learning model for predicting crop water stress index for precision irrigation of vineyards","authors":"Aviva Peeters ,&nbsp;Yafit Cohen ,&nbsp;Idan Bahat ,&nbsp;Noa Ohana-Levi ,&nbsp;Eitan Goldshtein ,&nbsp;Yishai Netzer ,&nbsp;Tomás R. Tenreiro ,&nbsp;Victor Alchanatis ,&nbsp;Alon Ben-Gal","doi":"10.1016/j.compag.2024.109578","DOIUrl":"10.1016/j.compag.2024.109578","url":null,"abstract":"<div><div>Optimization of water inputs is possible through precision irrigation based on prescription maps. The crop water stress index (CWSI) is an indicator of spatial and dynamic changes in plant water status that can serve irrigation management decision-making. The driving hypothesis was that in-season CWSI maps based on combined static and spatial-dynamic variables could be used to delineate irrigation MZs. A primary incentive was to minimize thermal-imaging campaigns and to complement CWSI maps between campaigns with cost-effective multi-spectral imaging campaigns producing normalized difference vegetative index (NDVI) maps. A spatial machine-learning model based on a random-forest (RF) algorithm combined with spatial statistical methods was developed to predict the spatial and temporal variability in CWSI of single vines in a vineyard. Model criteria and objectives included the reduction of sample data and input variables to a minimum without impacting prediction accuracy, consideration of only variables readily available to farmers, and accounting for spatial location and spatial processes.</div><div>The model was developed and tested on data from a ‘Cabernet Sauvignon’ vineyard in Israel over two years. Prediction of CWSI was driven by terrain parameters, slope, aspect and topographical wetness index, soil apparent electrical conductivity (ECa), and NDVI.</div><div>Spatial models based on RF were found to support CWSI prediction. Adding a geospatial component significantly improved model performance and accuracy, particularly when raw data was represented as z-scores or when z-scores were used as weights. NDVI, followed by ECa, aspect, or slope, was the most important variable predicting CWSI in the non-spatial models. The stronger the variable importance of NDVI, the better the model performed. The weaker the effect of NDVI in predicting CWSI, the stronger the effect of terrain and soil variables. In the spatial models, based on z-transformed values or on weighted values, the most important variable in predicting CWSI was either NDVI or location.</div><div>The model, based on a limited and readily accessible number of variables, can serve as the basis for user-friendly decision support tools for precision irrigation. Additional research is needed to evaluate alternative prediction variables and to account for case studies in more geographical locations to address overfitting specific input data. Socio-economic and cost-benefit considerations should be integrated to examine whether precision irrigation management based on such models has the desired effects on water consumption and yield.</div></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":"227 ","pages":"Article 109578"},"PeriodicalIF":7.7,"publicationDate":"2024-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142699943","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Integrating UAV, UGV and UAV-UGV collaboration in future industrialized agriculture: Analysis, opportunities and challenges 在未来工业化农业中整合 UAV、UGV 和 UAV-UGV 协作:分析、机遇和挑战
IF 7.7 1区 农林科学 Q1 AGRICULTURE, MULTIDISCIPLINARY Pub Date : 2024-11-23 DOI: 10.1016/j.compag.2024.109631
Zhigang Ren, Han Zheng, Jian Chen, Tao Chen, Pengyang Xie, Yunzhe Xu, Jiaming Deng, Huanzhe Wang, Mingjiang Sun, Wenchi Jiao
Industrialized agriculture is the direction of future agricultural development, which is developing in the direction of scale, diversification, unmanned and integration. The cooperative operation of UAV, UGV and UAV-UGV is a hot topic in the field of intelligent agricultural multi-machine research. However, at present, most of the research projects have not systematically given the solutions of UAV, UGV and UAV-UGV collaborative application in the future industrialized agriculture. Therefore, we propose the development model of future industrialized agriculture, which derives the key technologies and applications of agricultural UAV, UGV and UAV-UGV collaboration. We summarize and discuss the difficulties and innovative design of the application of UAV, UGV and UAV-UGV collaboration technology in the future industrialized environment, and analyze the opportunities and challenges of the application of UAV, UGV and UAV-UGV collaboration technology in combination with future industrialized agricultural production. Finally, we describe that more technologies (multi-modal sensing technology, embodied intelligent control technology, edge computing technology, end-edge cloud collaborative management and control technology, virtual reality, augmented reality, etc.) are the future research directions for the application of UAV, UGV and UAV-UGV collaboration in industrialized agriculture.
产业化农业是未来农业发展的方向,正朝着规模化、多样化、无人化、集成化方向发展。无人机、无人潜航器和无人潜航器-无人潜航器的协同作业是智能农业多机研究领域的热点话题。然而,目前大多数研究项目还没有系统地给出无人机、无人潜航器和无人潜航器-无人潜航器协同应用于未来农业产业化的解决方案。因此,我们提出了未来农业产业化发展模式,推导出农业无人机、无人潜航器和无人潜航器-无人潜航器协同应用的关键技术和应用领域。我们总结和探讨了无人机、无人潜航器和无人潜航器-无人潜航器协同技术在未来工业化环境下应用的难点和创新设计,分析了无人机、无人潜航器和无人潜航器-无人潜航器协同技术结合未来工业化农业生产应用的机遇和挑战。最后,阐述了更多技术(多模态感知技术、体现式智能控制技术、边缘计算技术、端云协同管控技术、虚拟现实、增强现实等)是未来无人机、无人潜航器和无人潜航器-无人潜航器协同技术在农业产业化中应用的研究方向。
{"title":"Integrating UAV, UGV and UAV-UGV collaboration in future industrialized agriculture: Analysis, opportunities and challenges","authors":"Zhigang Ren,&nbsp;Han Zheng,&nbsp;Jian Chen,&nbsp;Tao Chen,&nbsp;Pengyang Xie,&nbsp;Yunzhe Xu,&nbsp;Jiaming Deng,&nbsp;Huanzhe Wang,&nbsp;Mingjiang Sun,&nbsp;Wenchi Jiao","doi":"10.1016/j.compag.2024.109631","DOIUrl":"10.1016/j.compag.2024.109631","url":null,"abstract":"<div><div>Industrialized agriculture is the direction of future agricultural development, which is developing in the direction of scale, diversification, unmanned and integration. The cooperative operation of UAV, UGV and UAV-UGV is a hot topic in the field of intelligent agricultural multi-machine research. However, at present, most of the research projects have not systematically given the solutions of UAV, UGV and UAV-UGV collaborative application in the future industrialized agriculture. Therefore, we propose the development model of future industrialized agriculture, which derives the key technologies and applications of agricultural UAV, UGV and UAV-UGV collaboration. We summarize and discuss the difficulties and innovative design of the application of UAV, UGV and UAV-UGV collaboration technology in the future industrialized environment, and analyze the opportunities and challenges of the application of UAV, UGV and UAV-UGV collaboration technology in combination with future industrialized agricultural production. Finally, we describe that more technologies (multi-modal sensing technology, embodied intelligent control technology, edge computing technology, end-edge cloud collaborative management and control technology, virtual reality, augmented reality, etc.) are the future research directions for the application of UAV, UGV and UAV-UGV collaboration in industrialized agriculture.</div></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":"227 ","pages":"Article 109631"},"PeriodicalIF":7.7,"publicationDate":"2024-11-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142699905","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Application of AMIS-optimized vision transformer in identifying disease in Nile Tilapia 应用 AMIS 优化视觉转换器识别尼罗罗非鱼疾病
IF 7.7 1区 农林科学 Q1 AGRICULTURE, MULTIDISCIPLINARY Pub Date : 2024-11-23 DOI: 10.1016/j.compag.2024.109676
Chutchai Kaewta , Rapeepan Pitakaso , Surajet Khonjun , Thanatkij Srichok , Peerawat Luesak , Sarayut Gonwirat , Prem Enkvetchakul , Achara Jutagate , Tuanthong Jutagate
Efficient health monitoring in Nile tilapia aquaculture is critical due to the substantial economic losses from diseases, underlining the necessity for innovative monitoring solutions. This study introduces an advanced, automated health monitoring system known as the “Automated System for Identifying Disease in Nile Tilapia (AS-ID-NT),” which incorporates a heterogeneous ensemble deep learning model using the Artificial Multiple Intelligence System (AMIS) as the decision fusion strategy (HE-DLM-AMIS). This system enhances the accuracy and efficiency of disease detection in Nile tilapia. The research utilized two specially curated video datasets, NT-1 and NT-2, each consisting of short videos lasting between 3–10 s, showcasing various behaviors of Nile tilapia in controlled environments. These datasets were critical for training and validating the ensemble model. Comparative analysis reveals that the HE-DLM-AMIS embedded in AS-ID-NT achieves superior performance, with an accuracy of 92.48% in detecting health issues in tilapia. This system outperforms both single model configurations, such as the 3D Convolutional Neural Network and Vision Transformer (ViT-large), which recorded accuracies of 84.64% and 85.7% respectively, and homogeneous ensemble models like ViT-large-Ho and ConvLSTM-Ho, which achieved accuracies of 88.49% and 86.84% respectively. AS-ID-NT provides a non-invasive, continuous, and automated solution for timely intervention, successfully identifying both healthy and unhealthy (infected and environmentally stressed) fish. This system not only demonstrates the potential of advanced AI and machine learning techniques in enhancing aquaculture management but also promotes sustainable practices and food security by maintaining healthier fish populations and supporting the economic viability of tilapia farms.
由于疾病造成的巨大经济损失,对尼罗罗非鱼水产养殖进行高效的健康监测至关重要,这凸显了创新监测解决方案的必要性。本研究介绍了一种先进的自动健康监测系统,即 "尼罗罗非鱼疾病自动识别系统(AS-ID-NT)",该系统采用人工多元智能系统(AMIS)的异构集合深度学习模型作为决策融合策略(HE-DLM-AMIS)。该系统提高了尼罗罗非鱼疾病检测的准确性和效率。该研究利用了两个专门制作的视频数据集(NT-1 和 NT-2),每个数据集由 3-10 秒的短视频组成,展示了尼罗罗非鱼在受控环境中的各种行为。这些数据集对于训练和验证集合模型至关重要。对比分析表明,嵌入 AS-ID-NT 的 HE-DLM-AMIS 性能卓越,在检测罗非鱼健康问题方面的准确率高达 92.48%。该系统优于三维卷积神经网络和视觉转换器(ViT-large)等单一模型配置(准确率分别为 84.64% 和 85.7%),也优于 ViT-large-Ho 和 ConvLSTM-Ho 等同构集合模型(准确率分别为 88.49% 和 86.84%)。AS-ID-NT 为及时干预提供了一种非侵入性、连续性和自动化的解决方案,成功识别了健康和不健康(感染和环境压力)的鱼类。该系统不仅展示了先进的人工智能和机器学习技术在加强水产养殖管理方面的潜力,还通过维持更健康的鱼类种群和支持罗非鱼养殖场的经济可行性,促进了可持续发展实践和食品安全。
{"title":"Application of AMIS-optimized vision transformer in identifying disease in Nile Tilapia","authors":"Chutchai Kaewta ,&nbsp;Rapeepan Pitakaso ,&nbsp;Surajet Khonjun ,&nbsp;Thanatkij Srichok ,&nbsp;Peerawat Luesak ,&nbsp;Sarayut Gonwirat ,&nbsp;Prem Enkvetchakul ,&nbsp;Achara Jutagate ,&nbsp;Tuanthong Jutagate","doi":"10.1016/j.compag.2024.109676","DOIUrl":"10.1016/j.compag.2024.109676","url":null,"abstract":"<div><div>Efficient health monitoring in Nile tilapia aquaculture is critical due to the substantial economic losses from diseases, underlining the necessity for innovative monitoring solutions. This study introduces an advanced, automated health monitoring system known as the “Automated System for Identifying Disease in Nile Tilapia (AS-ID-NT),” which incorporates a heterogeneous ensemble deep learning model using the Artificial Multiple Intelligence System (AMIS) as the decision fusion strategy (HE-DLM-AMIS). This system enhances the accuracy and efficiency of disease detection in Nile tilapia. The research utilized two specially curated video datasets, NT-1 and NT-2, each consisting of short videos lasting between 3–10 s, showcasing various behaviors of Nile tilapia in controlled environments. These datasets were critical for training and validating the ensemble model. Comparative analysis reveals that the HE-DLM-AMIS embedded in AS-ID-NT achieves superior performance, with an accuracy of 92.48% in detecting health issues in tilapia. This system outperforms both single model configurations, such as the 3D Convolutional Neural Network and Vision Transformer (ViT-large), which recorded accuracies of 84.64% and 85.7% respectively, and homogeneous ensemble models like ViT-large-Ho and ConvLSTM-Ho, which achieved accuracies of 88.49% and 86.84% respectively. AS-ID-NT provides a non-invasive, continuous, and automated solution for timely intervention, successfully identifying both healthy and unhealthy (infected and environmentally stressed) fish. This system not only demonstrates the potential of advanced AI and machine learning techniques in enhancing aquaculture management but also promotes sustainable practices and food security by maintaining healthier fish populations and supporting the economic viability of tilapia farms.</div></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":"227 ","pages":"Article 109676"},"PeriodicalIF":7.7,"publicationDate":"2024-11-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142699949","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A study of soil modelling methods based on line-structured light—Preparing for the subsoiling digital twin 基于线结构光的土壤建模方法研究--为地下数字孪生模型做准备
IF 7.7 1区 农林科学 Q1 AGRICULTURE, MULTIDISCIPLINARY Pub Date : 2024-11-23 DOI: 10.1016/j.compag.2024.109685
Xia Li , Birong You , Xuhui Wang , Zhipeng Zhao , Tianyu Qi , Jinyou Xu
The virtual model forms the foundation for building a digital twin system; however, methods for modelling dynamically changing soil in subsoiling have not yet been studied. To provide technical guidance for constructing such a system, this study employs a line structured light method for soil model construction. After conducting field and indoor trials, the extreme value method, grayscale centroid method, and Steger algorithm are used to extract the laser centreline. Results indicate that the extreme value method and grayscale centroid method require relatively little processing time—approximately 1.9 ms and 16 ms, respectively—with processing times being nearly the same in different environments. In contrast, the Steger algorithm requires over 300 ms. Regarding memory usage, the three methods demonstrate similar memory consumption when processing images of different environmental conditions: the extreme value method stabilizes at 86.48 MB, the grayscale centroid method at 105.72 MB, and the Steger algorithm fluctuates around 110 MB. The grayscale centroid method exhibits the best stability, making it most suitable for centreline extraction in the digital twin system. During 3D reconstruction, camera capture frequency is positively correlated with reconstruction quality, while movement speed negatively correlates. Each image’s processing time is under 1 ms, showing that the line laser 3D reconstruction method meets the real-time requirements of the digital twin system for subsoiling.
虚拟模型是建立数字孪生系统的基础,然而,目前尚未研究出建立地下土壤动态变化模型的方法。为了给此类系统的构建提供技术指导,本研究采用了线结构光法构建土壤模型。在进行实地和室内试验后,采用极值法、灰度中心点法和 Steger 算法提取激光中心线。结果表明,极值法和灰度向心法所需的处理时间相对较短,分别约为 1.9 毫秒和 16 毫秒,在不同环境下处理时间几乎相同。相比之下,Steger 算法需要 300 多毫秒。在内存使用方面,三种方法在处理不同环境条件下的图像时内存消耗相似:极值法稳定在 86.48 MB,灰度中心法为 105.72 MB,而 Steger 算法在 110 MB 左右波动。灰度向心法的稳定性最好,因此最适合用于数字孪生系统的中心线提取。在三维重建过程中,相机捕捉频率与重建质量呈正相关,而移动速度则呈负相关。每幅图像的处理时间小于 1 毫秒,这表明线激光三维重建方法符合数字孪生系统对底土测量的实时要求。
{"title":"A study of soil modelling methods based on line-structured light—Preparing for the subsoiling digital twin","authors":"Xia Li ,&nbsp;Birong You ,&nbsp;Xuhui Wang ,&nbsp;Zhipeng Zhao ,&nbsp;Tianyu Qi ,&nbsp;Jinyou Xu","doi":"10.1016/j.compag.2024.109685","DOIUrl":"10.1016/j.compag.2024.109685","url":null,"abstract":"<div><div>The virtual model forms the foundation for building a digital twin system; however, methods for modelling dynamically changing soil in subsoiling have not yet been studied. To provide technical guidance for constructing such a system, this study employs a line structured light method for soil model construction. After conducting field and indoor trials, the extreme value method, grayscale centroid method, and Steger algorithm are used to extract the laser centreline. Results indicate that the extreme value method and grayscale centroid method require relatively little processing time—approximately 1.9 ms and 16 ms, respectively—with processing times being nearly the same in different environments. In contrast, the Steger algorithm requires over 300 ms. Regarding memory usage, the three methods demonstrate similar memory consumption when processing images of different environmental conditions: the extreme value method stabilizes at 86.48 MB, the grayscale centroid method at 105.72 MB, and the Steger algorithm fluctuates around 110 MB. The grayscale centroid method exhibits the best stability, making it most suitable for centreline extraction in the digital twin system. During 3D reconstruction, camera capture frequency is positively correlated with reconstruction quality, while movement speed negatively correlates. Each image’s processing time is under 1 ms, showing that the line laser 3D reconstruction method meets the real-time requirements of the digital twin system for subsoiling.</div></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":"227 ","pages":"Article 109685"},"PeriodicalIF":7.7,"publicationDate":"2024-11-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142699948","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A point-based method for identification and counting of tiny object insects in cotton fields 基于点的棉田微小物体昆虫识别和计数方法
IF 7.7 1区 农林科学 Q1 AGRICULTURE, MULTIDISCIPLINARY Pub Date : 2024-11-22 DOI: 10.1016/j.compag.2024.109648
Mingshuang Bai , Tao Chen , Jia Yuan , Gang Zhou , Jiajia Wang , Zhenhong Jia
Monitoring of crop pests in the field can be achieved by using sticky traps that capture pests. However, due to the small size and high density of the captured pests, conventional object detection methods relying on bounding boxes struggle to accurately identify and count pests, as they are highly sensitive to positional deviations. Therefore, we propose a novel point framework for multi-species insect identification and counting, termed MS-P2P, which is free from the limitation of Bounding box. Specifically, we employ the lightweight object detection network YOLOv7-tiny for feature extraction and incorporate a lightweight attention detection head (LAHead) for point coordinate regression and insect classification. The LAHead enhances the model’s sensitivity to subtle insect features in complex environments. Additionally, we utilize point proposal prediction and the Hungarian matching algorithm to achieve one-to-one matching of optimal prediction points for targets, which simplifies post-processing methods significantly. Finally, we introduce SmoothL1 Loss and Focal Loss to address the issues of matching instability and class imbalance in the point estimation strategy, respectively. Extensive experiments on the self-built NSC dataset and the publicly available YST dataset have demonstrated the effectiveness of our designed MS-P2P. In particular, on our self-built dataset of 9 insect species, the overall counting metrics achieved a MAE of 18.9 and a RMSE of 28.8. The combined localization and counting metric, nAP0.5, reached 86.4%. Compared with other state-of-the-art algorithms, MS-P2P achieved the best overall results in both localization and counting metrics.
使用捕捉害虫的粘性诱捕器可以实现对田间作物害虫的监测。然而,由于捕获的害虫体积小、密度高,传统的物体检测方法依赖于边界框,对位置偏差高度敏感,难以准确识别和计数害虫。因此,我们提出了一种用于多物种昆虫识别和计数的新型点框架,称为 MS-P2P,它摆脱了边界框的限制。具体来说,我们采用轻量级对象检测网络 YOLOv7-tiny 进行特征提取,并结合轻量级注意力检测头(LAHead)进行点坐标回归和昆虫分类。LAHead 增强了模型对复杂环境中昆虫细微特征的灵敏度。此外,我们还利用点建议预测和匈牙利匹配算法来实现目标最佳预测点的一对一匹配,从而大大简化了后处理方法。最后,我们引入了 SmoothL1 Loss 和 Focal Loss,以分别解决点估计策略中匹配不稳定和类不平衡的问题。在自建的 NSC 数据集和公开的 YST 数据集上进行的大量实验证明了我们设计的 MS-P2P 的有效性。特别是在我们自建的 9 个昆虫物种数据集上,整体计数指标的 MAE 为 18.9,RMSE 为 28.8。综合定位和计数指标 nAP0.5 达到了 86.4%。与其他最先进的算法相比,MS-P2P 在定位和计数指标方面都取得了最佳的总体结果。
{"title":"A point-based method for identification and counting of tiny object insects in cotton fields","authors":"Mingshuang Bai ,&nbsp;Tao Chen ,&nbsp;Jia Yuan ,&nbsp;Gang Zhou ,&nbsp;Jiajia Wang ,&nbsp;Zhenhong Jia","doi":"10.1016/j.compag.2024.109648","DOIUrl":"10.1016/j.compag.2024.109648","url":null,"abstract":"<div><div>Monitoring of crop pests in the field can be achieved by using sticky traps that capture pests. However, due to the small size and high density of the captured pests, conventional object detection methods relying on bounding boxes struggle to accurately identify and count pests, as they are highly sensitive to positional deviations. Therefore, we propose a novel point framework for multi-species insect identification and counting, termed MS-P2P, which is free from the limitation of Bounding box. Specifically, we employ the lightweight object detection network YOLOv7-tiny for feature extraction and incorporate a lightweight attention detection head (LAHead) for point coordinate regression and insect classification. The LAHead enhances the model’s sensitivity to subtle insect features in complex environments. Additionally, we utilize point proposal prediction and the Hungarian matching algorithm to achieve one-to-one matching of optimal prediction points for targets, which simplifies post-processing methods significantly. Finally, we introduce SmoothL1 Loss and Focal Loss to address the issues of matching instability and class imbalance in the point estimation strategy, respectively. Extensive experiments on the self-built NSC dataset and the publicly available YST dataset have demonstrated the effectiveness of our designed MS-P2P. In particular, on our self-built dataset of 9 insect species, the overall counting metrics achieved a MAE of 18.9 and a RMSE of 28.8. The combined localization and counting metric, nAP0.5, reached 86.4%. Compared with other state-of-the-art algorithms, MS-P2P achieved the best overall results in both localization and counting metrics.</div></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":"227 ","pages":"Article 109648"},"PeriodicalIF":7.7,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142700047","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Computers and Electronics in Agriculture
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1