StraTracker:基于多目标跟踪的草莓生长动态计数法

IF 7.7 1区 农林科学 Q1 AGRICULTURE, MULTIDISCIPLINARY Computers and Electronics in Agriculture Pub Date : 2024-11-09 DOI:10.1016/j.compag.2024.109564
Qilin An, Yongzhi Cui, Wenyu Tong, Yangchun Liu, Bo Zhao, Liguo Wei
{"title":"StraTracker:基于多目标跟踪的草莓生长动态计数法","authors":"Qilin An,&nbsp;Yongzhi Cui,&nbsp;Wenyu Tong,&nbsp;Yangchun Liu,&nbsp;Bo Zhao,&nbsp;Liguo Wei","doi":"10.1016/j.compag.2024.109564","DOIUrl":null,"url":null,"abstract":"<div><div>Accurately counting fruit in orchards is a critical step for effective digital farming management. However, the variability in fruit size, overlapping shadows, and light interference present significant challenges to applying computer vision during the strawberry growth phase. To address these challenges, we propose StraTracker, a multi-object tracking (MOT) algorithm specifically designed to identify and count strawberries at various growth stages. StraTracker transforms the counting task into a frame-by-frame tracking problem, integrating both motion and appearance features. The algorithm is composed of three key components: a strawberry detector based on YOLOv8n, a feature association module, and a dual-area counting (DC) module. First, the strawberry detector accurately recognizes five growth stages, achieving an average accuracy of 91.93 % at 38.3 FPS. Next, the feature association module, incorporating the Feature Slicing Attention (FSA) and Adaptive Kalman Filtering (AKF) modules, mitigates issues such as light interference, impractical tracking frames, and ID switching (IDs). As a result, StraTracker achieves a Multi-Object Tracking Accuracy (MOTA) of 83.28 % and a Higher-Order Tracking Accuracy (HOTA) of 77.26 %, with only 259 IDs, outperforming existing baseline models. Finally, the DC module categorizes fruit counts based on the unique IDs assigned during tracking. The algorithm’s coefficient of determination (<span><math><mrow><msup><mrow><mi>R</mi></mrow><mn>2</mn></msup></mrow></math></span> = 0.91) and GEH of 2.33 indicate a strong correlation between predicted and actual counts. In conclusion, StraTracker offers a promising solution for farmers to optimize planting strategies and develop more precise harvesting plans.</div></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":"227 ","pages":"Article 109564"},"PeriodicalIF":7.7000,"publicationDate":"2024-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"StraTracker: A dynamic counting method for growing strawberries based on multi-target tracking\",\"authors\":\"Qilin An,&nbsp;Yongzhi Cui,&nbsp;Wenyu Tong,&nbsp;Yangchun Liu,&nbsp;Bo Zhao,&nbsp;Liguo Wei\",\"doi\":\"10.1016/j.compag.2024.109564\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Accurately counting fruit in orchards is a critical step for effective digital farming management. However, the variability in fruit size, overlapping shadows, and light interference present significant challenges to applying computer vision during the strawberry growth phase. To address these challenges, we propose StraTracker, a multi-object tracking (MOT) algorithm specifically designed to identify and count strawberries at various growth stages. StraTracker transforms the counting task into a frame-by-frame tracking problem, integrating both motion and appearance features. The algorithm is composed of three key components: a strawberry detector based on YOLOv8n, a feature association module, and a dual-area counting (DC) module. First, the strawberry detector accurately recognizes five growth stages, achieving an average accuracy of 91.93 % at 38.3 FPS. Next, the feature association module, incorporating the Feature Slicing Attention (FSA) and Adaptive Kalman Filtering (AKF) modules, mitigates issues such as light interference, impractical tracking frames, and ID switching (IDs). As a result, StraTracker achieves a Multi-Object Tracking Accuracy (MOTA) of 83.28 % and a Higher-Order Tracking Accuracy (HOTA) of 77.26 %, with only 259 IDs, outperforming existing baseline models. Finally, the DC module categorizes fruit counts based on the unique IDs assigned during tracking. The algorithm’s coefficient of determination (<span><math><mrow><msup><mrow><mi>R</mi></mrow><mn>2</mn></msup></mrow></math></span> = 0.91) and GEH of 2.33 indicate a strong correlation between predicted and actual counts. In conclusion, StraTracker offers a promising solution for farmers to optimize planting strategies and develop more precise harvesting plans.</div></div>\",\"PeriodicalId\":50627,\"journal\":{\"name\":\"Computers and Electronics in Agriculture\",\"volume\":\"227 \",\"pages\":\"Article 109564\"},\"PeriodicalIF\":7.7000,\"publicationDate\":\"2024-11-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computers and Electronics in Agriculture\",\"FirstCategoryId\":\"97\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0168169924009554\",\"RegionNum\":1,\"RegionCategory\":\"农林科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AGRICULTURE, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers and Electronics in Agriculture","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0168169924009554","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

摘要

对果园中的果实进行精确计数是实现有效数字农业管理的关键一步。然而,果实大小的可变性、阴影重叠和光线干扰给在草莓生长阶段应用计算机视觉带来了巨大挑战。为了应对这些挑战,我们提出了 StraTracker,这是一种多目标跟踪 (MOT) 算法,专门用于识别和计数处于不同生长阶段的草莓。StraTracker 将计数任务转化为逐帧跟踪问题,同时整合了运动和外观特征。该算法由三个关键部分组成:基于 YOLOv8n 的草莓检测器、特征关联模块和双区域计数(DC)模块。首先,草莓检测器能准确识别五个生长阶段,在 38.3 FPS 下达到 91.93% 的平均准确率。接着,特征关联模块结合了特征切分注意(FSA)和自适应卡尔曼滤波(AKF)模块,缓解了光线干扰、不切实际的跟踪帧和 ID 切换(ID)等问题。因此,StraTracker 的多目标跟踪准确率 (MOTA) 达到 83.28%,高阶跟踪准确率 (HOTA) 达到 77.26%,ID 数量仅为 259 个,优于现有的基线模型。最后,DC 模块根据跟踪过程中分配的唯一 ID 对水果数量进行分类。该算法的判定系数(R2 = 0.91)和 2.33 的 GEH 表明,预测计数与实际计数之间具有很强的相关性。总之,StraTracker 为农民优化种植策略和制定更精确的收获计划提供了一个前景广阔的解决方案。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
StraTracker: A dynamic counting method for growing strawberries based on multi-target tracking
Accurately counting fruit in orchards is a critical step for effective digital farming management. However, the variability in fruit size, overlapping shadows, and light interference present significant challenges to applying computer vision during the strawberry growth phase. To address these challenges, we propose StraTracker, a multi-object tracking (MOT) algorithm specifically designed to identify and count strawberries at various growth stages. StraTracker transforms the counting task into a frame-by-frame tracking problem, integrating both motion and appearance features. The algorithm is composed of three key components: a strawberry detector based on YOLOv8n, a feature association module, and a dual-area counting (DC) module. First, the strawberry detector accurately recognizes five growth stages, achieving an average accuracy of 91.93 % at 38.3 FPS. Next, the feature association module, incorporating the Feature Slicing Attention (FSA) and Adaptive Kalman Filtering (AKF) modules, mitigates issues such as light interference, impractical tracking frames, and ID switching (IDs). As a result, StraTracker achieves a Multi-Object Tracking Accuracy (MOTA) of 83.28 % and a Higher-Order Tracking Accuracy (HOTA) of 77.26 %, with only 259 IDs, outperforming existing baseline models. Finally, the DC module categorizes fruit counts based on the unique IDs assigned during tracking. The algorithm’s coefficient of determination (R2 = 0.91) and GEH of 2.33 indicate a strong correlation between predicted and actual counts. In conclusion, StraTracker offers a promising solution for farmers to optimize planting strategies and develop more precise harvesting plans.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Computers and Electronics in Agriculture
Computers and Electronics in Agriculture 工程技术-计算机:跨学科应用
CiteScore
15.30
自引率
14.50%
发文量
800
审稿时长
62 days
期刊介绍: Computers and Electronics in Agriculture provides international coverage of advancements in computer hardware, software, electronic instrumentation, and control systems applied to agricultural challenges. Encompassing agronomy, horticulture, forestry, aquaculture, and animal farming, the journal publishes original papers, reviews, and applications notes. It explores the use of computers and electronics in plant or animal agricultural production, covering topics like agricultural soils, water, pests, controlled environments, and waste. The scope extends to on-farm post-harvest operations and relevant technologies, including artificial intelligence, sensors, machine vision, robotics, networking, and simulation modeling. Its companion journal, Smart Agricultural Technology, continues the focus on smart applications in production agriculture.
期刊最新文献
Construction and validation of a mathematical model for the pressure subsidence of mixed crop straw in Shajiang black soil Fish feeding behavior recognition using time-domain and frequency-domain signals fusion from six-axis inertial sensors Estimation of crop leaf area index based on Sentinel-2 images and PROSAIL-Transformer coupling model Design, integration, and field evaluation of a selective harvesting robot for broccoli A Novel Behavior Detection Method for Sows and Piglets during Lactation Based on an Inspection Robot
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1