He Wang , Song Zhang , Shili Zhao , Qi Wang , Daoliang Li , Ran Zhao
{"title":"基于改进的YOLOV5和siamrpn++的鱼类异常行为实时检测与跟踪","authors":"He Wang , Song Zhang , Shili Zhao , Qi Wang , Daoliang Li , Ran Zhao","doi":"10.1016/j.compag.2021.106512","DOIUrl":null,"url":null,"abstract":"<div><p><span>In recirculating aquaculture system, the abnormal behavior of fish is usually caused by poor water quality, </span>hypoxia<span><span> or diseases. Delayed recognition of this behavior will lead to large number of fish deaths. Thus, real-time detection and tracking of fish that behaviors abnormally is an effective way to promote the fish welfare and to improve the survival rate as well as economic benefits of aquaculture. However, due to the high-density breeding, the targets in the fish images are often quite small and in occlusion, which causes high false detection and target loss rate. This article proposes a combined end-to-end neural network to detect and track the abnormal behavior of porphyry </span>seabream<span>. The detection algorithm passes the initial value of the target into the tracking algorithm, and the tracking algorithm tracks subsequent frames to achieve end-to-end abnormal fish behavior detection and achieve high-speed and accurate tracking of abnormal behavior individuals.</span></span></p><p>In the target detection part, YOLOV5s is improved by incorporating multi-level features and adding feature mapping. Compared with the original network, the detection precision <span><math><mrow><mi>A</mi><msub><mi>P</mi><mrow><mn>50</mn><mo>:</mo><mn>95</mn></mrow></msub></mrow></math></span> is increased by 8.8% while <span><math><mrow><mi>A</mi><msub><mi>P</mi><mn>50</mn></msub></mrow></math></span> reaches 99.4%. In the target tracking part, this paper achieves multi-target tracking of abnormal fish based on single-target tracking algorithm SiamRPN++. The tracking precision is 76.7%. By combining the two approaches, individual fish with abnormal behavior can be detected precisely and tracked in real time.</p></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":null,"pages":null},"PeriodicalIF":7.7000,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"60","resultStr":"{\"title\":\"Real-time detection and tracking of fish abnormal behavior based on improved YOLOV5 and SiamRPN++\",\"authors\":\"He Wang , Song Zhang , Shili Zhao , Qi Wang , Daoliang Li , Ran Zhao\",\"doi\":\"10.1016/j.compag.2021.106512\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p><span>In recirculating aquaculture system, the abnormal behavior of fish is usually caused by poor water quality, </span>hypoxia<span><span> or diseases. Delayed recognition of this behavior will lead to large number of fish deaths. Thus, real-time detection and tracking of fish that behaviors abnormally is an effective way to promote the fish welfare and to improve the survival rate as well as economic benefits of aquaculture. However, due to the high-density breeding, the targets in the fish images are often quite small and in occlusion, which causes high false detection and target loss rate. This article proposes a combined end-to-end neural network to detect and track the abnormal behavior of porphyry </span>seabream<span>. The detection algorithm passes the initial value of the target into the tracking algorithm, and the tracking algorithm tracks subsequent frames to achieve end-to-end abnormal fish behavior detection and achieve high-speed and accurate tracking of abnormal behavior individuals.</span></span></p><p>In the target detection part, YOLOV5s is improved by incorporating multi-level features and adding feature mapping. Compared with the original network, the detection precision <span><math><mrow><mi>A</mi><msub><mi>P</mi><mrow><mn>50</mn><mo>:</mo><mn>95</mn></mrow></msub></mrow></math></span> is increased by 8.8% while <span><math><mrow><mi>A</mi><msub><mi>P</mi><mn>50</mn></msub></mrow></math></span> reaches 99.4%. In the target tracking part, this paper achieves multi-target tracking of abnormal fish based on single-target tracking algorithm SiamRPN++. The tracking precision is 76.7%. By combining the two approaches, individual fish with abnormal behavior can be detected precisely and tracked in real time.</p></div>\",\"PeriodicalId\":50627,\"journal\":{\"name\":\"Computers and Electronics in Agriculture\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":7.7000,\"publicationDate\":\"2022-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"60\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computers and Electronics in Agriculture\",\"FirstCategoryId\":\"97\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0168169921005299\",\"RegionNum\":1,\"RegionCategory\":\"农林科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AGRICULTURE, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers and Electronics in Agriculture","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0168169921005299","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
Real-time detection and tracking of fish abnormal behavior based on improved YOLOV5 and SiamRPN++
In recirculating aquaculture system, the abnormal behavior of fish is usually caused by poor water quality, hypoxia or diseases. Delayed recognition of this behavior will lead to large number of fish deaths. Thus, real-time detection and tracking of fish that behaviors abnormally is an effective way to promote the fish welfare and to improve the survival rate as well as economic benefits of aquaculture. However, due to the high-density breeding, the targets in the fish images are often quite small and in occlusion, which causes high false detection and target loss rate. This article proposes a combined end-to-end neural network to detect and track the abnormal behavior of porphyry seabream. The detection algorithm passes the initial value of the target into the tracking algorithm, and the tracking algorithm tracks subsequent frames to achieve end-to-end abnormal fish behavior detection and achieve high-speed and accurate tracking of abnormal behavior individuals.
In the target detection part, YOLOV5s is improved by incorporating multi-level features and adding feature mapping. Compared with the original network, the detection precision is increased by 8.8% while reaches 99.4%. In the target tracking part, this paper achieves multi-target tracking of abnormal fish based on single-target tracking algorithm SiamRPN++. The tracking precision is 76.7%. By combining the two approaches, individual fish with abnormal behavior can be detected precisely and tracked in real time.
期刊介绍:
Computers and Electronics in Agriculture provides international coverage of advancements in computer hardware, software, electronic instrumentation, and control systems applied to agricultural challenges. Encompassing agronomy, horticulture, forestry, aquaculture, and animal farming, the journal publishes original papers, reviews, and applications notes. It explores the use of computers and electronics in plant or animal agricultural production, covering topics like agricultural soils, water, pests, controlled environments, and waste. The scope extends to on-farm post-harvest operations and relevant technologies, including artificial intelligence, sensors, machine vision, robotics, networking, and simulation modeling. Its companion journal, Smart Agricultural Technology, continues the focus on smart applications in production agriculture.