Krishna Moorthy Babu, Daniel Bentall, David T Ashton, Morgan Puklowski, Warren Fantham, Harris T Lin, Nicholas P L Tuckey, Maren Wellenreuther, Linley K Jesson
{"title":"水产养殖中的计算机视觉:以幼鱼计数为例","authors":"Krishna Moorthy Babu, Daniel Bentall, David T Ashton, Morgan Puklowski, Warren Fantham, Harris T Lin, Nicholas P L Tuckey, Maren Wellenreuther, Linley K Jesson","doi":"10.1080/03036758.2022.2101484","DOIUrl":null,"url":null,"abstract":"<p><p>In aquaculture breeding or production programmes, counting juvenile fish represents a considerable cost in terms of the human hours needed. In this study, we explored the use of two state-of-the-art machine learning architectures (Single Shot Detection, hereafter SSD and Faster Regions with convolutional neural networks, hereafter Faster R-CNN) to augment a manual image-based juvenile fish counting method for the Australasian snapper (<i>Chrysophrys auratus</i>) bred at The New Zealand Institute for Plant and Food Research Limited. We tested model accuracy after tuning for confidence thresholds and non-maximal suppression overlap parameters, and implementing a bias correction using a Poisson regression model. Validation of image data showed that after tuning, bias-corrected SSD and Faster R-CNN models had mean absolute percent errors (MAPE) of less than 10%, with SSD having MAPE of less than 5%. Comparison of the results with those from manual counts showed that, while manual counts are slightly more accurate (MAPE = 1.56), the machine learning methods allow for more rapid assessment of counts and thus facilitating a higher throughput. This work represents a first step for deploying machine learning applications to an existing real-life aquaculture scenario and provides a useful starting point for further developments, such as real-time counting of fish or collecting additional phenotypic data from the source images.</p>","PeriodicalId":49984,"journal":{"name":"Journal of the Royal Society of New Zealand","volume":"53 1","pages":"52-68"},"PeriodicalIF":2.1000,"publicationDate":"2022-08-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11459735/pdf/","citationCount":"0","resultStr":"{\"title\":\"Computer vision in aquaculture: a case study of juvenile fish counting.\",\"authors\":\"Krishna Moorthy Babu, Daniel Bentall, David T Ashton, Morgan Puklowski, Warren Fantham, Harris T Lin, Nicholas P L Tuckey, Maren Wellenreuther, Linley K Jesson\",\"doi\":\"10.1080/03036758.2022.2101484\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>In aquaculture breeding or production programmes, counting juvenile fish represents a considerable cost in terms of the human hours needed. In this study, we explored the use of two state-of-the-art machine learning architectures (Single Shot Detection, hereafter SSD and Faster Regions with convolutional neural networks, hereafter Faster R-CNN) to augment a manual image-based juvenile fish counting method for the Australasian snapper (<i>Chrysophrys auratus</i>) bred at The New Zealand Institute for Plant and Food Research Limited. We tested model accuracy after tuning for confidence thresholds and non-maximal suppression overlap parameters, and implementing a bias correction using a Poisson regression model. Validation of image data showed that after tuning, bias-corrected SSD and Faster R-CNN models had mean absolute percent errors (MAPE) of less than 10%, with SSD having MAPE of less than 5%. Comparison of the results with those from manual counts showed that, while manual counts are slightly more accurate (MAPE = 1.56), the machine learning methods allow for more rapid assessment of counts and thus facilitating a higher throughput. This work represents a first step for deploying machine learning applications to an existing real-life aquaculture scenario and provides a useful starting point for further developments, such as real-time counting of fish or collecting additional phenotypic data from the source images.</p>\",\"PeriodicalId\":49984,\"journal\":{\"name\":\"Journal of the Royal Society of New Zealand\",\"volume\":\"53 1\",\"pages\":\"52-68\"},\"PeriodicalIF\":2.1000,\"publicationDate\":\"2022-08-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11459735/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of the Royal Society of New Zealand\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://doi.org/10.1080/03036758.2022.2101484\",\"RegionNum\":4,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2023/1/1 0:00:00\",\"PubModel\":\"eCollection\",\"JCR\":\"Q2\",\"JCRName\":\"MULTIDISCIPLINARY SCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of the Royal Society of New Zealand","FirstCategoryId":"103","ListUrlMain":"https://doi.org/10.1080/03036758.2022.2101484","RegionNum":4,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/1/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"MULTIDISCIPLINARY SCIENCES","Score":null,"Total":0}
引用次数: 0
摘要
摘要在水产养殖养殖或生产计划中,就所需工时而言,计算幼鱼数量是一项相当大的成本。在这项研究中,我们探索了使用两种最先进的机器学习架构(Single Shot Detection,以下简称SSD和Faster Regions with convolutional neural Network,以下简称Faster R-CNN)来增强新西兰植物与食品研究所有限公司培育的澳大拉西亚鲷鱼(金黄色鲷)的手动图像幼鱼计数方法。在调整置信阈值和非最大抑制重叠参数,并使用泊松回归模型实现偏差校正后,我们测试了模型的准确性。图像数据的验证表明,在调谐后,经偏置校正的SSD和Faster R-CNN模型的平均绝对百分比误差(MAPE)小于10%,SSD的MAPE小于5%。将结果与手动计数的结果进行比较表明,虽然手动计数的准确性略高(MAPE = 1.56),机器学习方法允许更快速地评估计数,从而促进更高的吞吐量。这项工作代表了将机器学习应用程序部署到现有的真实水产养殖场景的第一步,并为进一步的开发提供了一个有用的起点,例如鱼类的实时计数或从源图像中收集额外的表型数据。
Computer vision in aquaculture: a case study of juvenile fish counting.
In aquaculture breeding or production programmes, counting juvenile fish represents a considerable cost in terms of the human hours needed. In this study, we explored the use of two state-of-the-art machine learning architectures (Single Shot Detection, hereafter SSD and Faster Regions with convolutional neural networks, hereafter Faster R-CNN) to augment a manual image-based juvenile fish counting method for the Australasian snapper (Chrysophrys auratus) bred at The New Zealand Institute for Plant and Food Research Limited. We tested model accuracy after tuning for confidence thresholds and non-maximal suppression overlap parameters, and implementing a bias correction using a Poisson regression model. Validation of image data showed that after tuning, bias-corrected SSD and Faster R-CNN models had mean absolute percent errors (MAPE) of less than 10%, with SSD having MAPE of less than 5%. Comparison of the results with those from manual counts showed that, while manual counts are slightly more accurate (MAPE = 1.56), the machine learning methods allow for more rapid assessment of counts and thus facilitating a higher throughput. This work represents a first step for deploying machine learning applications to an existing real-life aquaculture scenario and provides a useful starting point for further developments, such as real-time counting of fish or collecting additional phenotypic data from the source images.
期刊介绍:
Aims: The Journal of the Royal Society of New Zealand reflects the role of Royal Society Te Aparangi in fostering research and debate across natural sciences, social sciences, and the humanities in New Zealand/Aotearoa and the surrounding Pacific. Research published in Journal of the Royal Society of New Zealand advances scientific knowledge, informs government policy, public awareness and broader society, and is read by researchers worldwide.