Deep learning based classification of sheep behaviour from accelerometer data with imbalance

IF 7.7 Q1 AGRICULTURE, MULTIDISCIPLINARY Information Processing in Agriculture Pub Date : 2023-09-01 DOI:10.1016/j.inpa.2022.04.001
Kirk E. Turner , Andrew Thompson , Ian Harris , Mark Ferguson , Ferdous Sohel
{"title":"Deep learning based classification of sheep behaviour from accelerometer data with imbalance","authors":"Kirk E. Turner ,&nbsp;Andrew Thompson ,&nbsp;Ian Harris ,&nbsp;Mark Ferguson ,&nbsp;Ferdous Sohel","doi":"10.1016/j.inpa.2022.04.001","DOIUrl":null,"url":null,"abstract":"<div><p>Classification of sheep behaviour from a sequence of tri-axial accelerometer data has the potential to enhance sheep management. Sheep behaviour is inherently imbalanced (e.g., more <em>ruminating</em> than <em>walking</em>) resulting in underperforming classification for the minority activities which hold importance. Existing works have not addressed class imbalance and use traditional machine learning techniques, e.g., Random Forest (RF). We investigated Deep Learning (DL) models, namely, Long Short Term Memory (LSTM) and Bidirectional LSTM (BLSTM), appropriate for sequential data, from imbalanced data. Two data sets were collected in normal grazing conditions using jaw-mounted and ear-mounted sensors. Novel to this study, alongside typical single classes, e.g., <em>walking</em>, depending on the behaviours, data samples were labelled with compound classes, e.g., <em>walking_grazing</em>. The number of steps a sheep performed in the observed 10 s time window was also recorded and incorporated in the models. We designed several multi-class classification studies with imbalance being addressed using synthetic data. DL models achieved superior performance to traditional ML models, especially with augmented data (e.g., 4-Class + Steps: LSTM 88.0%, RF 82.5%). DL methods showed superior generalisability on unseen sheep (i.e., F1-score: BLSTM 0.84, LSTM 0.83, RF 0.65). LSTM, BLSTM and RF achieved sub-millisecond average inference time, making them suitable for real-time applications. The results demonstrate the effectiveness of DL models for sheep behaviour classification in grazing conditions. The results also demonstrate the DL techniques can generalise across different sheep. The study presents a strong foundation of the development of such models for real-time animal monitoring.</p></div>","PeriodicalId":53443,"journal":{"name":"Information Processing in Agriculture","volume":"10 3","pages":"Pages 377-390"},"PeriodicalIF":7.7000,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"11","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Processing in Agriculture","FirstCategoryId":"1091","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2214317322000415","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 11

Abstract

Classification of sheep behaviour from a sequence of tri-axial accelerometer data has the potential to enhance sheep management. Sheep behaviour is inherently imbalanced (e.g., more ruminating than walking) resulting in underperforming classification for the minority activities which hold importance. Existing works have not addressed class imbalance and use traditional machine learning techniques, e.g., Random Forest (RF). We investigated Deep Learning (DL) models, namely, Long Short Term Memory (LSTM) and Bidirectional LSTM (BLSTM), appropriate for sequential data, from imbalanced data. Two data sets were collected in normal grazing conditions using jaw-mounted and ear-mounted sensors. Novel to this study, alongside typical single classes, e.g., walking, depending on the behaviours, data samples were labelled with compound classes, e.g., walking_grazing. The number of steps a sheep performed in the observed 10 s time window was also recorded and incorporated in the models. We designed several multi-class classification studies with imbalance being addressed using synthetic data. DL models achieved superior performance to traditional ML models, especially with augmented data (e.g., 4-Class + Steps: LSTM 88.0%, RF 82.5%). DL methods showed superior generalisability on unseen sheep (i.e., F1-score: BLSTM 0.84, LSTM 0.83, RF 0.65). LSTM, BLSTM and RF achieved sub-millisecond average inference time, making them suitable for real-time applications. The results demonstrate the effectiveness of DL models for sheep behaviour classification in grazing conditions. The results also demonstrate the DL techniques can generalise across different sheep. The study presents a strong foundation of the development of such models for real-time animal monitoring.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于深度学习的不平衡加速度计数据羊行为分类
从一系列三轴加速度计数据中对羊的行为进行分类有可能加强羊的管理。羊的行为本质上是不平衡的(例如,反刍多于行走),导致对少数重要活动的分类表现不佳。现有的工作没有解决阶级不平衡问题,并使用传统的机器学习技术,例如随机森林(RF)。我们研究了深度学习(DL)模型,即长短期记忆(LSTM)和双向LSTM (BLSTM),适用于序列数据,来自不平衡数据。在正常放牧条件下,采用下颌和耳戴式传感器采集两组数据。本研究的新颖之处在于,除了典型的单一类别,例如步行,根据行为,数据样本被标记为复合类别,例如步行-放牧。在观察到的10 s时间窗口内,羊的步数也被记录并纳入模型。我们设计了几个多类分类研究,使用合成数据解决了不平衡问题。深度学习模型取得了优于传统ML模型的性能,特别是在增强数据(例如,4类+步骤:LSTM 88.0%, RF 82.5%)。DL方法在未见绵羊上表现出较好的通用性(即f1得分:BLSTM 0.84, LSTM 0.83, RF 0.65)。LSTM, BLSTM和RF实现了亚毫秒的平均推理时间,使它们适合实时应用。结果表明DL模型对放牧条件下绵羊行为分类的有效性。结果还表明,深度学习技术可以推广到不同的绵羊身上。该研究为开发此类实时动物监测模型提供了坚实的基础。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Information Processing in Agriculture
Information Processing in Agriculture Agricultural and Biological Sciences-Animal Science and Zoology
CiteScore
21.10
自引率
0.00%
发文量
80
期刊介绍: Information Processing in Agriculture (IPA) was established in 2013 and it encourages the development towards a science and technology of information processing in agriculture, through the following aims: • Promote the use of knowledge and methods from the information processing technologies in the agriculture; • Illustrate the experiences and publications of the institutes, universities and government, and also the profitable technologies on agriculture; • Provide opportunities and platform for exchanging knowledge, strategies and experiences among the researchers in information processing worldwide; • Promote and encourage interactions among agriculture Scientists, Meteorologists, Biologists (Pathologists/Entomologists) with IT Professionals and other stakeholders to develop and implement methods, techniques, tools, and issues related to information processing technology in agriculture; • Create and promote expert groups for development of agro-meteorological databases, crop and livestock modelling and applications for development of crop performance based decision support system. Topics of interest include, but are not limited to: • Smart Sensor and Wireless Sensor Network • Remote Sensing • Simulation, Optimization, Modeling and Automatic Control • Decision Support Systems, Intelligent Systems and Artificial Intelligence • Computer Vision and Image Processing • Inspection and Traceability for Food Quality • Precision Agriculture and Intelligent Instrument • The Internet of Things and Cloud Computing • Big Data and Data Mining
期刊最新文献
Editorial Board Artificial intelligence solutions to reduce information asymmetry for Colombian cocoa small-scale farmers Automated detection of sugarcane crop lines from UAV images using deep learning Detection and counting method of juvenile abalones based on improved SSD network Constrained temperature and relative humidity predictive control: Agricultural greenhouse case of study
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1