使用立体录像和深度学习的马运动学步态分析:步幅和站立时间估计

IF 1.2 4区 农林科学 Q3 AGRICULTURAL ENGINEERING Journal of the ASABE Pub Date : 2023-01-01 DOI:10.13031/ja.15386
Nariman Niknejad, Jessica L. Caro, Rafael Bidese-Puhl, Y. Bao, E. Staiger
{"title":"使用立体录像和深度学习的马运动学步态分析:步幅和站立时间估计","authors":"Nariman Niknejad, Jessica L. Caro, Rafael Bidese-Puhl, Y. Bao, E. Staiger","doi":"10.13031/ja.15386","DOIUrl":null,"url":null,"abstract":"Highlights Stereo machine vision and deep learning techniques were investigated for infield equine kinematic gait analysis. The proposed pipeline tracks equine body landmarks in 3D space and estimates stride length and stance duration. The system can serve as a cost-effective, rapid, and easy-to-use tool for equine locomotion research. Abstract. Equine kinematic gait analysis (EKGA) currently requires a complicated, expensive, and labor-intensive procedure for equine locomotion research. An automated stereo video processing pipeline was developed and evaluated for measuring equine biomechanical parameters. Using stereo videos of 40 different walking horses, a DeepLabCut (DLC) model was trained to detect body landmarks in individual frames. With an autoregressive integrated moving average filter, the landmark detection had a root mean square error of 5.14 pixels and a mean absolute error of 4.87 pixels. As a case study, methods were developed to extract stride length (SL) and stance duration (SD). Individual hoof gait phase detection was achieved using a fine-tuned Faster R-CNN model and a mode filter, yielding precision and recall values of 0.83 and 0.95, respectively. The semi-global block matching (SGBM) algorithm was used to estimate depth maps, and the accuracy was assessed by comparing head length estimation with infield measurements. A Bland-Altman analysis for DLC-detected head length in combination with SGBM-based 3D reconstruction yielded a bias of -0.014 m with upper and lower limits of agreement (LoAs) of 0.03 m and -0.061 m, respectively. Furthermore, Bland-Altman analyses on SD and SL when compared to image-level manual measurements showed biases of -0.02 sec and -0.042 m, respectively. The corresponding LoAs were (0.01907 sec, -0.24 sec) for SD and (0.04 m, -0.12 m) for SL. The proposed method showed promising potential in performing EKGA in an automated, cost-effective, and rapid manner under field conditions. Keywords: 3D Reconstruction, Animal Pose Estimation, Deep Learning, Equine Kinematic Gait Analysis, Stereo Matching.","PeriodicalId":29714,"journal":{"name":"Journal of the ASABE","volume":"44 1","pages":""},"PeriodicalIF":1.2000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Equine Kinematic Gait Analysis Using Stereo Videography and Deep Learning: Stride Length and Stance Duration Estimation\",\"authors\":\"Nariman Niknejad, Jessica L. Caro, Rafael Bidese-Puhl, Y. Bao, E. Staiger\",\"doi\":\"10.13031/ja.15386\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Highlights Stereo machine vision and deep learning techniques were investigated for infield equine kinematic gait analysis. The proposed pipeline tracks equine body landmarks in 3D space and estimates stride length and stance duration. The system can serve as a cost-effective, rapid, and easy-to-use tool for equine locomotion research. Abstract. Equine kinematic gait analysis (EKGA) currently requires a complicated, expensive, and labor-intensive procedure for equine locomotion research. An automated stereo video processing pipeline was developed and evaluated for measuring equine biomechanical parameters. Using stereo videos of 40 different walking horses, a DeepLabCut (DLC) model was trained to detect body landmarks in individual frames. With an autoregressive integrated moving average filter, the landmark detection had a root mean square error of 5.14 pixels and a mean absolute error of 4.87 pixels. As a case study, methods were developed to extract stride length (SL) and stance duration (SD). Individual hoof gait phase detection was achieved using a fine-tuned Faster R-CNN model and a mode filter, yielding precision and recall values of 0.83 and 0.95, respectively. The semi-global block matching (SGBM) algorithm was used to estimate depth maps, and the accuracy was assessed by comparing head length estimation with infield measurements. A Bland-Altman analysis for DLC-detected head length in combination with SGBM-based 3D reconstruction yielded a bias of -0.014 m with upper and lower limits of agreement (LoAs) of 0.03 m and -0.061 m, respectively. Furthermore, Bland-Altman analyses on SD and SL when compared to image-level manual measurements showed biases of -0.02 sec and -0.042 m, respectively. The corresponding LoAs were (0.01907 sec, -0.24 sec) for SD and (0.04 m, -0.12 m) for SL. The proposed method showed promising potential in performing EKGA in an automated, cost-effective, and rapid manner under field conditions. Keywords: 3D Reconstruction, Animal Pose Estimation, Deep Learning, Equine Kinematic Gait Analysis, Stereo Matching.\",\"PeriodicalId\":29714,\"journal\":{\"name\":\"Journal of the ASABE\",\"volume\":\"44 1\",\"pages\":\"\"},\"PeriodicalIF\":1.2000,\"publicationDate\":\"2023-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of the ASABE\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.13031/ja.15386\",\"RegionNum\":4,\"RegionCategory\":\"农林科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"AGRICULTURAL ENGINEERING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of the ASABE","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.13031/ja.15386","RegionNum":4,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"AGRICULTURAL ENGINEERING","Score":null,"Total":0}
引用次数: 0

摘要

重点研究了立体机器视觉和深度学习技术在内场马运动学步态分析中的应用。提议的管道在3D空间中跟踪马的身体地标,并估计步幅和站立时间。该系统可作为一种经济、快速、易于使用的马运动研究工具。摘要马运动学步态分析(EKGA)目前需要一个复杂的,昂贵的,劳动密集型的程序马运动研究。开发并评估了用于测量马生物力学参数的自动立体视频处理管道。使用40个不同行走马的立体视频,deepplabcut (DLC)模型被训练来检测单个帧中的身体地标。采用自回归积分移动平均滤波,检测结果均方根误差为5.14像素,平均绝对误差为4.87像素。作为案例研究,开发了提取步幅(SL)和站立时间(SD)的方法。使用微调的Faster R-CNN模型和模式滤波器实现了个体蹄步相位检测,精度和召回率分别为0.83和0.95。采用半全局块匹配(SGBM)算法估计深度图,并通过比较头长估计和内场测量来评估深度图的精度。Bland-Altman对dlc检测到的头部长度进行分析,结合基于sgbm的3D重建,偏差为-0.014 m,一致性上限(LoAs)分别为0.03 m和-0.061 m。此外,与图像级手动测量相比,Bland-Altman对SD和SL的分析显示,偏差分别为-0.02秒和-0.042 m。SD和SL对应的LoAs分别为(0.01907秒,-0.24秒)和(0.04米,-0.12米)。该方法在现场条件下具有自动化、经济、快速的EKGA潜力。关键词:三维重建,动物姿态估计,深度学习,马运动步态分析,立体匹配。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Equine Kinematic Gait Analysis Using Stereo Videography and Deep Learning: Stride Length and Stance Duration Estimation
Highlights Stereo machine vision and deep learning techniques were investigated for infield equine kinematic gait analysis. The proposed pipeline tracks equine body landmarks in 3D space and estimates stride length and stance duration. The system can serve as a cost-effective, rapid, and easy-to-use tool for equine locomotion research. Abstract. Equine kinematic gait analysis (EKGA) currently requires a complicated, expensive, and labor-intensive procedure for equine locomotion research. An automated stereo video processing pipeline was developed and evaluated for measuring equine biomechanical parameters. Using stereo videos of 40 different walking horses, a DeepLabCut (DLC) model was trained to detect body landmarks in individual frames. With an autoregressive integrated moving average filter, the landmark detection had a root mean square error of 5.14 pixels and a mean absolute error of 4.87 pixels. As a case study, methods were developed to extract stride length (SL) and stance duration (SD). Individual hoof gait phase detection was achieved using a fine-tuned Faster R-CNN model and a mode filter, yielding precision and recall values of 0.83 and 0.95, respectively. The semi-global block matching (SGBM) algorithm was used to estimate depth maps, and the accuracy was assessed by comparing head length estimation with infield measurements. A Bland-Altman analysis for DLC-detected head length in combination with SGBM-based 3D reconstruction yielded a bias of -0.014 m with upper and lower limits of agreement (LoAs) of 0.03 m and -0.061 m, respectively. Furthermore, Bland-Altman analyses on SD and SL when compared to image-level manual measurements showed biases of -0.02 sec and -0.042 m, respectively. The corresponding LoAs were (0.01907 sec, -0.24 sec) for SD and (0.04 m, -0.12 m) for SL. The proposed method showed promising potential in performing EKGA in an automated, cost-effective, and rapid manner under field conditions. Keywords: 3D Reconstruction, Animal Pose Estimation, Deep Learning, Equine Kinematic Gait Analysis, Stereo Matching.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
3.10
自引率
0.00%
发文量
0
期刊最新文献
Application of Uniaxial Compression Curve Fractal Dimension in the Identification of Cañihua (Chenopodium Pallidicaule Aellen) Grain Cultivars Calculation of Swath Width and Swath Displacement for Uncrewed Aerial Spray Systems Evaluating Draft EPA Emissions Models for Laying Hen Facilities Calibration and Validation of RZWQM2-P Model to Simulate Phosphorus Loss in a Clay Loam Soil in Michigan Investigation of Depth Camera Potentials for Variable-Rate Sprayers
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1