{"title":"PMotion:一种先进的无标记姿态估计方法,基于新颖的深度学习框架,用于揭示神经行为。","authors":"Xiaodong Lv, Haijie Liu, Luyao Chen, Chuankai Dai, Penghu Wei, Junwei Hao, Guoguang Zhao","doi":"10.1088/1741-2552/acd603","DOIUrl":null,"url":null,"abstract":"<p><p><i>Objective.</i>The evaluation of animals' motion behavior has played a vital role in neuromuscular biomedical research and clinical diagnostics, which reflects the changes caused by neuromodulation or neurodamage. Currently, the existing animal pose estimation methods are unreliable, unpractical, and inaccurate.<i>Approach.</i>Data augmentation (random scaling, random standard deviation Gaussian blur, random contrast, and random uniform color quantization) is adopted to augment image dataset. For the key points recognition, we present a novel efficient convolutional deep learning framework (PMotion), which combines modified ConvNext using multi-kernel feature fusion and self-defined stacked Hourglass block with SiLU activation function.<i>Main results.</i>PMotion is useful to predict the key points of dynamics of unmarked animal body joints in real time with high spatial precision. Gait quantification (step length, step height, and joint angle) was performed for the study of lateral lower limb movements with rats on a treadmill.<i>Significance.</i>The performance accuracy of PMotion on rat joint dataset was improved by 1.98, 1.46, and 0.55 pixels compared with deepposekit, deeplabcut, and stacked hourglass, respectively. This approach also may be applied for neurobehavioral studies of freely moving animals' behavior in challenging environments (e.g.<i>Drosophila melanogaster</i>and openfield-Pranav) with a high accuracy.</p>","PeriodicalId":16753,"journal":{"name":"Journal of neural engineering","volume":"20 4","pages":""},"PeriodicalIF":3.7000,"publicationDate":"2023-07-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"PMotion: an advanced markerless pose estimation approach based on novel deep learning framework used to reveal neurobehavior.\",\"authors\":\"Xiaodong Lv, Haijie Liu, Luyao Chen, Chuankai Dai, Penghu Wei, Junwei Hao, Guoguang Zhao\",\"doi\":\"10.1088/1741-2552/acd603\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p><i>Objective.</i>The evaluation of animals' motion behavior has played a vital role in neuromuscular biomedical research and clinical diagnostics, which reflects the changes caused by neuromodulation or neurodamage. Currently, the existing animal pose estimation methods are unreliable, unpractical, and inaccurate.<i>Approach.</i>Data augmentation (random scaling, random standard deviation Gaussian blur, random contrast, and random uniform color quantization) is adopted to augment image dataset. For the key points recognition, we present a novel efficient convolutional deep learning framework (PMotion), which combines modified ConvNext using multi-kernel feature fusion and self-defined stacked Hourglass block with SiLU activation function.<i>Main results.</i>PMotion is useful to predict the key points of dynamics of unmarked animal body joints in real time with high spatial precision. Gait quantification (step length, step height, and joint angle) was performed for the study of lateral lower limb movements with rats on a treadmill.<i>Significance.</i>The performance accuracy of PMotion on rat joint dataset was improved by 1.98, 1.46, and 0.55 pixels compared with deepposekit, deeplabcut, and stacked hourglass, respectively. This approach also may be applied for neurobehavioral studies of freely moving animals' behavior in challenging environments (e.g.<i>Drosophila melanogaster</i>and openfield-Pranav) with a high accuracy.</p>\",\"PeriodicalId\":16753,\"journal\":{\"name\":\"Journal of neural engineering\",\"volume\":\"20 4\",\"pages\":\"\"},\"PeriodicalIF\":3.7000,\"publicationDate\":\"2023-07-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of neural engineering\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1088/1741-2552/acd603\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, BIOMEDICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of neural engineering","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1088/1741-2552/acd603","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
PMotion: an advanced markerless pose estimation approach based on novel deep learning framework used to reveal neurobehavior.
Objective.The evaluation of animals' motion behavior has played a vital role in neuromuscular biomedical research and clinical diagnostics, which reflects the changes caused by neuromodulation or neurodamage. Currently, the existing animal pose estimation methods are unreliable, unpractical, and inaccurate.Approach.Data augmentation (random scaling, random standard deviation Gaussian blur, random contrast, and random uniform color quantization) is adopted to augment image dataset. For the key points recognition, we present a novel efficient convolutional deep learning framework (PMotion), which combines modified ConvNext using multi-kernel feature fusion and self-defined stacked Hourglass block with SiLU activation function.Main results.PMotion is useful to predict the key points of dynamics of unmarked animal body joints in real time with high spatial precision. Gait quantification (step length, step height, and joint angle) was performed for the study of lateral lower limb movements with rats on a treadmill.Significance.The performance accuracy of PMotion on rat joint dataset was improved by 1.98, 1.46, and 0.55 pixels compared with deepposekit, deeplabcut, and stacked hourglass, respectively. This approach also may be applied for neurobehavioral studies of freely moving animals' behavior in challenging environments (e.g.Drosophila melanogasterand openfield-Pranav) with a high accuracy.
期刊介绍:
The goal of Journal of Neural Engineering (JNE) is to act as a forum for the interdisciplinary field of neural engineering where neuroscientists, neurobiologists and engineers can publish their work in one periodical that bridges the gap between neuroscience and engineering. The journal publishes articles in the field of neural engineering at the molecular, cellular and systems levels.
The scope of the journal encompasses experimental, computational, theoretical, clinical and applied aspects of: Innovative neurotechnology; Brain-machine (computer) interface; Neural interfacing; Bioelectronic medicines; Neuromodulation; Neural prostheses; Neural control; Neuro-rehabilitation; Neurorobotics; Optical neural engineering; Neural circuits: artificial & biological; Neuromorphic engineering; Neural tissue regeneration; Neural signal processing; Theoretical and computational neuroscience; Systems neuroscience; Translational neuroscience; Neuroimaging.