ConvPose: An efficient human pose estimation method based on ConvNeXt

Ke Lin, S. Zhang, Zhisong Qin
{"title":"ConvPose: An efficient human pose estimation method based on ConvNeXt","authors":"Ke Lin, S. Zhang, Zhisong Qin","doi":"10.1145/3569966.3569989","DOIUrl":null,"url":null,"abstract":"Human pose estimation methods have developed rapidly in recent years and many high precision models have emerged. However, the computational costs of these methods are often very huge, especially for transformer-based models. In this work, we propose ConvPose, an efficient human pose estimation model based on convolutional neural network architecture. ConvPose uses an efficient single branch structure, using the ConvNeXt Block as a baseline and incorporating the Coordinate Attention module. This composition not only provides better feature extraction capabilities, but also can efficiently obtain the global dependency relationships between human keypoints and scenes. The effective combination of the large convolution kernel and the attention module gives our model the ability to focus more on detailed features when oriented to complex scenes. In addition, the number of parameters and GFLOPs of our model are at a lighter level compared to current high- performance models, which offers more possibilities for deployment of the model in low-end devices. Experiments show that our model achieves 73.6AP on the MS-COCO dataset with only 6.3M parameters, which is a very competitive result.","PeriodicalId":145580,"journal":{"name":"Proceedings of the 5th International Conference on Computer Science and Software Engineering","volume":"3 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 5th International Conference on Computer Science and Software Engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3569966.3569989","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Human pose estimation methods have developed rapidly in recent years and many high precision models have emerged. However, the computational costs of these methods are often very huge, especially for transformer-based models. In this work, we propose ConvPose, an efficient human pose estimation model based on convolutional neural network architecture. ConvPose uses an efficient single branch structure, using the ConvNeXt Block as a baseline and incorporating the Coordinate Attention module. This composition not only provides better feature extraction capabilities, but also can efficiently obtain the global dependency relationships between human keypoints and scenes. The effective combination of the large convolution kernel and the attention module gives our model the ability to focus more on detailed features when oriented to complex scenes. In addition, the number of parameters and GFLOPs of our model are at a lighter level compared to current high- performance models, which offers more possibilities for deployment of the model in low-end devices. Experiments show that our model achieves 73.6AP on the MS-COCO dataset with only 6.3M parameters, which is a very competitive result.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
卷积:一种基于卷积next的高效人体姿态估计方法
人体姿态估计方法近年来发展迅速,出现了许多高精度模型。然而,这些方法的计算成本往往非常巨大,特别是对于基于变压器的模型。在这项工作中,我们提出了一种基于卷积神经网络架构的高效人体姿态估计模型ConvPose。ConvPose使用高效的单分支结构,使用ConvNeXt块作为基线,并结合坐标注意模块。这种组合不仅提供了更好的特征提取能力,而且可以有效地获得人体关键点与场景之间的全局依赖关系。大卷积核和注意力模块的有效结合使我们的模型在面向复杂场景时能够更多地关注细节特征。此外,我们的模型的参数数量和gflop与目前的高性能模型相比处于更轻的水平,这为模型在低端设备中的部署提供了更多的可能性。实验表明,我们的模型在MS-COCO数据集上仅使用6.3万个参数就能达到73.6AP,这是一个非常有竞争力的结果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Accurate and Time-saving Deepfake Detection in Multi-face Scenarios Using Combined Features The Exponential Dynamic Analysis of Network Attention Based on Big Data Research on Data Governance and Data Migration based on Oracle Database Appliance in campus Research on Conformance Engineering process of Airborne Software quality Assurance in Civil Aviation Extending Take-Grant Model for More Flexible Privilege Propagation
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1