学生课堂行为识别的有效模式

Hongye Zhu, Jinhua Zhao, L. Niu
{"title":"学生课堂行为识别的有效模式","authors":"Hongye Zhu, Jinhua Zhao, L. Niu","doi":"10.1109/IEIR56323.2022.10050077","DOIUrl":null,"url":null,"abstract":"AI and big data analysis for student classroom behavior recognition can be used as auxiliary means to improve teaching quality. Recognition in classroom scenarios suffers from issues such as tiny targets and complex environmental interference. To tackle these problems, an efficient model based on YOLOv4-tiny is proposed in this paper. Specifically, we design a new module named ResBlock-S to reduce the floating point operations (FLOPs) of the model to improve the speed. Then, the introduction of the Convolutional Block Attention Module (CBAM) mechanism to obtain extra local information of images during the training process, which can ensure the recognition accuracy. As most available public datasets are not applicable to this work, we construct a classroom behavior dataset. Experiments were conducted on the public dataset and our self-built dataset to verify the performance of our model in general scenarios and classroom scenarios, respectively. Compared with YOLOv4-tiny and other lightweight CNN models such as MobileNetv2, MobileNetv3 and ShuffleNetv2, the mean Average Precision (mAP) of our approach on the self-built dataset is higher and up to 89.9%. Additionally, the detection speed of our approach is faster than the aforementioned methods, which is up to 167 fps.","PeriodicalId":183709,"journal":{"name":"2022 International Conference on Intelligent Education and Intelligent Research (IEIR)","volume":"37 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"An Efficient Model For Student Behavior Recognition in Classroom\",\"authors\":\"Hongye Zhu, Jinhua Zhao, L. Niu\",\"doi\":\"10.1109/IEIR56323.2022.10050077\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"AI and big data analysis for student classroom behavior recognition can be used as auxiliary means to improve teaching quality. Recognition in classroom scenarios suffers from issues such as tiny targets and complex environmental interference. To tackle these problems, an efficient model based on YOLOv4-tiny is proposed in this paper. Specifically, we design a new module named ResBlock-S to reduce the floating point operations (FLOPs) of the model to improve the speed. Then, the introduction of the Convolutional Block Attention Module (CBAM) mechanism to obtain extra local information of images during the training process, which can ensure the recognition accuracy. As most available public datasets are not applicable to this work, we construct a classroom behavior dataset. Experiments were conducted on the public dataset and our self-built dataset to verify the performance of our model in general scenarios and classroom scenarios, respectively. Compared with YOLOv4-tiny and other lightweight CNN models such as MobileNetv2, MobileNetv3 and ShuffleNetv2, the mean Average Precision (mAP) of our approach on the self-built dataset is higher and up to 89.9%. Additionally, the detection speed of our approach is faster than the aforementioned methods, which is up to 167 fps.\",\"PeriodicalId\":183709,\"journal\":{\"name\":\"2022 International Conference on Intelligent Education and Intelligent Research (IEIR)\",\"volume\":\"37 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-12-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 International Conference on Intelligent Education and Intelligent Research (IEIR)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/IEIR56323.2022.10050077\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 International Conference on Intelligent Education and Intelligent Research (IEIR)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IEIR56323.2022.10050077","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

摘要

人工智能和大数据分析对学生课堂行为的识别可以作为提高教学质量的辅助手段。课堂场景中的识别存在目标微小、环境干扰复杂等问题。针对这些问题,本文提出了一种基于YOLOv4-tiny的高效模型。具体而言,我们设计了一个名为ResBlock-S的新模块,以减少模型的浮点运算(FLOPs),从而提高速度。然后,引入卷积块注意模块(CBAM)机制,在训练过程中获取图像的额外局部信息,保证识别的准确性;由于大多数可用的公共数据集不适用于这项工作,我们构建了一个课堂行为数据集。在公共数据集和自建数据集上分别进行了实验,验证了我们的模型在一般场景和课堂场景下的性能。与YOLOv4-tiny和其他轻量级CNN模型(如MobileNetv2、MobileNetv3和ShuffleNetv2)相比,我们的方法在自建数据集上的平均平均精度(mAP)更高,达到89.9%。此外,我们的方法的检测速度比前面提到的方法更快,高达167 fps。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
An Efficient Model For Student Behavior Recognition in Classroom
AI and big data analysis for student classroom behavior recognition can be used as auxiliary means to improve teaching quality. Recognition in classroom scenarios suffers from issues such as tiny targets and complex environmental interference. To tackle these problems, an efficient model based on YOLOv4-tiny is proposed in this paper. Specifically, we design a new module named ResBlock-S to reduce the floating point operations (FLOPs) of the model to improve the speed. Then, the introduction of the Convolutional Block Attention Module (CBAM) mechanism to obtain extra local information of images during the training process, which can ensure the recognition accuracy. As most available public datasets are not applicable to this work, we construct a classroom behavior dataset. Experiments were conducted on the public dataset and our self-built dataset to verify the performance of our model in general scenarios and classroom scenarios, respectively. Compared with YOLOv4-tiny and other lightweight CNN models such as MobileNetv2, MobileNetv3 and ShuffleNetv2, the mean Average Precision (mAP) of our approach on the self-built dataset is higher and up to 89.9%. Additionally, the detection speed of our approach is faster than the aforementioned methods, which is up to 167 fps.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Is the Research on AI Empowered Pedagogy in China Decaying? Explore the interrelationship of cognition, emotion and interaction when learners engage in online discussion Solving Word Function Problems in Line with Educational Cognition Way Comparative Analysis of Problem Representation Learning in Math Word Problem Solving Prompt-Based Missing Entity Recovery for Solving Arithmetic Word Problems
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1