Deep Knowledge Tracing Incorporating a Hypernetwork With Independent Student and Item Networks

IF 2.9 3区 教育学 Q2 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS IEEE Transactions on Learning Technologies Pub Date : 2023-12-25 DOI:10.1109/TLT.2023.3346671
Emiko Tsutsumi;Yiming Guo;Ryo Kinoshita;Maomi Ueno
{"title":"Deep Knowledge Tracing Incorporating a Hypernetwork With Independent Student and Item Networks","authors":"Emiko Tsutsumi;Yiming Guo;Ryo Kinoshita;Maomi Ueno","doi":"10.1109/TLT.2023.3346671","DOIUrl":null,"url":null,"abstract":"Knowledge tracing (KT), the task of tracking the knowledge state of a student over time, has been assessed actively by artificial intelligence researchers. Recent reports have described that Deep-IRT, which combines item response theory (IRT) with a deep learning method, provides superior performance. It can express the abilities of each student and the difficulty of each item such as IRT. Nevertheless, its interpretability is inadequate compared to that of IRT because the ability parameter depends on each item. Deep-IRT implicitly assumes that items with the same skills are equivalent, which does not hold when item difficulties for the same skills differ greatly. For identical skills, items that are not equivalent hinder the interpretation of a student's ability estimate. To overcome those difficulties, this study proposes a novel Deep-IRT that models a student response to an item using two independent networks: 1) a student network and 2) an item network. The proposed Deep-IRT method learns student parameters and item parameters independently to avoid impairing the predictive accuracy. Moreover, we propose a novel hypernetwork architecture for the proposed Deep-IRT to balance both the current and the past data in the latent variable storing student's knowledge states. Results of experiments with six benchmark datasets demonstrate that the proposed method improves the prediction accuracy by about 2.0%, on average. In addition, experiments for the simulation dataset demonstrated that the proposed method provides a stronger correlation with true parameters than the earlier Deep-IRT method does at the \n<inline-formula><tex-math>$p&lt; 0.5$</tex-math></inline-formula>\n significance level.","PeriodicalId":49191,"journal":{"name":"IEEE Transactions on Learning Technologies","volume":"17 ","pages":"951-965"},"PeriodicalIF":2.9000,"publicationDate":"2023-12-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10373110","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Learning Technologies","FirstCategoryId":"95","ListUrlMain":"https://ieeexplore.ieee.org/document/10373110/","RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0

Abstract

Knowledge tracing (KT), the task of tracking the knowledge state of a student over time, has been assessed actively by artificial intelligence researchers. Recent reports have described that Deep-IRT, which combines item response theory (IRT) with a deep learning method, provides superior performance. It can express the abilities of each student and the difficulty of each item such as IRT. Nevertheless, its interpretability is inadequate compared to that of IRT because the ability parameter depends on each item. Deep-IRT implicitly assumes that items with the same skills are equivalent, which does not hold when item difficulties for the same skills differ greatly. For identical skills, items that are not equivalent hinder the interpretation of a student's ability estimate. To overcome those difficulties, this study proposes a novel Deep-IRT that models a student response to an item using two independent networks: 1) a student network and 2) an item network. The proposed Deep-IRT method learns student parameters and item parameters independently to avoid impairing the predictive accuracy. Moreover, we propose a novel hypernetwork architecture for the proposed Deep-IRT to balance both the current and the past data in the latent variable storing student's knowledge states. Results of experiments with six benchmark datasets demonstrate that the proposed method improves the prediction accuracy by about 2.0%, on average. In addition, experiments for the simulation dataset demonstrated that the proposed method provides a stronger correlation with true parameters than the earlier Deep-IRT method does at the $p< 0.5$ significance level.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
将超网络与独立的学生和项目网络结合起来的深度知识追踪
知识追踪(KT)是一项追踪学生知识状态的任务,人工智能研究人员对此进行了积极的评估。最近有报告称,将项目反应理论(IRT)与深度学习方法相结合的 Deep-IRT 具有卓越的性能。它可以像 IRT 一样表达每个学生的能力和每个项目的难度。然而,与 IRT 相比,它的可解释性不足,因为能力参数取决于每个项目。深度-IRT 隐含地假设具有相同技能的项目是等价的,但当相同技能的项目难度相差很大时,这种假设就不成立了。对于相同的技能,不等同的项目会妨碍对学生能力估计值的解释。为了克服这些困难,本研究提出了一种新颖的深度 IRT,利用两个独立的网络对学生对题目的反应进行建模:1) 学生网络和 2) 项目网络。所提出的深度-IRT 方法独立学习学生参数和项目参数,以避免影响预测的准确性。此外,我们还为 Deep-IRT 提出了一种新颖的超网络架构,以平衡存储学生知识状态的潜在变量中当前和过去的数据。六个基准数据集的实验结果表明,所提出的方法平均提高了约 2.0% 的预测准确率。此外,模拟数据集的实验结果表明,在$p< 0.5$显著性水平下,与早期的 Deep-IRT 方法相比,所提出的方法与真实参数的相关性更强。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
IEEE Transactions on Learning Technologies
IEEE Transactions on Learning Technologies COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS-
CiteScore
7.50
自引率
5.40%
发文量
82
审稿时长
>12 weeks
期刊介绍: The IEEE Transactions on Learning Technologies covers all advances in learning technologies and their applications, including but not limited to the following topics: innovative online learning systems; intelligent tutors; educational games; simulation systems for education and training; collaborative learning tools; learning with mobile devices; wearable devices and interfaces for learning; personalized and adaptive learning systems; tools for formative and summative assessment; tools for learning analytics and educational data mining; ontologies for learning systems; standards and web services that support learning; authoring tools for learning materials; computer support for peer tutoring; learning via computer-mediated inquiry, field, and lab work; social learning techniques; social networks and infrastructures for learning and knowledge sharing; and creation and management of learning objects.
期刊最新文献
Empowering Instructors: Augmented Reality Authoring Toolkit for Aviation Weather Education Guest Editorial Intelligence Augmentation: The Owl of Athena Designing Learning Technologies: Assessing Attention in Children With Autism Through a Single Case Study Investigating the Efficacy of ChatGPT-3.5 for Tutoring in Chinese Elementary Education Settings Impact of Gamified Learning Experience on Online Learning Effectiveness
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1