学习者行为的数字指纹:利用深度学习进行个性化学习的经验证据

Asaf Salman, Giora Alexandron
{"title":"学习者行为的数字指纹:利用深度学习进行个性化学习的经验证据","authors":"Asaf Salman,&nbsp;Giora Alexandron","doi":"10.1016/j.caeai.2024.100322","DOIUrl":null,"url":null,"abstract":"<div><div>Personalized learning builds upon the fundamental assumption of uniqueness in learning behavior, often taken for granted. Quite surprisingly, however, the literature provides little to no empirical evidence backing the existence of individual learning behaviors. Driven by curiosity, we challenge this axiom. Our operationalization of a unique learning behavior draws an analogy to a fingerprint – a distinctive trait that sets individuals apart, which we correspondingly termed the ‘Digital Fingerprint of Learner Behavior’ (DFL). If such a thing as DFL truly exists, then given enough fine-grained behavioral data, we argue that it should be possible to model a DFL to a level of discriminability that enables training machine learning models to associate (map) between the (de-identified) digital traces of the same learner in diverse contexts. To test our hypothesis, we experimented with data from 24 MITx massive open online courses (MOOCs) offered via edX between 2014 and 2017. We focused our investigation on contexts where both the content and platform remain constant. A learner's DFL was computed from the learner's activity data within a specific course chapter, as stored in the system's logs. The results show that the mean level of accuracy (across courses) in identifying unseen DFLs is 0.582 (<em>SD</em>=0.173). Using Shapley Additive exPlanations (SHAP), we rank 686 features for their importance in differentiating between DFLs. To the best of our knowledge, this study is the first to provide empirical evidence that learners' behavior is unique to a degree that can distinguish between them on an individual level, similar to the level of identification provided by a fingerprint, and sets a benchmark for the task of DFL identification.</div></div>","PeriodicalId":34469,"journal":{"name":"Computers and Education Artificial Intelligence","volume":"7 ","pages":"Article 100322"},"PeriodicalIF":0.0000,"publicationDate":"2024-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The digital fingerprint of learner behavior: Empirical evidence for individuality in learning using deep learning\",\"authors\":\"Asaf Salman,&nbsp;Giora Alexandron\",\"doi\":\"10.1016/j.caeai.2024.100322\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Personalized learning builds upon the fundamental assumption of uniqueness in learning behavior, often taken for granted. Quite surprisingly, however, the literature provides little to no empirical evidence backing the existence of individual learning behaviors. Driven by curiosity, we challenge this axiom. Our operationalization of a unique learning behavior draws an analogy to a fingerprint – a distinctive trait that sets individuals apart, which we correspondingly termed the ‘Digital Fingerprint of Learner Behavior’ (DFL). If such a thing as DFL truly exists, then given enough fine-grained behavioral data, we argue that it should be possible to model a DFL to a level of discriminability that enables training machine learning models to associate (map) between the (de-identified) digital traces of the same learner in diverse contexts. To test our hypothesis, we experimented with data from 24 MITx massive open online courses (MOOCs) offered via edX between 2014 and 2017. We focused our investigation on contexts where both the content and platform remain constant. A learner's DFL was computed from the learner's activity data within a specific course chapter, as stored in the system's logs. The results show that the mean level of accuracy (across courses) in identifying unseen DFLs is 0.582 (<em>SD</em>=0.173). Using Shapley Additive exPlanations (SHAP), we rank 686 features for their importance in differentiating between DFLs. To the best of our knowledge, this study is the first to provide empirical evidence that learners' behavior is unique to a degree that can distinguish between them on an individual level, similar to the level of identification provided by a fingerprint, and sets a benchmark for the task of DFL identification.</div></div>\",\"PeriodicalId\":34469,\"journal\":{\"name\":\"Computers and Education Artificial Intelligence\",\"volume\":\"7 \",\"pages\":\"Article 100322\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-10-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computers and Education Artificial Intelligence\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2666920X24001255\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"Social Sciences\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers and Education Artificial Intelligence","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666920X24001255","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"Social Sciences","Score":null,"Total":0}
引用次数: 0

摘要

个性化学习建立在学习行为独特性这一基本假设之上,而这一假设往往被认为是理所当然的。然而,令人惊讶的是,文献几乎没有提供任何实证来证明个人学习行为的存在。在好奇心的驱使下,我们对这一公理提出了挑战。我们将独特学习行为的可操作性比作指纹--一种将个体区分开来的独特特征,我们相应地将其称为 "学习者行为数字指纹"(DFL)。如果 DFL 真的存在,那么只要有足够多的细粒度行为数据,我们认为就有可能将 DFL 建模到一定的可辨别水平,从而使机器学习模型能够在不同情境下关联(映射)同一学习者的(去身份化的)数字痕迹。为了验证我们的假设,我们利用 2014 年至 2017 年间通过 edX 提供的 24 门麻省理工学院大规模开放在线课程(MOOC)的数据进行了实验。我们将调查重点放在内容和平台都保持不变的情况下。学习者的 DFL 是根据系统日志中存储的学习者在特定课程章节中的活动数据计算得出的。结果显示,识别未见 DFL 的平均准确率(跨课程)为 0.582(SD=0.173)。通过使用 Shapley Additive exPlanations (SHAP),我们对 686 个特征进行了排序,以确定它们在区分 DFL 方面的重要性。据我们所知,这项研究首次提供了实证证据,证明学习者的行为具有一定程度的独特性,可以在个体层面上区分学习者,类似于指纹识别所提供的识别水平,并为 DFL 识别任务树立了标杆。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
The digital fingerprint of learner behavior: Empirical evidence for individuality in learning using deep learning
Personalized learning builds upon the fundamental assumption of uniqueness in learning behavior, often taken for granted. Quite surprisingly, however, the literature provides little to no empirical evidence backing the existence of individual learning behaviors. Driven by curiosity, we challenge this axiom. Our operationalization of a unique learning behavior draws an analogy to a fingerprint – a distinctive trait that sets individuals apart, which we correspondingly termed the ‘Digital Fingerprint of Learner Behavior’ (DFL). If such a thing as DFL truly exists, then given enough fine-grained behavioral data, we argue that it should be possible to model a DFL to a level of discriminability that enables training machine learning models to associate (map) between the (de-identified) digital traces of the same learner in diverse contexts. To test our hypothesis, we experimented with data from 24 MITx massive open online courses (MOOCs) offered via edX between 2014 and 2017. We focused our investigation on contexts where both the content and platform remain constant. A learner's DFL was computed from the learner's activity data within a specific course chapter, as stored in the system's logs. The results show that the mean level of accuracy (across courses) in identifying unseen DFLs is 0.582 (SD=0.173). Using Shapley Additive exPlanations (SHAP), we rank 686 features for their importance in differentiating between DFLs. To the best of our knowledge, this study is the first to provide empirical evidence that learners' behavior is unique to a degree that can distinguish between them on an individual level, similar to the level of identification provided by a fingerprint, and sets a benchmark for the task of DFL identification.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
16.80
自引率
0.00%
发文量
66
审稿时长
50 days
期刊最新文献
Enhancing data analysis and programming skills through structured prompt training: The impact of generative AI in engineering education Understanding the practices, perceptions, and (dis)trust of generative AI among instructors: A mixed-methods study in the U.S. higher education Technological self-efficacy and sense of coherence: Key drivers in teachers' AI acceptance and adoption The influence of AI literacy on complex problem-solving skills through systematic thinking skills and intuition thinking skills: An empirical study in Thai gen Z accounting students Psychometrics of an Elo-based large-scale online learning system
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1