首页 > 最新文献

Proceedings of the Tenth International Conference on Learning Analytics & Knowledge最新文献

英文 中文
How good is my feedback?: a content analysis of written feedback 我的反馈有多好?内容分析:书面反馈
Anderson Pinheiro Cavalcanti, A. Diego, R. F. Mello, Katerina Mangaroska, André C. A. Nascimento, F. Freitas, D. Gašević
Feedback is a crucial element in helping students identify gaps and assess their learning progress. In online courses, feedback becomes even more critical as it is one of the resources where the teacher interacts directly with the student. However, with the growing number of students enrolled in online learning, it becomes a challenge for instructors to provide good quality feedback that helps the student self-regulate. In this context, this paper proposed a content analysis of feedback text provided by instructors based on different indicators of good feedback. A random forest classifier was trained and evaluated at different feedback levels. The results achieved outcomes up to 87% and 0.39 of accuracy and Cohen's κ, respectively. The paper also provides insights into the most influential textual features of feedback that predict feedback quality.
反馈是帮助学生发现差距和评估学习进度的关键因素。在在线课程中,反馈变得更加重要,因为它是教师直接与学生互动的资源之一。然而,随着越来越多的学生参加在线学习,教师提供高质量的反馈,帮助学生自我调节成为一个挑战。在此背景下,本文根据良好反馈的不同指标,对教师反馈文本进行了内容分析。对随机森林分类器进行了训练,并在不同的反馈水平上进行了评估。结果分别达到87%和0.39的准确率和科恩κ。本文还提供了最具影响力的文本特征,反馈预测反馈质量的见解。
{"title":"How good is my feedback?: a content analysis of written feedback","authors":"Anderson Pinheiro Cavalcanti, A. Diego, R. F. Mello, Katerina Mangaroska, André C. A. Nascimento, F. Freitas, D. Gašević","doi":"10.1145/3375462.3375477","DOIUrl":"https://doi.org/10.1145/3375462.3375477","url":null,"abstract":"Feedback is a crucial element in helping students identify gaps and assess their learning progress. In online courses, feedback becomes even more critical as it is one of the resources where the teacher interacts directly with the student. However, with the growing number of students enrolled in online learning, it becomes a challenge for instructors to provide good quality feedback that helps the student self-regulate. In this context, this paper proposed a content analysis of feedback text provided by instructors based on different indicators of good feedback. A random forest classifier was trained and evaluated at different feedback levels. The results achieved outcomes up to 87% and 0.39 of accuracy and Cohen's κ, respectively. The paper also provides insights into the most influential textual features of feedback that predict feedback quality.","PeriodicalId":355800,"journal":{"name":"Proceedings of the Tenth International Conference on Learning Analytics & Knowledge","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-03-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133796957","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 29
Learning-centred translucence: an approach to understand how teachers talk about classroom data 以学习为中心的半透明:一种理解教师如何谈论课堂数据的方法
Rita Prestigiacomo, R. Hadgraft, J. Hunter, Lori Lockyer, Simon Knight, E. V. D. Hoven, Roberto Martínez Maldonado
Teachers are increasingly being encouraged to embrace evidence-based practices. Learning analytics (LA) offer great promise in supporting these by providing evidence for teachers and learners to make informed decisions and transform the educational experience. However, LA limitations and their uptake by educators are coming under critical scrutiny. This is in part due to the lack of involvement of teachers and learners in the design of LA tools. In this paper, we propose a human-centred approach to generate understanding of teachers' data needs through the lens of three key principles of translucence: visibility, awareness and accountability. We illustrate our approach through a participatory design sprint to identify how teachers talk about classroom data. We describe teachers' perspectives on the evidence they need for making better-informed decisions and discuss the implications of our approach for the design of human-centred LA in the next years.
越来越多的教师被鼓励采用循证实践。学习分析(LA)通过为教师和学习者做出明智的决策和改变教育体验提供证据,在支持这些方面提供了巨大的希望。然而,洛杉矶的限制以及教育工作者对它们的吸收正受到严格审查。这在一定程度上是由于教师和学习者在学习辅助工具的设计中缺乏参与。在本文中,我们提出了一种以人为中心的方法,通过透明的三个关键原则:可见性、意识和问责制,来理解教师的数据需求。我们通过参与式设计冲刺来说明我们的方法,以确定教师如何谈论课堂数据。我们描述了教师对做出更明智决策所需证据的观点,并讨论了我们的方法对未来几年以人为本的洛杉矶设计的影响。
{"title":"Learning-centred translucence: an approach to understand how teachers talk about classroom data","authors":"Rita Prestigiacomo, R. Hadgraft, J. Hunter, Lori Lockyer, Simon Knight, E. V. D. Hoven, Roberto Martínez Maldonado","doi":"10.1145/3375462.3375475","DOIUrl":"https://doi.org/10.1145/3375462.3375475","url":null,"abstract":"Teachers are increasingly being encouraged to embrace evidence-based practices. Learning analytics (LA) offer great promise in supporting these by providing evidence for teachers and learners to make informed decisions and transform the educational experience. However, LA limitations and their uptake by educators are coming under critical scrutiny. This is in part due to the lack of involvement of teachers and learners in the design of LA tools. In this paper, we propose a human-centred approach to generate understanding of teachers' data needs through the lens of three key principles of translucence: visibility, awareness and accountability. We illustrate our approach through a participatory design sprint to identify how teachers talk about classroom data. We describe teachers' perspectives on the evidence they need for making better-informed decisions and discuss the implications of our approach for the design of human-centred LA in the next years.","PeriodicalId":355800,"journal":{"name":"Proceedings of the Tenth International Conference on Learning Analytics & Knowledge","volume":"80 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-03-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124871453","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
Focused or stuck together: multimodal patterns reveal triads' performance in collaborative problem solving 集中或粘在一起:多模态模式揭示了三和弦在协作解决问题中的表现
Hana Vrzakova, M. J. Amon, Angela E. B. Stewart, Nicholas D. Duran, S. D’Mello
Collaborative problem solving (CPS) in virtual environments is an increasingly important context of 21st century learning. However, our understanding of this complex and dynamic phenomenon is still limited. Here, we examine unimodal primitives (activity on the screen, speech, and body movements), and their multimodal combinations during remote CPS. We analyze two datasets where 116 triads collaboratively engaged in a challenging visual programming task using video conferencing software. We investigate how UI-interactions, behavioral primitives, and multimodal patterns were associated with teams' subjective and objective performance outcomes. We found that idling with limited speech (i.e., silence or backchannel feedback only) and without movement was negatively correlated with task performance and with participants' subjective perceptions of the collaboration. However, being silent and focused during solution execution was positively correlated with task performance. Results illustrate that in some cases, multimodal patterns improved the predictions and improved explanatory power over the unimodal primitives. We discuss how the findings can inform the design of real-time interventions for remote CPS.
虚拟环境中的协同问题解决(CPS)是21世纪学习的一个日益重要的背景。然而,我们对这一复杂而动态的现象的认识仍然有限。在这里,我们研究了远程CPS期间的单模态原语(屏幕上的活动、语音和身体运动)及其多模态组合。我们分析了两个数据集,其中116个三合会使用视频会议软件协作从事具有挑战性的可视化编程任务。我们研究了ui交互、行为原语和多模态模式如何与团队的主观和客观绩效结果相关联。我们发现,在有限的言语(即沉默或只有反向反馈)和没有运动的情况下,空转与任务绩效和参与者对合作的主观看法呈负相关。然而,在解决方案执行过程中保持沉默和专注与任务绩效呈正相关。结果表明,在某些情况下,与单模态原语相比,多模态模式提高了预测能力和解释力。我们讨论了这些发现如何为远程CPS的实时干预设计提供信息。
{"title":"Focused or stuck together: multimodal patterns reveal triads' performance in collaborative problem solving","authors":"Hana Vrzakova, M. J. Amon, Angela E. B. Stewart, Nicholas D. Duran, S. D’Mello","doi":"10.1145/3375462.3375467","DOIUrl":"https://doi.org/10.1145/3375462.3375467","url":null,"abstract":"Collaborative problem solving (CPS) in virtual environments is an increasingly important context of 21st century learning. However, our understanding of this complex and dynamic phenomenon is still limited. Here, we examine unimodal primitives (activity on the screen, speech, and body movements), and their multimodal combinations during remote CPS. We analyze two datasets where 116 triads collaboratively engaged in a challenging visual programming task using video conferencing software. We investigate how UI-interactions, behavioral primitives, and multimodal patterns were associated with teams' subjective and objective performance outcomes. We found that idling with limited speech (i.e., silence or backchannel feedback only) and without movement was negatively correlated with task performance and with participants' subjective perceptions of the collaboration. However, being silent and focused during solution execution was positively correlated with task performance. Results illustrate that in some cases, multimodal patterns improved the predictions and improved explanatory power over the unimodal primitives. We discuss how the findings can inform the design of real-time interventions for remote CPS.","PeriodicalId":355800,"journal":{"name":"Proceedings of the Tenth International Conference on Learning Analytics & Knowledge","volume":"107 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-03-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127669119","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 34
Towards skills-based curriculum analytics: can we automate the recognition of prior learning? 面向基于技能的课程分析:我们能否自动识别先前的学习?
Kirsty Kitto, Nikhil Sarathy, Aleksandr Gromov, Ming Liu, Katarzyna Musial, S. B. Shum
In an era that will increasingly depend upon lifelong learning, the LA community will need to facilitate the movement and sharing of data and information across institutional and geographic boundaries. This will help us to recognise prior learning (RPL) and to personalise the learner experience. Here, we explore the utility of skills-based curriculum analytics and how it might facilitate the process of awarding RPL between two institutions. We explore the potential utility of combining natural language processing and skills taxonomies to map between subject descriptions for these two different institutions, presenting two algorithms we have developed to facilitate RPL and evaluating their performance. We draw attention to some of the issues that arise, listing areas that we consider ripe for future work in a surprisingly underexplored area.
在一个越来越依赖终身学习的时代,洛杉矶社区将需要促进跨机构和地理边界的数据和信息的移动和共享。这将帮助我们识别先验学习(RPL)并个性化学习者体验。在这里,我们探讨了基于技能的课程分析的效用,以及它如何促进两个机构之间授予RPL的过程。我们探索了将自然语言处理和技能分类法结合起来在这两个不同机构的主题描述之间进行映射的潜在效用,提出了我们开发的两种算法,以促进RPL并评估其性能。我们提请注意出现的一些问题,列出了我们认为在一个令人惊讶的未被开发的领域中未来工作成熟的领域。
{"title":"Towards skills-based curriculum analytics: can we automate the recognition of prior learning?","authors":"Kirsty Kitto, Nikhil Sarathy, Aleksandr Gromov, Ming Liu, Katarzyna Musial, S. B. Shum","doi":"10.1145/3375462.3375526","DOIUrl":"https://doi.org/10.1145/3375462.3375526","url":null,"abstract":"In an era that will increasingly depend upon lifelong learning, the LA community will need to facilitate the movement and sharing of data and information across institutional and geographic boundaries. This will help us to recognise prior learning (RPL) and to personalise the learner experience. Here, we explore the utility of skills-based curriculum analytics and how it might facilitate the process of awarding RPL between two institutions. We explore the potential utility of combining natural language processing and skills taxonomies to map between subject descriptions for these two different institutions, presenting two algorithms we have developed to facilitate RPL and evaluating their performance. We draw attention to some of the issues that arise, listing areas that we consider ripe for future work in a surprisingly underexplored area.","PeriodicalId":355800,"journal":{"name":"Proceedings of the Tenth International Conference on Learning Analytics & Knowledge","volume":"222 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114405480","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 18
Personalized visualizations to promote young learners' SRL: the learning path app 个性化可视化,促进年轻学习者的SRL:学习路径应用
I. Molenaar, A. Horvers, R. Dijkstra, R. Baker
This paper describes the design and evaluation of personalized visualizations to support young learners' Self-Regulated Learning (SRL) in Adaptive Learning Technologies (ALTs). Our learning path app combines three Personalized Visualizations (PV) that are designed as an external reference to support learners' internal regulation process. The personalized visualizations are based on three pillars: grounding in SRL theory, the usage of trace data and the provision of clear actionable recommendations for learners to improve regulation. This quasi-experimental pre-posttest study finds that learners in the personalized visualization condition improved the regulation of their practice behavior, as indicated by higher accuracy and less complex moment-by-moment learning curves compared to learners in the control group. Learners in the PV condition showed better transfer on learning. Finally, students in the personalized visualizations condition were more likely to under-estimate instead of over-estimate their performance. Overall, these findings indicates that the personalized visualizations improved regulation of practice behavior, transfer of learning and changed the bias in relative monitoring accuracy.
本文描述了个性化可视化的设计和评估,以支持青少年学习者在适应性学习技术(ALTs)中的自我调节学习(SRL)。我们的学习路径应用程序结合了三个个性化可视化(PV),旨在作为外部参考来支持学习者的内部调节过程。个性化可视化基于三个支柱:SRL理论的基础,跟踪数据的使用以及为学习者提供明确的可操作建议以改进监管。这项准实验前-后测试研究发现,个性化可视化条件下的学习者对练习行为的调节有所改善,表现为与对照组相比,学习者的学习精度更高,每一刻的学习曲线更简单。在PV条件下,学习者表现出更好的学习迁移。最后,个性化可视化条件下的学生更有可能低估而不是高估他们的表现。总体而言,这些发现表明个性化可视化改善了练习行为的调节,学习迁移和改变了相对监测准确性的偏差。
{"title":"Personalized visualizations to promote young learners' SRL: the learning path app","authors":"I. Molenaar, A. Horvers, R. Dijkstra, R. Baker","doi":"10.1145/3375462.3375465","DOIUrl":"https://doi.org/10.1145/3375462.3375465","url":null,"abstract":"This paper describes the design and evaluation of personalized visualizations to support young learners' Self-Regulated Learning (SRL) in Adaptive Learning Technologies (ALTs). Our learning path app combines three Personalized Visualizations (PV) that are designed as an external reference to support learners' internal regulation process. The personalized visualizations are based on three pillars: grounding in SRL theory, the usage of trace data and the provision of clear actionable recommendations for learners to improve regulation. This quasi-experimental pre-posttest study finds that learners in the personalized visualization condition improved the regulation of their practice behavior, as indicated by higher accuracy and less complex moment-by-moment learning curves compared to learners in the control group. Learners in the PV condition showed better transfer on learning. Finally, students in the personalized visualizations condition were more likely to under-estimate instead of over-estimate their performance. Overall, these findings indicates that the personalized visualizations improved regulation of practice behavior, transfer of learning and changed the bias in relative monitoring accuracy.","PeriodicalId":355800,"journal":{"name":"Proceedings of the Tenth International Conference on Learning Analytics & Knowledge","volume":"44 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123838672","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 29
edX log data analysis made easy: introducing ELAT: An open-source, privacy-aware and browser-based edX log data analysis tool 引入ELAT:一个开源、隐私意识和基于浏览器的edX日志数据分析工具,使edX日志数据分析变得简单
Manuel Valle Torre, Esther Tan, C. Hauff
Massive Open Online Courses (MOOCs), delivered on platforms such as edX and Coursera, have led to a surge in large-scale learning research. MOOC platforms gather a continuous stream of learner traces, which can amount to several Gigabytes per MOOC, that learning analytics researchers use to conduct exploratory analyses as well as to evaluate deployed interventions. edX has proven to be a popular platform for such experiments, as the data each MOOC generates is easily accessible to the institution running the MOOC. One of the issues researchers face is the preprocessing, cleaning and formatting of those large-scale learner traces. It is a tedious process that requires considerable computational skills. To reduce this burden, a number of tools have been proposed and released with the aim of simplifying this process. Those tools though still have a significant setup cost, are already out-of-date or require already preprocessed data as a starting point. In contrast, in this paper we introduce ELAT, the edX Log file Analysis Tool, which is browser-based (i.e., no setup costs), keeps the data local (i.e., no server is necessary and the privacy-sensitive learner data is not send anywhere) and takes edX data dumps as input. ELAT does not only process the raw data, but also generates semantically meaningful units (learner sessions instead of just click events) that are visualized in various ways (learning paths, forum participation, video watching sequences). We report on two evaluations we conducted: (i) a technological evaluation and a (ii) user study with potential end users of ELAT. ELAT is open-source and available at https://mvallet91.github.io/ELAT/.
在edX和Coursera等平台上提供的大规模开放在线课程(MOOCs)导致了大规模学习研究的激增。MOOC平台收集了连续的学习者轨迹流,每个MOOC可达数gb,学习分析研究人员使用这些数据进行探索性分析,并评估已部署的干预措施。事实证明,edX是一个很受欢迎的实验平台,因为每个MOOC产生的数据很容易被运行MOOC的机构获取。研究人员面临的问题之一是对这些大规模学习者痕迹进行预处理、清理和格式化。这是一个繁琐的过程,需要相当的计算技巧。为了减轻这一负担,已经提出并发布了一些工具,目的是简化这一过程。尽管这些工具的安装成本仍然很高,但它们要么已经过时,要么需要已经预处理过的数据作为起点。相比之下,在本文中,我们介绍了ELAT, edX日志文件分析工具,它是基于浏览器的(即,没有设置成本),保持数据本地(即,不需要服务器,隐私敏感的学习者数据不会发送到任何地方),并将edX数据转储作为输入。ELAT不仅处理原始数据,还生成语义上有意义的单元(学习者会话,而不仅仅是点击事件),这些单元以各种方式(学习路径、论坛参与、视频观看序列)可视化。我们报告了我们进行的两项评估:(i)技术评估和(ii) ELAT潜在最终用户的用户研究。ELAT是开源的,可以在https://mvallet91.github.io/ELAT/上获得。
{"title":"edX log data analysis made easy: introducing ELAT: An open-source, privacy-aware and browser-based edX log data analysis tool","authors":"Manuel Valle Torre, Esther Tan, C. Hauff","doi":"10.1145/3375462.3375510","DOIUrl":"https://doi.org/10.1145/3375462.3375510","url":null,"abstract":"Massive Open Online Courses (MOOCs), delivered on platforms such as edX and Coursera, have led to a surge in large-scale learning research. MOOC platforms gather a continuous stream of learner traces, which can amount to several Gigabytes per MOOC, that learning analytics researchers use to conduct exploratory analyses as well as to evaluate deployed interventions. edX has proven to be a popular platform for such experiments, as the data each MOOC generates is easily accessible to the institution running the MOOC. One of the issues researchers face is the preprocessing, cleaning and formatting of those large-scale learner traces. It is a tedious process that requires considerable computational skills. To reduce this burden, a number of tools have been proposed and released with the aim of simplifying this process. Those tools though still have a significant setup cost, are already out-of-date or require already preprocessed data as a starting point. In contrast, in this paper we introduce ELAT, the edX Log file Analysis Tool, which is browser-based (i.e., no setup costs), keeps the data local (i.e., no server is necessary and the privacy-sensitive learner data is not send anywhere) and takes edX data dumps as input. ELAT does not only process the raw data, but also generates semantically meaningful units (learner sessions instead of just click events) that are visualized in various ways (learning paths, forum participation, video watching sequences). We report on two evaluations we conducted: (i) a technological evaluation and a (ii) user study with potential end users of ELAT. ELAT is open-source and available at https://mvallet91.github.io/ELAT/.","PeriodicalId":355800,"journal":{"name":"Proceedings of the Tenth International Conference on Learning Analytics & Knowledge","volume":"520 ","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"120881683","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
From theory to action: developing and evaluating learning analytics for learning design 从理论到行动:为学习设计开发和评估学习分析
Korah J. Wiley, Y. Dimitriadis, Alison Bradford, Marcia C. Linn
The effectiveness of using learning analytics for learning design primarily depends upon two concepts: grounding and alignment. This is the primary conjecture for the study described in this paper. In our design-based research study, we design, test, and evaluate teacher-facing learning analytics for an online inquiry science unit on global climate change. We design our learning analytics in accordance with a socioconstructivism-based pedagogical framework, called Knowledge Integration, and the principles of learning analytics Implementation Design. Our methodology for the design process draws upon the principle of the Orchestrating for Learning Analytics framework to engage stakeholders (i.e. teachers, researchers, and developers). The resulting learning analytics were aligned to unit activities that engaged students in key aspects of the knowledge integration process. They provided teachers with actionable insight into their students' understanding at critical junctures in the learning process. We demonstrate the efficacy of the learning analytics in supporting the optimization of the unit's learning design. We conclude by synthesizing the principles that guided our design process into a framework for developing and evaluating learning analytics for learning design.
在学习设计中使用学习分析的有效性主要取决于两个概念:基础和对齐。这是本文所述研究的主要猜想。在我们基于设计的研究性学习中,我们为全球气候变化的在线探究科学单元设计、测试和评估面向教师的学习分析。我们根据基于社会建构主义的教学框架(称为知识整合)和学习分析实施设计原则来设计我们的学习分析。我们的设计过程方法借鉴了编排学习分析框架的原则,以吸引利益相关者(即教师,研究人员和开发人员)。由此产生的学习分析与单元活动相一致,这些活动使学生参与到知识整合过程的关键方面。他们在学习过程的关键时刻为教师提供了可操作的洞察学生的理解。我们证明了学习分析在支持单元学习设计优化方面的功效。最后,我们将指导我们设计过程的原则综合到一个框架中,用于开发和评估学习设计的学习分析。
{"title":"From theory to action: developing and evaluating learning analytics for learning design","authors":"Korah J. Wiley, Y. Dimitriadis, Alison Bradford, Marcia C. Linn","doi":"10.1145/3375462.3375540","DOIUrl":"https://doi.org/10.1145/3375462.3375540","url":null,"abstract":"The effectiveness of using learning analytics for learning design primarily depends upon two concepts: grounding and alignment. This is the primary conjecture for the study described in this paper. In our design-based research study, we design, test, and evaluate teacher-facing learning analytics for an online inquiry science unit on global climate change. We design our learning analytics in accordance with a socioconstructivism-based pedagogical framework, called Knowledge Integration, and the principles of learning analytics Implementation Design. Our methodology for the design process draws upon the principle of the Orchestrating for Learning Analytics framework to engage stakeholders (i.e. teachers, researchers, and developers). The resulting learning analytics were aligned to unit activities that engaged students in key aspects of the knowledge integration process. They provided teachers with actionable insight into their students' understanding at critical junctures in the learning process. We demonstrate the efficacy of the learning analytics in supporting the optimization of the unit's learning design. We conclude by synthesizing the principles that guided our design process into a framework for developing and evaluating learning analytics for learning design.","PeriodicalId":355800,"journal":{"name":"Proceedings of the Tenth International Conference on Learning Analytics & Knowledge","volume":"35 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126701737","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 26
Exploring student approaches to learning through sequence analysis of reading logs 通过阅读日志的序列分析,探索学生的学习方法
Gökhan Akçapınar, Mei-Rong Alice Chen, Rwitajit Majumdar, B. Flanagan, H. Ogata
In this paper, we aim to explore students' study approaches (e.g., deep, strategic, surface) from the logs collected by an electronic textbook (eBook) system. Data was collected from 89 students related to their reading activities both in and out of the class in a Freshman English course. Students are given a task to study reading materials through the eBook system, highlight the text that is related to the main or supporting ideas, and answer the questions prepared for measuring their level of comprehension. Students in and out of class reading times and their usage of the marker feature were used as a proxy to understand their study approaches. We used theory-driven and data-driven approaches together to model the study approaches of students. Our results showed that three groups of students who have different study approaches could be identified. Relationships between students' reading behaviors and their academic performance is also investigated by using association rule mining analysis. Obtained results are discussed in terms of monitoring, feedback, predicting learning outcomes, and identifying problems with the content design.
在本文中,我们旨在从电子教科书(电子书)系统收集的日志中探索学生的学习方法(如深度,策略和表面)。本研究收集了89名大一新生在课堂内外的阅读活动数据。学生的任务是通过电子书系统学习阅读材料,突出与主要或支持观点相关的文本,并回答为衡量他们的理解水平而准备的问题。学生在课堂上和课外的阅读时间以及他们对标记特征的使用情况被用作了解他们学习方法的代理。我们使用理论驱动和数据驱动的方法来模拟学生的学习方法。我们的研究结果表明,可以识别出具有不同学习方法的三组学生。运用关联规则挖掘分析方法,研究了学生阅读行为与学习成绩之间的关系。从监控、反馈、预测学习结果和识别内容设计中的问题等方面讨论获得的结果。
{"title":"Exploring student approaches to learning through sequence analysis of reading logs","authors":"Gökhan Akçapınar, Mei-Rong Alice Chen, Rwitajit Majumdar, B. Flanagan, H. Ogata","doi":"10.1145/3375462.3375492","DOIUrl":"https://doi.org/10.1145/3375462.3375492","url":null,"abstract":"In this paper, we aim to explore students' study approaches (e.g., deep, strategic, surface) from the logs collected by an electronic textbook (eBook) system. Data was collected from 89 students related to their reading activities both in and out of the class in a Freshman English course. Students are given a task to study reading materials through the eBook system, highlight the text that is related to the main or supporting ideas, and answer the questions prepared for measuring their level of comprehension. Students in and out of class reading times and their usage of the marker feature were used as a proxy to understand their study approaches. We used theory-driven and data-driven approaches together to model the study approaches of students. Our results showed that three groups of students who have different study approaches could be identified. Relationships between students' reading behaviors and their academic performance is also investigated by using association rule mining analysis. Obtained results are discussed in terms of monitoring, feedback, predicting learning outcomes, and identifying problems with the content design.","PeriodicalId":355800,"journal":{"name":"Proceedings of the Tenth International Conference on Learning Analytics & Knowledge","volume":"15 3","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114136242","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
Exploration of the robustness and generalizability of the additive factors model 探讨加性因子模型的稳健性和泛化性
Tomáš Effenberger, Radek Pelánek, Jaroslav Čechák
Additive Factors Model is a widely used student model, which is primarily used for refining knowledge component models (Q-matrices). We explore the robustness and generalizability of the model. We explicitly formulate simplifying assumptions that the model makes and we discuss methods for visualizing learning curves based on the model. We also report on an application of the model to data from a learning system for introductory programming; these experiments illustrate possibly misleading interpretation of model results due to differences in item difficulty. Overall, our results show that greater care has to be taken in the application of the model and in the interpretation of results obtained with the model.
加性因子模型是一种广泛使用的学生模型,主要用于提炼知识成分模型(q矩阵)。探讨了模型的鲁棒性和泛化性。我们明确地制定了简化模型的假设,并讨论了基于模型可视化学习曲线的方法。我们还报告了该模型在入门编程学习系统数据中的应用;这些实验说明,由于项目难度的差异,模型结果可能被误解。总的来说,我们的结果表明,在应用模型和解释用模型获得的结果时,必须更加小心。
{"title":"Exploration of the robustness and generalizability of the additive factors model","authors":"Tomáš Effenberger, Radek Pelánek, Jaroslav Čechák","doi":"10.1145/3375462.3375491","DOIUrl":"https://doi.org/10.1145/3375462.3375491","url":null,"abstract":"Additive Factors Model is a widely used student model, which is primarily used for refining knowledge component models (Q-matrices). We explore the robustness and generalizability of the model. We explicitly formulate simplifying assumptions that the model makes and we discuss methods for visualizing learning curves based on the model. We also report on an application of the model to data from a learning system for introductory programming; these experiments illustrate possibly misleading interpretation of model results due to differences in item difficulty. Overall, our results show that greater care has to be taken in the application of the model and in the interpretation of results obtained with the model.","PeriodicalId":355800,"journal":{"name":"Proceedings of the Tenth International Conference on Learning Analytics & Knowledge","volume":"13 15","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132546607","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
The relationship between confusion and metacognitive strategies in Betty's Brain 贝蒂大脑中混淆与元认知策略的关系
Yingbin Zhang, L. Paquette, R. Baker, Jaclyn L. Ocumpaugh, Nigel Bosch, Anabil Munshi, G. Biswas
Confusion has been shown to be prevalent during complex learning and has mixed effects on learning. Whether confusion facilitates or hampers learning may depend on whether it is resolved or not. Confusion resolution, behind which is the resolution of cognitive disequilibrium, requires learners to possess some skills, but it is unclear what these skills are. One possibility may be metacognitive strategies (MS), strategies for regulating cognition. This study examined the relationship between confusion and actions related to MS in Betty's Brain, a computer-based learning environment. The results revealed that MS behavior differed during and outside confusion. However, confusion resolution was not related to MS behavior, and MS did not moderate the effect of confusion on learning.
在复杂的学习过程中,困惑是普遍存在的,并且对学习有不同的影响。困惑是促进还是阻碍学习可能取决于它是否得到解决。解决困惑的背后是认知失衡的解决,它要求学习者具备一些技能,但这些技能是什么目前还不清楚。一种可能是元认知策略(MS),即调节认知的策略。这项研究考察了在Betty's Brain(一个基于计算机的学习环境)中与MS相关的困惑和行为之间的关系。结果显示,在混乱状态下和混乱状态下,MS的行为是不同的。然而,困惑解决与多发性硬化行为无关,多发性硬化也没有调节困惑对学习的影响。
{"title":"The relationship between confusion and metacognitive strategies in Betty's Brain","authors":"Yingbin Zhang, L. Paquette, R. Baker, Jaclyn L. Ocumpaugh, Nigel Bosch, Anabil Munshi, G. Biswas","doi":"10.1145/3375462.3375518","DOIUrl":"https://doi.org/10.1145/3375462.3375518","url":null,"abstract":"Confusion has been shown to be prevalent during complex learning and has mixed effects on learning. Whether confusion facilitates or hampers learning may depend on whether it is resolved or not. Confusion resolution, behind which is the resolution of cognitive disequilibrium, requires learners to possess some skills, but it is unclear what these skills are. One possibility may be metacognitive strategies (MS), strategies for regulating cognition. This study examined the relationship between confusion and actions related to MS in Betty's Brain, a computer-based learning environment. The results revealed that MS behavior differed during and outside confusion. However, confusion resolution was not related to MS behavior, and MS did not moderate the effect of confusion on learning.","PeriodicalId":355800,"journal":{"name":"Proceedings of the Tenth International Conference on Learning Analytics & Knowledge","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115704029","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
期刊
Proceedings of the Tenth International Conference on Learning Analytics & Knowledge
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1