首页 > 最新文献

Proceedings of the 9th International Conference on Learning Analytics & Knowledge最新文献

英文 中文
Multichannel data for understanding cognitive affordances during complex problem solving 多通道数据用于理解复杂问题解决过程中的认知能力
Charlotte Larmuseau, Pieter Vanneste, P. Desmet, F. Depaepe
This exploratory study challenges the current practices in cognitive load measurement by using multichannel data to investigate cognitive load affordances during online complex problem solving. Moreover, it is an attempt to investigate how cognitive load is related to strategy use. Accordingly, in the current study a well- and an ill-structured problem were developed in a virtual learning environment. Online support was provided. Participants were 15 students from the teacher training program. This study incorporated subjective measurements of students' cognitive load (i.e., intrinsic, extraneous, germane load and their mental effort) combined with physiological data containing galvanic skin response (GSR) and skin temperature (ST). A first aim was to investigate whether there was a significant difference for the subjective measurements, physiological data and consultation of support between the well-and ill-structured problem. Secondly this study investigated how individual differences of subjective measurements are related to individual differences of physiological data and consultation of support. Results reveal significant differences for intrinsic load, mental effort between a well- and ill-structured problem. Moreover, when investigating individual differences, findings reveal that GSR might be related to mental effort. Additionally, results indicate that cognitive load influences strategy use. Future research with larger sample sizes should verify these findings in order to have more insight into how we can measure cognitive load and how its related to self-directed learning. These insights should allow us to provide adaptive support in virtual learning environments.
本探索性研究通过使用多通道数据来调查在线复杂问题解决过程中的认知负荷能力,挑战了当前认知负荷测量的实践。此外,本研究还试图探讨认知负荷与策略使用之间的关系。因此,在当前的研究中,在虚拟学习环境中开发了一个结构良好和一个结构不良的问题。提供在线支持。参与者是教师培训项目的15名学生。本研究将学生的认知负荷(即内在负荷、外在负荷、相关负荷和脑力劳动)的主观测量与皮肤电反应(GSR)和皮肤温度(ST)的生理数据相结合。第一个目的是调查结构良好和结构不良的问题在主观测量、生理数据和咨询支持方面是否存在显著差异。其次,本研究探讨了主观测量的个体差异与生理数据和支持咨询的个体差异之间的关系。结果显示,在结构良好和结构不良的问题中,内在负荷、心理努力存在显著差异。此外,在调查个体差异时,研究结果显示GSR可能与心理努力有关。此外,研究结果表明,认知负荷影响策略的使用。未来更大样本量的研究应该验证这些发现,以便更深入地了解我们如何测量认知负荷及其与自主学习的关系。这些见解应该允许我们在虚拟学习环境中提供适应性支持。
{"title":"Multichannel data for understanding cognitive affordances during complex problem solving","authors":"Charlotte Larmuseau, Pieter Vanneste, P. Desmet, F. Depaepe","doi":"10.1145/3303772.3303778","DOIUrl":"https://doi.org/10.1145/3303772.3303778","url":null,"abstract":"This exploratory study challenges the current practices in cognitive load measurement by using multichannel data to investigate cognitive load affordances during online complex problem solving. Moreover, it is an attempt to investigate how cognitive load is related to strategy use. Accordingly, in the current study a well- and an ill-structured problem were developed in a virtual learning environment. Online support was provided. Participants were 15 students from the teacher training program. This study incorporated subjective measurements of students' cognitive load (i.e., intrinsic, extraneous, germane load and their mental effort) combined with physiological data containing galvanic skin response (GSR) and skin temperature (ST). A first aim was to investigate whether there was a significant difference for the subjective measurements, physiological data and consultation of support between the well-and ill-structured problem. Secondly this study investigated how individual differences of subjective measurements are related to individual differences of physiological data and consultation of support. Results reveal significant differences for intrinsic load, mental effort between a well- and ill-structured problem. Moreover, when investigating individual differences, findings reveal that GSR might be related to mental effort. Additionally, results indicate that cognitive load influences strategy use. Future research with larger sample sizes should verify these findings in order to have more insight into how we can measure cognitive load and how its related to self-directed learning. These insights should allow us to provide adaptive support in virtual learning environments.","PeriodicalId":382957,"journal":{"name":"Proceedings of the 9th International Conference on Learning Analytics & Knowledge","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133380911","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
Clustering Analysis Reveals Authentic Science Inquiry Trajectories Among Undergraduates 聚类分析揭示大学生科学探究的真实轨迹
Melanie E. Peffer, David Quigley, M. Mostowfi
Science education reforms in the United States call for an emphasis on teaching of scientific practices, such as inquiry. Previous work examined expert versus novice practices in authentic science inquiry and found although experts have fairly consistent inquiry strategies, novices exist on a continuum. In this paper, we extend our previous qualitative work to quantitatively analyze differences in inquiry practices among novices. Using clustering analysis, we found that non-science majors who performed simple investigations tended to cluster together and biology majors who performed complex investigations also tended to cluster together. We observed two additional clusters that contain both non-science majors and biology majors, but who performed distinct inquiry strategies. This raises some critical questions about how to pedagogically target students within each cluster.
美国的科学教育改革要求强调科学实践的教学,例如探究。以前的工作研究了专家和新手在真实科学探究中的实践,发现尽管专家有相当一致的探究策略,但新手存在于一个连续体中。在本文中,我们扩展了之前的定性工作,以定量分析新手在探究实践中的差异。通过聚类分析,我们发现从事简单调查的非理工科学生倾向于聚集在一起,从事复杂调查的生物专业学生也倾向于聚集在一起。我们观察到另外两个集群既包括非科学专业的学生,也包括生物专业的学生,但他们执行不同的探究策略。这就提出了一些关于如何在教学上针对每个集群中的学生的关键问题。
{"title":"Clustering Analysis Reveals Authentic Science Inquiry Trajectories Among Undergraduates","authors":"Melanie E. Peffer, David Quigley, M. Mostowfi","doi":"10.1145/3303772.3303831","DOIUrl":"https://doi.org/10.1145/3303772.3303831","url":null,"abstract":"Science education reforms in the United States call for an emphasis on teaching of scientific practices, such as inquiry. Previous work examined expert versus novice practices in authentic science inquiry and found although experts have fairly consistent inquiry strategies, novices exist on a continuum. In this paper, we extend our previous qualitative work to quantitatively analyze differences in inquiry practices among novices. Using clustering analysis, we found that non-science majors who performed simple investigations tended to cluster together and biology majors who performed complex investigations also tended to cluster together. We observed two additional clusters that contain both non-science majors and biology majors, but who performed distinct inquiry strategies. This raises some critical questions about how to pedagogically target students within each cluster.","PeriodicalId":382957,"journal":{"name":"Proceedings of the 9th International Conference on Learning Analytics & Knowledge","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124449284","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Exploring students' sensemaking of learning analytics dashboards: Does frame of reference make a difference? 探究学生对学习分析仪表板的理解:参考框架会产生影响吗?
Lisa-Angelique Lim, S. Dawson, Srécko Joksimovíc, D. Gašević
Learning Analytics Dashboards (LAD) are becoming an increasingly popular way to provide students with personalised feedback. Despite the number of LADs being developed, significant research gaps exist around the student perspective, especially how students make sense of graphics provided in LADs, and how they intend to act on the feedback provided therein. This study employed a randomized-controlled trial to examine students' sense-making of LADs showing four different frames of reference, and to what extent the impact of LADs was mediated by baseline self-regulation. Using a mix of quantitative and qualitative data analysis, the results revealed rather distinct patterns in students' sense-making across the four LADs. These patterns involved the intersection of visual salience and planned learning actions. However, collectively, across all four LADs a consistent theme emerged around students planned learning actions. This theme was classified as time and study environment management. A key finding of the study is that the use of LADs as a primary feedback process should be personalized and include training and support to aid student sensemaking.
学习分析仪表板(LAD)正在成为为学生提供个性化反馈的一种越来越受欢迎的方式。尽管正在开发的应用程序数量众多,但围绕学生视角的研究仍存在重大差距,特别是学生如何理解应用程序中提供的图形,以及他们打算如何根据其中提供的反馈采取行动。本研究采用随机对照试验,考察学生在四种不同的参考框架下对学习进度的理解,以及基线自我调节在多大程度上介导了学习进度的影响。通过混合使用定量和定性数据分析,结果揭示了四个地区学生在理解意义方面的不同模式。这些模式涉及到视觉显著性和有计划的学习行为的交集。然而,总的来说,在所有四个lad中,围绕学生计划的学习行动出现了一致的主题。这一主题被划分为时间和学习环境管理。这项研究的一项重要发现是,将学习能力评估作为主要反馈过程的使用应该是个性化的,并包括培训和支持,以帮助学生理解。
{"title":"Exploring students' sensemaking of learning analytics dashboards: Does frame of reference make a difference?","authors":"Lisa-Angelique Lim, S. Dawson, Srécko Joksimovíc, D. Gašević","doi":"10.1145/3303772.3303804","DOIUrl":"https://doi.org/10.1145/3303772.3303804","url":null,"abstract":"Learning Analytics Dashboards (LAD) are becoming an increasingly popular way to provide students with personalised feedback. Despite the number of LADs being developed, significant research gaps exist around the student perspective, especially how students make sense of graphics provided in LADs, and how they intend to act on the feedback provided therein. This study employed a randomized-controlled trial to examine students' sense-making of LADs showing four different frames of reference, and to what extent the impact of LADs was mediated by baseline self-regulation. Using a mix of quantitative and qualitative data analysis, the results revealed rather distinct patterns in students' sense-making across the four LADs. These patterns involved the intersection of visual salience and planned learning actions. However, collectively, across all four LADs a consistent theme emerged around students planned learning actions. This theme was classified as time and study environment management. A key finding of the study is that the use of LADs as a primary feedback process should be personalized and include training and support to aid student sensemaking.","PeriodicalId":382957,"journal":{"name":"Proceedings of the 9th International Conference on Learning Analytics & Knowledge","volume":"34 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123639397","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 42
Analytics of Learning Strategies: Associations with Academic Performance and Feedback 学习策略分析:与学习成绩和反馈的关系
W. Matcha, D. Gašević, Nora'ayu Ahmad Uzir, J. Jovanović, A. Pardo
Learning analytics has the potential to detect and explain characteristics of learning strategies through analysis of trace data and communicate the findings via feedback. However, the role of learning analytics-based feedback in selection and regulation of learning strategies is still insufficiently explored and understood. This research aims to examine the sequential and temporal characteristics of learning strategies and investigate their association with feedback. Three years of trace data were collected from online pre-class activities of a flipped classroom, where different types of feedback were employed in each year. Clustering, sequence mining, and process mining were used to detect and interpret learning tactics and strategies. Inferential statistics were used to examine the association of feedback with the learning performance and the detected learning strategies. The results suggest a positive association between the personalised feedback and the effective strategies.
学习分析有可能通过分析跟踪数据来检测和解释学习策略的特征,并通过反馈来传达发现。然而,基于学习分析的反馈在学习策略的选择和调节中的作用仍然没有得到充分的探索和理解。本研究旨在探讨学习策略的时序特征和时间特征,以及它们与反馈的关系。从翻转课堂的在线课前活动中收集了三年的跟踪数据,每年采用不同类型的反馈。聚类、序列挖掘和过程挖掘用于检测和解释学习策略和策略。采用推理统计的方法检验反馈与学习绩效和被检测的学习策略之间的关系。结果表明,个性化反馈与有效策略之间存在正相关关系。
{"title":"Analytics of Learning Strategies: Associations with Academic Performance and Feedback","authors":"W. Matcha, D. Gašević, Nora'ayu Ahmad Uzir, J. Jovanović, A. Pardo","doi":"10.1145/3303772.3303787","DOIUrl":"https://doi.org/10.1145/3303772.3303787","url":null,"abstract":"Learning analytics has the potential to detect and explain characteristics of learning strategies through analysis of trace data and communicate the findings via feedback. However, the role of learning analytics-based feedback in selection and regulation of learning strategies is still insufficiently explored and understood. This research aims to examine the sequential and temporal characteristics of learning strategies and investigate their association with feedback. Three years of trace data were collected from online pre-class activities of a flipped classroom, where different types of feedback were employed in each year. Clustering, sequence mining, and process mining were used to detect and interpret learning tactics and strategies. Inferential statistics were used to examine the association of feedback with the learning performance and the detected learning strategies. The results suggest a positive association between the personalised feedback and the effective strategies.","PeriodicalId":382957,"journal":{"name":"Proceedings of the 9th International Conference on Learning Analytics & Knowledge","volume":"29 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122178385","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 90
Can Background Music Facilitate Learning?: Preliminary Results on Reading Comprehension 背景音乐能促进学习吗?阅读理解的初步结果
Xiao Hu, Fanjie Li, Runzhi Kong
It is a common phenomenon for students to listen to background music while studying. However, there are mixed and inconclusive Kindings in the literature, leaving it unclear whether and in which circumstances background music can facilitate or hinder learning. This paper reports a study investigating the effects of Kive different types of background audio (four types of music and one environmental sound) on reading comprehension. An experiment was conducted with 33 graduate students, where a series of cognitive, metacognitive, affective variables and physiological signals were collected and analyzed. Preliminary results show that there were differences on these variables across different music types. This study contributes to the understanding and optimizing of background music for facilitating learning.
学生在学习时听背景音乐是一种普遍现象。然而,在文献中有混合的和不确定的Kindings,留下不清楚背景音乐是否以及在哪种情况下可以促进或阻碍学习。本文报道了一项研究,调查了五种不同类型的背景音频(四种音乐和一种环境声音)对阅读理解的影响。以33名研究生为实验对象,收集并分析了一系列认知、元认知、情感变量和生理信号。初步结果表明,不同的音乐类型在这些变量上存在差异。本研究有助于理解和优化背景音乐,促进学习。
{"title":"Can Background Music Facilitate Learning?: Preliminary Results on Reading Comprehension","authors":"Xiao Hu, Fanjie Li, Runzhi Kong","doi":"10.1145/3303772.3303839","DOIUrl":"https://doi.org/10.1145/3303772.3303839","url":null,"abstract":"It is a common phenomenon for students to listen to background music while studying. However, there are mixed and inconclusive Kindings in the literature, leaving it unclear whether and in which circumstances background music can facilitate or hinder learning. This paper reports a study investigating the effects of Kive different types of background audio (four types of music and one environmental sound) on reading comprehension. An experiment was conducted with 33 graduate students, where a series of cognitive, metacognitive, affective variables and physiological signals were collected and analyzed. Preliminary results show that there were differences on these variables across different music types. This study contributes to the understanding and optimizing of background music for facilitating learning.","PeriodicalId":382957,"journal":{"name":"Proceedings of the 9th International Conference on Learning Analytics & Knowledge","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125333273","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
Learning analytics at the intersections of student trust, disclosure and benefit 在学生信任、信息披露和利益的交叉点学习分析
Sharon Slade, P. Prinsloo, Mohammad Khalil
Evidence suggests that individuals are often willing to exchange personal data for (real or perceived) benefits. Such an exchange may be impacted by their trust in a particular context and their (real or perceived) control over their data. Students remain concerned about the scope and detail of surveillance of their learning behavior, their privacy, their control over what data are collected, the purpose of the collection, and the implications of any analysis. Questions arise as to the extent to which students are aware of the benefits and risks inherent in the exchange of their data, and whether they are willing to exchange personal data for more effective and supported learning experiences. This study reports on the views of entry level students at the Open University (OU) in 2018. The primary aim is to explore differences between stated attitudes to privacy and their online behaviors, and whether these same attitudes extend to their university's uses of their (personal) data. The analysis indicates, inter alia, that there is no obvious relationship between how often students are online or their awareness of/concerns about privacy issues in online contexts and what they actually do to protect themselves. Significantly though, the findings indicate that students overwhelmingly have an inherent trust in their university to use their data appropriately and ethically. Based on the findings, we outline a number of issues for consideration by higher education institutions, such as the need for transparency (of purpose and scope), the provision of some element of student control, and an acknowledgment of the exchange value of information in the nexus of the privacy calculus.
有证据表明,个人通常愿意交换个人数据以换取(实际的或感知的)利益。这种交换可能会受到他们在特定上下文中的信任以及他们对数据的(实际或感知的)控制的影响。学生们仍然关心监视他们学习行为的范围和细节,他们的隐私,他们对收集数据的控制,收集的目的,以及任何分析的含义。学生在多大程度上意识到交换其数据所固有的利益和风险,以及他们是否愿意交换个人数据以获得更有效和更有支持的学习体验,这些问题都出现了。本研究报告了2018年开放大学(OU)入门级学生的观点。研究的主要目的是探索他们对隐私的态度和他们的网络行为之间的差异,以及这些态度是否会延伸到他们的大学对他们(个人)数据的使用。分析表明,除其他外,学生上网的频率或他们对网络环境中隐私问题的意识/担忧与他们实际采取的保护自己的措施之间没有明显的关系。然而,值得注意的是,调查结果表明,绝大多数学生对他们的大学有一种内在的信任,相信他们的大学会恰当地、合乎道德地使用他们的数据。基于这些发现,我们概述了高等教育机构需要考虑的一些问题,例如对透明度(目的和范围)的需求,提供学生控制的某些元素,以及在隐私计算的关系中承认信息的交换价值。
{"title":"Learning analytics at the intersections of student trust, disclosure and benefit","authors":"Sharon Slade, P. Prinsloo, Mohammad Khalil","doi":"10.1145/3303772.3303796","DOIUrl":"https://doi.org/10.1145/3303772.3303796","url":null,"abstract":"Evidence suggests that individuals are often willing to exchange personal data for (real or perceived) benefits. Such an exchange may be impacted by their trust in a particular context and their (real or perceived) control over their data. Students remain concerned about the scope and detail of surveillance of their learning behavior, their privacy, their control over what data are collected, the purpose of the collection, and the implications of any analysis. Questions arise as to the extent to which students are aware of the benefits and risks inherent in the exchange of their data, and whether they are willing to exchange personal data for more effective and supported learning experiences. This study reports on the views of entry level students at the Open University (OU) in 2018. The primary aim is to explore differences between stated attitudes to privacy and their online behaviors, and whether these same attitudes extend to their university's uses of their (personal) data. The analysis indicates, inter alia, that there is no obvious relationship between how often students are online or their awareness of/concerns about privacy issues in online contexts and what they actually do to protect themselves. Significantly though, the findings indicate that students overwhelmingly have an inherent trust in their university to use their data appropriately and ethically. Based on the findings, we outline a number of issues for consideration by higher education institutions, such as the need for transparency (of purpose and scope), the provision of some element of student control, and an acknowledgment of the exchange value of information in the nexus of the privacy calculus.","PeriodicalId":382957,"journal":{"name":"Proceedings of the 9th International Conference on Learning Analytics & Knowledge","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127795152","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 70
On multi-device use: Using technological modality profiles to explain differences in students' learning 关于多设备使用:用技术模式分析来解释学生学习的差异
Varshita Sher, M. Hatala, D. Gašević
With increasing abundance and ubiquity of mobile phones, desktop PCs, and tablets in the last decade, we are seeing students intermixing these modalities to learn and regulate their learning. However, the role of these modalities in educational settings is still largely under-researched. Similarly, little attention has been paid to the research on the extension of learning analytics to analyze the learning processes of students adopting various modalities during a learning activity. Traditionally, research on how modalities affect the way in which activities are completed has mainly relied upon self-reported data or mere counts of access from each modality. We explore the use of technological modalities in regulating learning via learning management systems (LMS) in the context of blended courses. We used data mining techniques to analyze patterns in sequences of actions performed by learners (n = 120) across different modalities in order to identify technological modality profiles of sequences. These profiles were used to detect the technological modality strategies adopted by students. We found a moderate effect size (∈2 = 0.12) of students' adopted strategies on the final course grade. Furthermore, when looking specifically at online discussion engagement and performance, students' adopted technological modality strategies explained a large amount of variance (η2 = 0.68) in their engagement and quality of contributions. The result implications and further research are discussed.
在过去的十年里,随着手机、台式电脑和平板电脑的日益普及和普及,我们看到学生们混合使用这些方式来学习和调节他们的学习。然而,这些模式在教育环境中的作用在很大程度上仍未得到充分研究。同样,很少有人关注学习分析的延伸研究,以分析学生在学习活动中采用各种方式的学习过程。传统上,关于模式如何影响活动完成方式的研究主要依赖于自我报告的数据或仅仅是对每种模式的访问次数的统计。我们探索在混合课程的背景下,通过学习管理系统(LMS)使用技术模式来规范学习。我们使用数据挖掘技术来分析学习者(n = 120)在不同模式下执行的动作序列中的模式,以确定序列的技术模式概况。这些概况被用来检测学生采用的技术模式策略。我们发现学生所采用的策略对最终课程成绩的影响大小适中(∈2 = 0.12)。此外,当具体观察在线讨论参与和表现时,学生采用的技术模式策略解释了他们参与和贡献质量的大量方差(η2 = 0.68)。讨论了研究结果的意义和进一步的研究。
{"title":"On multi-device use: Using technological modality profiles to explain differences in students' learning","authors":"Varshita Sher, M. Hatala, D. Gašević","doi":"10.1145/3303772.3303790","DOIUrl":"https://doi.org/10.1145/3303772.3303790","url":null,"abstract":"With increasing abundance and ubiquity of mobile phones, desktop PCs, and tablets in the last decade, we are seeing students intermixing these modalities to learn and regulate their learning. However, the role of these modalities in educational settings is still largely under-researched. Similarly, little attention has been paid to the research on the extension of learning analytics to analyze the learning processes of students adopting various modalities during a learning activity. Traditionally, research on how modalities affect the way in which activities are completed has mainly relied upon self-reported data or mere counts of access from each modality. We explore the use of technological modalities in regulating learning via learning management systems (LMS) in the context of blended courses. We used data mining techniques to analyze patterns in sequences of actions performed by learners (n = 120) across different modalities in order to identify technological modality profiles of sequences. These profiles were used to detect the technological modality strategies adopted by students. We found a moderate effect size (∈2 = 0.12) of students' adopted strategies on the final course grade. Furthermore, when looking specifically at online discussion engagement and performance, students' adopted technological modality strategies explained a large amount of variance (η2 = 0.68) in their engagement and quality of contributions. The result implications and further research are discussed.","PeriodicalId":382957,"journal":{"name":"Proceedings of the 9th International Conference on Learning Analytics & Knowledge","volume":"32 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114906818","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
The Impact of Student Opt-Out on Educational Predictive Models 学生选择退出对教育预测模型的影响
Warren Li, Christopher A. Brooks, F. Schaub
Privacy concerns may lead people to opt-in or opt-out of having their educational data collected. These decisions may impact the performance of educational predictive models. To understand this, we conducted a survey to determine the propensity of students to withhold or grant access to their data for the purposes of training predictive models. We simulated the effects of opt-out on the accuracy of educational predictive models by dropping a random sample of data over a range of increments, and then contextualize our findings using the survey results. We find that grade predictive models are fairly robust and that kappa scores do not decrease unless there is signiicant opt-out, but when there is, the deteriorating performance disproportionately affects certain subpopulations.
隐私问题可能会导致人们选择加入或退出他们的教育数据被收集。这些决定可能会影响教育预测模型的性能。为了理解这一点,我们进行了一项调查,以确定学生为了训练预测模型而拒绝或允许访问他们的数据的倾向。我们通过在一定范围内随机抽取数据样本来模拟选择退出对教育预测模型准确性的影响,然后使用调查结果将我们的发现置于背景中。我们发现,年级预测模型相当稳健,kappa分数不会下降,除非有显著的选择退出,但当有,恶化的表现不成比例地影响某些亚群。
{"title":"The Impact of Student Opt-Out on Educational Predictive Models","authors":"Warren Li, Christopher A. Brooks, F. Schaub","doi":"10.1145/3303772.3303809","DOIUrl":"https://doi.org/10.1145/3303772.3303809","url":null,"abstract":"Privacy concerns may lead people to opt-in or opt-out of having their educational data collected. These decisions may impact the performance of educational predictive models. To understand this, we conducted a survey to determine the propensity of students to withhold or grant access to their data for the purposes of training predictive models. We simulated the effects of opt-out on the accuracy of educational predictive models by dropping a random sample of data over a range of increments, and then contextualize our findings using the survey results. We find that grade predictive models are fairly robust and that kappa scores do not decrease unless there is signiicant opt-out, but when there is, the deteriorating performance disproportionately affects certain subpopulations.","PeriodicalId":382957,"journal":{"name":"Proceedings of the 9th International Conference on Learning Analytics & Knowledge","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129004093","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
An Analysis of Student Representation, Representative Features and Classification Algorithms to Predict Degree Dropout 学生代表性分析、代表性特征及分类算法预测学位辍学
R. Manrique, B. Nunes, O. Mariño, M. Casanova, Terhi Nurmikko-Fuller
Identifying and monitoring students who are likely to dropout is a vital issue for universities. Early detection allows institutions to intervene, addressing problems and retaining students. Prior research into the early detection of at-risk students has opted for the use of predictive models, but a comprehensive assessment of the suitability of different algorithms and approaches is complicated by the large number of variable features that constitute a student's educational experience. Predictive models vary in terms of their amplitude, temporality and the learning algorithms employed. While amplitude refers to the ability of the model to operate on multiple degrees, temporality is often considered due to the natural temporal aspect of the data. In the absence of a comparative framework of learning algorithms, the aim of this paper has been to provide such an analysis, based on a proposed classification of strategies for predicting dropouts in Higher Education Institutions. Three different student representations are implemented (namely Global Feature-Based, Local Feature-Based, and Time Series) in conjunction with the appropriate learning algorithms for each of them. A description of each approach, as well as its implementation process, are presented in this paper as technical contributions. An experiment based on a dataset of student information from two degrees, namely Business Administration and Architecture, acquired through an automated management system from a university in Brazil is used. Our findings can be summarized as: (i) of the three proposed student representations, the Local Feature-Based was the most suitable approach for predicting dropout. In addition to providing high quality results, the Local Feature-Based representations are simple to build, and the construction of the model is less expensive when compared to more complex ones; (ii) as a conclusion of the results obtained via Local Feature-Based, dropout can be said to be accurately predicted using grades of a few core courses, so there is no need for a complex features extraction process; (iii) considering temporal aspects of the data does not seem to contribute to the prediction performance although it increases computational costs as the model complexity increases.
对大学来说,识别和监控可能辍学的学生是一个至关重要的问题。及早发现可以让学校进行干预,解决问题并留住学生。先前对高危学生早期检测的研究选择了使用预测模型,但由于学生教育经历中存在大量可变特征,因此对不同算法和方法的适用性进行全面评估变得复杂。预测模型在其振幅、时间性和所采用的学习算法方面各不相同。振幅指的是模型在多个度上运行的能力,而时间性通常被认为是由于数据的自然时间方面。在缺乏学习算法的比较框架的情况下,本文的目的是提供这样一个分析,基于预测高等教育机构辍学的策略的拟议分类。实现了三种不同的学生表示(即基于全局特征、基于局部特征和时间序列),并结合了相应的学习算法。每一种方法的描述,以及它的实现过程,在本文中作为技术贡献呈现。实验基于巴西一所大学通过自动化管理系统获得的工商管理和建筑学两个学位的学生信息数据集。我们的研究结果可以总结为:(i)在三种提出的学生表征中,基于局部特征的方法是最适合预测退学的方法。除了提供高质量的结果外,基于局部特征的表示易于构建,并且与更复杂的模型相比,模型的构建成本更低;(ii)从Local Feature-Based得到的结果来看,可以用少数核心课程的成绩准确预测辍学率,不需要进行复杂的特征提取过程;(iii)考虑数据的时间方面似乎对预测性能没有贡献,尽管它会随着模型复杂性的增加而增加计算成本。
{"title":"An Analysis of Student Representation, Representative Features and Classification Algorithms to Predict Degree Dropout","authors":"R. Manrique, B. Nunes, O. Mariño, M. Casanova, Terhi Nurmikko-Fuller","doi":"10.1145/3303772.3303800","DOIUrl":"https://doi.org/10.1145/3303772.3303800","url":null,"abstract":"Identifying and monitoring students who are likely to dropout is a vital issue for universities. Early detection allows institutions to intervene, addressing problems and retaining students. Prior research into the early detection of at-risk students has opted for the use of predictive models, but a comprehensive assessment of the suitability of different algorithms and approaches is complicated by the large number of variable features that constitute a student's educational experience. Predictive models vary in terms of their amplitude, temporality and the learning algorithms employed. While amplitude refers to the ability of the model to operate on multiple degrees, temporality is often considered due to the natural temporal aspect of the data. In the absence of a comparative framework of learning algorithms, the aim of this paper has been to provide such an analysis, based on a proposed classification of strategies for predicting dropouts in Higher Education Institutions. Three different student representations are implemented (namely Global Feature-Based, Local Feature-Based, and Time Series) in conjunction with the appropriate learning algorithms for each of them. A description of each approach, as well as its implementation process, are presented in this paper as technical contributions. An experiment based on a dataset of student information from two degrees, namely Business Administration and Architecture, acquired through an automated management system from a university in Brazil is used. Our findings can be summarized as: (i) of the three proposed student representations, the Local Feature-Based was the most suitable approach for predicting dropout. In addition to providing high quality results, the Local Feature-Based representations are simple to build, and the construction of the model is less expensive when compared to more complex ones; (ii) as a conclusion of the results obtained via Local Feature-Based, dropout can be said to be accurately predicted using grades of a few core courses, so there is no need for a complex features extraction process; (iii) considering temporal aspects of the data does not seem to contribute to the prediction performance although it increases computational costs as the model complexity increases.","PeriodicalId":382957,"journal":{"name":"Proceedings of the 9th International Conference on Learning Analytics & Knowledge","volume":"35 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114834724","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 27
Measuring Knowledge Gaps in Student Responses by Mining Networked Representations of Texts 通过挖掘文本的网络表示来测量学生回答中的知识差距
Chen Qiao, Xiao Hu
Gaps between knowledge sources are interesting to various stakeholders: they might indicate potential misconceptions awaiting correction, complex or novel knowledge that requires careful delivery or studying. Motivated by these underlying values, this study explores the knowledge gap phenomenon in the context of student textual responses. In the method proposed in this study, discourses are first mapped into structured knowledge spaces where gaps between correct/incorrect responses and assessed knowledge are measured by network-based metrics. Empirical results demonstrate the effectiveness of the proposed method in measuring gaps in student responses. The networked representation of texts proposed in this study is novel in quantitatively framing gaps of knowledge. It also offers a set of validated metrics for analyzing student responses in research and practice.
知识来源之间的差距对各种利益相关者都很有趣:它们可能表明等待纠正的潜在误解,需要仔细传递或研究的复杂或新颖的知识。在这些潜在价值观的推动下,本研究探讨了学生语篇反应中的知识鸿沟现象。在本研究中提出的方法中,话语首先被映射到结构化的知识空间中,其中正确/不正确的回答与评估知识之间的差距通过基于网络的度量来衡量。实证结果证明了所提出的方法在测量学生反应差距方面的有效性。本研究中提出的文本网络表示在定量框架知识差距方面是新颖的。它还提供了一套有效的指标来分析学生在研究和实践中的反应。
{"title":"Measuring Knowledge Gaps in Student Responses by Mining Networked Representations of Texts","authors":"Chen Qiao, Xiao Hu","doi":"10.1145/3303772.3303822","DOIUrl":"https://doi.org/10.1145/3303772.3303822","url":null,"abstract":"Gaps between knowledge sources are interesting to various stakeholders: they might indicate potential misconceptions awaiting correction, complex or novel knowledge that requires careful delivery or studying. Motivated by these underlying values, this study explores the knowledge gap phenomenon in the context of student textual responses. In the method proposed in this study, discourses are first mapped into structured knowledge spaces where gaps between correct/incorrect responses and assessed knowledge are measured by network-based metrics. Empirical results demonstrate the effectiveness of the proposed method in measuring gaps in student responses. The networked representation of texts proposed in this study is novel in quantitatively framing gaps of knowledge. It also offers a set of validated metrics for analyzing student responses in research and practice.","PeriodicalId":382957,"journal":{"name":"Proceedings of the 9th International Conference on Learning Analytics & Knowledge","volume":"28 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126134295","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
期刊
Proceedings of the 9th International Conference on Learning Analytics & Knowledge
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1