首页 > 最新文献

Proceedings of the Tenth International Conference on Learning Analytics & Knowledge最新文献

英文 中文
From childhood to maturity: Are we there yet? Mapping the intellectual progress in learning analytics during the past decade 从童年到成熟:我们到了吗?描绘过去十年学习分析的智力进步
Z. Papamitsiou, M. Giannakos, X. Ochoa
This study aims to identify the conceptual structure and the thematic progress in Learning Analytics (evolution) and to elaborate on backbone/emerging topics in the field (maturity) from 2011 to September 2019. To address this objective, this paper employs hierarchical clustering, strategic diagrams and network analysis to construct the intellectual map of the Learning Analytics community and to visualize the thematic landscape in this field, using co-word analysis. Overall, a total of 459 papers from the proceedings of the Learning Analytics and Knowledge (LAK) conference and 168 articles published in the Journal of Learning Analytics (JLA), and the respective 3092 author-assigned keywords and 4051 machine-extracted key-phrases, were included in the analyses. The results indicate that the community has significantly focused in areas like Massive Open Online Courses and visualizations; Learning Management Systems, assessment and self-regulated learning are also basic topics, yet topics like natural language processing and orchestration are emerging. The analysis highlights the shift of the research interest throughout the past decade, and the rise of new topics, comprising evidence that the field is expanding. Limitations of the approach and future work plans conclude the paper.
本研究旨在确定学习分析(进化)的概念结构和主题进展,并详细阐述该领域从2011年到2019年9月的骨干/新兴主题(成熟度)。为了实现这一目标,本文采用分层聚类、战略图和网络分析来构建学习分析社区的智力地图,并使用共词分析来可视化该领域的主题景观。总体而言,来自学习分析与知识(LAK)会议的459篇论文和发表在学习分析杂志(JLA)上的168篇文章,以及各自的3092个作者指定的关键字和4051个机器提取的关键短语,被纳入分析。结果表明,社区非常关注大规模开放在线课程和可视化等领域;学习管理系统、评估和自我调节学习也是基本主题,但自然语言处理和编排等主题正在兴起。该分析强调了过去十年研究兴趣的转变,以及新主题的兴起,包括该领域正在扩大的证据。该方法的局限性和未来的工作计划是本文的结论。
{"title":"From childhood to maturity: Are we there yet? Mapping the intellectual progress in learning analytics during the past decade","authors":"Z. Papamitsiou, M. Giannakos, X. Ochoa","doi":"10.1145/3375462.3375519","DOIUrl":"https://doi.org/10.1145/3375462.3375519","url":null,"abstract":"This study aims to identify the conceptual structure and the thematic progress in Learning Analytics (evolution) and to elaborate on backbone/emerging topics in the field (maturity) from 2011 to September 2019. To address this objective, this paper employs hierarchical clustering, strategic diagrams and network analysis to construct the intellectual map of the Learning Analytics community and to visualize the thematic landscape in this field, using co-word analysis. Overall, a total of 459 papers from the proceedings of the Learning Analytics and Knowledge (LAK) conference and 168 articles published in the Journal of Learning Analytics (JLA), and the respective 3092 author-assigned keywords and 4051 machine-extracted key-phrases, were included in the analyses. The results indicate that the community has significantly focused in areas like Massive Open Online Courses and visualizations; Learning Management Systems, assessment and self-regulated learning are also basic topics, yet topics like natural language processing and orchestration are emerging. The analysis highlights the shift of the research interest throughout the past decade, and the rise of new topics, comprising evidence that the field is expanding. Limitations of the approach and future work plans conclude the paper.","PeriodicalId":355800,"journal":{"name":"Proceedings of the Tenth International Conference on Learning Analytics & Knowledge","volume":"61 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126466635","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
Analytics of time management and learning strategies for effective online learning in blended environments 在混合环境中有效在线学习的时间管理和学习策略分析
Nora'ayu Ahmad Uzir, D. Gašević, J. Jovanović, W. Matcha, Lisa-Angelique Lim, Anthea Fudge
This paper reports on the findings of a study that proposed a novel learning analytics methodology that combines three complimentary techniques - agglomerative hierarchical clustering, epistemic network analysis, and process mining. The methodology allows for identification and interpretation of self-regulated learning in terms of the use of learning strategies. The main advantage of the new technique over the existing ones is that it combines the time management and learning tactic dimensions of learning strategies, which are typically studied in isolation. The new technique allows for novel insights into learning strategies by studying the frequency of, strength of connections between, and ordering and time of execution of time management and learning tactics. The technique was validated in a study that was conducted on the trace data of first-year undergraduate students who were enrolled into two consecutive offerings (N2017 = 250 and N2018 = 232) of a course at an Australian university. The application of the proposed technique identified four strategy groups derived from three distinct time management tactics and five learning tactics. The tactics and strategies identified with the technique were correlated with academic performance and were interpreted according to the established theories and practices of self-regulated learning.
本文报告了一项研究的结果,该研究提出了一种新的学习分析方法,该方法结合了三种互补的技术-聚集分层聚类,认知网络分析和过程挖掘。该方法允许在学习策略的使用方面识别和解释自我调节学习。新技术相对于现有技术的主要优势在于,它结合了学习策略的时间管理和学习策略两个维度,而这两个维度通常是单独研究的。这项新技术通过研究时间管理和学习策略的执行频率、联系强度、顺序和时间,为学习策略提供了新的见解。该技术在一项研究中得到了验证,该研究对澳大利亚一所大学一年级本科生的跟踪数据进行了研究,这些学生连续参加了两门课程(N2017 = 250和N2018 = 232)。所提出的技术的应用确定了从三个不同的时间管理策略和五个学习策略派生的四个策略组。与该技术相关的战术和策略与学业成绩相关,并根据已建立的自我调节学习理论和实践进行解释。
{"title":"Analytics of time management and learning strategies for effective online learning in blended environments","authors":"Nora'ayu Ahmad Uzir, D. Gašević, J. Jovanović, W. Matcha, Lisa-Angelique Lim, Anthea Fudge","doi":"10.1145/3375462.3375493","DOIUrl":"https://doi.org/10.1145/3375462.3375493","url":null,"abstract":"This paper reports on the findings of a study that proposed a novel learning analytics methodology that combines three complimentary techniques - agglomerative hierarchical clustering, epistemic network analysis, and process mining. The methodology allows for identification and interpretation of self-regulated learning in terms of the use of learning strategies. The main advantage of the new technique over the existing ones is that it combines the time management and learning tactic dimensions of learning strategies, which are typically studied in isolation. The new technique allows for novel insights into learning strategies by studying the frequency of, strength of connections between, and ordering and time of execution of time management and learning tactics. The technique was validated in a study that was conducted on the trace data of first-year undergraduate students who were enrolled into two consecutive offerings (N2017 = 250 and N2018 = 232) of a course at an Australian university. The application of the proposed technique identified four strategy groups derived from three distinct time management tactics and five learning tactics. The tactics and strategies identified with the technique were correlated with academic performance and were interpreted according to the established theories and practices of self-regulated learning.","PeriodicalId":355800,"journal":{"name":"Proceedings of the Tenth International Conference on Learning Analytics & Knowledge","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128189211","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 47
#Confused and beyond: detecting confusion in course forums using students' hashtags #困惑和超越:使用学生的标签来检测课程论坛中的困惑
Shay A. Geller, Nicholas Hoernle, Y. Gal, A. Segal, Amy X. Zhang, David R Karger, M. Facciotti, Michele Igo
Students' confusion is a barrier for learning, contributing to loss of motivation and to disengagement with course materials. However, detecting students' confusion in large-scale courses is both time and resource intensive. This paper provides a new approach for confusion detection in online forums that is based on harnessing the power of students' self-reported affective states (reported using a set of pre-defined hashtags). It presents a rule for labeling confusion, based on students' hashtags in their posts, that is shown to align with teachers' judgement. We use this labeling rule to inform the design of an automated classifier for confusion detection for the case when there are no self-reported hashtags present in the test set. We demonstrate this approach in a large scale Biology course using the Nota Bene annotation platform. This work lays the foundation to empower teachers with better support tools for detecting and alleviating confusion in online courses.
学生的困惑是学习的障碍,会导致他们失去动力,对课程材料不感兴趣。然而,在大型课程中发现学生的困惑既费时又耗资源。本文提供了一种在在线论坛中检测混淆的新方法,该方法基于利用学生自我报告的情感状态的力量(使用一组预定义的标签进行报告)。它提出了一个标签混淆的规则,基于学生在他们的帖子中的标签,这与教师的判断是一致的。我们使用这个标记规则来通知自动分类器的设计,以便在测试集中没有自我报告的标签时进行混淆检测。我们在使用Nota Bene注释平台的大型生物学课程中演示了这种方法。这项工作为教师提供更好的支持工具,以发现和减轻在线课程中的困惑奠定了基础。
{"title":"#Confused and beyond: detecting confusion in course forums using students' hashtags","authors":"Shay A. Geller, Nicholas Hoernle, Y. Gal, A. Segal, Amy X. Zhang, David R Karger, M. Facciotti, Michele Igo","doi":"10.1145/3375462.3375485","DOIUrl":"https://doi.org/10.1145/3375462.3375485","url":null,"abstract":"Students' confusion is a barrier for learning, contributing to loss of motivation and to disengagement with course materials. However, detecting students' confusion in large-scale courses is both time and resource intensive. This paper provides a new approach for confusion detection in online forums that is based on harnessing the power of students' self-reported affective states (reported using a set of pre-defined hashtags). It presents a rule for labeling confusion, based on students' hashtags in their posts, that is shown to align with teachers' judgement. We use this labeling rule to inform the design of an automated classifier for confusion detection for the case when there are no self-reported hashtags present in the test set. We demonstrate this approach in a large scale Biology course using the Nota Bene annotation platform. This work lays the foundation to empower teachers with better support tools for detecting and alleviating confusion in online courses.","PeriodicalId":355800,"journal":{"name":"Proceedings of the Tenth International Conference on Learning Analytics & Knowledge","volume":"35 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125893818","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
Automated insightful drill-down recommendations for learning analytics dashboards 为学习分析仪表板提供自动深入的建议
Shiva Shabaninejad, Hassan Khosravi, M. Indulska, Aneesha Bakharia, P. Isaías
The big data revolution is an exciting opportunity for universities, which typically have rich and complex digital data on their learners. It has motivated many universities around the world to invest in the development and implementation of learning analytics dashboards (LADs). These dashboards commonly make use of interactive visualisation widgets to assist educators in understanding and making informed decisions about the learning process. A common operation in analytical dashboards is a 'drill-down', which in an educational setting allows users to explore the behaviour of sub-populations of learners by progressively adding filters. Nevertheless, drill-down challenges exist, which hamper the most effective use of the data, especially by users without a formal background in data analysis. Accordingly, in this paper, we address this problem by proposing an approach that recommends insightful drill-downs to LAD users. We present results from an application of our proposed approach using an existing LAD. A set of insightful drill-down criteria from a course with 875 students are explored and discussed.
对于大学来说,大数据革命是一个令人兴奋的机会,因为大学通常拥有丰富而复杂的学生数字数据。它促使世界各地的许多大学投资于学习分析仪表板(LADs)的开发和实施。这些仪表板通常使用交互式可视化小部件来帮助教育工作者理解和做出有关学习过程的明智决策。分析仪表板中的一个常见操作是“向下钻取”,在教育环境中,它允许用户通过逐步添加过滤器来探索学习者子群体的行为。然而,深入的挑战仍然存在,这阻碍了数据的最有效利用,特别是对于没有正式数据分析背景的用户。因此,在本文中,我们通过提出一种方法来解决这个问题,该方法向LAD用户推荐有洞察力的钻取。我们将介绍我们建议的方法在现有LAD中的应用结果。从一门有875名学生的课程中探索和讨论了一套富有洞察力的深入标准。
{"title":"Automated insightful drill-down recommendations for learning analytics dashboards","authors":"Shiva Shabaninejad, Hassan Khosravi, M. Indulska, Aneesha Bakharia, P. Isaías","doi":"10.1145/3375462.3375539","DOIUrl":"https://doi.org/10.1145/3375462.3375539","url":null,"abstract":"The big data revolution is an exciting opportunity for universities, which typically have rich and complex digital data on their learners. It has motivated many universities around the world to invest in the development and implementation of learning analytics dashboards (LADs). These dashboards commonly make use of interactive visualisation widgets to assist educators in understanding and making informed decisions about the learning process. A common operation in analytical dashboards is a 'drill-down', which in an educational setting allows users to explore the behaviour of sub-populations of learners by progressively adding filters. Nevertheless, drill-down challenges exist, which hamper the most effective use of the data, especially by users without a formal background in data analysis. Accordingly, in this paper, we address this problem by proposing an approach that recommends insightful drill-downs to LAD users. We present results from an application of our proposed approach using an existing LAD. A set of insightful drill-down criteria from a course with 875 students are explored and discussed.","PeriodicalId":355800,"journal":{"name":"Proceedings of the Tenth International Conference on Learning Analytics & Knowledge","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115022968","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
R2DE: a NLP approach to estimating IRT parameters of newly generated questions R2DE:一种估计新生成问题的IRT参数的NLP方法
Luca Benedetto, Andrea Cappelli, R. Turrin, P. Cremonesi
The main objective of exams consists in performing an assessment of students' expertise on a specific subject. Such expertise, also referred to as skill or knowledge level, can then be leveraged in different ways (e.g., to assign a grade to the students, to understand whether a student might need some support, etc.). Similarly, the questions appearing in the exams have to be assessed in some way before being used to evaluate students. Standard approaches to questions' assessment are either subjective (e.g., assessment by human experts) or introduce a long delay in the process of question generation (e.g., pretesting with real students). In this work we introduce R2DE (which is a Regressor for Difficulty and Discrimination Estimation), a model capable of assessing newly generated multiple-choice questions by looking at the text of the question and the text of the possible choices. In particular, it can estimate the difficulty and the discrimination of each question, as they are defined in Item Response Theory. We also present the results of extensive experiments we carried out on a real world large scale dataset coming from an e-learning platform, showing that our model can be used to perform an initial assessment of newly created questions and ease some of the problems that arise in question generation.
考试的主要目的在于评估学生对某一特定学科的专业知识。这样的专业知识,也被称为技能或知识水平,然后可以以不同的方式加以利用(例如,给学生分配分数,了解学生是否需要一些支持,等等)。同样,考试中出现的问题在用来评估学生之前,也必须以某种方式进行评估。问题评估的标准方法要么是主观的(例如,由人类专家评估),要么在问题生成过程中引入很长的延迟(例如,与真实学生进行预测)。在这项工作中,我们引入了R2DE(难度和区分估计的回归因子),这是一个能够通过查看问题文本和可能选择的文本来评估新生成的多项选择题的模型。特别是,它可以估计每个问题的难度和歧视,因为它们在项目反应理论中定义。我们还展示了我们在来自电子学习平台的真实世界大规模数据集上进行的广泛实验的结果,表明我们的模型可用于对新创建的问题进行初步评估,并缓解问题生成过程中出现的一些问题。
{"title":"R2DE: a NLP approach to estimating IRT parameters of newly generated questions","authors":"Luca Benedetto, Andrea Cappelli, R. Turrin, P. Cremonesi","doi":"10.1145/3375462.3375517","DOIUrl":"https://doi.org/10.1145/3375462.3375517","url":null,"abstract":"The main objective of exams consists in performing an assessment of students' expertise on a specific subject. Such expertise, also referred to as skill or knowledge level, can then be leveraged in different ways (e.g., to assign a grade to the students, to understand whether a student might need some support, etc.). Similarly, the questions appearing in the exams have to be assessed in some way before being used to evaluate students. Standard approaches to questions' assessment are either subjective (e.g., assessment by human experts) or introduce a long delay in the process of question generation (e.g., pretesting with real students). In this work we introduce R2DE (which is a Regressor for Difficulty and Discrimination Estimation), a model capable of assessing newly generated multiple-choice questions by looking at the text of the question and the text of the possible choices. In particular, it can estimate the difficulty and the discrimination of each question, as they are defined in Item Response Theory. We also present the results of extensive experiments we carried out on a real world large scale dataset coming from an e-learning platform, showing that our model can be used to perform an initial assessment of newly created questions and ease some of the problems that arise in question generation.","PeriodicalId":355800,"journal":{"name":"Proceedings of the Tenth International Conference on Learning Analytics & Knowledge","volume":"115 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-01-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123456834","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 27
Predicting student performance in interactive online question pools using mouse interaction features 使用鼠标交互功能预测学生在交互式在线问题池中的表现
Huan Wei, Haotian Li, Meng Xia, Yong Wang, Huamin Qu
Modeling student learning and further predicting the performance is a well-established task in online learning and is crucial to personalized education by recommending different learning resources to different students based on their needs. Interactive online question pools (e.g., educational game platforms), an important component of online education, have become increasingly popular in recent years. However, most existing work on student performance prediction targets at online learning platforms with a well-structured curriculum, predefined question order and accurate knowledge tags provided by domain experts. It remains unclear how to conduct student performance prediction in interactive online question pools without such well-organized question orders or knowledge tags by experts. In this paper, we propose a novel approach to boost student performance prediction in interactive online question pools by further considering student interaction features and the similarity between questions. Specifically, we introduce new features (e.g., think time, first attempt, and first drag-and-drop) based on student mouse movement trajectories to delineate students' problem-solving details. In addition, heterogeneous information network is applied to integrating students' historical problem-solving information on similar questions, enhancing student performance predictions on a new question. We evaluate the proposed approach on the dataset from a real-world interactive question pool using four typical machine learning models. The result shows that our approach can achieve a much higher accuracy for student performance prediction in interactive online question pools than the traditional way of only using the statistical features (e.g., students' historical question scores) in various models. We further discuss the performance consistency of our approach across different prediction models and question classes, as well as the importance of the proposed interaction features in detail.
对学生的学习进行建模并进一步预测学生的学习表现是在线学习中一项成熟的任务,对于根据不同学生的需求推荐不同的学习资源进行个性化教育至关重要。交互式在线题库(如教育游戏平台)是在线教育的重要组成部分,近年来越来越受欢迎。然而,大多数现有的学生成绩预测工作都是针对在线学习平台,这些平台具有结构良好的课程、预定义的问题顺序和由领域专家提供的准确的知识标签。目前尚不清楚如何在没有专家组织的问题顺序或知识标签的情况下,在交互式在线问题池中进行学生表现预测。在本文中,我们提出了一种新的方法,通过进一步考虑学生的互动特征和问题之间的相似性来提高交互式在线问题池中的学生成绩预测。具体来说,我们根据学生的鼠标运动轨迹引入了新的功能(例如,思考时间、第一次尝试和第一次拖放),以描绘学生解决问题的细节。此外,应用异构信息网络整合学生对同类问题的历史解题信息,增强学生对新问题的成绩预测。我们使用四种典型的机器学习模型对来自现实世界交互式问题池的数据集进行了评估。结果表明,我们的方法比传统方法在各种模型中仅使用统计特征(例如学生的历史问题分数)的方法在交互式在线问题池中可以实现更高的学生成绩预测精度。我们进一步讨论了我们的方法在不同预测模型和问题类之间的性能一致性,以及所提出的交互特征的重要性。
{"title":"Predicting student performance in interactive online question pools using mouse interaction features","authors":"Huan Wei, Haotian Li, Meng Xia, Yong Wang, Huamin Qu","doi":"10.1145/3375462.3375521","DOIUrl":"https://doi.org/10.1145/3375462.3375521","url":null,"abstract":"Modeling student learning and further predicting the performance is a well-established task in online learning and is crucial to personalized education by recommending different learning resources to different students based on their needs. Interactive online question pools (e.g., educational game platforms), an important component of online education, have become increasingly popular in recent years. However, most existing work on student performance prediction targets at online learning platforms with a well-structured curriculum, predefined question order and accurate knowledge tags provided by domain experts. It remains unclear how to conduct student performance prediction in interactive online question pools without such well-organized question orders or knowledge tags by experts. In this paper, we propose a novel approach to boost student performance prediction in interactive online question pools by further considering student interaction features and the similarity between questions. Specifically, we introduce new features (e.g., think time, first attempt, and first drag-and-drop) based on student mouse movement trajectories to delineate students' problem-solving details. In addition, heterogeneous information network is applied to integrating students' historical problem-solving information on similar questions, enhancing student performance predictions on a new question. We evaluate the proposed approach on the dataset from a real-world interactive question pool using four typical machine learning models. The result shows that our approach can achieve a much higher accuracy for student performance prediction in interactive online question pools than the traditional way of only using the statistical features (e.g., students' historical question scores) in various models. We further discuss the performance consistency of our approach across different prediction models and question classes, as well as the importance of the proposed interaction features in detail.","PeriodicalId":355800,"journal":{"name":"Proceedings of the Tenth International Conference on Learning Analytics & Knowledge","volume":"36 8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-01-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121164967","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 28
Are forum networks social networks?: a methodological perspective 论坛网络是社交网络吗?方法论观点
Oleksandra Poquet, L. Tupikina, Marc Santolini
The mission of learning analytics (LA) is to improve learner experiences using the insights from digitally collected learner data. While some areas of LA are maturing, this is not consistent across all LA specialisations. For instance, LA for social learning lack validated approaches to account for the effects of cross-course variability in learner behavior. Although the associations between network structure and learning outcomes have been examined in the context of online forums, it remains unclear whether such associations represent bona fide social effects, or merely reflect heterogeneity in individual posting behavior, leading to seemingly complex but artefactual social network structures. We argue that to start addressing this issue, posting activity should be explicitly included and modelled in forum network representations. To gain insight to what extent learner degree and edge weight are merely derivatives of learner activity, we construct random models that control for the level of posting and post properties, such as popularity and thread hierarchy level. Analysis of forum networks in twenty online courses presented in this paper demonstrates that individual posting behavior is highly predictive of both the breadth (degree) and frequency (strength) in forum communication networks. This implies that, in the context of forum-based modelling, degree and frequency may not reflect the social dynamics. However, results suggest that clustering of the network structure is not a derivative of individual posting behaviour. Hence, weighted local clustering coefficient may be a better proxy for social relationships. The empirical results are relevant to scientists interested in social interactions and learner networks in digital learning, and more generally to researchers interested in deriving informative social network models from online forums.
学习分析(LA)的使命是利用数字化收集的学习者数据的见解来改善学习者的体验。虽然洛杉矶的一些领域正在走向成熟,但并非所有的专业领域都是如此。例如,社会学习的LA缺乏有效的方法来解释学习者行为的跨课程变异性的影响。尽管网络结构和学习成果之间的关联已经在在线论坛的背景下进行了研究,但尚不清楚这种关联是否代表真正的社会效应,或者仅仅反映了个人发帖行为的异质性,从而导致了看似复杂但人为的社会网络结构。我们认为,要开始解决这个问题,发帖活动应该明确地包括在论坛网络表示中,并建立模型。为了深入了解学习者程度和边缘权重在多大程度上仅仅是学习者活动的衍生物,我们构建了随机模型来控制发布级别和发布属性,例如流行度和线程层次级别。本文对20门在线课程的论坛网络进行了分析,结果表明,个人发帖行为对论坛传播网络的广度(程度)和频率(强度)都具有高度的预测性。这意味着,在基于论坛的建模方面,程度和频率可能不能反映社会动态。然而,结果表明,网络结构的聚类不是个人张贴行为的衍生物。因此,加权局部聚类系数可能是社会关系的更好代理。实证结果适用于对数字学习中的社会互动和学习者网络感兴趣的科学家,以及对从在线论坛中推导信息社会网络模型感兴趣的研究人员。
{"title":"Are forum networks social networks?: a methodological perspective","authors":"Oleksandra Poquet, L. Tupikina, Marc Santolini","doi":"10.1145/3375462.3375531","DOIUrl":"https://doi.org/10.1145/3375462.3375531","url":null,"abstract":"The mission of learning analytics (LA) is to improve learner experiences using the insights from digitally collected learner data. While some areas of LA are maturing, this is not consistent across all LA specialisations. For instance, LA for social learning lack validated approaches to account for the effects of cross-course variability in learner behavior. Although the associations between network structure and learning outcomes have been examined in the context of online forums, it remains unclear whether such associations represent bona fide social effects, or merely reflect heterogeneity in individual posting behavior, leading to seemingly complex but artefactual social network structures. We argue that to start addressing this issue, posting activity should be explicitly included and modelled in forum network representations. To gain insight to what extent learner degree and edge weight are merely derivatives of learner activity, we construct random models that control for the level of posting and post properties, such as popularity and thread hierarchy level. Analysis of forum networks in twenty online courses presented in this paper demonstrates that individual posting behavior is highly predictive of both the breadth (degree) and frequency (strength) in forum communication networks. This implies that, in the context of forum-based modelling, degree and frequency may not reflect the social dynamics. However, results suggest that clustering of the network structure is not a derivative of individual posting behaviour. Hence, weighted local clustering coefficient may be a better proxy for social relationships. The empirical results are relevant to scientists interested in social interactions and learner networks in digital learning, and more generally to researchers interested in deriving informative social network models from online forums.","PeriodicalId":355800,"journal":{"name":"Proceedings of the Tenth International Conference on Learning Analytics & Knowledge","volume":"65 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131488073","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 17
Assessment that matters: balancing reliability and learner-centered pedagogy in MOOC assessment 重要的评估:在MOOC评估中平衡可靠性和以学习者为中心的教学法
Giora Alexandron, Mary Ellen Wiltrout, Aviram Berg, José A. Ruipérez Valiente
Learner-centered pedagogy highlights active learning and formative feedback. Instructors often incentivize learners to engage in such formative assessment activities by crediting their completion and score in the final grade, a pedagogical practice that is very relevant to MOOCs as well. However, previous studies have shown that too many MOOC learners exploit the anonymity to abuse the formative feedback, which is critical in the learning process, to earn points without effort. Unfortunately, limiting feedback and access to decrease cheating is counter-pedagogic and reduces the openness of MOOCs. We aimed to identify and analyze a MOOC assessment strategy that balances this tension between learner-centered pedagogy, incentive design, and reliability of the assessment. In this study, we evaluated an assessment model that MITx Biology introduced in a MOOC to reduce cheating with respect to its effect on two aspects of learner behavior - the amount of cheating and learners' engagement in formative course activities. The contribution of the paper is twofold. First, this work provides MOOC designers with an 'analytically-verified' MOOC assessment model to reduce cheating without compromising learner engagement in formative assessments. Second, this study provides a learning analytics methodology to approximate the effect of such an intervention.
以学习者为中心的教学法强调主动学习和形成性反馈。教师通常会将学习者的完成情况和得分计入最终成绩,以此来激励学习者参与这种形成性评估活动,这种教学实践也与mooc非常相关。然而,之前的研究表明,有太多的MOOC学习者利用匿名性来滥用形成性反馈,而形成性反馈在学习过程中至关重要,从而不劳而获。不幸的是,限制反馈和获取以减少作弊是反教育的,降低了mooc的开放性。我们旨在确定和分析一种MOOC评估策略,以平衡以学习者为中心的教学法、激励设计和评估可靠性之间的紧张关系。在本研究中,我们评估了MITx生物学在MOOC中引入的一个评估模型,以减少作弊对学习者行为的两个方面的影响——作弊的数量和学习者对形成性课程活动的参与。这篇论文的贡献是双重的。首先,这项工作为MOOC设计师提供了一个“分析验证”的MOOC评估模型,以减少作弊,同时不影响学习者对形成性评估的参与。其次,本研究提供了一种学习分析方法来近似这种干预的效果。
{"title":"Assessment that matters: balancing reliability and learner-centered pedagogy in MOOC assessment","authors":"Giora Alexandron, Mary Ellen Wiltrout, Aviram Berg, José A. Ruipérez Valiente","doi":"10.1145/3375462.3375464","DOIUrl":"https://doi.org/10.1145/3375462.3375464","url":null,"abstract":"Learner-centered pedagogy highlights active learning and formative feedback. Instructors often incentivize learners to engage in such formative assessment activities by crediting their completion and score in the final grade, a pedagogical practice that is very relevant to MOOCs as well. However, previous studies have shown that too many MOOC learners exploit the anonymity to abuse the formative feedback, which is critical in the learning process, to earn points without effort. Unfortunately, limiting feedback and access to decrease cheating is counter-pedagogic and reduces the openness of MOOCs. We aimed to identify and analyze a MOOC assessment strategy that balances this tension between learner-centered pedagogy, incentive design, and reliability of the assessment. In this study, we evaluated an assessment model that MITx Biology introduced in a MOOC to reduce cheating with respect to its effect on two aspects of learner behavior - the amount of cheating and learners' engagement in formative course activities. The contribution of the paper is twofold. First, this work provides MOOC designers with an 'analytically-verified' MOOC assessment model to reduce cheating without compromising learner engagement in formative assessments. Second, this study provides a learning analytics methodology to approximate the effect of such an intervention.","PeriodicalId":355800,"journal":{"name":"Proceedings of the Tenth International Conference on Learning Analytics & Knowledge","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127890966","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 16
Macro MOOC learning analytics: exploring trends across global and regional providers 宏观MOOC学习分析:探索全球和区域供应商的趋势
José A. Ruipérez Valiente, Matt Jenner, T. Staubitz, Xitong Li, Tobias Rohloff, Sherif A. Halawa, C. Turró, Yuan Cheng, Jiayin Zhang, Ignacio M. Despujol, J. Reich
Massive Open Online Courses (MOOCs) have opened new educational possibilities for learners around the world. Most of the research and spotlight has been concentrated on a handful of global, English-language providers, but there are a growing number of regional providers of MOOCS in languages other than English. In this work, we have partnered with thirteen MOOC providers from around the world. We apply a multi-platform approach generating a joint and comparable analysis with data from millions of learners. This allows us to examine learning analytics trends at a macro level across various MOOC providers, with a goal of understanding which MOOC trends are globally universal and which of them are context-dependent. The analysis reports preliminary results on the differences and similarities of trends based on the country of origin, level of education, gender and age of their learners across global and regional MOOC providers. This study exemplifies the potential of macro learning analytics in MOOCs to understand the ecosystem and inform the whole community, while calling for more large scale studies in learning analytics through partnerships among researchers and institutions.
大规模在线开放课程(MOOCs)为世界各地的学习者开辟了新的教育可能性。大多数研究和关注都集中在少数几家全球性的英语提供商身上,但也有越来越多的地区性mooc提供商提供英语以外的语言。在这项工作中,我们与来自世界各地的13家MOOC提供商合作。我们采用多平台方法,从数百万学习者的数据中生成联合和可比较的分析。这使我们能够在宏观层面上检查各种MOOC提供商的学习分析趋势,目的是了解哪些MOOC趋势是全球通用的,哪些是与环境相关的。该分析报告了基于全球和地区MOOC提供商的原籍国、教育水平、学习者性别和年龄的趋势差异和相似之处的初步结果。这项研究举例说明了宏观学习分析在mooc中理解生态系统和为整个社区提供信息的潜力,同时呼吁通过研究人员和机构之间的合作,进行更多大规模的学习分析研究。
{"title":"Macro MOOC learning analytics: exploring trends across global and regional providers","authors":"José A. Ruipérez Valiente, Matt Jenner, T. Staubitz, Xitong Li, Tobias Rohloff, Sherif A. Halawa, C. Turró, Yuan Cheng, Jiayin Zhang, Ignacio M. Despujol, J. Reich","doi":"10.1145/3375462.3375482","DOIUrl":"https://doi.org/10.1145/3375462.3375482","url":null,"abstract":"Massive Open Online Courses (MOOCs) have opened new educational possibilities for learners around the world. Most of the research and spotlight has been concentrated on a handful of global, English-language providers, but there are a growing number of regional providers of MOOCS in languages other than English. In this work, we have partnered with thirteen MOOC providers from around the world. We apply a multi-platform approach generating a joint and comparable analysis with data from millions of learners. This allows us to examine learning analytics trends at a macro level across various MOOC providers, with a goal of understanding which MOOC trends are globally universal and which of them are context-dependent. The analysis reports preliminary results on the differences and similarities of trends based on the country of origin, level of education, gender and age of their learners across global and regional MOOC providers. This study exemplifies the potential of macro learning analytics in MOOCs to understand the ecosystem and inform the whole community, while calling for more large scale studies in learning analytics through partnerships among researchers and institutions.","PeriodicalId":355800,"journal":{"name":"Proceedings of the Tenth International Conference on Learning Analytics & Knowledge","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121768008","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 17
期刊
Proceedings of the Tenth International Conference on Learning Analytics & Knowledge
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1