首页 > 最新文献

Computers & Education最新文献

英文 中文
Investigating behavioral and cognitive patterns among high-performers and low-performers in Co-viewing video lectures 调查共同观看视频讲座中成绩好和成绩差的学生的行为和认知模式
IF 8.9 1区 教育学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-07-03 DOI: 10.1016/j.compedu.2024.105110
Zhongling Pi , Yuan Yang , Xin Zhao , Qiuyi Guo , Xiying Li

Co-viewing video lectures, where students watch lectures simultaneously with one or more remote peers and engage in interpersonal communication on learning tasks online, is becoming increasingly popular. However, there is a dearth of studies examining students' behavioral and cognitive patterns during the co-viewing process. This study employed eye-tracking and screen recording methods to examine undergraduate students' learning processes in co-viewing video lectures. It specifically focused on how students used video lectures and engaged in discussions to complete a design task. Lag sequential analysis of learning behaviors revealed that, compared to low-performers, high-performers were more engaged in behavioral sequences involving clarifying learning tasks. Furthermore, epistemic network analysis of conversations revealed that high-performers demonstrated stronger connections between deep-level knowledge and a high level of uptake in design skills. In contrast, low-performers exhibited more connections between superficial-level knowledge and a low level of uptake in these skills. The findings suggest that in co-viewing video lectures, it's crucial to engage students in clarifying behavioral sequences. Furthermore, the co-occurrence of deep-level knowledge, design skills, and a high level of uptake in shared ideas significantly enhances learning. Our research on learning processes suggests important strategies for students during co-viewing of video lectures: teachers are encouraged to design effective interactive activities and create suitable support interventions to enhance student learning performance in video lectures.

共同观看视频讲座,即学生与一个或多个远程同伴同时观看讲座,并就在线学习任务进行人际交流,正变得越来越流行。然而,对学生在共同观看过程中的行为和认知模式的研究却很少。本研究采用眼动跟踪和屏幕录制方法,考察了本科生在共同观看视频讲座时的学习过程。研究特别关注学生如何利用视频讲座和参与讨论来完成设计任务。对学习行为的滞后序列分析表明,与学习成绩差的学生相比,学习成绩好的学生更多地参与了涉及澄清学习任务的行为序列。此外,对对话进行的认识论网络分析显示,高分者在深层次知识和高水平设计技能吸收之间表现出更强的联系。相比之下,成绩差的学生则表现出更多的浅层知识与这些技能的低水平吸收之间的联系。研究结果表明,在共同观看视频讲座时,让学生参与澄清行为序列至关重要。此外,深层次知识、设计技能和对共同想法的高吸收水平的共同出现也能显著提高学习效果。我们对学习过程的研究为学生在共同观看视频讲座时提供了重要策略:鼓励教师设计有效的互动活动,并创建合适的支持干预措施,以提高学生在视频讲座中的学习成绩。
{"title":"Investigating behavioral and cognitive patterns among high-performers and low-performers in Co-viewing video lectures","authors":"Zhongling Pi ,&nbsp;Yuan Yang ,&nbsp;Xin Zhao ,&nbsp;Qiuyi Guo ,&nbsp;Xiying Li","doi":"10.1016/j.compedu.2024.105110","DOIUrl":"https://doi.org/10.1016/j.compedu.2024.105110","url":null,"abstract":"<div><p>Co-viewing video lectures, where students watch lectures simultaneously with one or more remote peers and engage in interpersonal communication on learning tasks online, is becoming increasingly popular. However, there is a dearth of studies examining students' behavioral and cognitive patterns during the co-viewing process. This study employed eye-tracking and screen recording methods to examine undergraduate students' learning processes in co-viewing video lectures. It specifically focused on how students used video lectures and engaged in discussions to complete a design task. Lag sequential analysis of learning behaviors revealed that, compared to low-performers, high-performers were more engaged in behavioral sequences involving clarifying learning tasks. Furthermore, epistemic network analysis of conversations revealed that high-performers demonstrated stronger connections between deep-level knowledge and a high level of uptake in design skills. In contrast, low-performers exhibited more connections between superficial-level knowledge and a low level of uptake in these skills. The findings suggest that in co-viewing video lectures, it's crucial to engage students in clarifying behavioral sequences. Furthermore, the co-occurrence of deep-level knowledge, design skills, and a high level of uptake in shared ideas significantly enhances learning. Our research on learning processes suggests important strategies for students during co-viewing of video lectures: teachers are encouraged to design effective interactive activities and create suitable support interventions to enhance student learning performance in video lectures.</p></div>","PeriodicalId":10568,"journal":{"name":"Computers & Education","volume":"219 ","pages":"Article 105110"},"PeriodicalIF":8.9,"publicationDate":"2024-07-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141543690","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Feasibility of adaptive teaching with technology: Which implementation conditions matter? 利用技术进行适应性教学的可行性:哪些实施条件很重要?
IF 8.9 1区 教育学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-07-02 DOI: 10.1016/j.compedu.2024.105108
Leonie Sibley , Andreas Lachner , Christine Plicht , Armin Fabian , Iris Backfisch , Katharina Scheiter , Thorsten Bohl

Adaptive teaching is regarded to address students' heterogeneity in schools and to individually support their learning. Technology may help to teach adaptively. However, it is still unclear whether realizing adaptive teaching with technology is a feasible teaching practice in real-world classrooms. More importantly, it is an open question which boundary conditions constrain the feasibility of adaptive teaching with technology. We realized a four-year co-design-project in which researchers and teachers co-constructively developed adaptive teaching units (duration: 3–4 weeks) by deliberately integrating technology across secondary education. To assess the feasibility of technology-enhanced adaptive teaching, we followed a sequential-explanatory mixed-methods approach during the co-design-process. We combined a quantitative study (N = 183), investigating students' learning gains and potential moderators, and a qualitative study by means of semi-structured teacher interviews (N = 3) on implementation conditions of the adaptive teaching units. We observed that the teaching units were particularly beneficial for students with low prior knowledge and when they were highly adaptive to students’ needs. Fine-grained qualitative findings indicated that formative assessments and consolidation phases were crucial for the feasibility of technology-enhanced adaptive teaching, as well as a parsimonious use of technologies. These findings indicate that the feasibility of adaptive teaching with technology depends on boundary conditions, highlighting the need for further support to unfold the potential of adaptive teaching.

适应性教学被认为是为了解决学校中学生的异质性问题,并为他们的学习提供个别支持。技术可能有助于自适应教学。然而,在现实世界的课堂中,利用技术实现自适应教学是否是一种可行的教学实践,目前还不清楚。更重要的是,哪些边界条件制约了技术自适应教学的可行性,这还是一个未决问题。我们开展了一个为期四年的共同设计项目,在该项目中,研究人员和教师通过在中学教育中有意识地整合技术,共同构建了自适应教学单元(持续时间:3-4 周)。为了评估技术强化自适应教学的可行性,我们在共同设计过程中采用了一种顺序-解释混合方法。我们将定量研究(N = 183)与定性研究相结合,前者调查学生的学习收获和潜在的调节因素,后者通过半结构化教师访谈(N = 3)了解自适应教学单元的实施条件。我们观察到,教学单元对原有知识水平较低的学生特别有益,而且能高度适应学生的需要。精细的定性研究结果表明,形成性评估和巩固阶段对于技术强化自适应教学的可行性以及技术的合理使用至关重要。这些研究结果表明,利用技术进行适应性教学的可行性取决于边界条件,这突出表明需要进一步提供支持,以发挥适应性教学的潜力。
{"title":"Feasibility of adaptive teaching with technology: Which implementation conditions matter?","authors":"Leonie Sibley ,&nbsp;Andreas Lachner ,&nbsp;Christine Plicht ,&nbsp;Armin Fabian ,&nbsp;Iris Backfisch ,&nbsp;Katharina Scheiter ,&nbsp;Thorsten Bohl","doi":"10.1016/j.compedu.2024.105108","DOIUrl":"https://doi.org/10.1016/j.compedu.2024.105108","url":null,"abstract":"<div><p>Adaptive teaching is regarded to address students' heterogeneity in schools and to individually support their learning. Technology may help to teach adaptively. However, it is still unclear whether realizing adaptive teaching with technology is a feasible teaching practice in real-world classrooms. More importantly, it is an open question which boundary conditions constrain the feasibility of adaptive teaching with technology. We realized a four-year co-design-project in which researchers and teachers co-constructively developed adaptive teaching units (duration: 3–4 weeks) by deliberately integrating technology across secondary education. To assess the feasibility of technology-enhanced adaptive teaching, we followed a sequential-explanatory mixed-methods approach during the co-design-process. We combined a quantitative study (<em>N</em> = 183), investigating students' learning gains and potential moderators, and a qualitative study by means of semi-structured teacher interviews (<em>N</em> = 3) on implementation conditions of the adaptive teaching units. We observed that the teaching units were particularly beneficial for students with low prior knowledge and when they were highly adaptive to students’ needs. Fine-grained qualitative findings indicated that formative assessments and consolidation phases were crucial for the feasibility of technology-enhanced adaptive teaching, as well as a parsimonious use of technologies. These findings indicate that the feasibility of adaptive teaching with technology depends on boundary conditions, highlighting the need for further support to unfold the potential of adaptive teaching.</p></div>","PeriodicalId":10568,"journal":{"name":"Computers & Education","volume":"219 ","pages":"Article 105108"},"PeriodicalIF":8.9,"publicationDate":"2024-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0360131524001222/pdfft?md5=2c01d46d4cf7100e15bad520de4cf5f3&pid=1-s2.0-S0360131524001222-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141595936","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Profiling students’ learning engagement in MOOC discussions to identify learning achievement: An automated configurational approach 分析学生在 MOOC 讨论中的学习参与情况,以确定学习成绩:自动配置方法
IF 8.9 1区 教育学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-07-02 DOI: 10.1016/j.compedu.2024.105109
Zhi Liu , Qianhui Tang , Fan Ouyang , Taotao Long , Sannyuya Liu

In the Massive Online Open Course (MOOC) forum, learning engagement encompasses three fundamental dimensions—cognitive, emotional, and behavioral engagement—that intricately interact to jointly influence students' learning achievements. However, the interplay between multiple engagement dimensions and their correlations with learning achievement remain understudied, particularly across different academic disciplines. This study adopts an automated configurational approach that integrates bidirectional encoder representation from transformers (BERT) and fuzzy set qualitative comparative analysis (fsQCA) to explore the configurations of learning engagement, their connections with learning achievement, and variations across disciplines. Our analysis reveals a nuanced profile of learners' learning engagement, indicating the high-achieving individuals demonstrated more frequent posting and commenting behaviors and the high-level cognitive engagement than low-achieving individuals. Second, our analysis revealed multiple configurations where the coexistence or absence of factors at different levels of the cognitive, behavioral, and emotional dimensions significantly impacted learning achievement. Learners who conducted posting and replying behaviors, expressed positive emotions, and engaged in deep cognitive engagement tended to achieve superior learning outcomes. Third, there were significant differences in behavioral and emotional engagement among learners across different academic disciplines. Specifically, pure discipline learners were more inclined to engage in posting behaviors than the applied discipline learners. Across academic disciplines, positive emotions correlated strongly with higher achievement. These findings deepen our understanding of the multifaceted characteristics of learning engagement in MOOCs and highlight the importance of disciplinary distinctions, providing a foundation for educators and designers to optimize learners’ MOOC effects and tailor learning experiences in diverse disciplinary contexts.

在大规模在线开放课程(MOOC)论坛上,学习参与包括三个基本维度--认知、情感和行为参与--它们错综复杂地相互作用,共同影响着学生的学习成绩。然而,多种参与维度之间的相互作用及其与学习成绩的相关性仍未得到充分研究,尤其是在不同学科之间。本研究采用了一种自动配置方法,整合了转换器双向编码器表征(BERT)和模糊集定性比较分析(fsQCA),以探索学习参与的配置、它们与学习成绩的联系以及不同学科之间的差异。我们的分析揭示了学习者学习参与的细微特征,表明学习成绩好的人比学习成绩差的人表现出更频繁的发帖和评论行为以及更高层次的认知参与。其次,我们的分析表明,认知、行为和情感等不同层面的因素并存或缺失,会对学习成绩产生显著影响。有发帖和回帖行为、表达积极情绪和深度认知参与的学习者往往能取得更好的学习成绩。第三,不同学科的学习者在行为和情感参与方面存在显著差异。具体来说,纯学科学习者比应用学科学习者更倾向于参与发帖行为。在所有学科中,积极情绪与更高的成就密切相关。这些发现加深了我们对MOOC学习参与的多方面特征的理解,并强调了学科区分的重要性,为教育者和设计者优化学习者的MOOC效果以及在不同学科背景下定制学习体验奠定了基础。
{"title":"Profiling students’ learning engagement in MOOC discussions to identify learning achievement: An automated configurational approach","authors":"Zhi Liu ,&nbsp;Qianhui Tang ,&nbsp;Fan Ouyang ,&nbsp;Taotao Long ,&nbsp;Sannyuya Liu","doi":"10.1016/j.compedu.2024.105109","DOIUrl":"https://doi.org/10.1016/j.compedu.2024.105109","url":null,"abstract":"<div><p>In the Massive Online Open Course (MOOC) forum, learning engagement encompasses three fundamental dimensions—cognitive, emotional, and behavioral engagement—that intricately interact to jointly influence students' learning achievements. However, the interplay between multiple engagement dimensions and their correlations with learning achievement remain understudied, particularly across different academic disciplines. This study adopts an automated configurational approach that integrates bidirectional encoder representation from transformers (BERT) and fuzzy set qualitative comparative analysis (fsQCA) to explore the configurations of learning engagement, their connections with learning achievement, and variations across disciplines. Our analysis reveals a nuanced profile of learners' learning engagement, indicating the high-achieving individuals demonstrated more frequent posting and commenting behaviors and the high-level cognitive engagement than low-achieving individuals. Second, our analysis revealed multiple configurations where the coexistence or absence of factors at different levels of the cognitive, behavioral, and emotional dimensions significantly impacted learning achievement. Learners who conducted posting and replying behaviors, expressed positive emotions, and engaged in deep cognitive engagement tended to achieve superior learning outcomes. Third, there were significant differences in behavioral and emotional engagement among learners across different academic disciplines. Specifically, pure discipline learners were more inclined to engage in postin<u>g</u> behaviors than the applied discipline learners. Across academic disciplines, positive emotions correlated strongly with higher achievement. These findings deepen our understanding of the multifaceted characteristics of learning engagement in MOOCs and highlight the importance of disciplinary distinctions, providing a foundation for educators and designers to optimize learners’ MOOC effects and tailor learning experiences in diverse disciplinary contexts.</p></div>","PeriodicalId":10568,"journal":{"name":"Computers & Education","volume":"219 ","pages":"Article 105109"},"PeriodicalIF":8.9,"publicationDate":"2024-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141595926","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The smell of paper or the shine of a screen? Students’ reading comprehension, text processing, and attitudes when reading on paper and screen 纸张的味道还是屏幕的光泽?学生在纸上和屏幕上阅读时的阅读理解、文本处理和态度
IF 8.9 1区 教育学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-07-01 DOI: 10.1016/j.compedu.2024.105107
Ragnhild Engdal Jensen, Astrid Roe, Marte Blikstad-Balas

With the increasing prevalence of digital devices such as smartphones, tablets and e-readers, more and more reading is happening in digital formats – also in classrooms across the world. The present study focuses on lower secondary school students and their reading comprehension and attitudes toward reading on paper and screens. The study uses an innovative methodological approach were eye-tracking technology is used to observe ten carefully sampled eight grade students with different reading levels. The students read a selection of texts and answered questions from the Norwegian national reading assessment on comparable versions on paper and on screen. By analyzing eye movement data (reading transitions), including more than 25000 fixations, in combination with text reading comprehension outcomes, students' cued retrospective reporting from reading, and interview data we have obtained detailed and comprehensive data on students' reading comprehension, reading behavior, and reading experiences across different media. A key result is that reading on screen leads to more shallow processing and can hinder reading comprehension. Importantly, our results from the students' cued retrospective reporting of their eye tracking, showed that they were unaware of their reading behavior and didn't reflect much on reading in different media. These findings have implications for the increasing shift to digital learning environments in the educational context. It is important to recognize the difference between reading processes, and policymakers and practitioners cannot assume that these processes are the same across individuals and different delivery modes.

随着智能手机、平板电脑和电子阅读器等数字设备的日益普及,越来越多的阅读以数字形式进行--在世界各地的教室里也是如此。本研究的重点是初中学生及其阅读理解能力和对纸质阅读和屏幕阅读的态度。研究采用了一种创新的方法,即利用眼动跟踪技术来观察 10 名经过仔细抽样的八年级学生,他们的阅读水平各不相同。这些学生在纸上和屏幕上阅读了精选的文章,并回答了挪威国家阅读评估中的问题。通过分析眼动数据(阅读转换),包括超过 25000 次的定点移动,并结合文本阅读理解结果、学生的阅读提示回溯报告和访谈数据,我们获得了有关学生阅读理解、阅读行为和不同媒体阅读体验的详细而全面的数据。一个重要的结果是,在屏幕上阅读会导致更浅层的处理,并可能妨碍阅读理解。重要的是,我们从学生对眼动追踪的提示性回顾报告中得出的结果显示,他们并没有意识到自己的阅读行为,也没有对不同媒体下的阅读进行过多反思。这些发现对教育领域日益向数字化学习环境转变具有重要意义。重要的是要认识到不同阅读过程之间的差异,决策者和实践者不能假定这些过程在不同个体和不同教学模式之间是相同的。
{"title":"The smell of paper or the shine of a screen? Students’ reading comprehension, text processing, and attitudes when reading on paper and screen","authors":"Ragnhild Engdal Jensen,&nbsp;Astrid Roe,&nbsp;Marte Blikstad-Balas","doi":"10.1016/j.compedu.2024.105107","DOIUrl":"https://doi.org/10.1016/j.compedu.2024.105107","url":null,"abstract":"<div><p>With the increasing prevalence of digital devices such as smartphones, tablets and e-readers, more and more reading is happening in digital formats – also in classrooms across the world. The present study focuses on lower secondary school students and their reading comprehension and attitudes toward reading on paper and screens. <em>The study uses an innovative methodological approach were eye-tracking technology is used to observe ten carefully sampled eight grade students with different reading levels.</em> The students read a selection of texts and answered questions from the Norwegian national reading assessment on comparable versions <em>on paper and on screen. By analyzing eye movement data (reading transitions), including more than 25000 fixations, in combination with text reading comprehension outcomes, students' cued retrospective reporting from reading, and interview data we have obtained detailed and comprehensive data on students' reading comprehension, reading behavior, and reading experiences across different media</em>. A key result is that reading on screen leads to more shallow processing and can hinder reading comprehension. Importantly, our results from the students' cued retrospective reporting of their eye tracking, showed that they were unaware of their reading behavior and didn't reflect much on reading in different media. These findings have implications for the increasing shift to digital learning environments in the educational context. It is important to recognize the difference between reading processes, and policymakers and practitioners cannot assume that these processes are the same across individuals and different delivery modes.</p></div>","PeriodicalId":10568,"journal":{"name":"Computers & Education","volume":"219 ","pages":"Article 105107"},"PeriodicalIF":8.9,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0360131524001210/pdfft?md5=c9d07fa53ea050445156731b710018aa&pid=1-s2.0-S0360131524001210-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141543664","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Collaborative activities in hybrid learning environments: Exploring teacher orchestration load and students’ perceptions 混合学习环境中的协作活动:探究教师的安排负荷和学生的看法
IF 8.9 1区 教育学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-06-14 DOI: 10.1016/j.compedu.2024.105105
Alejandro Ortega-Arranz , Ishari Amarasinghe , Alejandra Martínez-Monés , Juan I. Asensio-Pérez , Yannis Dimitriadis , Mario Corrales-Astorgano , Davinia Hernández-Leo

The recent Covid-19 pandemic made universities rethink their traditional educational models, shifting, in some cases, to pure online or hybrid models. Hybrid settings usually involve onsite (i.e., in the classroom) and online (e.g., in a different classroom, at home) students simultaneously under the instruction of the same teacher. However, while these models provide more flexibility to students, hybridity poses additional challenges for the specific case of collaborative learning, likely increasing the teachers' orchestration load and potentially hampering fruitful interactions among learners. In order to gather empirical evidence on the impact of hybridity in collaborative learning, this paper reports a study conducted in a hybrid classroom where a Jigsaw collaborative pattern was implemented with the Engageli software. The study involved 2 teachers and 67 students enrolled in a computer science undergraduate course. Teachers' post-interviews, questionnaires and an epistemic network analysis (ENA) were used to produce study findings. Results show that teachers reported a medium-to-high orchestration load for implementing and setting up the collaborative activities in the hybrid classroom. Among the factors that contributed most to such load, teachers highlighted the creation and live management of groups and collaborative documents. Additionally, the ENA showed that teachers put much effort on monitoring group interactions and solving technical issues. Finally, we observed relevant differences on students' perceptions (e.g., satisfaction with the attention received by the teachers) based on the cohort sizes and on the students’ attendance modality (onsite vs. online).

最近流行的 Covid-19 使大学重新思考其传统的教育模式,在某些情况下转向纯在线或混合模式。混合模式通常是指学生在同一教师的指导下,同时在现场(即在教室)和在线(如在不同的教室、在家里)学习。然而,虽然这些模式为学生提供了更多的灵活性,但混合式教学也为协作学习的具体情况带来了额外的挑战,可能会增加教师的协调负担,并可能阻碍学习者之间富有成效的互动。为了收集有关混合模式在协作学习中的影响的实证证据,本文报告了一项在混合课堂上进行的研究,在该混合课堂上使用 Engageli 软件实施了 Jigsaw 协作模式。这项研究涉及 2 名教师和 67 名计算机科学本科生。教师的后期访谈、问卷调查和认识网络分析(ENA)被用来得出研究结果。结果显示,教师在混合课堂中实施和设置协作活动的协调工作量为中等至高等。在造成这种负担的最主要因素中,教师们强调了小组和协作文件的创建和实时管理。此外,ENA 显示,教师在监控小组互动和解决技术问题方面投入了大量精力。最后,我们观察到学生的看法(如对教师关注的满意度)因学生人数和上课方式(现场与在线)而有所不同。
{"title":"Collaborative activities in hybrid learning environments: Exploring teacher orchestration load and students’ perceptions","authors":"Alejandro Ortega-Arranz ,&nbsp;Ishari Amarasinghe ,&nbsp;Alejandra Martínez-Monés ,&nbsp;Juan I. Asensio-Pérez ,&nbsp;Yannis Dimitriadis ,&nbsp;Mario Corrales-Astorgano ,&nbsp;Davinia Hernández-Leo","doi":"10.1016/j.compedu.2024.105105","DOIUrl":"10.1016/j.compedu.2024.105105","url":null,"abstract":"<div><p>The recent Covid-19 pandemic made universities rethink their traditional educational models, shifting, in some cases, to pure online or hybrid models. Hybrid settings usually involve onsite (<em>i.e.</em>, in the classroom) and online (<em>e.g.</em>, in a different classroom, at home) students simultaneously under the instruction of the same teacher. However, while these models provide more flexibility to students, hybridity poses additional challenges for the specific case of collaborative learning, likely increasing the teachers' orchestration load and potentially hampering fruitful interactions among learners. In order to gather empirical evidence on the impact of hybridity in collaborative learning, this paper reports a study conducted in a hybrid classroom where a Jigsaw collaborative pattern was implemented with the Engageli software. The study involved 2 teachers and 67 students enrolled in a computer science undergraduate course. Teachers' post-interviews, questionnaires and an epistemic network analysis (ENA) were used to produce study findings. Results show that teachers reported a medium-to-high orchestration load for implementing and setting up the collaborative activities in the hybrid classroom. Among the factors that contributed most to such load, teachers highlighted the creation and live management of groups and collaborative documents. Additionally, the ENA showed that teachers put much effort on monitoring group interactions and solving technical issues. Finally, we observed relevant differences on students' perceptions (<em>e.g.</em>, satisfaction with the attention received by the teachers) based on the cohort sizes and on the students’ attendance modality (onsite vs. online).</p></div>","PeriodicalId":10568,"journal":{"name":"Computers & Education","volume":"219 ","pages":"Article 105105"},"PeriodicalIF":8.9,"publicationDate":"2024-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0360131524001192/pdfft?md5=8b1f3e93053d5cc237b80a2a26820df4&pid=1-s2.0-S0360131524001192-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141393048","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Facilitating self-directed language learning in real-life scene description tasks with automated evaluation 通过自动评估促进真实场景描述任务中的语言自主学习
IF 12 1区 教育学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-06-13 DOI: 10.1016/j.compedu.2024.105106
Ruibin Zhao , Yipeng Zhuang , ZhiWei Xie , Philip L.H. Yu

Engaging children in describing real-life scenes provides an effective approach to fostering language production and developing their language skills, enabling them to establish meaningful connections between their language proficiency and authentic contexts. However, for such learning tasks, there has been a lack of research focusing on promoting self-directed language learning by using artificial intelligence techniques, primarily due to the challenges of handling multimodal information involved in such tasks. To address this gap, this study introduced a two-stage automated evaluation method that employed emerging cross-modal matching AI techniques. Firstly, an automated scoring model was developed to evaluate the quality of students' responses to scene description tasks. Compared with manually assigned human scores, our model scored students' descriptions accurately, as evidenced by a small testing mean absolute error of 0.3969 for a total score of 10 points. Based on the scoring results, immediate feedback was then provided to students by generating targeted comments and suggestions. The goal of this feedback was to assist students in progressively improving their descriptions of daily-life scenes, thereby enabling them to practice their language skills independently. To assess the effectiveness of the feedback, a comprehensive investigation was conducted involving 157 students from middle schools in China, and both qualitative and quantitative experimental data were collected from the students. It is found that the quality of students' descriptions was improved significantly with the assistance of immediate feedback. On average, students achieved an increase of 1.48 points in their scores after making revisions based on the feedback. In addition, students reported positive learning experiences and expressed favorable opinions regarding the language learning tasks with the automated evaluation. The findings of this study have significant implications for future research and educational practice. They not only highlighted the potential of emerging cross-modal matching AI techniques in automatically evaluating learning tasks involving multimodal data but also suggested that providing immediate targeted feedback based on automated scoring results can effectively promote students’ self-directed language learning.

让儿童参与描述真实生活场景,是促进语言生产和发展语言技能的有效方法,可使他们在语言能力和真实语境之间建立有意义的联系。然而,对于这类学习任务,目前还缺乏利用人工智能技术促进自主语言学习的研究,这主要是由于处理这类任务所涉及的多模态信息所带来的挑战。为弥补这一不足,本研究引入了一种两阶段自动评估方法,采用了新兴的跨模态匹配人工智能技术。首先,开发了一个自动评分模型,用于评估学生对场景描述任务的回答质量。与人工评分相比,我们的模型对学生的描述进行了准确评分,这体现在总分 10 分的测试平均绝对误差为 0.3969,误差较小。根据评分结果,我们通过生成有针对性的评论和建议向学生提供即时反馈。这种反馈的目的是帮助学生逐步改进他们对日常生活场景的描述,从而使他们能够独立练习语言技能。为了评估反馈的有效性,我们对来自中国中学的 157 名学生进行了全面调查,收集了学生的定性和定量实验数据。结果发现,在即时反馈的帮助下,学生的描述质量得到了显著提高。根据反馈进行修改后,学生的分数平均提高了 1.48 分。此外,学生们还报告了积极的学习体验,并对自动评价下的语言学习任务表达了良好的看法。本研究的结果对未来研究和教育实践具有重要意义。它们不仅凸显了新兴的跨模态匹配人工智能技术在自动评估涉及多模态数据的学习任务方面的潜力,还表明根据自动评分结果提供即时的有针对性的反馈能有效促进学生的语言自主学习。
{"title":"Facilitating self-directed language learning in real-life scene description tasks with automated evaluation","authors":"Ruibin Zhao ,&nbsp;Yipeng Zhuang ,&nbsp;ZhiWei Xie ,&nbsp;Philip L.H. Yu","doi":"10.1016/j.compedu.2024.105106","DOIUrl":"10.1016/j.compedu.2024.105106","url":null,"abstract":"<div><p>Engaging children in describing real-life scenes provides an effective approach to fostering language production and developing their language skills, enabling them to establish meaningful connections between their language proficiency and authentic contexts. However, for such learning tasks, there has been a lack of research focusing on promoting self-directed language learning by using artificial intelligence techniques, primarily due to the challenges of handling multimodal information involved in such tasks. To address this gap, this study introduced a two-stage automated evaluation method that employed emerging cross-modal matching AI techniques. Firstly, an automated scoring model was developed to evaluate the quality of students' responses to scene description tasks. Compared with manually assigned human scores, our model scored students' descriptions accurately, as evidenced by a small testing mean absolute error of 0.3969 for a total score of 10 points. Based on the scoring results, immediate feedback was then provided to students by generating targeted comments and suggestions. The goal of this feedback was to assist students in progressively improving their descriptions of daily-life scenes, thereby enabling them to practice their language skills independently. To assess the effectiveness of the feedback, a comprehensive investigation was conducted involving 157 students from middle schools in China, and both qualitative and quantitative experimental data were collected from the students. It is found that the quality of students' descriptions was improved significantly with the assistance of immediate feedback. On average, students achieved an increase of 1.48 points in their scores after making revisions based on the feedback. In addition, students reported positive learning experiences and expressed favorable opinions regarding the language learning tasks with the automated evaluation. The findings of this study have significant implications for future research and educational practice. They not only highlighted the potential of emerging cross-modal matching AI techniques in automatically evaluating learning tasks involving multimodal data but also suggested that providing immediate targeted feedback based on automated scoring results can effectively promote students’ self-directed language learning.</p></div>","PeriodicalId":10568,"journal":{"name":"Computers & Education","volume":"219 ","pages":"Article 105106"},"PeriodicalIF":12.0,"publicationDate":"2024-06-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141404561","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The moderating effects of total comments on the relationship between comment implementation and online peer-supported writing performance 总评论对评论实施与在线同伴互助写作成绩之间关系的调节作用
IF 12 1区 教育学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-06-11 DOI: 10.1016/j.compedu.2024.105104
Galina Shulgina , Mik Fanguy , Han Zhang , Matthew Courtney , Matthew Baldwin , Jamie Costley

Prior research has suggested that participation in peer feedback activities, specifically the giving and receiving of comments, and the implementation of suggested ideas helps to improve writing quality. However, it is not always the case that received feedback is implemented. Currently, there is uncertainty regarding how the total number of comments received during a peer feedback activity interacts with the number of implemented comments and subsequent text quality. Therefore, the present study examined the online peer feedback sessions of 186 graduate students enrolled in a scientific writing course at a Korean university. It aimed to investigate the possible moderating effect of the total number of comments on the relationship between implementation of comments and student writing performance. The results showed that there is no relationship between the number of received comments and student writing performance. Furthermore, no significant correlation was observed between the number of implemented comments and student writing performance. However, importantly, a moderating effect of the total number of comments on the relationship between implementation of comments and student writing performance was found. In other words, the more total comments students receive, the less their implementation will be associated with significant improvement of writing quality. This result is significant because it suggests that in online collaborative learning contexts, there is an upper limit of peer comments, above which the original author can no longer effectively implement them to improve writing performance.

先前的研究表明,参与同伴反馈活动,特别是给予和接受评论以及落实建议意见,有助于提高写作质量。然而,收到的反馈意见并不总能得到落实。目前,还不确定在同伴反馈活动中收到的评论总数与落实的评论数量以及随后的文章质量之间是如何相互作用的。因此,本研究考察了韩国一所大学科学写作课程中 186 名研究生的在线同伴反馈情况。研究旨在探讨评论总数对评论实施与学生写作成绩之间关系可能产生的调节作用。结果表明,收到的评语数量与学生的写作成绩之间没有关系。此外,也没有观察到落实评语的数量与学生写作成绩之间存在明显的相关性。然而,重要的是,研究发现评语总数对评语落实与学生写作成绩之间的关系有调节作用。换句话说,学生收到的评语总数越多,评语的实施与写作质量的显著提高之间的关系就越小。这一结果意义重大,因为它表明,在在线协作学习情境中,同伴评语是有上限的,超过这个上限,原作者就不能再有效地实施评语来提高写作成绩。
{"title":"The moderating effects of total comments on the relationship between comment implementation and online peer-supported writing performance","authors":"Galina Shulgina ,&nbsp;Mik Fanguy ,&nbsp;Han Zhang ,&nbsp;Matthew Courtney ,&nbsp;Matthew Baldwin ,&nbsp;Jamie Costley","doi":"10.1016/j.compedu.2024.105104","DOIUrl":"https://doi.org/10.1016/j.compedu.2024.105104","url":null,"abstract":"<div><p>Prior research has suggested that participation in peer feedback activities, specifically the giving and receiving of comments, and the implementation of suggested ideas helps to improve writing quality. However, it is not always the case that received feedback is implemented. Currently, there is uncertainty regarding how the total number of comments received during a peer feedback activity interacts with the number of implemented comments and subsequent text quality. Therefore, the present study examined the online peer feedback sessions of 186 graduate students enrolled in a scientific writing course at a Korean university. It aimed to investigate the possible moderating effect of the total number of comments on the relationship between implementation of comments and student writing performance. The results showed that there is no relationship between the number of received comments and student writing performance. Furthermore, no significant correlation was observed between the number of implemented comments and student writing performance. However, importantly, a moderating effect of the total number of comments on the relationship between implementation of comments and student writing performance was found. In other words, the more total comments students receive, the less their implementation will be associated with significant improvement of writing quality. This result is significant because it suggests that in online collaborative learning contexts, there is an upper limit of peer comments, above which the original author can no longer effectively implement them to improve writing performance.</p></div>","PeriodicalId":10568,"journal":{"name":"Computers & Education","volume":"219 ","pages":"Article 105104"},"PeriodicalIF":12.0,"publicationDate":"2024-06-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0360131524001180/pdfft?md5=f47727552e2544e5a573ef7309e72f59&pid=1-s2.0-S0360131524001180-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141324873","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The influence of ChatGPT on student engagement: A systematic review and future research agenda ChatGPT 对学生参与的影响:系统回顾与未来研究议程
IF 12 1区 教育学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-06-08 DOI: 10.1016/j.compedu.2024.105100
Chung Kwan Lo , Khe Foon Hew , Morris Siu-yung Jong

ChatGPT, a state-of-the-art artificial intelligence (AI) chatbot, has gained considerable attention as a transformative yet controversial tool for enhancing teaching and learning experiences. Several reviews and numerous articles have been written about harnessing ChatGPT in education since its release on November 30, 2022. Besides summarising its strengths, weaknesses, opportunities, and threats (SWOT) as identified in previous systematic reviews of ChatGPT research, this systematic review aims to develop a new understanding of its influence on student engagement by synthesising the existing related research using a three-dimensional framework comprising behavioural, emotional, and cognitive aspects. We searched relevant databases and included 72 empirical studies published within one year of ChatGPT's initial release. The findings reveal robust but narrowly focused evidence related to behavioural engagement (i.e., work with ChatGPT) and disengagement (i.e., academic dishonesty). The evidence related to the emotional aspect is mixed, with instances of both engagement (e.g., satisfaction and interest/fun) and disengagement (e.g., disappointment and worry/anxiety). There is broad but weak evidence regarding cognitive engagement (e.g., increased understanding and positive self-perception) and disengagement (e.g., reduced critical thinking and overreliance). Our review uncovers several under-explored indicators of student engagement, pointing to the need for further research. Specifically, future studies could focus on students' study habits and attendance (behavioural engagement), social interaction (emotional engagement), and self-regulation and critical thinking (cognitive engagement) in ChatGPT-supported learning environments.

ChatGPT 是一种最先进的人工智能(AI)聊天机器人,作为一种具有变革性但又备受争议的工具,它在增强教学体验方面获得了相当多的关注。自 ChatGPT 于 2022 年 11 月 30 日发布以来,有关在教育领域利用 ChatGPT 的评论和文章不胜枚举。除了总结以往 ChatGPT 研究系统性综述中发现的其优势、劣势、机会和威胁(SWOT)之外,本系统性综述旨在通过使用一个包括行为、情感和认知方面的三维框架来综合现有的相关研究,从而对 ChatGPT 对学生参与度的影响有一个新的认识。我们搜索了相关数据库,收录了 ChatGPT 发布一年内发表的 72 项实证研究。研究结果显示了与行为参与(即使用 ChatGPT 工作)和脱离参与(即学术不诚实)相关的有力证据,但范围较窄。与情感方面有关的证据参差不齐,既有参与(如满意和兴趣/乐趣),也有脱离(如失望和担忧/焦虑)。关于认知参与(如增加理解和积极的自我认知)和脱离参与(如减少批判性思维和过度依赖),有广泛但薄弱的证据。我们的综述发现了几个未被充分探索的学生参与指标,这表明我们有必要开展进一步的研究。具体来说,未来的研究可以关注学生在 ChatGPT 支持的学习环境中的学习习惯和出勤率(行为参与)、社交互动(情感参与)以及自我调节和批判性思维(认知参与)。
{"title":"The influence of ChatGPT on student engagement: A systematic review and future research agenda","authors":"Chung Kwan Lo ,&nbsp;Khe Foon Hew ,&nbsp;Morris Siu-yung Jong","doi":"10.1016/j.compedu.2024.105100","DOIUrl":"https://doi.org/10.1016/j.compedu.2024.105100","url":null,"abstract":"<div><p>ChatGPT, a state-of-the-art artificial intelligence (AI) chatbot, has gained considerable attention as a transformative yet controversial tool for enhancing teaching and learning experiences. Several reviews and numerous articles have been written about harnessing ChatGPT in education since its release on November 30, 2022. Besides summarising its strengths, weaknesses, opportunities, and threats (SWOT) as identified in previous systematic reviews of ChatGPT research, this systematic review aims to develop a new understanding of its influence on student engagement by synthesising the existing related research using a three-dimensional framework comprising behavioural, emotional, and cognitive aspects. We searched relevant databases and included 72 empirical studies published within one year of ChatGPT's initial release. The findings reveal robust but narrowly focused evidence related to behavioural engagement (i.e., work with ChatGPT) and disengagement (i.e., academic dishonesty). The evidence related to the emotional aspect is mixed, with instances of both engagement (e.g., satisfaction and interest/fun) and disengagement (e.g., disappointment and worry/anxiety). There is broad but weak evidence regarding cognitive engagement (e.g., increased understanding and positive self-perception) and disengagement (e.g., reduced critical thinking and overreliance). Our review uncovers several under-explored indicators of student engagement, pointing to the need for further research. Specifically, future studies could focus on students' study habits and attendance (behavioural engagement), social interaction (emotional engagement), and self-regulation and critical thinking (cognitive engagement) in ChatGPT-supported learning environments.</p></div>","PeriodicalId":10568,"journal":{"name":"Computers & Education","volume":"219 ","pages":"Article 105100"},"PeriodicalIF":12.0,"publicationDate":"2024-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0360131524001143/pdfft?md5=6b36c245ca2976a7bd74e9a258f26460&pid=1-s2.0-S0360131524001143-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141303986","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Towards teaching strategies addressing online learning in blended learning courses for adult-learners 针对成人学习者混合式学习课程中的在线学习制定教学策略
IF 12 1区 教育学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-06-08 DOI: 10.1016/j.compedu.2024.105103
Nanda van der Stap , Theo van den Bogaart , Stan van Ginkel , Ebrahim Rahimi , Johan Versendaal

Blended learning offers a learner-centred approach that employs both in-class learning and digital technology to facilitate online learning. Such an approach is especially advantageous to adult-learners in higher education as it meets their educational needs. However, adult-learners’ participation in blended learning programmes remains challenging due to a general lack of online interaction, and no clear teaching strategies that address this concern. Literature relating to adult-learners’ educational needs and online interaction was consulted in order to design teaching strategies that foster adult-learners’ online interaction. The aim of this study is to further validate these teaching strategies, hence a multiple case study was carried out using a mixed method approach. As such, eight teachers and sixteen students from four courses across three universities in Belgium and the Netherlands were interviewed. Additionally, a questionnaire testing a pre-defined set of variables was distributed to 84 students. The results lead to a set of validated teaching strategies that help teachers to further develop their professional skills and expertise. The teaching strategies can be grouped into three categories, namely 1) the teacher's online presence, 2) collaborative learning activities and preparatory learning activities, and 3) the distribution of learning content and learning activities across online and in-class learning. An elaborate set of validated teaching strategies is included. This study aids towards teacher professional development and adds evidence-based knowledge to teaching strategies and instructional frameworks for adult-learners in higher education.

Teaching/learning strategies, adult-learning, cooperative/collaborative learning, teacher professional development, online learning.

混合式学习提供了一种以学习者为中心的方法,既利用课堂学习,又利用数字技术促进在线学习。这种方法对高等教育中的成人学习者尤为有利,因为它能满足他们的教育需求。然而,由于成人学习者普遍缺乏在线互动,也没有明确的教学策略来解决这一问题,因此,成人学习者参与混合式学习课程仍然具有挑战性。本研究参考了与成人学习者的教育需求和在线互动有关的文献,以设计促进成人学习者在线互动的教学策略。本研究的目的是进一步验证这些教学策略,因此采用混合方法进行了多案例研究。因此,对比利时和荷兰三所大学四门课程的八名教师和十六名学生进行了访谈。此外,还向 84 名学生发放了一份调查问卷,测试预先确定的一系列变量。结果得出了一套经过验证的教学策略,有助于教师进一步提高专业技能和专业知识。这些教学策略可分为三类,即 1) 教师的在线存在;2) 协作学习活动和预习学习活动;3) 学习内容和学习活动在在线学习和课堂学习中的分配。研究还包括一套精心设计的经过验证的教学策略。这项研究有助于教师的专业发展,并为高等教育中成人学习者的教学策略和教学框架增添了循证知识。
{"title":"Towards teaching strategies addressing online learning in blended learning courses for adult-learners","authors":"Nanda van der Stap ,&nbsp;Theo van den Bogaart ,&nbsp;Stan van Ginkel ,&nbsp;Ebrahim Rahimi ,&nbsp;Johan Versendaal","doi":"10.1016/j.compedu.2024.105103","DOIUrl":"https://doi.org/10.1016/j.compedu.2024.105103","url":null,"abstract":"<div><p>Blended learning offers a learner-centred approach that employs both in-class learning and digital technology to facilitate online learning. Such an approach is especially advantageous to adult-learners in higher education as it meets their educational needs. However, adult-learners’ participation in blended learning programmes remains challenging due to a general lack of online interaction, and no clear teaching strategies that address this concern. Literature relating to adult-learners’ educational needs and online interaction was consulted in order to design teaching strategies that foster adult-learners’ online interaction. The aim of this study is to further validate these teaching strategies, hence a multiple case study was carried out using a mixed method approach. As such, eight teachers and sixteen students from four courses across three universities in Belgium and the Netherlands were interviewed. Additionally, a questionnaire testing a pre-defined set of variables was distributed to 84 students. The results lead to a set of validated teaching strategies that help teachers to further develop their professional skills and expertise. The teaching strategies can be grouped into three categories, namely 1) the teacher's online presence, 2) collaborative learning activities and preparatory learning activities, and 3) the distribution of learning content and learning activities across online and in-class learning. An elaborate set of validated teaching strategies is included. This study aids towards teacher professional development and adds evidence-based knowledge to teaching strategies and instructional frameworks for adult-learners in higher education.</p><p>Teaching/learning strategies, adult-learning, cooperative/collaborative learning, teacher professional development, online learning.</p></div>","PeriodicalId":10568,"journal":{"name":"Computers & Education","volume":"219 ","pages":"Article 105103"},"PeriodicalIF":12.0,"publicationDate":"2024-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0360131524001179/pdfft?md5=329b24ea71dcf0d40f3a112bc789fb71&pid=1-s2.0-S0360131524001179-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141294576","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Predicting problem-solving success in an office simulation applying N-grams and a random forest to behavioral process data 将 N-grams 和随机森林应用于行为过程数据,预测办公室模拟中解决问题的成功率
IF 12 1区 教育学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-06-03 DOI: 10.1016/j.compedu.2024.105093
Sabrina Ludwig , Andreas Rausch , Viola Deutscher , Jürgen Seifried

Predicting students' problem-solving success in computer-based simulations at an early stage allows adaptive educational systems to provide learners with personalized support. In this paper, we predict students' problem-solving success by applying a machine-learning model, the random forest, to produce a binary classification (more vs. less successful students). During a business-related problem scenario that lasted 55 min, early behavioral data (during the first 5, 10, and 20 min) such as mouse clicks and keyboard strokes (approx. 29,800 early-window clickstreams and keystrokes during the first 20 min) of 234 trainees were recorded, mirroring the students' problem-solving behavior. We used the n-gram sequence mining technique, which was originally introduced within the emerging disciplines of natural language processing, text mining, and machine learning and has proven to be effective, particularly in the examination of online behavior. We trained the random forest model with training datasets that included all features (bigrams), as well as selected features (the most predictable bigrams explaining inter-group differences). Our results show that early predictions based on the first 10 and 20 min contained sufficient information to accurately predict problem-solving success, while predictions that are too early (based on the first 5 min) do not. As the size of the initial time window expanded, the classification performance improved. Moreover, the selection of the most predictable features improved the models' performance for all three time intervals. The model that was trained with only selected robust features that occurred in the first 20 min achieved the highest ROC AUC score of almost 0.70. This result falls within the range of accuracy scores observed in similar studies. From the instructor's perspective, predictions help in the early identification of weak students and can provide them with personalized learning prompts. For more successful students, tasks can be enriched adaptively.

在早期阶段预测学生在计算机模拟中解决问题的成功率,可以让自适应教育系统为学习者提供个性化支持。在本文中,我们通过应用机器学习模型--随机森林来预测学生解决问题的成功率,从而得出二元分类(成功率较高与较低的学生)。在一个持续 55 分钟的商业相关问题情景中,我们记录了 234 名学员的早期行为数据(前 5 分钟、10 分钟和 20 分钟),如鼠标点击和键盘敲击(前 20 分钟内约有 29,800 次早期窗口点击流和键盘敲击),这些数据反映了学生解决问题的行为。我们使用了 n-gram 序列挖掘技术,该技术最初是在自然语言处理、文本挖掘和机器学习等新兴学科中引入的,已被证明非常有效,尤其是在检查在线行为方面。我们使用包含所有特征(大词组)和选定特征(解释组间差异的最可预测的大词组)的训练数据集对随机森林模型进行了训练。我们的结果表明,基于前 10 分钟和 20 分钟的早期预测包含了足够的信息,可以准确预测问题解决的成功率,而过早(基于前 5 分钟)的预测则不能。随着初始时间窗口的扩大,分类性能也得到了提高。此外,选择最可预测的特征也提高了模型在所有三个时间间隔内的性能。仅选择前 20 分钟内出现的稳健特征来训练的模型的 ROC AUC 得分最高,接近 0.70。这一结果属于类似研究中观察到的准确率范围。从教师的角度来看,预测有助于早期识别能力较弱的学生,并为他们提供个性化的学习提示。对于成绩较好的学生,可以自适应地丰富任务。
{"title":"Predicting problem-solving success in an office simulation applying N-grams and a random forest to behavioral process data","authors":"Sabrina Ludwig ,&nbsp;Andreas Rausch ,&nbsp;Viola Deutscher ,&nbsp;Jürgen Seifried","doi":"10.1016/j.compedu.2024.105093","DOIUrl":"https://doi.org/10.1016/j.compedu.2024.105093","url":null,"abstract":"<div><p>Predicting students' problem-solving success in computer-based simulations at an early stage allows adaptive educational systems to provide learners with personalized support. In this paper, we predict students' problem-solving success by applying a machine-learning model, the random forest, to produce a binary classification (more vs. less successful students). During a business-related problem scenario that lasted 55 min, early behavioral data (during the first 5, 10, and 20 min) such as mouse clicks and keyboard strokes (approx. 29,800 early-window clickstreams and keystrokes during the first 20 min) of 234 trainees were recorded, mirroring the students' problem-solving behavior. We used the n-gram sequence mining technique, which was originally introduced within the emerging disciplines of natural language processing, text mining, and machine learning and has proven to be effective, particularly in the examination of online behavior. We trained the random forest model with training datasets that included all features (bigrams), as well as selected features (the most predictable bigrams explaining inter-group differences). Our results show that early predictions based on the first 10 and 20 min contained sufficient information to accurately predict problem-solving success, while predictions that are too early (based on the first 5 min) do not. As the size of the initial time window expanded, the classification performance improved. Moreover, the selection of the most predictable features improved the models' performance for all three time intervals. The model that was trained with only selected robust features that occurred in the first 20 min achieved the highest ROC AUC score of almost 0.70. This result falls within the range of accuracy scores observed in similar studies. From the instructor's perspective, predictions help in the early identification of weak students and can provide them with personalized learning prompts. For more successful students, tasks can be enriched adaptively.</p></div>","PeriodicalId":10568,"journal":{"name":"Computers & Education","volume":"218 ","pages":"Article 105093"},"PeriodicalIF":12.0,"publicationDate":"2024-06-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141249685","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Computers & Education
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1