首页 > 最新文献

Journal of Computer Assisted Learning最新文献

英文 中文
Factors Influencing University Students' Behavioural Intention to Use Generative Artificial Intelligence for Educational Purposes Based on a Revised UTAUT2 Model 基于修正UTAUT2模型的大学生生成式人工智能教育行为意向影响因素研究
IF 5.1 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-12-19 DOI: 10.1111/jcal.13105
Xin Tang, Zhiqiang Yuan, Shaojun Qu
<div> <section> <h3> Background</h3> <p>Generative artificial intelligence (AI) represents a significant technological leap, with platforms like OpenAI's ChatGPT and Baidu's Ernie Bot at the forefront of innovation. This technology has seen widespread adoption across various sectors of society and is anticipated to revolutionise the educational landscape, especially in the domain of tertiary education. However, there is a gap in understanding factors influencing university students' behavioural intention to use generative AI, leading to hesitation in its adoption.</p> </section> <section> <h3> Objectives</h3> <p>The primary objective of this study was to investigate the factors that influence university students' behavioural intention to engage with and utilise generative AI. The study sought to delve into the fundamental reasons and obstacles that university students encounter when contemplating the adoption of this technology for their academic endeavours.</p> </section> <section> <h3> Methods</h3> <p>The study used a quantitative research design, utilising a revised version of the Unified Theory of Acceptance and Use of Technology 2 (UTAUT2) model. Data were collected from a sample of 380 university students in Changsha, the capital city of Hunan in China. Partial least squares structural equation modelling (PLS-SEM) was used to analyse the relationships between the variables of the model, which included performance expectancy (PE), effort expectancy (EE), social influence (SI), facilitating conditions (FC), learning value, habit and behavioural intention.</p> </section> <section> <h3> Results</h3> <p>The analysis revealed that PE and EE have a direct impact on learning value. Additionally, SI and FC were found to directly affect the formation of habit. Among these factors, learning value emerged as the most potent predictor of university students' behavioural intention to use generative AI. Habit also demonstrated a significant, albeit smaller, effect on behavioural intention.</p> </section> <section> <h3> Conclusions</h3> <p>The study's findings underscore the importance of learning value in driving the adoption of generative AI among university students. Efforts to enhance the learning value of generative AI could significantly increase its uptake in higher education. Furthermore, the role of habit, while less pronounced, suggests that consistent exposure and use can foster a greater inclination towards generative AI. These insights provide a foundation for targeted interventions aimed at improving the integration and application of generative A
背景 生成式人工智能(AI)是一项重大的技术飞跃,OpenAI 的 ChatGPT 和百度的 Ernie Bot 等平台处于创新的前沿。这项技术已在社会各领域得到广泛应用,预计将彻底改变教育领域,尤其是高等教育领域。然而,在了解影响大学生使用生成式人工智能的行为意向的因素方面还存在差距,导致他们在采用该技术时犹豫不决。 研究目的 本研究的主要目的是调查影响大学生参与和使用生成式人工智能的行为意向的因素。研究试图深入探讨大学生在考虑采用该技术进行学术研究时遇到的根本原因和障碍。 研究方法 本研究采用定量研究设计,使用了修订版的 "技术接受和使用统一理论 2"(UTAUT2)模型。数据收集自中国湖南省会城市长沙的 380 名大学生样本。采用偏最小二乘结构方程模型(PLS-SEM)分析模型中各变量之间的关系,这些变量包括绩效期望(PE)、努力期望(EE)、社会影响(SI)、便利条件(FC)、学习价值、习惯和行为意向。 结果 分析表明,PE 和 EE 对学习价值有直接影响。此外,SI 和 FC 也直接影响习惯的形成。在这些因素中,学习价值是预测大学生使用生成式人工智能行为意向的最有力因素。习惯对行为意向也有显著影响,尽管影响较小。 结论 本研究的结论强调了学习价值在推动大学生采用生成式人工智能方面的重要性。努力提高生成式人工智能的学习价值可以大大提高其在高等教育中的普及率。此外,习惯的作用虽然不那么明显,但表明持续的接触和使用可以促进对生成式人工智能的更大倾向。这些见解为采取有针对性的干预措施,改善生成式人工智能在教育环境中的整合与应用奠定了基础。包括教育工作者、政策制定者和创生式人工智能设计者在内的利益相关者可以利用这些发现来创造一个有利于在高等教育中采用和有效使用创生式人工智能的环境。
{"title":"Factors Influencing University Students' Behavioural Intention to Use Generative Artificial Intelligence for Educational Purposes Based on a Revised UTAUT2 Model","authors":"Xin Tang,&nbsp;Zhiqiang Yuan,&nbsp;Shaojun Qu","doi":"10.1111/jcal.13105","DOIUrl":"https://doi.org/10.1111/jcal.13105","url":null,"abstract":"&lt;div&gt;\u0000 \u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;h3&gt; Background&lt;/h3&gt;\u0000 \u0000 &lt;p&gt;Generative artificial intelligence (AI) represents a significant technological leap, with platforms like OpenAI's ChatGPT and Baidu's Ernie Bot at the forefront of innovation. This technology has seen widespread adoption across various sectors of society and is anticipated to revolutionise the educational landscape, especially in the domain of tertiary education. However, there is a gap in understanding factors influencing university students' behavioural intention to use generative AI, leading to hesitation in its adoption.&lt;/p&gt;\u0000 &lt;/section&gt;\u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;h3&gt; Objectives&lt;/h3&gt;\u0000 \u0000 &lt;p&gt;The primary objective of this study was to investigate the factors that influence university students' behavioural intention to engage with and utilise generative AI. The study sought to delve into the fundamental reasons and obstacles that university students encounter when contemplating the adoption of this technology for their academic endeavours.&lt;/p&gt;\u0000 &lt;/section&gt;\u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;h3&gt; Methods&lt;/h3&gt;\u0000 \u0000 &lt;p&gt;The study used a quantitative research design, utilising a revised version of the Unified Theory of Acceptance and Use of Technology 2 (UTAUT2) model. Data were collected from a sample of 380 university students in Changsha, the capital city of Hunan in China. Partial least squares structural equation modelling (PLS-SEM) was used to analyse the relationships between the variables of the model, which included performance expectancy (PE), effort expectancy (EE), social influence (SI), facilitating conditions (FC), learning value, habit and behavioural intention.&lt;/p&gt;\u0000 &lt;/section&gt;\u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;h3&gt; Results&lt;/h3&gt;\u0000 \u0000 &lt;p&gt;The analysis revealed that PE and EE have a direct impact on learning value. Additionally, SI and FC were found to directly affect the formation of habit. Among these factors, learning value emerged as the most potent predictor of university students' behavioural intention to use generative AI. Habit also demonstrated a significant, albeit smaller, effect on behavioural intention.&lt;/p&gt;\u0000 &lt;/section&gt;\u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;h3&gt; Conclusions&lt;/h3&gt;\u0000 \u0000 &lt;p&gt;The study's findings underscore the importance of learning value in driving the adoption of generative AI among university students. Efforts to enhance the learning value of generative AI could significantly increase its uptake in higher education. Furthermore, the role of habit, while less pronounced, suggests that consistent exposure and use can foster a greater inclination towards generative AI. These insights provide a foundation for targeted interventions aimed at improving the integration and application of generative A","PeriodicalId":48071,"journal":{"name":"Journal of Computer Assisted Learning","volume":"41 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2024-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142861620","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Tech-driven excellence: A quantitative analysis of cutting-edge technology impact on professional sports training 技术驱动卓越:尖端技术对职业体育训练影响的定量分析
IF 5.1 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-12-17 DOI: 10.1111/jcal.13082
Meiyan Huang, Tang Yongquan

Aim

In recent years, the integration of cutting-edge technology into professional sports training (ST) has revolutionized the way athletes prepare for competition. The study aims to quantitatively analyse the impact of cutting-edge technology on enhancing performance, efficiency, and outcomes in professional ST programs.

Purpose

The purpose of this study is to investigate how advanced technologies influence training effectiveness in professional sports, with a focus on performance enhancement, injury prevention, and overall athlete development.

Methods

This study utilized a quantitative descriptive research design to assess technology's impact on ST. A sample of 450 sports professionals, selected through purposive sampling, completed structured questionnaires. Data were analysed using SPSS to identify correlations between technology use and training outcomes.

Findings

The research findings indicate that athletes utilizing virtual reality (VR), AR, and wearable technology (WT) in their training exhibit significant improvements in performance metrics (PM) and a reduction in injury risks compared to those relying on traditional training methods.

Result

The study results demonstrate that technology-assisted training improves cognitive skills (CS), decision-making, and psychological aspects like motivation and focus. Additionally, advanced analytics and artificial intelligence (AI) enable more effective, personalized coaching strategies, enhancing overall training outcomes.

Originality

This study's contribution lies in its novel approach, demonstrating virtual and augmented reality, wearable tech, and advanced analytics enhance ST by improving performance, CS, and resilience, while also reducing injuries and speeding up recovery.

Conclusion

This research significantly advances the sports science domain by offering empirical evidence supporting technology integration, filling prevalent gaps in the current literature.

目的 近年来,将尖端技术融入专业运动训练(ST)彻底改变了运动员备战比赛的方式。本研究旨在定量分析尖端科技对提高专业体育训练项目的表现、效率和成果的影响。 目的 本研究的目的是调查先进技术如何影响专业体育训练的效果,重点是提高成绩、预防伤病和运动员的整体发展。 方法 本研究采用定量描述性研究设计来评估技术对 ST 的影响。通过有目的的抽样选出的 450 名体育专业人士填写了结构化问卷。使用 SPSS 对数据进行分析,以确定技术使用与训练成果之间的相关性。 研究结果 研究结果表明,与依赖传统训练方法的运动员相比,在训练中使用虚拟现实(VR)、增强现实(AR)和可穿戴技术(WT)的运动员在成绩指标(PM)方面有显著提高,受伤风险也有所降低。 结果 研究结果表明,技术辅助训练可提高认知技能(CS)、决策以及动机和专注力等心理方面。此外,先进的分析技术和人工智能(AI)可实现更有效的个性化教练策略,从而提高整体训练效果。 独创性 本研究的贡献在于它采用了新颖的方法,展示了虚拟现实和增强现实技术、可穿戴技术和先进的分析技术,通过提高成绩、CS 和应变能力来增强 ST,同时还能减少损伤和加快恢复。 结论 本研究通过提供支持技术整合的经验证据,填补了当前文献中的普遍空白,极大地推动了体育科学领域的发展。
{"title":"Tech-driven excellence: A quantitative analysis of cutting-edge technology impact on professional sports training","authors":"Meiyan Huang,&nbsp;Tang Yongquan","doi":"10.1111/jcal.13082","DOIUrl":"https://doi.org/10.1111/jcal.13082","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Aim</h3>\u0000 \u0000 <p>In recent years, the integration of cutting-edge technology into professional sports training (ST) has revolutionized the way athletes prepare for competition. The study aims to quantitatively analyse the impact of cutting-edge technology on enhancing performance, efficiency, and outcomes in professional ST programs.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Purpose</h3>\u0000 \u0000 <p>The purpose of this study is to investigate how advanced technologies influence training effectiveness in professional sports, with a focus on performance enhancement, injury prevention, and overall athlete development.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>This study utilized a quantitative descriptive research design to assess technology's impact on ST. A sample of 450 sports professionals, selected through purposive sampling, completed structured questionnaires. Data were analysed using SPSS to identify correlations between technology use and training outcomes.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Findings</h3>\u0000 \u0000 <p>The research findings indicate that athletes utilizing virtual reality (VR), AR, and wearable technology (WT) in their training exhibit significant improvements in performance metrics (PM) and a reduction in injury risks compared to those relying on traditional training methods.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Result</h3>\u0000 \u0000 <p>The study results demonstrate that technology-assisted training improves cognitive skills (CS), decision-making, and psychological aspects like motivation and focus. Additionally, advanced analytics and artificial intelligence (AI) enable more effective, personalized coaching strategies, enhancing overall training outcomes.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Originality</h3>\u0000 \u0000 <p>This study's contribution lies in its novel approach, demonstrating virtual and augmented reality, wearable tech, and advanced analytics enhance ST by improving performance, CS, and resilience, while also reducing injuries and speeding up recovery.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusion</h3>\u0000 \u0000 <p>This research significantly advances the sports science domain by offering empirical evidence supporting technology integration, filling prevalent gaps in the current literature.</p>\u0000 </section>\u0000 </div>","PeriodicalId":48071,"journal":{"name":"Journal of Computer Assisted Learning","volume":"41 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2024-12-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142861833","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Towards a Design of the Best Practices for AR-Guided Oral Communication Development: A Systematic Review of Selected Research Published From 2000 to 2023 面向ar引导的口头交流发展的最佳实践设计:对2000年至2023年发表的精选研究的系统回顾
IF 5.1 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-12-11 DOI: 10.1111/jcal.13103
Keng-Chih Hsu, Gi-Zen Liu

Background

Augmented reality (AR) emerges as a technology with considerable promise and substantial potential for pedagogical integration within language education contexts. However, there remains a scarcity of review studies exploring the best practices and principles for oral communication facilitation based on robust theoretical models or research-proven theories.

Objectives

This paper aims to explore the major constituents for achieving the successful outcomes of AR-assisted oral communication, grounded in the theory-based design model, and formulate theoretical guidelines to enhance the best practice facilitation process.

Methods

Starting from 255 sources, 25 studies from the ISI Web of Science were selected through rigorous screening processes based on the guidelines of the PRISMA statement. Furthermore, the researchers adopted qualitative content analysis and complementary quantitative descriptive analysis for data synthesis in accordance with four key variables of the established model.

Results and Conclusions

The results showed that the guided learner-directed learning approach supported by constructionists and reflective learning mechanisms was identified as an effective pedagogical design. Additionally, educational practitioners could employ hybrid learning strategies, including situated, collaborative, self-regulated and game-based learning strategies, to facilitate effective verbal communication. Finally, besides augmenting location-based content and facilitating contextual information and discussion, AR designers were advised to integrate personalised features such as self-monitoring and evaluating and learner manipulation of virtual objects into system development to promote learners' locus of control and embodied cognition.

增强现实(AR)作为一项具有相当前景和巨大潜力的技术出现在语言教育背景下的教学整合中。然而,基于强大的理论模型或研究证明的理论,探索促进口头交流的最佳实践和原则的综述研究仍然很少。本文旨在以基于理论的设计模型为基础,探讨实现ar辅助口头交流成功的主要因素,并制定理论指导方针,以增强最佳实践促进过程。方法根据PRISMA声明的指导原则,通过严格的筛选程序,从ISI Web of Science的255个来源中选出25项研究。根据所建立模型的四个关键变量,采用定性内容分析和补充性定量描述性分析进行数据综合。结果与结论结果表明,建构主义和反思性学习机制支持的学习者导向学习方法是一种有效的教学设计。此外,教育从业者可以采用混合学习策略,包括情境学习策略、协作学习策略、自我调节学习策略和基于游戏的学习策略,以促进有效的语言交流。最后,除了增强基于位置的内容和促进上下文信息和讨论外,AR设计师还被建议将个性化功能(如自我监控和评估以及学习者对虚拟物体的操作)集成到系统开发中,以促进学习者的控制点和具身认知。
{"title":"Towards a Design of the Best Practices for AR-Guided Oral Communication Development: A Systematic Review of Selected Research Published From 2000 to 2023","authors":"Keng-Chih Hsu,&nbsp;Gi-Zen Liu","doi":"10.1111/jcal.13103","DOIUrl":"https://doi.org/10.1111/jcal.13103","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Background</h3>\u0000 \u0000 <p>Augmented reality (AR) emerges as a technology with considerable promise and substantial potential for pedagogical integration within language education contexts. However, there remains a scarcity of review studies exploring the best practices and principles for oral communication facilitation based on robust theoretical models or research-proven theories.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Objectives</h3>\u0000 \u0000 <p>This paper aims to explore the major constituents for achieving the successful outcomes of AR-assisted oral communication, grounded in the theory-based design model, and formulate theoretical guidelines to enhance the best practice facilitation process.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>Starting from 255 sources, 25 studies from the ISI Web of Science were selected through rigorous screening processes based on the guidelines of the PRISMA statement. Furthermore, the researchers adopted qualitative content analysis and complementary quantitative descriptive analysis for data synthesis in accordance with four key variables of the established model.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results and Conclusions</h3>\u0000 \u0000 <p>The results showed that the guided learner-directed learning approach supported by constructionists and reflective learning mechanisms was identified as an effective pedagogical design. Additionally, educational practitioners could employ hybrid learning strategies, including situated, collaborative, self-regulated and game-based learning strategies, to facilitate effective verbal communication. Finally, besides augmenting location-based content and facilitating contextual information and discussion, AR designers were advised to integrate personalised features such as self-monitoring and evaluating and learner manipulation of virtual objects into system development to promote learners' locus of control and embodied cognition.</p>\u0000 </section>\u0000 </div>","PeriodicalId":48071,"journal":{"name":"Journal of Computer Assisted Learning","volume":"41 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2024-12-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142868359","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Unlocking Augmented Reality Learning Design Based on Evidence From Empirical Cognitive Load Studies—A Systematic Literature Review 基于实证认知负荷研究证据的增强现实学习设计--系统性文献综述
IF 5.1 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-12-02 DOI: 10.1111/jcal.13095
Jana Gonnermann-Müller, Jule M. Krüger

Background

Despite the numerous positive effects of augmented reality (AR) on learning, previous research has shown ambiguous results regarding the cognitive demand on the learner arising from, for example, the overlay of virtual elements or novel interaction techniques. At the same time, the number of evidence-based guidelines on designing AR is limited or focuses on global effects, primarily relying on media comparison studies, whose validity is criticised.

Objective

To guide the meaningful design of learning and training settings, this paper systematically reviews empirical research on AR design and synthesises the findings to develop evidence-based recommendations for designing AR systems considering cognitive load.

Methods

We conducted a systematic literature review, initially screening 810 distinct papers and ultimately analysing findings from 27 publications, which report on 29 distinct experimental studies. This selection was based on rigorously defined inclusion and exclusion criteria, adhering to the PRISMA guidelines.

Results and Conclusion

The central value of this paper is the aggregation of existing evidence from empirical studies, resulting in 15 recommendations for AR design based on six design dimensions: Spatiality-related, Interaction-related, Contextuality-related, Content-related, Guidance-related and Display Selection. Additionally, with three points for future research, this systematic literature review, first, stresses the need for more empirical evidence and value-added studies. Second, learner characteristics that might influence cognitive load in AR-based learning should be examined. Third, it advocates for the inclusion of measurements beyond the NASA-TLX, and including more physiological measurements (e.g., eye-tracking, EEG) to enhance the applicability of the results for learning and training situations.

尽管增强现实(AR)对学习产生了许多积极的影响,但以往的研究在虚拟元素的叠加或新的交互技术对学习者产生的认知需求方面显示出模糊的结果。与此同时,基于证据的AR设计指南数量有限或侧重于全球影响,主要依赖于媒体比较研究,其有效性受到批评。为了指导有意义的学习和培训环境设计,本文系统地回顾了AR设计的实证研究,并综合研究结果,为考虑认知负荷的AR系统设计提供循证建议。我们进行了系统的文献综述,最初筛选了810篇不同的论文,最终分析了27篇出版物的发现,这些出版物报告了29项不同的实验研究。这一选择是基于严格定义的纳入和排除标准,坚持PRISMA指南。本文的核心价值在于对现有实证研究的证据进行汇总,得出了基于六个设计维度的15条AR设计建议:空间相关、交互相关、情境相关、内容相关、引导相关和显示选择。此外,对于未来的研究,本系统的文献综述有三点,首先,强调需要更多的经验证据和增值研究。其次,应该研究可能影响基于ar学习认知负荷的学习者特征。第三,它主张在NASA-TLX之外纳入更多的测量,包括更多的生理测量(如眼动追踪、脑电图),以增强结果对学习和训练情况的适用性。
{"title":"Unlocking Augmented Reality Learning Design Based on Evidence From Empirical Cognitive Load Studies—A Systematic Literature Review","authors":"Jana Gonnermann-Müller,&nbsp;Jule M. Krüger","doi":"10.1111/jcal.13095","DOIUrl":"https://doi.org/10.1111/jcal.13095","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Background</h3>\u0000 \u0000 <p>Despite the numerous positive effects of augmented reality (AR) on learning, previous research has shown ambiguous results regarding the cognitive demand on the learner arising from, for example, the overlay of virtual elements or novel interaction techniques. At the same time, the number of evidence-based guidelines on designing AR is limited or focuses on global effects, primarily relying on media comparison studies, whose validity is criticised.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Objective</h3>\u0000 \u0000 <p>To guide the meaningful design of learning and training settings, this paper systematically reviews empirical research on AR design and synthesises the findings to develop evidence-based recommendations for designing AR systems considering cognitive load.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>We conducted a systematic literature review, initially screening 810 distinct papers and ultimately analysing findings from 27 publications, which report on 29 distinct experimental studies. This selection was based on rigorously defined inclusion and exclusion criteria, adhering to the PRISMA guidelines.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results and Conclusion</h3>\u0000 \u0000 <p>The central value of this paper is the aggregation of existing evidence from empirical studies, resulting in 15 recommendations for AR design based on six design dimensions: Spatiality-related, Interaction-related, Contextuality-related, Content-related, Guidance-related and Display Selection. Additionally, with three points for future research, this systematic literature review, first, stresses the need for more empirical evidence and value-added studies. Second, learner characteristics that might influence cognitive load in AR-based learning should be examined. Third, it advocates for the inclusion of measurements beyond the NASA-TLX, and including more physiological measurements (e.g., eye-tracking, EEG) to enhance the applicability of the results for learning and training situations.</p>\u0000 </section>\u0000 </div>","PeriodicalId":48071,"journal":{"name":"Journal of Computer Assisted Learning","volume":"41 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2024-12-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/jcal.13095","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142860026","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Learning Programming With Augmented Reality-Based Editor: A Dynamic Code Visualisation Approach 基于增强现实的编辑器学习编程:一种动态代码可视化方法
IF 5.1 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-11-28 DOI: 10.1111/jcal.13093
Merve Aydin, Ünal Çakiroğlu

Background

Students experience higher-order thinking skills by finding ways to solve the problem, debugging errors while applying the solution, and testing the solution in programming. However, the inability to create schemas that will characterise programming structures is one of the difficulties during this process.

Objectives

This study aimed to create an augmented reality-based programming editor and evaluate its contributions to learning programming. Text-based programming codes developed by the students on the editor were instantly visualised through a traffic metaphor in dynamic visualisation via augmented reality. The findings of this study highlight the significance of a novel usage of augmented reality in shaping cognitive processes during the programming learning process.

Methods

An exploratory case study was adopted in the study. Participants voluntarily selected 15 students in the same secondary school's 4th and 5th grades. The data to determine the programming performances were collected via a programming performance test and analysed with the rubric created by the authors. Interviews and screen recordings were employed to determine the factors that had a role in the programming learning process.

Results and Conclusions

The results indicated that teaching programming using the augmented reality-based editor has positively contributed to learning programming. The editor's scenario, animation, and error display features incorporated with an authentic dynamic visualisation were remarkable in this contribution. The editor also contributed to reducing students' efforts to create schemas for programming by bringing the context closer to reality throughout the programming process.

学生通过寻找解决问题的方法,在应用解决方案时调试错误,以及在编程中测试解决方案来体验高阶思维技能。然而,无法创建能够描述编程结构的模式是这个过程中的困难之一。本研究旨在创造一个基于扩增实境的程式设计编辑器,并评估其对程式设计学习的贡献。学生们在编辑器上开发的基于文本的编程代码,通过增强现实的动态可视化,通过交通隐喻立即可视化。本研究的发现强调了增强现实在编程学习过程中塑造认知过程的新用途的重要性。方法采用探索性案例研究方法。参与者自愿选择了同一所中学四年级和五年级的15名学生。通过编程性能测试收集了用于确定编程性能的数据,并用作者创建的标准进行了分析。采用访谈和屏幕录音来确定在编程学习过程中起作用的因素。结果与结论使用基于增强现实的编辑器进行编程教学对编程学习有积极的促进作用。编辑器的场景、动画和错误显示功能与真实的动态可视化相结合,在这方面的贡献是显著的。该编辑器还通过在整个编程过程中使上下文更接近现实,减少了学生为编程创建模式的工作量。
{"title":"Learning Programming With Augmented Reality-Based Editor: A Dynamic Code Visualisation Approach","authors":"Merve Aydin,&nbsp;Ünal Çakiroğlu","doi":"10.1111/jcal.13093","DOIUrl":"https://doi.org/10.1111/jcal.13093","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Background</h3>\u0000 \u0000 <p>Students experience higher-order thinking skills by finding ways to solve the problem, debugging errors while applying the solution, and testing the solution in programming. However, the inability to create schemas that will characterise programming structures is one of the difficulties during this process.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Objectives</h3>\u0000 \u0000 <p>This study aimed to create an augmented reality-based programming editor and evaluate its contributions to learning programming. Text-based programming codes developed by the students on the editor were instantly visualised through a traffic metaphor in dynamic visualisation via augmented reality. The findings of this study highlight the significance of a novel usage of augmented reality in shaping cognitive processes during the programming learning process.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>An exploratory case study was adopted in the study. Participants voluntarily selected 15 students in the same secondary school's 4th and 5th grades. The data to determine the programming performances were collected via a programming performance test and analysed with the rubric created by the authors. Interviews and screen recordings were employed to determine the factors that had a role in the programming learning process.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results and Conclusions</h3>\u0000 \u0000 <p>The results indicated that teaching programming using the augmented reality-based editor has positively contributed to learning programming. The editor's scenario, animation, and error display features incorporated with an authentic dynamic visualisation were remarkable in this contribution. The editor also contributed to reducing students' efforts to create schemas for programming by bringing the context closer to reality throughout the programming process.</p>\u0000 </section>\u0000 </div>","PeriodicalId":48071,"journal":{"name":"Journal of Computer Assisted Learning","volume":"41 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2024-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142862199","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Effect of AI-Based Systems on Mathematics Achievement in Rural Context: A Quantitative Study 基于人工智能的系统对农村地区数学成绩的影响:定量研究
IF 5.1 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-11-19 DOI: 10.1111/jcal.13098
Rashmi Khazanchi, Daniele Di Mitri, Hendrik Drachsler
<div> <section> <h3> Background</h3> <p>Despite educational advances, poor mathematics achievement persists among K-12 students, particularly in rural areas with limited resources and skilled teachers. Artificial Intelligence (AI) based systems have increasingly been adopted to support the diverse learning needs of students and have been shown to enhance mathematics achievement through personalized learning experiences by adapting to student's needs. Existing studies have documented the positive impact of AI-based systems on mathematics achievement. However, there is a lack of research that has studied AI-based systems on students' mathematics achievement and engagement in rural settings. The present study addresses the existing literature gap by focusing on the AI-based Edmentum Exact Path, analyzing its effectiveness in enhancing mathematics achievement and engagement among 8th-grade students in rural schools in the Southern United States. By examining both cognitive and affective engagement, along with students' mathematics achievement, this research explores the role of AI-based systems in student learning.</p> </section> <section> <h3> Objective</h3> <p>This study aims to explore the effectiveness of Edmentum Exact Path, an AI-based system, in improving 8th-grade students' mathematics achievement and affective and cognitive engagement in the Southern United States.</p> </section> <section> <h3> Methods</h3> <p>This study utilized a quasi-experimental design involving 78 students from socioeconomically disadvantaged backgrounds, comparing those receiving supplemental Edmentum Exact Path-led instruction and traditional teacher-led methods to a control group receiving only the teacher-led instructions. Mathematics achievement was measured through pre-tests and post-tests, while student engagement was assessed using the 5-point Student Engagement Instrument (SEI). Statistical analysis was performed using <i>t</i>-tests and ANOVA.</p> </section> <section> <h3> Results and Conclusions</h3> <p>The findings revealed statistically significant improvements in mathematics achievement for both the experimental and control groups. However, the group using teacher-led instruction showed a statistically significant improvement in affective engagement, while no statistically significant differences were observed in cognitive engagement between groups.</p> </section> <section> <h3> Implications</h3> <p>The findings suggest that integrating AI-based systems lik
背景 尽管教育取得了进步,但 K-12 学生的数学成绩仍然很差,尤其是在资源和师资有限的农村地区。基于人工智能(AI)的系统已被越来越多地采用,以支持学生的不同学习需求,并通过适应学生需求的个性化学习体验来提高数学成绩。现有研究记录了人工智能系统对数学成绩的积极影响。然而,目前还缺乏关于人工智能系统对农村学生数学成绩和参与度的研究。本研究关注基于人工智能的 Edmentum Exact Path,分析了它在提高美国南部农村学校八年级学生数学成绩和参与度方面的有效性,从而弥补了现有的文献空白。通过考察认知和情感参与以及学生的数学成绩,本研究探讨了基于人工智能的系统在学生学习中的作用。 目的 本研究旨在探索 Edmentum Exact Path(一种基于人工智能的系统)在提高美国南部八年级学生数学成绩以及情感和认知参与方面的有效性。 方法 本研究采用准实验设计,涉及 78 名来自社会经济弱势背景的学生,将接受以 Edmentum Exact Path 为主导的补充教学和传统教师指导方法的学生与仅接受教师指导的对照组学生进行比较。数学成绩通过前测和后测进行测量,而学生参与度则通过 5 点学生参与度问卷(SEI)进行评估。统计分析采用 t 检验和方差分析。 结果与结论 研究结果显示,实验组和对照组的数学成绩均有显著提高。然而,使用教师指导的实验组在情感参与度方面有明显的统计意义上的提高,而在认知参与度方面,实验组和对照组之间没有统计意义上的显著差异。 启示 研究结果表明,整合 Edmentum Exact Path 等人工智能系统可提高农村地区学生的数学情感参与度。然而,对认知参与的影响仍不清楚,这表明需要进一步研究。这些结果支持了整合人工智能系统以提高农村地区数学成绩的潜力。
{"title":"The Effect of AI-Based Systems on Mathematics Achievement in Rural Context: A Quantitative Study","authors":"Rashmi Khazanchi,&nbsp;Daniele Di Mitri,&nbsp;Hendrik Drachsler","doi":"10.1111/jcal.13098","DOIUrl":"https://doi.org/10.1111/jcal.13098","url":null,"abstract":"&lt;div&gt;\u0000 \u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;h3&gt; Background&lt;/h3&gt;\u0000 \u0000 &lt;p&gt;Despite educational advances, poor mathematics achievement persists among K-12 students, particularly in rural areas with limited resources and skilled teachers. Artificial Intelligence (AI) based systems have increasingly been adopted to support the diverse learning needs of students and have been shown to enhance mathematics achievement through personalized learning experiences by adapting to student's needs. Existing studies have documented the positive impact of AI-based systems on mathematics achievement. However, there is a lack of research that has studied AI-based systems on students' mathematics achievement and engagement in rural settings. The present study addresses the existing literature gap by focusing on the AI-based Edmentum Exact Path, analyzing its effectiveness in enhancing mathematics achievement and engagement among 8th-grade students in rural schools in the Southern United States. By examining both cognitive and affective engagement, along with students' mathematics achievement, this research explores the role of AI-based systems in student learning.&lt;/p&gt;\u0000 &lt;/section&gt;\u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;h3&gt; Objective&lt;/h3&gt;\u0000 \u0000 &lt;p&gt;This study aims to explore the effectiveness of Edmentum Exact Path, an AI-based system, in improving 8th-grade students' mathematics achievement and affective and cognitive engagement in the Southern United States.&lt;/p&gt;\u0000 &lt;/section&gt;\u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;h3&gt; Methods&lt;/h3&gt;\u0000 \u0000 &lt;p&gt;This study utilized a quasi-experimental design involving 78 students from socioeconomically disadvantaged backgrounds, comparing those receiving supplemental Edmentum Exact Path-led instruction and traditional teacher-led methods to a control group receiving only the teacher-led instructions. Mathematics achievement was measured through pre-tests and post-tests, while student engagement was assessed using the 5-point Student Engagement Instrument (SEI). Statistical analysis was performed using &lt;i&gt;t&lt;/i&gt;-tests and ANOVA.&lt;/p&gt;\u0000 &lt;/section&gt;\u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;h3&gt; Results and Conclusions&lt;/h3&gt;\u0000 \u0000 &lt;p&gt;The findings revealed statistically significant improvements in mathematics achievement for both the experimental and control groups. However, the group using teacher-led instruction showed a statistically significant improvement in affective engagement, while no statistically significant differences were observed in cognitive engagement between groups.&lt;/p&gt;\u0000 &lt;/section&gt;\u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;h3&gt; Implications&lt;/h3&gt;\u0000 \u0000 &lt;p&gt;The findings suggest that integrating AI-based systems lik","PeriodicalId":48071,"journal":{"name":"Journal of Computer Assisted Learning","volume":"41 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2024-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/jcal.13098","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142862058","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Eye Movement Modelling Examples as Cues to Guide Attention and Improve Learning in Short or Long Animations 以眼动模型示例为线索,引导注意力并提高长短动画的学习效果
IF 5.1 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-11-19 DOI: 10.1111/jcal.13094
Fuxing Wang, Xiaoxue Leng, Ziyi Kuang, Tingting Zhao

Background

Both eye movement modelling examples (EMMEs) and cues guide attention and improve learning in multimedia learning environments. EMME can act as a special form of cue. However, no studies have directly examined whether EMME would be superior to visual cues.

Objective

The study was to investigate whether there were advantages of EMME over cues on visual attention, learning outcomes and subjective perception in a multimedia environment.

Method

In Experiment 1, 67 college students were randomly assigned to the EMME group, cue group and control group and learned from animations explaining the synaptic transmission. In Experiment 2, we replicated Experiment 1 using longer learning material. Seventy-one college students were randomly assigned to three groups (EMME, cue and control) and learned from animations explaining the process of cell division.

Results and Conclusions

In Experiment 1, results indicated both EMMEs and cues guide attention and facilitate learning. Regarding learning outcomes and subjective perception, learners did not benefit more from EMMEs than cues. Eye movement indicators showed that EMMEs were better than cues. In Experiment 2, results were consistent with Experiment 1.

Implications

This study is the first to compare EMMEs and cues. We found that EMMEs and cues were equivalent in producing effects on learning outcomes and subjective perception. EMMEs were superior to cues in guiding attention and conveying strategies, as indicated by eye movements. Both theoretical and practical implications could be drawn.

背景 在多媒体学习环境中,眼动模型(EMMEs)和提示都能引导注意力,提高学习效果。眼动模型可以作为一种特殊形式的线索。然而,目前还没有研究直接探讨眼动模型是否优于视觉线索。 本研究的目的是探讨在多媒体环境中,EMME 在视觉注意力、学习效果和主观感知方面是否比视觉线索更有优势。 方法 在实验 1 中,67 名大学生被随机分配到 EMME 组、提示组和对照组,通过讲解突触传递的动画进行学习。在实验 2 中,我们用更长的学习材料重复了实验 1。71 名大学生被随机分配到三个组(EMME 组、提示组和对照组),通过讲解细胞分裂过程的动画进行学习。 结果与结论 在实验 1 中,结果表明 EMME 和提示都能引导注意力并促进学习。在学习结果和主观感受方面,学习者从电子学习媒体中获得的益处并不比从提示中获得的益处多。眼动指标显示,眼动监测仪比提示更好。实验 2 的结果与实验 1 一致。 意义 本研究是首次对眼动监测器和提示进行比较。我们发现,在对学习结果和主观感知产生影响方面,眼动监测仪和线索具有同等作用。在引导注意力和传达策略方面,从眼球运动的角度来看,教育监测媒体优于线索。这既有理论意义,也有实践意义。
{"title":"Eye Movement Modelling Examples as Cues to Guide Attention and Improve Learning in Short or Long Animations","authors":"Fuxing Wang,&nbsp;Xiaoxue Leng,&nbsp;Ziyi Kuang,&nbsp;Tingting Zhao","doi":"10.1111/jcal.13094","DOIUrl":"https://doi.org/10.1111/jcal.13094","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Background</h3>\u0000 \u0000 <p>Both eye movement modelling examples (EMMEs) and cues guide attention and improve learning in multimedia learning environments. EMME can act as a special form of cue. However, no studies have directly examined whether EMME would be superior to visual cues.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Objective</h3>\u0000 \u0000 <p>The study was to investigate whether there were advantages of EMME over cues on visual attention, learning outcomes and subjective perception in a multimedia environment.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Method</h3>\u0000 \u0000 <p>In Experiment 1, 67 college students were randomly assigned to the EMME group, cue group and control group and learned from animations explaining the synaptic transmission. In Experiment 2, we replicated Experiment 1 using longer learning material. Seventy-one college students were randomly assigned to three groups (EMME, cue and control) and learned from animations explaining the process of cell division.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results and Conclusions</h3>\u0000 \u0000 <p>In Experiment 1, results indicated both EMMEs and cues guide attention and facilitate learning. Regarding learning outcomes and subjective perception, learners did not benefit more from EMMEs than cues. Eye movement indicators showed that EMMEs were better than cues. In Experiment 2, results were consistent with Experiment 1.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Implications</h3>\u0000 \u0000 <p>This study is the first to compare EMMEs and cues. We found that EMMEs and cues were equivalent in producing effects on learning outcomes and subjective perception. EMMEs were superior to cues in guiding attention and conveying strategies, as indicated by eye movements. Both theoretical and practical implications could be drawn.</p>\u0000 </section>\u0000 </div>","PeriodicalId":48071,"journal":{"name":"Journal of Computer Assisted Learning","volume":"41 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2024-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142862059","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Uncovering adults' problem-solving patterns from process data with hidden Markov model and network analysis 利用隐马尔可夫模型和网络分析从过程数据中发现成人解决问题的模式
IF 5.1 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-11-14 DOI: 10.1111/jcal.13089
Xiaoxiao Liu, Okan Bulut, Ying Cui, Yizhu Gao

Background

Process data captured by computer-based assessments provide valuable insight into respondents' cognitive processes during problem-solving tasks. Although previous studies have utilized process data to analyse behavioural patterns or strategies in problem-solving tasks, the connection between latent cognitive states and their theoretical interpretation in problem solving remains unclear.

Objectives

This research aims to investigate the connections between similar hidden response states and unfold respondents' transition paths in problem-solving processes. Analysing process data from the 2012 United States Programme for the International Assessment of Adult Competencies (PIAAC), this study seeks to discern patterns in problem solving among participants.

Methods

The hidden Markov model was first used to uncover the hidden states based on a sequence of observed actions. Next, Gaussian graphical network analysis was employed to analyse the relationships between hidden response states.

Results and Conclusions

Results indicated that correct responders had simpler, clearer state relationships, while incorrect responders displayed more complex connections. Respondents who solved the tasks correctly had clearer thoughts about the problem-solving process, whereas incorrect respondents struggled to understand the problem and failed to figure out solutions. Cognitive state changes during problem solving also varied between groups. The correct groups showed cohesive, logical transitions, in contrast to the emerged isolated, erratic patterns of the incorrect groups.

基于计算机的评估获取的过程数据为调查对象在解决问题任务期间的认知过程提供了有价值的见解。虽然以前的研究利用过程数据来分析问题解决任务中的行为模式或策略,但潜在认知状态与其在问题解决中的理论解释之间的联系尚不清楚。目的探讨相似隐藏反应状态之间的联系,揭示被调查者在问题解决过程中的转换路径。本研究分析了2012年美国成人国际能力评估项目(PIAAC)的过程数据,旨在辨别参与者解决问题的模式。方法首先利用隐马尔可夫模型,根据观察到的动作序列揭示隐藏状态。其次,采用高斯图网络分析方法分析了隐藏响应状态之间的关系。结果与结论结果表明,正确应答者的状态关系较为简单、清晰,错误应答者的状态关系较为复杂。正确解决任务的受访者对解决问题的过程有更清晰的想法,而不正确的受访者则难以理解问题,无法找到解决方案。在解决问题的过程中,认知状态的变化在不同的组之间也有所不同。正确的组呈现出连贯的、逻辑的过渡,而不正确的组则呈现出孤立的、不稳定的模式。
{"title":"Uncovering adults' problem-solving patterns from process data with hidden Markov model and network analysis","authors":"Xiaoxiao Liu,&nbsp;Okan Bulut,&nbsp;Ying Cui,&nbsp;Yizhu Gao","doi":"10.1111/jcal.13089","DOIUrl":"https://doi.org/10.1111/jcal.13089","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Background</h3>\u0000 \u0000 <p>Process data captured by computer-based assessments provide valuable insight into respondents' cognitive processes during problem-solving tasks. Although previous studies have utilized process data to analyse behavioural patterns or strategies in problem-solving tasks, the connection between latent cognitive states and their theoretical interpretation in problem solving remains unclear.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Objectives</h3>\u0000 \u0000 <p>This research aims to investigate the connections between similar hidden response states and unfold respondents' transition paths in problem-solving processes. Analysing process data from the 2012 United States Programme for the International Assessment of Adult Competencies (PIAAC), this study seeks to discern patterns in problem solving among participants.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>The hidden Markov model was first used to uncover the hidden states based on a sequence of observed actions. Next, Gaussian graphical network analysis was employed to analyse the relationships between hidden response states.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results and Conclusions</h3>\u0000 \u0000 <p>Results indicated that correct responders had simpler, clearer state relationships, while incorrect responders displayed more complex connections. Respondents who solved the tasks correctly had clearer thoughts about the problem-solving process, whereas incorrect respondents struggled to understand the problem and failed to figure out solutions. Cognitive state changes during problem solving also varied between groups. The correct groups showed cohesive, logical transitions, in contrast to the emerged isolated, erratic patterns of the incorrect groups.</p>\u0000 </section>\u0000 </div>","PeriodicalId":48071,"journal":{"name":"Journal of Computer Assisted Learning","volume":"41 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2024-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/jcal.13089","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142861138","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The impact of frequency and stakes of formative assessment on student achievement in higher education: A learning analytics study 高等教育中形成性评估的频率和利害关系对学生成绩的影响:一项学习分析研究
IF 5.1 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-11-13 DOI: 10.1111/jcal.13087
Okan Bulut, Guher Gorgun, Seyma Nur Yildirim-Erbasli

Background

Research shows that how formative assessments are operationalized plays a crucial role in shaping their engagement with formative assessments, thereby impacting their effectiveness in predicting academic achievement. Mandatory assessments can ensure consistent student participation, leading to better tracking of learning progress. Optional assessments may encourage voluntary engagement, potentially leading to a more genuine reflection of student understanding. Also, frequent assessments provide continuous opportunities for feedback and adjustment, which can keep students actively engaged in the learning process.

Objectives

This study aims to investigate two crucial facets of formative assessments: frequency and the level of stakes involved (mandatory vs. optional). We examine how modifying the frequency of formative assessments affects students' course performance. Additionally, we evaluate the impact of mandatory versus optional formative assessments on students' course performance in higher education.

Methods

The sample of this study consisted of undergraduate students (n = 336) enrolled in three sections of a large asynchronous course at a Canadian university. We extracted features associated with online formative assessments (e.g., the number of attempts and average scores) from the learning management system. Next, we used these features to predict students' performance in summative assessments (two midterms and a final exam).

Results and Conclusions

Our findings indicated that increasing the frequency of online formative assessments did not consistently improve student performance. Also, participation frequency in online formative assessments seemed to vary depending on assessment stakes (i.e., optional vs. mandatory). We recommend that instructors examine what conditions can maximize the contribution of formative assessments to students' academic achievement before building predictive models.

研究表明,形成性评估的操作方式在塑造学生参与形成性评估的过程中起着至关重要的作用,从而影响其预测学业成绩的有效性。强制性评估可以确保学生的持续参与,从而更好地跟踪学习进度。可选的评估可能会鼓励自愿参与,可能会更真实地反映学生的理解。此外,频繁的评估为反馈和调整提供了持续的机会,这可以使学生积极地参与到学习过程中。本研究旨在探讨形成性评估的两个关键方面:频率和涉及的利害关系水平(强制性与可选性)。我们研究如何修改形成性评估的频率影响学生的课程表现。此外,我们评估了强制性和可选性形成性评估对学生在高等教育中的课程表现的影响。方法本研究的样本包括参加加拿大一所大学大型异步课程的三个部分的本科生(n = 336)。我们从学习管理系统中提取了与在线形成性评估相关的特征(例如,尝试次数和平均分数)。接下来,我们使用这些特征来预测学生在总结性评估中的表现(两次期中考试和一次期末考试)。结果和结论我们的研究结果表明,增加在线形成性评估的频率并不能持续提高学生的表现。此外,参与在线形成性评估的频率似乎因评估风险而异(即,可选与强制性)。我们建议教师在建立预测模型之前,检查哪些条件可以最大限度地发挥形成性评估对学生学业成绩的贡献。
{"title":"The impact of frequency and stakes of formative assessment on student achievement in higher education: A learning analytics study","authors":"Okan Bulut,&nbsp;Guher Gorgun,&nbsp;Seyma Nur Yildirim-Erbasli","doi":"10.1111/jcal.13087","DOIUrl":"https://doi.org/10.1111/jcal.13087","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Background</h3>\u0000 \u0000 <p>Research shows that how formative assessments are operationalized plays a crucial role in shaping their engagement with formative assessments, thereby impacting their effectiveness in predicting academic achievement. Mandatory assessments can ensure consistent student participation, leading to better tracking of learning progress. Optional assessments may encourage voluntary engagement, potentially leading to a more genuine reflection of student understanding. Also, frequent assessments provide continuous opportunities for feedback and adjustment, which can keep students actively engaged in the learning process.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Objectives</h3>\u0000 \u0000 <p>This study aims to investigate two crucial facets of formative assessments: frequency and the level of stakes involved (mandatory vs. optional). We examine how modifying the frequency of formative assessments affects students' course performance. Additionally, we evaluate the impact of mandatory versus optional formative assessments on students' course performance in higher education.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>The sample of this study consisted of undergraduate students (<i>n</i> = 336) enrolled in three sections of a large asynchronous course at a Canadian university. We extracted features associated with online formative assessments (e.g., the number of attempts and average scores) from the learning management system. Next, we used these features to predict students' performance in summative assessments (two midterms and a final exam).</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results and Conclusions</h3>\u0000 \u0000 <p>Our findings indicated that increasing the frequency of online formative assessments did not consistently improve student performance. Also, participation frequency in online formative assessments seemed to vary depending on assessment stakes (i.e., optional vs. mandatory). We recommend that instructors examine what conditions can maximize the contribution of formative assessments to students' academic achievement before building predictive models.</p>\u0000 </section>\u0000 </div>","PeriodicalId":48071,"journal":{"name":"Journal of Computer Assisted Learning","volume":"41 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2024-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/jcal.13087","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142861032","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A systematic review and meta-analysis of AI-enabled assessment in language learning: Design, implementation, and effectiveness 人工智能辅助语言学习评估的系统回顾和荟萃分析:设计、实施和效果
IF 5.1 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-11-12 DOI: 10.1111/jcal.13064
Angxuan Chen, Yuyue Zhang, Jiyou Jia, Min Liang, Yingying Cha, Cher Ping Lim

Background

Language assessment plays a pivotal role in language education, serving as a bridge between students' understanding and educators' instructional approaches. Recently, advancements in Artificial Intelligence (AI) technologies have introduced transformative possibilities for automating and personalising language assessments.

Objectives

This article aims to explore the design and implementation of AI-enabled assessment tools in language education, filling the research gaps regarding the impact of assessment type, intervention duration, education level, and first language learner/second language learner (L1/L2) on the effectiveness of AI-enabled assessment tools in enhancing students' language learning outcome.

Methods

This study conducted a systematic review and meta-analysis to examine 25 empirical studies from January 2012 to March 2024 from six databases (including EBSCO, ProQuest, Scopus, Web of Science, ACM Digital Library and CNKI).

Results

The predominant design in AI-driven assessment tools is the structural AI architecture. These tools are most frequently deployed in classroom settings for upper primary students within a short duration. A subsequent meta-analysis showed a medium overall effect size (Hedges's g = 0.390, p < 0.001) for the application of AI-enabled assessment tools in enhancing students' language learning, underscoring their significant impact on language learning outcomes. This evidence robustly supports the practical utility of these tools in educational contexts.

Conclusions

The analysis of several moderator variables (i.e., assessment type, intervention duration, educational level and L1/L2 learners) and potential impacts on language learning performance indicates that AI-enabled assessment could be more useful in language education with a proper implementation design. Future research could investigate diverse instructional designs for integrating AI-based assessment tools in language education.

背景 语言评估在语言教育中起着举足轻重的作用,是学生理解能力和教育者教学方法之间的桥梁。最近,人工智能(AI)技术的进步为语言评估的自动化和个性化带来了变革性的可能性。 本文旨在探讨人工智能评估工具在语言教育中的设计和实施,填补有关评估类型、干预时间、教育水平和第一语言学习者/第二语言学习者(L1/L2)对人工智能评估工具提高学生语言学习效果的影响的研究空白。 方法 本研究采用系统综述和荟萃分析的方法,从六个数据库(包括 EBSCO、ProQuest、Scopus、Web of Science、ACM 数字图书馆和 CNKI)中选取了 2012 年 1 月至 2024 年 3 月期间的 25 项实证研究。 结果 人工智能驱动的评估工具的主要设计是结构性人工智能架构。这些工具最常用于小学高年级学生的课堂教学,使用时间较短。随后的荟萃分析表明,人工智能评估工具在提高学生语言学习方面的应用具有中等的总体效应(Hedges's g = 0.390,p < 0.001),强调了其对语言学习成果的显著影响。这些证据有力地证明了这些工具在教育环境中的实用性。 结论 对几个调节变量(即评估类型、干预持续时间、教育水平和 L1/L2 学习者)以及对语言学习成绩的潜在影响进行的分析表明,如果实施设计得当,人工智能评估在语言教育中可能会更有用。未来的研究可以探讨在语言教育中整合基于人工智能的评估工具的各种教学设计。
{"title":"A systematic review and meta-analysis of AI-enabled assessment in language learning: Design, implementation, and effectiveness","authors":"Angxuan Chen,&nbsp;Yuyue Zhang,&nbsp;Jiyou Jia,&nbsp;Min Liang,&nbsp;Yingying Cha,&nbsp;Cher Ping Lim","doi":"10.1111/jcal.13064","DOIUrl":"https://doi.org/10.1111/jcal.13064","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Background</h3>\u0000 \u0000 <p>Language assessment plays a pivotal role in language education, serving as a bridge between students' understanding and educators' instructional approaches. Recently, advancements in Artificial Intelligence (AI) technologies have introduced transformative possibilities for automating and personalising language assessments.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Objectives</h3>\u0000 \u0000 <p>This article aims to explore the design and implementation of AI-enabled assessment tools in language education, filling the research gaps regarding the impact of assessment type, intervention duration, education level, and first language learner/second language learner (L1/L2) on the effectiveness of AI-enabled assessment tools in enhancing students' language learning outcome.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>This study conducted a systematic review and meta-analysis to examine 25 empirical studies from January 2012 to March 2024 from six databases (including EBSCO, ProQuest, Scopus, Web of Science, ACM Digital Library and CNKI).</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>The predominant design in AI-driven assessment tools is the structural AI architecture. These tools are most frequently deployed in classroom settings for upper primary students within a short duration. A subsequent meta-analysis showed a medium overall effect size (Hedges's <i>g</i> = 0.390, <i>p</i> &lt; 0.001) for the application of AI-enabled assessment tools in enhancing students' language learning, underscoring their significant impact on language learning outcomes. This evidence robustly supports the practical utility of these tools in educational contexts.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusions</h3>\u0000 \u0000 <p>The analysis of several moderator variables (i.e., assessment type, intervention duration, educational level and L1/L2 learners) and potential impacts on language learning performance indicates that AI-enabled assessment could be more useful in language education with a proper implementation design. Future research could investigate diverse instructional designs for integrating AI-based assessment tools in language education.</p>\u0000 </section>\u0000 </div>","PeriodicalId":48071,"journal":{"name":"Journal of Computer Assisted Learning","volume":"41 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2024-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142860795","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of Computer Assisted Learning
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1