首页 > 最新文献

British Journal of Educational Technology最新文献

英文 中文
Adaptive support for self-regulated learning in digital learning environments 为数字学习环境中的自我调节学习提供适应性支持
IF 6.6 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-05-05 DOI: 10.1111/bjet.13479
Mohammad Khalil, Jacqueline Wong, Barbara Wasson, Fred Paas

A core focus of self-regulated learning (SRL) research lies in uncovering methods to empower learners within digital learning environments. As digital technologies continue to evolve during the current hype of artificial intelligence (AI) in education, the theoretical, empirical and methodological nuances to support SRL are emerging and offering new ways for adaptive support and guidance for learners. Such affordances offer a unique opportunity for personalised learning experiences, including adaptive interventions. Exploring the application of adaptivity to enhance SRL is an important and emerging area of research that requires further attention. This editorial introduces the contributions of seven papers for the special section on adaptive support for SRL within digital learning environments. These papers explore various themes related to enhancing SRL strategies through technological interventions, offering valuable insights and paving the way for future advancements in this dynamic area.

自我调节学习(SRL)研究的核心重点在于发现在数字学习环境中增强学习者能力的方法。随着数字技术在当前人工智能(AI)教育热潮中的不断发展,支持自律学习的理论、经验和方法上的细微差别正在出现,并为学习者提供自适应支持和指导的新方法。这种能力为个性化学习体验(包括自适应干预)提供了独特的机会。探索如何应用适应性来提高自学能力是一个重要的新兴研究领域,需要进一步关注。本社论介绍了为数字学习环境中自适应性支持自学学习特别部分撰写的七篇论文。这些论文探讨了与通过技术干预加强自学学习策略有关的各种主题,提出了宝贵的见解,并为这一充满活力的领域的未来发展铺平了道路。
{"title":"Adaptive support for self-regulated learning in digital learning environments","authors":"Mohammad Khalil,&nbsp;Jacqueline Wong,&nbsp;Barbara Wasson,&nbsp;Fred Paas","doi":"10.1111/bjet.13479","DOIUrl":"10.1111/bjet.13479","url":null,"abstract":"<p>A core focus of self-regulated learning (SRL) research lies in uncovering methods to empower learners within digital learning environments. As digital technologies continue to evolve during the current hype of artificial intelligence (AI) in education, the theoretical, empirical and methodological nuances to support SRL are emerging and offering new ways for adaptive support and guidance for learners. Such affordances offer a unique opportunity for personalised learning experiences, including adaptive interventions. Exploring the application of adaptivity to enhance SRL is an important and emerging area of research that requires further attention. This editorial introduces the contributions of seven papers for the special section on adaptive support for SRL within digital learning environments. These papers explore various themes related to enhancing SRL strategies through technological interventions, offering valuable insights and paving the way for future advancements in this dynamic area.</p>","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"55 4","pages":"1281-1289"},"PeriodicalIF":6.6,"publicationDate":"2024-05-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/bjet.13479","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140887474","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Pre-service teachers' inclination to integrate AI into STEM education: Analysis of influencing factors 职前教师将人工智能融入 STEM 教育的倾向:影响因素分析
IF 6.7 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-05-03 DOI: 10.1111/bjet.13469
Fengyao Sun, Peiyao Tian, Daner Sun, Yanhua Fan, Yuqin Yang
<div> <section> <p>In the ever-evolving AI-driven education, integrating AI technologies into teaching practices has become increasingly imperative for aspiring STEM educators. Yet, there remains a dearth of studies exploring pre-service STEM teachers' readiness to incorporate AI into their teaching practices. This study examined the factors influencing teachers' willingness to integrate AI (WIAI), especially from the perspective of pre-service STEM teachers' attitudes towards the application of AI in teaching. In the study, a comprehensive survey was conducted among 239 pre-service STEM teachers, examining the influences and interconnectedness of Technological Pedagogical Content Knowledge (TPACK), Perceived Usefulness (PU), Perceived Ease of Use (PE), and Self-Efficacy (SE) on WIAI. Structural Equation Modeling (SEM) was employed for data analysis. The findings illuminated direct influences of TPACK, PU, PE, and SE on WIAI. TPACK was found to directly affect PE, PU, and SE, while PE and PU also directly influenced SE. Further analysis revealed significant mediating roles of PE, PU, and SE in the relationship between TPACK and WIAI, highlighting the presence of a chain mediation effect. In light of these insights, the study offers several recommendations on promoting pre-service STEM teachers' willingness to integrate AI into their teaching practices.</p> </section> <section> <div> <div> <h3>Practitioner notes</h3> <p>What is already known about this topic? </p><ul> <li>The potential of AI technologies to enrich learning experiences and improve outcomes in STEM education has been recognized.</li> <li>Pre-service teachers' willingness to integrate AI into teaching practice is crucial for shaping the future learning environment.</li> <li>The TAM and TPACK frameworks are used to analyse teacher factors in technology-supported learning environments.</li> <li>Few studies have been conducted for examining factors of pre-service teachers' willingness to integrate AI into teaching practices in the context of STEM education.</li> </ul> <p>What this paper adds? </p><ul> <li>A survey was designed and developed for exploring pre-service STEM teachers' WIAI and its relationships with factors including TPACK, PE, PU, and SE.</li> <li>TPACK, SE, PU, and PE have direct impact on pre-service STEM teachers' WIAI.</li> <li>SE, PU, and PE have been identified as mediating variables in the relationship
在不断发展的人工智能驱动的教育中,将人工智能技术融入教学实践对于有抱负的 STEM 教育工作者来说已变得越来越必要。然而,关于职前 STEM 教师是否准备好将人工智能融入教学实践的研究仍然十分匮乏。本研究探讨了影响教师融入人工智能意愿(WIAI)的因素,特别是从职前 STEM 教师对在教学中应用人工智能的态度角度进行了研究。研究对 239 名职前 STEM 教师进行了全面调查,考察了技术教学内容知识(TPACK)、感知有用性(PU)、感知易用性(PE)和自我效能感(SE)对 WIAI 的影响和相互联系。数据分析采用了结构方程模型(SEM)。研究结果表明了 TPACK、PU、PE 和 SE 对 WIAI 的直接影响。发现 TPACK 直接影响 PE、PU 和 SE,而 PE 和 PU 也直接影响 SE。进一步的分析表明,在 TPACK 与 WIAI 的关系中,PE、PU 和 SE 起着重要的中介作用,突出了连锁中介效应的存在。鉴于这些见解,本研究就促进职前 STEM 教师将人工智能融入教学实践的意愿提出了若干建议。 人工智能技术在丰富 STEM 教育的学习体验和提高成果方面的潜力已得到认可。职前教师将人工智能融入教学实践的意愿对于塑造未来的学习环境至关重要。TAM和TPACK框架被用来分析教师在技术支持的学习环境中的因素。在 STEM 教育背景下,很少有研究探讨职前教师将人工智能融入教学实践的意愿因素。本文有何新意? 本文设计并编制了一份调查问卷,以探讨职前 STEM 教师的 WIAI 及其与 TPACK、PE、PU 和 SE 等因素的关系。TPACK、SE、PU和PE对职前STEM教师的WIAI有直接影响。在 TPACK 与 WIAI 的关系中,SE、PU 和 PE 被认为是中介变量。研究还发现了两个连续的中介效应,即 TPACK → PE → SE → WIAI 和 TPACK → PU → SE → WIAI。本研究对实践和/或政策的启示 鼓励职前 STEM 教师探索和利用人工智能技术,增强他们将人工智能融入教学实践的信心和自我效能感。展示成功案例和实践经验对于培养将人工智能融入 STEM 教育的意识至关重要。建议在教师培训课程中引入人工智能教育课程。提供与人工智能技术相关的实习和实践机会,可以提高他们将人工智能融入教育的实践技能。
{"title":"Pre-service teachers' inclination to integrate AI into STEM education: Analysis of influencing factors","authors":"Fengyao Sun,&nbsp;Peiyao Tian,&nbsp;Daner Sun,&nbsp;Yanhua Fan,&nbsp;Yuqin Yang","doi":"10.1111/bjet.13469","DOIUrl":"10.1111/bjet.13469","url":null,"abstract":"&lt;div&gt;\u0000 \u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;p&gt;In the ever-evolving AI-driven education, integrating AI technologies into teaching practices has become increasingly imperative for aspiring STEM educators. Yet, there remains a dearth of studies exploring pre-service STEM teachers' readiness to incorporate AI into their teaching practices. This study examined the factors influencing teachers' willingness to integrate AI (WIAI), especially from the perspective of pre-service STEM teachers' attitudes towards the application of AI in teaching. In the study, a comprehensive survey was conducted among 239 pre-service STEM teachers, examining the influences and interconnectedness of Technological Pedagogical Content Knowledge (TPACK), Perceived Usefulness (PU), Perceived Ease of Use (PE), and Self-Efficacy (SE) on WIAI. Structural Equation Modeling (SEM) was employed for data analysis. The findings illuminated direct influences of TPACK, PU, PE, and SE on WIAI. TPACK was found to directly affect PE, PU, and SE, while PE and PU also directly influenced SE. Further analysis revealed significant mediating roles of PE, PU, and SE in the relationship between TPACK and WIAI, highlighting the presence of a chain mediation effect. In light of these insights, the study offers several recommendations on promoting pre-service STEM teachers' willingness to integrate AI into their teaching practices.&lt;/p&gt;\u0000 &lt;/section&gt;\u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;div&gt;\u0000 \u0000 &lt;div&gt;\u0000 \u0000 &lt;h3&gt;Practitioner notes&lt;/h3&gt;\u0000 &lt;p&gt;What is already known about this topic?\u0000\u0000 &lt;/p&gt;&lt;ul&gt;\u0000 \u0000 &lt;li&gt;The potential of AI technologies to enrich learning experiences and improve outcomes in STEM education has been recognized.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;Pre-service teachers' willingness to integrate AI into teaching practice is crucial for shaping the future learning environment.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;The TAM and TPACK frameworks are used to analyse teacher factors in technology-supported learning environments.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;Few studies have been conducted for examining factors of pre-service teachers' willingness to integrate AI into teaching practices in the context of STEM education.&lt;/li&gt;\u0000 &lt;/ul&gt;\u0000 &lt;p&gt;What this paper adds?\u0000\u0000 &lt;/p&gt;&lt;ul&gt;\u0000 \u0000 &lt;li&gt;A survey was designed and developed for exploring pre-service STEM teachers' WIAI and its relationships with factors including TPACK, PE, PU, and SE.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;TPACK, SE, PU, and PE have direct impact on pre-service STEM teachers' WIAI.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;SE, PU, and PE have been identified as mediating variables in the relationship ","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"55 6","pages":"2574-2596"},"PeriodicalIF":6.7,"publicationDate":"2024-05-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140837388","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Primary school teachers' classroom-based e-assessment practices: Insights from the theory of planned behaviour 小学教师基于课堂的电子评估实践:计划行为理论的启示
IF 6.7 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-05-03 DOI: 10.1111/bjet.13478
Ying Zhan, Daner Sun, Ho Man Kong, Ye Zeng

There is a global trend in the increased adoption of e-assessment in school classrooms to enhance learning. Teachers, as classroom-based assessment designers and implementers, play a vital role in such assessment change. However, little is known about school teachers' classroom-based e-assessment practices and the underlying reasons. To address this research gap, this study identified the factors influencing Hong Kong primary school teachers' e-assessment practices underpinned by the theory of planned behaviour (TPB). A large-scale survey was issued to 878 teachers via Qualtrics. Structural equation modelling (SEM) analysis shows that primary school teachers' intentions of using e-assessment and perceived behavioural control of it were the two strongest factors predicting their e-assessment practices in a general way. Specifically, teachers' intentions outweighed perceived behavioural control in determining their use of alternative e-assessment tasks and e-feedback, but this reversed for e-tests/exercises. The impact of perceived behavioural control was consistent across the three types of e-assessment practices. Furthermore, teachers' attitudes significantly influenced their intentions to use alternative e-assessment tasks, while subject norms primarily predicted their intentions to use e-feedback. The findings have implications for primary schools to take countermeasures to facilitate the successful implementation of e-assessment at the classroom level.

在学校课堂上越来越多地采用电子评估来促进学习,这是一个全球趋势。教师作为课堂评价的设计者和实施者,在这种评价变革中扮演着至关重要的角色。然而,人们对学校教师的课堂电子评估实践及其背后的原因知之甚少。针对这一研究空白,本研究以计划行为理论(TPB)为基础,找出了影响香港小学教师电子评估实践的因素。本研究通过 Qualtrics 向 878 名教师进行了大规模调查。结构方程模型(SEM)分析表明,小学教师使用电子评教的意向和对电子评教的感知行为控制是预测其电子评教实践的两个最有力的因素。具体地说,在决定教师使用其他电子评估任务和电子反馈时,教师的意向超过了行为控制感知,但在使用电子测试/练习时,这种情况发生了逆转。在三种电子评估实践中,行为控制感的影响是一致的。此外,教师的态度极大地影响了他们使用替代性电子评估任务的意愿,而学科规范则主要预测了他们使用电子反馈的意愿。过去三年来,围绕在课堂环境中使用电子评估的讨论和研究激增,主要集中在高等教育领域。小学教师在日常教学中使用电子测试或练习的次数多于其他电子评估任务和电子反馈。在决定教师是否使用替代性电子评估任务和电子反馈时,教师的意向大于行为控制感知,但在使用电子测试/练习时,这种情况发生了逆转。教师的态度对他们使用替代性电子评估任务的意向有显著影响,而学科规范则主要预测了他们使用电子反馈的意向。应提高教师使用其他电子评估和电子反馈的意愿,以加强它们在课堂上的使用。应培养教师的电子评估素养,使他们能够将电子评估融入日常教学。
{"title":"Primary school teachers' classroom-based e-assessment practices: Insights from the theory of planned behaviour","authors":"Ying Zhan,&nbsp;Daner Sun,&nbsp;Ho Man Kong,&nbsp;Ye Zeng","doi":"10.1111/bjet.13478","DOIUrl":"10.1111/bjet.13478","url":null,"abstract":"<p>There is a global trend in the increased adoption of e-assessment in school classrooms to enhance learning. Teachers, as classroom-based assessment designers and implementers, play a vital role in such assessment change. However, little is known about school teachers' classroom-based e-assessment practices and the underlying reasons. To address this research gap, this study identified the factors influencing Hong Kong primary school teachers' e-assessment practices underpinned by the theory of planned behaviour (TPB). A large-scale survey was issued to 878 teachers via Qualtrics. Structural equation modelling (SEM) analysis shows that primary school teachers' intentions of using e-assessment and perceived behavioural control of it were the two strongest factors predicting their e-assessment practices in a general way. Specifically, teachers' intentions outweighed perceived behavioural control in determining their use of alternative e-assessment tasks and e-feedback, but this reversed for e-tests/exercises. The impact of perceived behavioural control was consistent across the three types of e-assessment practices. Furthermore, teachers' attitudes significantly influenced their intentions to use alternative e-assessment tasks, while subject norms primarily predicted their intentions to use e-feedback. The findings have implications for primary schools to take countermeasures to facilitate the successful implementation of e-assessment at the classroom level.\u0000 </p>","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"55 6","pages":"2740-2759"},"PeriodicalIF":6.7,"publicationDate":"2024-05-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/bjet.13478","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141015211","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Co-designing enduring learning analytics prediction and support tools in undergraduate biology courses 共同设计本科生物课程中的持久学习分析预测和支持工具
IF 6.7 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-05-03 DOI: 10.1111/bjet.13472
Robert D. Plumley, Matthew L. Bernacki, Jeffrey A. Greene, Shelbi Kuhlmann, Mladen Raković, Christopher J. Urban, Kelly A. Hogan, Chaewon Lee, Abigail T. Panter, Kathleen M. Gates

Even highly motivated undergraduates drift off their STEM career pathways. In large introductory STEM classes, instructors struggle to identify and support these students. To address these issues, we developed co-redesign methods in partnership with disciplinary experts to create high-structure STEM courses that better support students and produce informative digital event data. To those data, we applied theory- and context-relevant labels to reflect active and self-regulated learning processes involving LMS-hosted course materials, formative assessments, and help-seeking tools. We illustrate the predictive benefits of this process across two cycles of model creation and reapplication. In cycle 1, we used theory-relevant features from 3 weeks of data to inform a prediction model that accurately identified struggling students and sustained its accuracy when reapplied in future semesters. In cycle 2, we refit a model with temporally contextualized features that achieved superior accuracy using data from just two class meetings. This modelling approach can produce durable learning analytics solutions that afford scaled and sustained prediction and intervention opportunities that involve explainable artificial intelligence products. Those same products that inform prediction can also guide intervention approaches and inform future instructional design and delivery.

即使是积极性很高的本科生也会偏离他们的 STEM 职业道路。在大型 STEM 入门班中,教师很难识别和支持这些学生。为了解决这些问题,我们与学科专家合作开发了共同设计方法,以创建能更好地支持学生并产生翔实数字事件数据的高结构 STEM 课程。对于这些数据,我们应用了与理论和情境相关的标签,以反映主动和自我调节的学习过程,其中涉及 LMS 托管的课程材料、形成性评估和寻求帮助的工具。我们通过两个周期的模型创建和重新应用,说明了这一过程的预测优势。在周期 1 中,我们利用 3 周数据中与理论相关的特征,建立了一个预测模型,该模型能准确识别学习有困难的学生,并在未来学期重新应用时保持其准确性。在周期 2 中,我们利用时间背景特征重新设计了一个模型,该模型仅利用两次班会的数据就获得了极高的准确性。这种建模方法可以产生持久的学习分析解决方案,提供大规模、持续的预测和干预机会,其中涉及可解释的人工智能产品。基于人口统计数据的预测模型可能会延续系统性偏见。基于行为事件数据的预测模型可以准确预测学业成功,验证工作可以丰富这些数据,以反映学生在学习任务中的自我调节学习过程。学习分析可以成功地应用于在真实的中学后科学、技术、工程和数学环境中预测成绩,而使用情境和理论作为特征工程的指导,可以确保在再次应用时保持预测的准确性。这些设计还提供了观察和模拟以情境为基础的、与理论相一致的和时间定位的学习事件的机会,这些学习事件为预测模型提供了信息,而预测模型可以在初次应用和以后学期的再次应用中准确地对学生进行分类。研究人员和指导人员共同设计的关系对于开发特征工程的独特见解和产生可解释的人工智能预测建模方法至关重要,研究人员和指导人员共同设计的关系对于开发特征工程的独特见解和产生可解释的人工智能预测建模方法至关重要,研究人员和指导人员共同设计的关系对于开发特征工程的独特见解和产生可解释的人工智能预测建模方法至关重要。高结构课程设计可以为学生参与课程材料提供支架,从而提高学习效率,使特征工程的产品更具可解释性。当学习分析方法优先考虑反映学习过程的理论行为数据、对教学情境的敏感性以及开发可解释的成功预测指标,而不是依赖学生的人口统计特征作为预测指标时,学习分析计划可以避免系统性偏见的延续。
{"title":"Co-designing enduring learning analytics prediction and support tools in undergraduate biology courses","authors":"Robert D. Plumley,&nbsp;Matthew L. Bernacki,&nbsp;Jeffrey A. Greene,&nbsp;Shelbi Kuhlmann,&nbsp;Mladen Raković,&nbsp;Christopher J. Urban,&nbsp;Kelly A. Hogan,&nbsp;Chaewon Lee,&nbsp;Abigail T. Panter,&nbsp;Kathleen M. Gates","doi":"10.1111/bjet.13472","DOIUrl":"10.1111/bjet.13472","url":null,"abstract":"<p>Even highly motivated undergraduates drift off their STEM career pathways. In large introductory STEM classes, instructors struggle to identify and support these students. To address these issues, we developed co-redesign methods in partnership with disciplinary experts to create high-structure STEM courses that better support students and produce informative digital event data. To those data, we applied theory- and context-relevant labels to reflect active and self-regulated learning processes involving LMS-hosted course materials, formative assessments, and help-seeking tools. We illustrate the predictive benefits of this process across two cycles of model creation and reapplication. In cycle 1, we used theory-relevant features from 3 weeks of data to inform a prediction model that accurately identified struggling students and sustained its accuracy when reapplied in future semesters. In cycle 2, we refit a model with temporally contextualized features that achieved superior accuracy using data from just two class meetings. This modelling approach can produce durable learning analytics solutions that afford scaled and sustained prediction and intervention opportunities that involve explainable artificial intelligence products. Those same products that inform prediction can also guide intervention approaches and inform future instructional design and delivery.\u0000 </p>","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"55 5","pages":"1860-1883"},"PeriodicalIF":6.7,"publicationDate":"2024-05-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141015020","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The impact of an academic counselling learning analytics tool: Evidence from 3 years of use 学术咨询学习分析工具的影响:使用 3 年来的证据
IF 6.7 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-04-27 DOI: 10.1111/bjet.13474
Valeria Henríquez, Julio Guerra, Eliana Scheihing
<div> <section> <p>Despite the importance of academic counselling for student success, providing timely and personalized guidance can be challenging for higher education institutions. In this study, we investigate the impact of counselling instances supported by a learning analytics (LA) tool, called TrAC, which provides specific data about the curriculum and grades of each student. To evaluate the tool, we measured changes in students' performance ranking position over 3 years and compared the performance of students who received counselling with and without the tool. Our results show that using the tool is related to an improvement in cohort ranking. We further investigated the characteristics of counselled students using cluster analyses. The findings highlight the potential beneficial influence on academic outcomes arising from the provision of guidance to students regarding their course load decisions via TrAC-mediated counselling. This study contributes to the field of LA by providing evidence of the impact of counselling supported by an LA tool in a real-world setting over a long period of time. Our results suggest that incorporating LA into academic counselling practices can improve student success.</p> </section> <section> <div> <div> <h3>Practitioner notes</h3> <p>What is already known about this topic </p><ul> <li>By analysing student performance, teaching strategies and resource impact, learning analytics (LA) empowers institutions to make informed changes in curriculum design, resource allocation and educational policies.</li> <li>Through insights into academic progress, engagement and behaviour, LA counselling tools enable the identification of at-risk students and those needing additional support.</li> <li>In the related literature, there are areas for further exploration such as understanding the scalability and long-term effects of interventions on student success and retention.</li> </ul> <p>What this paper adds </p><ul> <li>Through rigorous data analysis, the paper establishes a connection between LA utilization and enhanced student performance, offering concrete evidence of the effectiveness of LA interventions.</li> <li>By examining various factors such as academic stage and course load, the research offers valuable insights into the contextual nuances that optimize the outcomes of LA tool-based support.</li> <li>It adds to the growing body of evidence that supports the efficacy of data-driven interventio
尽管学业辅导对学生的成功非常重要,但对于高等教育机构来说,提供及时和个性化的指导可能具有挑战性。在本研究中,我们调查了由名为 TrAC 的学习分析(LA)工具支持的辅导实例的影响,该工具可提供有关每个学生的课程和成绩的具体数据。为了对该工具进行评估,我们测量了三年来学生成绩排名位置的变化,并比较了接受和未接受该工具辅导的学生的成绩。我们的结果表明,使用该工具与学生成绩排名的提高有关。我们还利用聚类分析进一步调查了接受辅导的学生的特点。研究结果凸显了通过以 TrAC 为媒介的辅导为学生的课程负担决策提供指导对学业成绩产生的潜在有利影响。本研究通过提供证据,证明了在现实世界环境中,通过LA工具支持的辅导在很长一段时间内产生的影响,从而为LA领域做出了贡献。通过分析学生成绩、教学策略和资源影响,学习分析(LA)使教育机构能够在课程设计、资源分配和教育政策方面做出明智的改变。通过对学业进展、参与度和行为的深入了解,LA 辅导工具能够识别高危学生和需要额外支持的学生。在相关文献中,还有一些需要进一步探索的领域,如了解干预措施对学生成功率和保留率的可扩展性和长期影响。本文的补充 通过严谨的数据分析,本文建立了使用 "LA "与提高学生成绩之间的联系,为 "LA "干预措施的有效性提供了具体证据。通过对学术阶段和课程负担等各种因素的研究,该研究对优化基于洛杉矶工具的支持结果的环境细微差别提供了有价值的见解。该研究补充了越来越多的证据,这些证据支持以数据为导向的教育干预措施的有效性,促进了一种更加知情和以证据为基础的学生支持和成功方法。对实践和政策的影响 加强学生支持策略:通过根据已确定的有效条件调整辅导干预措施,教育工作者可以积极主动地满足学生的个人需求,从而提高学习成绩和保留率。知情决策:已证明的积极影响凸显了类似的数据驱动措施在促进学生成功方面的潜力。政策制定者可以考虑在机构层面激励采用此类干预措施。未来的研究方向:通过确定影响LA干预措施效果的背景因素,鼓励进一步探索如何针对特定条件优化其他LA干预措施。这将为今后制定更精确、更有效的学生支持策略提供指导。
{"title":"The impact of an academic counselling learning analytics tool: Evidence from 3 years of use","authors":"Valeria Henríquez,&nbsp;Julio Guerra,&nbsp;Eliana Scheihing","doi":"10.1111/bjet.13474","DOIUrl":"10.1111/bjet.13474","url":null,"abstract":"&lt;div&gt;\u0000 \u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;p&gt;Despite the importance of academic counselling for student success, providing timely and personalized guidance can be challenging for higher education institutions. In this study, we investigate the impact of counselling instances supported by a learning analytics (LA) tool, called TrAC, which provides specific data about the curriculum and grades of each student. To evaluate the tool, we measured changes in students' performance ranking position over 3 years and compared the performance of students who received counselling with and without the tool. Our results show that using the tool is related to an improvement in cohort ranking. We further investigated the characteristics of counselled students using cluster analyses. The findings highlight the potential beneficial influence on academic outcomes arising from the provision of guidance to students regarding their course load decisions via TrAC-mediated counselling. This study contributes to the field of LA by providing evidence of the impact of counselling supported by an LA tool in a real-world setting over a long period of time. Our results suggest that incorporating LA into academic counselling practices can improve student success.&lt;/p&gt;\u0000 &lt;/section&gt;\u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;div&gt;\u0000 \u0000 &lt;div&gt;\u0000 \u0000 &lt;h3&gt;Practitioner notes&lt;/h3&gt;\u0000 &lt;p&gt;What is already known about this topic\u0000\u0000 &lt;/p&gt;&lt;ul&gt;\u0000 \u0000 &lt;li&gt;By analysing student performance, teaching strategies and resource impact, learning analytics (LA) empowers institutions to make informed changes in curriculum design, resource allocation and educational policies.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;Through insights into academic progress, engagement and behaviour, LA counselling tools enable the identification of at-risk students and those needing additional support.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;In the related literature, there are areas for further exploration such as understanding the scalability and long-term effects of interventions on student success and retention.&lt;/li&gt;\u0000 &lt;/ul&gt;\u0000 &lt;p&gt;What this paper adds\u0000\u0000 &lt;/p&gt;&lt;ul&gt;\u0000 \u0000 &lt;li&gt;Through rigorous data analysis, the paper establishes a connection between LA utilization and enhanced student performance, offering concrete evidence of the effectiveness of LA interventions.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;By examining various factors such as academic stage and course load, the research offers valuable insights into the contextual nuances that optimize the outcomes of LA tool-based support.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;It adds to the growing body of evidence that supports the efficacy of data-driven interventio","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"55 5","pages":"1884-1899"},"PeriodicalIF":6.7,"publicationDate":"2024-04-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140812299","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Improving executive functions at school. Integrating metacognitive exercise in class and computerized training at home to ensure training intensity and generalization. A feasibility pilot study 在学校提高执行功能。将课堂上的元认知练习和家庭中的电脑化训练结合起来,确保训练强度和普遍性。可行性试点研究
IF 6.7 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-04-27 DOI: 10.1111/bjet.13470
Carlotta Rivella, Clara Bombonato, Chiara Pecini, Andrea Frascari, Paola Viterbori
<div> <section> <p>Previous research has demonstrated the effectiveness of executive functions (EFs) training, both in computer-based and school-based formats. However, there is limited research on the combined effects of these training modalities. This study aims to assess the feasibility and preliminary efficacy of an EFs training programme for primary school children. The programme includes computerized training sessions for home use and school activities with metacognitive elements. The study included a sample of 53 second-grade children, with 21 children in the training group and 32 children in the control group. Feasibility questionnaires were completed by children, parents and teachers. The children also underwent an EFs evaluation. The results indicate that the training was enjoyable for children and feasible for parents and teachers. Furthermore, preliminary efficacy analysis revealed significant improvements in working memory. These findings suggest that the training model holds promise for enhancing EFs in children in the school context.</p> </section> <section> <div> <div> <h3>Practitioner notes</h3> <p>What is already known about this topic </p><ul> <li>Individual differences in executive functions influence acquisitions, behaviours and competencies in several specific domains from infancy to adulthood.</li> <li>Enhancing executive functions during school-age years can contribute to reducing or preventing academic, behavioural and social difficulties.</li> <li>Among interventions targeting executive functions in school-aged children, school-based interventions have shown the highest effectiveness, followed by metacognitive interventions and computer-based interventions.</li> </ul> <p>What this paper adds </p><ul> <li>This paper presents the implementation of an innovative school-based training programme designed to improve executive functions (EFs). The programme combines metacognitive sessions conducted at school with computer-based sessions carried out at home. The goal was to enhance the effectiveness and generalizability of the training.</li> <li>The training programme was found to be enjoyable for children and feasible for both parents and teachers.</li> <li>Preliminary efficacy data indicate promising results, suggesting that the training programme is effective in achieving its intended goals.</li>
以往的研究已经证明了执行功能(EFs)培训的有效性,包括基于计算机的培训和基于学校的培训。然而,关于这些训练模式的综合效果的研究却很有限。本研究旨在评估针对小学生的执行功能训练计划的可行性和初步效果。该计划包括供家庭使用的计算机化培训课程和具有元认知元素的学校活动。研究对象包括 53 名二年级儿童,其中 21 名儿童为训练组,32 名儿童为对照组。儿童、家长和教师填写了可行性问卷。这些儿童还接受了一项 EFs 评估。结果表明,培训对儿童来说是愉快的,对家长和教师来说也是可行的。此外,初步疗效分析表明,工作记忆有了显著改善。这些研究结果表明,该培训模式有望在学校环境中提高儿童的执行功能。在学龄期增强执行功能有助于减少或预防学业、行为和社交方面的困难。在针对学龄儿童执行功能的干预措施中,以学校为基础的干预措施效果最好,其次是元认知干预措施和以计算机为基础的干预措施。本文的补充内容 本文介绍了一项旨在改善执行功能(EFs)的创新性校本培训计划的实施情况。该计划将在学校开展的元认知课程与在家中开展的计算机课程相结合。目的是提高培训的有效性和可推广性。研究发现,该培训计划对儿童来说是愉快的,对家长和教师来说也是可行的。初步的效果数据表明,培训计划能有效地实现其预期目标。对实践和/或政策的启示 将校本元认知培训与在家进行的电脑化课程相结合,可以提供高强度的培训计划,而这可能是学校无法单独实现的。与教师和同伴一起在小组环境中开展的学校活动最受孩子们的欢迎,这表明在对孩子有意义的社会环境中,仅靠电脑课程无法取代学校元认知课程的价值。让家庭积极参与培训过程以确保良好的坚持性至关重要。此外,在实施培训计划之前,应评估每个家庭是否拥有技术资源。
{"title":"Improving executive functions at school. Integrating metacognitive exercise in class and computerized training at home to ensure training intensity and generalization. A feasibility pilot study","authors":"Carlotta Rivella,&nbsp;Clara Bombonato,&nbsp;Chiara Pecini,&nbsp;Andrea Frascari,&nbsp;Paola Viterbori","doi":"10.1111/bjet.13470","DOIUrl":"10.1111/bjet.13470","url":null,"abstract":"&lt;div&gt;\u0000 \u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;p&gt;Previous research has demonstrated the effectiveness of executive functions (EFs) training, both in computer-based and school-based formats. However, there is limited research on the combined effects of these training modalities. This study aims to assess the feasibility and preliminary efficacy of an EFs training programme for primary school children. The programme includes computerized training sessions for home use and school activities with metacognitive elements. The study included a sample of 53 second-grade children, with 21 children in the training group and 32 children in the control group. Feasibility questionnaires were completed by children, parents and teachers. The children also underwent an EFs evaluation. The results indicate that the training was enjoyable for children and feasible for parents and teachers. Furthermore, preliminary efficacy analysis revealed significant improvements in working memory. These findings suggest that the training model holds promise for enhancing EFs in children in the school context.&lt;/p&gt;\u0000 &lt;/section&gt;\u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;div&gt;\u0000 \u0000 &lt;div&gt;\u0000 \u0000 &lt;h3&gt;Practitioner notes&lt;/h3&gt;\u0000 &lt;p&gt;What is already known about this topic\u0000\u0000 &lt;/p&gt;&lt;ul&gt;\u0000 \u0000 &lt;li&gt;Individual differences in executive functions influence acquisitions, behaviours and competencies in several specific domains from infancy to adulthood.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;Enhancing executive functions during school-age years can contribute to reducing or preventing academic, behavioural and social difficulties.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;Among interventions targeting executive functions in school-aged children, school-based interventions have shown the highest effectiveness, followed by metacognitive interventions and computer-based interventions.&lt;/li&gt;\u0000 &lt;/ul&gt;\u0000 &lt;p&gt;What this paper adds\u0000\u0000 &lt;/p&gt;&lt;ul&gt;\u0000 \u0000 &lt;li&gt;This paper presents the implementation of an innovative school-based training programme designed to improve executive functions (EFs). The programme combines metacognitive sessions conducted at school with computer-based sessions carried out at home. The goal was to enhance the effectiveness and generalizability of the training.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;The training programme was found to be enjoyable for children and feasible for both parents and teachers.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;Preliminary efficacy data indicate promising results, suggesting that the training programme is effective in achieving its intended goals.&lt;/li&gt;\u0000 ","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"55 6","pages":"2719-2739"},"PeriodicalIF":6.7,"publicationDate":"2024-04-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/bjet.13470","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140812295","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exploring the impact of gamification on students’ academic performance: A comprehensive meta-analysis of studies from the year 2008 to 2023 探索游戏化对学生学习成绩的影响:对 2008 年至 2023 年研究的综合荟萃分析
IF 6.7 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-04-27 DOI: 10.1111/bjet.13471
Jiyuan Zeng, Daner Sun, Chee-Kit Looi, Andy Chun Wai Fan

Gamification, characterized by the integration of game design elements into non-game environments, has gained popularity in classrooms due to its potential for increased engagement and enjoyment compared to traditional lecture-based teaching methods. While students generally exhibit positive attitudes towards gamification, its impact on academic achievement remains a subject of debate. This study employed a meta-analysis approach to examine the overall influence of gamification on students' academic performance. The sample comprised 22 experimental studies conducted between 2008 and 2023, comparing the effects of gamified and non-gamified classes. Utilizing a random effects model, the results revealed a moderately positive effect of gamification on student academic performance (Hedges's g = 0.782, p < 0.05). The paper further discussed the outcomes of various moderator analyses, providing valuable insights into the selection and utilization of game design elements, as well as considerations specific to different educational stages.

游戏化的特点是在非游戏环境中融入游戏设计元素,与传统的讲授式教学方法相比,游戏化有可能提高学生的参与度和乐趣,因此在课堂上越来越受欢迎。虽然学生们普遍对游戏化持积极态度,但其对学习成绩的影响仍是一个争论的话题。本研究采用了荟萃分析法来考察游戏化对学生学业成绩的总体影响。样本包括 2008 年至 2023 年间进行的 22 项实验研究,比较了游戏化和非游戏化课堂的效果。利用随机效应模型,结果显示游戏化对学生学业成绩的影响为中度正效应(Hedges's g = 0.782, p < 0.05)。论文进一步讨论了各种调节分析的结果,为游戏设计元素的选择和利用以及不同教育阶段的具体注意事项提供了有价值的见解。目前的综述研究还不够全面。缺乏探讨游戏化各种影响的元分析。本文的补充 研究了地理区域、教育水平、学习环境、学科和游戏元素等因素对游戏化的影响。研究表明,游戏化对学生成绩的影响是显著而积极的,影响因素包括地理区域、教育水平、学习环境、学科和游戏元素。对实践和/或政策的启示 游戏化是教师提高学生成绩的明智选择。建议教师在教学方法中采用和运用适当的游戏元素。今后的研究可侧重于调查反馈作为游戏元素在教学中的影响。
{"title":"Exploring the impact of gamification on students’ academic performance: A comprehensive meta-analysis of studies from the year 2008 to 2023","authors":"Jiyuan Zeng,&nbsp;Daner Sun,&nbsp;Chee-Kit Looi,&nbsp;Andy Chun Wai Fan","doi":"10.1111/bjet.13471","DOIUrl":"10.1111/bjet.13471","url":null,"abstract":"<p>Gamification, characterized by the integration of game design elements into non-game environments, has gained popularity in classrooms due to its potential for increased engagement and enjoyment compared to traditional lecture-based teaching methods. While students generally exhibit positive attitudes towards gamification, its impact on academic achievement remains a subject of debate. This study employed a meta-analysis approach to examine the overall influence of gamification on students' academic performance. The sample comprised 22 experimental studies conducted between 2008 and 2023, comparing the effects of gamified and non-gamified classes. Utilizing a random effects model, the results revealed a moderately positive effect of gamification on student academic performance (Hedges's g = 0.782, <i>p</i> &lt; 0.05). The paper further discussed the outcomes of various moderator analyses, providing valuable insights into the selection and utilization of game design elements, as well as considerations specific to different educational stages.\u0000 </p>","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"55 6","pages":"2478-2502"},"PeriodicalIF":6.7,"publicationDate":"2024-04-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140812032","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluating technology enhanced learning by using single-case experimental design: A systematic review 利用单例实验设计评估技术强化学习:系统回顾
IF 6.7 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-04-26 DOI: 10.1111/bjet.13468
Nadira Dayo, Sameh Said Metwaly, Wim Van Den Noortgate

Single-case experimental designs (SCEDs) may offer a reliable and internally valid way to evaluate technology-enhanced learning (TEL). A systematic review was conducted to provide an overview of what, why and how SCEDs are used to evaluate TEL. Accordingly, 136 studies from nine databases fulfilling the inclusion criteria were included. The results showed that most of the studies were conducted in the field of special education focusing on evaluating the effectiveness of computer-assisted instructions, video prompts and mobile devices to improve language and communication, socio-emotional, skills and mental health. The research objective of most studies was to evaluate the effects of the intervention; often no specific justification for using SCED was provided. Additionally, multiple baseline and phase designs were the most common SCED types, with most measurements in the intervention phase. Frequent data collection methods were observation, tests, questionnaires and task analysis, whereas, visual and descriptive analysis were common methods for data analysis. Nearly half of the studies did not acknowledge any limitations, while a few mentioned generalization and small sample size as limitations. The review provides valuable insights into utilizing SCEDs to advance TEL evaluation methodology and concludes with a reflection on further opportunities that SCEDs can offer for evaluating TEL.

单例实验设计(SCED)可以为评估技术辅助学习(TEL)提供一种可靠且内部有效的方法。我们进行了一项系统性综述,以概述什么是单例实验设计、为什么要使用单例实验设计以及如何使用单例实验设计来评估技术辅助学习。因此,符合纳入标准的 9 个数据库中的 136 项研究被纳入其中。结果显示,大多数研究都是在特殊教育领域进行的,重点是评估计算机辅助教学、视频提示和移动设备在改善语言和沟通、社会情感、技能和心理健康方面的效果。大多数研究的目的是评估干预措施的效果;通常没有提供使用 SCED 的具体理由。此外,多基线和分阶段设计是最常见的 SCED 类型,大多数测量都是在干预阶段进行的。常用的数据收集方法是观察、测试、问卷调查和任务分析,而直观分析和描述性分析则是常用的数据分析方法。近一半的研究不承认有任何局限性,但也有少数研究提到了普遍性和样本量小的局限性。本综述为利用 SCED 推动 TEL 评估方法提供了有价值的见解,并在最后对 SCED 为 TEL 评估提供的更多机会进行了反思。SCED 在没有干预措施和有干预措施的情况下,使用多种测量方法在多种条件下对单个参与者进行研究。SCED 可以成为评估任何干预措施(包括测试基于技术的干预措施)引起的行为变化的严格设计。本文的补充揭示了在 TEL 中使用 SCED 的模式、趋势和差距。确定了使用 SCED 进行研究的学科、教育技术工具和结果变量。通过阐明方法技巧,全面了解如何使用 SCED 评估电子学习。丰富了有关将 SCED 用于 TEL 的合理性和局限性的见解。对实践和/或政策的影响 提供信息,说明如何使用严格的 SCED 方法评估各学科的技术驱动干预措施。因此,有助于提高证据库的质量,为政策制定者和不同利益相关者提供设计、实施和决定影音技术的综合资源。
{"title":"Evaluating technology enhanced learning by using single-case experimental design: A systematic review","authors":"Nadira Dayo,&nbsp;Sameh Said Metwaly,&nbsp;Wim Van Den Noortgate","doi":"10.1111/bjet.13468","DOIUrl":"10.1111/bjet.13468","url":null,"abstract":"<p>Single-case experimental designs (SCEDs) may offer a reliable and internally valid way to evaluate technology-enhanced learning (TEL). A systematic review was conducted to provide an overview of what, why and how SCEDs are used to evaluate TEL. Accordingly, 136 studies from nine databases fulfilling the inclusion criteria were included. The results showed that most of the studies were conducted in the field of special education focusing on evaluating the effectiveness of computer-assisted instructions, video prompts and mobile devices to improve language and communication, socio-emotional, skills and mental health. The research objective of most studies was to evaluate the effects of the intervention; often no specific justification for using SCED was provided. Additionally, multiple baseline and phase designs were the most common SCED types, with most measurements in the intervention phase. Frequent data collection methods were observation, tests, questionnaires and task analysis, whereas, visual and descriptive analysis were common methods for data analysis. Nearly half of the studies did not acknowledge any limitations, while a few mentioned generalization and small sample size as limitations. The review provides valuable insights into utilizing SCEDs to advance TEL evaluation methodology and concludes with a reflection on further opportunities that SCEDs can offer for evaluating TEL.\u0000 </p>","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"55 6","pages":"2457-2477"},"PeriodicalIF":6.7,"publicationDate":"2024-04-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140799665","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using explainable AI to unravel classroom dialogue analysis: Effects of explanations on teachers' trust, technology acceptance and cognitive load 使用可解释的人工智能来解读课堂对话分析:解释对教师信任度、技术接受度和认知负荷的影响
IF 6.7 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-04-23 DOI: 10.1111/bjet.13466
Deliang Wang, Cunling Bian, Gaowei Chen

Deep neural networks are increasingly employed to model classroom dialogue and provide teachers with prompt and valuable feedback on their teaching practices. However, these deep learning models often have intricate structures with numerous unknown parameters, functioning as black boxes. The lack of clear explanations regarding their classroom dialogue analysis likely leads teachers to distrust and underutilize these AI-powered models. To tackle this issue, we leveraged explainable AI to unravel classroom dialogue analysis and conducted an experiment to evaluate the effects of explanations. Fifty-nine pre-service teachers were recruited and randomly assigned to either a treatment (n = 30) or control (n = 29) group. Initially, both groups learned to analyse classroom dialogue using AI-powered models without explanations. Subsequently, the treatment group received both AI analysis and explanations, while the control group continued to receive only AI predictions. The results demonstrated that teachers in the treatment group exhibited significantly higher levels of trust in and technology acceptance of AI-powered models for classroom dialogue analysis compared to those in the control group. Notably, there were no significant differences in cognitive load between the two groups. Furthermore, teachers in the treatment group expressed high satisfaction with the explanations. During interviews, they also elucidated how the explanations changed their perceptions of model features and attitudes towards the models. This study is among the pioneering works to propose and validate the use of explainable AI to address interpretability challenges within deep learning-based models in the context of classroom dialogue analysis.

深度神经网络被越来越多地用于模拟课堂对话,并为教师的教学实践提供及时而有价值的反馈。然而,这些深度学习模型往往结构复杂,有许多未知参数,就像黑盒子一样。由于缺乏对课堂对话分析的清晰解释,教师很可能不信任这些人工智能驱动的模型,并对其利用不足。为了解决这个问题,我们利用可解释的人工智能来解释课堂对话分析,并进行了一项实验来评估解释的效果。我们招募了 59 名职前教师,并将他们随机分配到治疗组(30 人)或对照组(29 人)。起初,两组教师都学习使用人工智能驱动的模型分析课堂对话,但不做解释。随后,治疗组接受人工智能分析和解释,而对照组继续只接受人工智能预测。结果表明,与对照组教师相比,治疗组教师对人工智能驱动的课堂对话分析模型的信任度和技术接受度明显更高。值得注意的是,两组在认知负荷方面没有明显差异。此外,治疗组教师对解释表示非常满意。在访谈中,他们还阐明了讲解如何改变了他们对模型特征的认识和对模型的态度。课堂对话被认为是教学过程中的一个关键要素,研究人员越来越多地利用人工智能技术,特别是深度学习方法来分析课堂对话。本文通过一项实验研究证明,提供模型解释可以提高教师对人工智能课堂对话模型的信任度和技术接受度,同时不会增加他们的认知负担。教师们对可解释人工智能提供的模型解释表示满意。可解释人工智能的整合可以有效解决用于分析课堂对话的复杂人工智能模型的可解释性难题。为课堂对话设计的智能教学系统可以从先进的人工智能模型和可解释人工智能方法中受益,这些方法既能为用户提供自动分析,又能提供清晰的解释。通过让用户理解分析背后的基本原理,解释可以促进用户对人工智能模型的信任和接受。
{"title":"Using explainable AI to unravel classroom dialogue analysis: Effects of explanations on teachers' trust, technology acceptance and cognitive load","authors":"Deliang Wang,&nbsp;Cunling Bian,&nbsp;Gaowei Chen","doi":"10.1111/bjet.13466","DOIUrl":"10.1111/bjet.13466","url":null,"abstract":"<p>Deep neural networks are increasingly employed to model classroom dialogue and provide teachers with prompt and valuable feedback on their teaching practices. However, these deep learning models often have intricate structures with numerous unknown parameters, functioning as black boxes. The lack of clear explanations regarding their classroom dialogue analysis likely leads teachers to distrust and underutilize these AI-powered models. To tackle this issue, we leveraged explainable AI to unravel classroom dialogue analysis and conducted an experiment to evaluate the effects of explanations. Fifty-nine pre-service teachers were recruited and randomly assigned to either a treatment (<i>n</i> = 30) or control (<i>n</i> = 29) group. Initially, both groups learned to analyse classroom dialogue using AI-powered models without explanations. Subsequently, the treatment group received both AI analysis and explanations, while the control group continued to receive only AI predictions. The results demonstrated that teachers in the treatment group exhibited significantly higher levels of trust in and technology acceptance of AI-powered models for classroom dialogue analysis compared to those in the control group. Notably, there were no significant differences in cognitive load between the two groups. Furthermore, teachers in the treatment group expressed high satisfaction with the explanations. During interviews, they also elucidated how the explanations changed their perceptions of model features and attitudes towards the models. This study is among the pioneering works to propose and validate the use of explainable AI to address interpretability challenges within deep learning-based models in the context of classroom dialogue analysis.\u0000 </p>","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"55 6","pages":"2530-2556"},"PeriodicalIF":6.7,"publicationDate":"2024-04-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/bjet.13466","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140666555","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Towards inclusivity in AI: A comparative study of cognitive engagement between marginalized female students and peers 实现人工智能的包容性:边缘化女学生与同龄人认知参与的比较研究
IF 6.7 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-04-23 DOI: 10.1111/bjet.13467
Shiyan Jiang, Jeanne McClure, Cansu Tatar, Franziska Bickel, Carolyn P. Rosé, Jie Chao
<div> <section> <p>This study addresses the need for inclusive AI education by focusing on marginalized female students who historically lack access to learning opportunities in computing. It applies the theoretical framework of intersectionality to understand how gender, race and ethnicity intersect to shape these students' learning experiences and outcomes. Specifically, this study investigated 27 high-school students' cognitive engagement in machine learning practices. We conducted the Wilcoxon–Mann–Whitney test to explore differences in cognitive engagement between marginalized female students and their peers, employed comparative content analysis to delve into significant differences and analysed interview data thematically to gain deeper insights into students' machine learning model development processes. The findings indicated that, when engaging in machine learning practices requiring drawing diverse cultural perspectives, marginalized female students demonstrated significantly higher performance compared to their peers. In particular, marginalized female students exhibited strengths in holistic language analysis, paying attention to writers' intentions and recognizing cultural nuances in language. This study suggests that integrating language analysis and machine learning across subjects has the potential to empower marginalized female students and amplify their perspectives. Furthermore, it calls for a strengths-based approach to reshape the narrative of underrepresentation and promote equitable participation in machine learning and AI.</p> </section> <section> <div> <div> <h3>Practitioner notes</h3> <p>What is already known about this topic </p><ul> <li>Female students, particularly those from underrepresented groups such as African American and Latina students, often experience low levels of cognitive engagement in computing.</li> <li>Marginalized female students possess unique strengths that, when nurtured, have the potential to not only transform their own learning experiences but also contribute to the advancement of the computing field.</li> <li>It is critical to empower marginalized female students in K-12 AI (ie, a subfield of computing) education, seeking to bridge the gender and racial disparity in AI.</li> </ul> <p>What this paper adds </p><ul> <li>Marginalized female students outperformed their peers in responding to machine learning questions related to feature analysis and feature distribution interpretati
本研究关注历来缺乏计算机学习机会的边缘化女学生,以满足对包容性人工智能教育的需求。本研究运用交叉性理论框架来理解性别、种族和民族是如何交叉影响这些学生的学习经历和结果的。具体而言,本研究调查了 27 名高中学生在机器学习实践中的认知参与情况。我们通过 Wilcoxon-Mann-Whitney 检验来探索边缘化女学生与同龄人在认知参与方面的差异,采用比较内容分析法来深入研究显著差异,并对访谈数据进行专题分析,以深入了解学生的机器学习模型开发过程。研究结果表明,在参与需要汲取不同文化视角的机器学习实践时,边缘化女学生的表现明显高于同龄人。特别是,边缘化女学生在整体语言分析、关注作者意图和识别语言中的文化细微差别方面表现出优势。这项研究表明,跨学科整合语言分析和机器学习有可能增强边缘化女学生的能力,扩大她们的视野。此外,本研究还呼吁采用基于优势的方法来重塑代表性不足的说法,并促进对机器学习和人工智能的公平参与。关于本主题的已知情况女学生,尤其是那些来自非裔美国人和拉丁裔学生等代表性不足群体的女学生,在计算机领域的认知参与度往往较低。被边缘化的女学生拥有独特的优势,如果加以培养,她们不仅有可能改变自己的学习经历,还能为计算机领域的进步做出贡献。在 K-12 人工智能(即计算机的一个子领域)教育中,增强被边缘化的女学生的能力至关重要,这有助于弥合人工智能领域的性别和种族差异。在回答这些问题时,她们通过考虑特征之间的相互作用和作者的意图,展示了一种分析语言的整体方法。她们利用了有关在不同文化背景下如何使用语言表达意义的知识。对实践和/或政策的启示教育工作者应该设计学习环境,鼓励学生利用他们的文化背景、语言洞察力和不同经验,提高他们在人工智能相关活动中的参与度和表现。教育工作者应战略性地将语言分析和机器学习整合到不同学科中,创造跨学科学习体验,支持学生探索语言、文化和人工智能之间的相互作用。教育机构和政策倡议应采用基于优势的方法,通过承认边缘化女学生的固有能力和不同背景,重点增强她们的能力。
{"title":"Towards inclusivity in AI: A comparative study of cognitive engagement between marginalized female students and peers","authors":"Shiyan Jiang,&nbsp;Jeanne McClure,&nbsp;Cansu Tatar,&nbsp;Franziska Bickel,&nbsp;Carolyn P. Rosé,&nbsp;Jie Chao","doi":"10.1111/bjet.13467","DOIUrl":"10.1111/bjet.13467","url":null,"abstract":"&lt;div&gt;\u0000 \u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;p&gt;This study addresses the need for inclusive AI education by focusing on marginalized female students who historically lack access to learning opportunities in computing. It applies the theoretical framework of intersectionality to understand how gender, race and ethnicity intersect to shape these students' learning experiences and outcomes. Specifically, this study investigated 27 high-school students' cognitive engagement in machine learning practices. We conducted the Wilcoxon–Mann–Whitney test to explore differences in cognitive engagement between marginalized female students and their peers, employed comparative content analysis to delve into significant differences and analysed interview data thematically to gain deeper insights into students' machine learning model development processes. The findings indicated that, when engaging in machine learning practices requiring drawing diverse cultural perspectives, marginalized female students demonstrated significantly higher performance compared to their peers. In particular, marginalized female students exhibited strengths in holistic language analysis, paying attention to writers' intentions and recognizing cultural nuances in language. This study suggests that integrating language analysis and machine learning across subjects has the potential to empower marginalized female students and amplify their perspectives. Furthermore, it calls for a strengths-based approach to reshape the narrative of underrepresentation and promote equitable participation in machine learning and AI.&lt;/p&gt;\u0000 &lt;/section&gt;\u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;div&gt;\u0000 \u0000 &lt;div&gt;\u0000 \u0000 &lt;h3&gt;Practitioner notes&lt;/h3&gt;\u0000 &lt;p&gt;What is already known about this topic\u0000\u0000 &lt;/p&gt;&lt;ul&gt;\u0000 \u0000 &lt;li&gt;Female students, particularly those from underrepresented groups such as African American and Latina students, often experience low levels of cognitive engagement in computing.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;Marginalized female students possess unique strengths that, when nurtured, have the potential to not only transform their own learning experiences but also contribute to the advancement of the computing field.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;It is critical to empower marginalized female students in K-12 AI (ie, a subfield of computing) education, seeking to bridge the gender and racial disparity in AI.&lt;/li&gt;\u0000 &lt;/ul&gt;\u0000 &lt;p&gt;What this paper adds\u0000\u0000 &lt;/p&gt;&lt;ul&gt;\u0000 \u0000 &lt;li&gt;Marginalized female students outperformed their peers in responding to machine learning questions related to feature analysis and feature distribution interpretati","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"55 6","pages":"2557-2573"},"PeriodicalIF":6.7,"publicationDate":"2024-04-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/bjet.13467","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140670385","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
British Journal of Educational Technology
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1