首页 > 最新文献

British Journal of Educational Technology最新文献

英文 中文
Evaluating the use of BERT and Llama to analyse classroom dialogue for teachers' learning of dialogic pedagogy 评价BERT和Llama分析课堂对话对教师学习对话教学法的作用
IF 8.1 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2025-05-12 DOI: 10.1111/bjet.13604
Deliang Wang, Gaowei Chen

Classroom dialogue is crucial for effective teaching and learning, prompting many professional development (PD) programs to focus on dialogic pedagogy. Traditionally, these programs rely on manual analysis of classroom practices, which limits timely feedback to teachers. To address this, artificial intelligence (AI) has been employed for rapid dialogue analysis. However, practical applications of AI models remain limited, often prioritising state-of-the-art performance over educational impact. This study explores whether higher accuracy in AI models correlates with better educational outcomes. We evaluated the performance of two language models—BERT and Llama3—in dialogic analysis and assessed the impact of their performance differences on teachers' learning within a PD program. By fine-tuning BERT and engineering prompts for Llama3, we found that BERT exhibited substantially higher accuracy in analysing dialogic moves. Sixty preservice teachers were randomly assigned to either the BERT or Llama3 group, both participating in a workshop on the academically productive talk (APT) framework. The BERT group utilized the fine-tuned BERT model to facilitate their learning, while the Llama3 group employed the Llama3 model. Statistical analysis showed significant improvements in both groups' knowledge and motivation to learn the APT framework, with high levels of satisfaction reported. Notably, no significant differences were found between the two groups in posttest knowledge, motivation, and satisfaction. Interviews further elucidated how both models facilitated teachers' learning of the APT framework. This study validates the use of AI in teacher training and is among the first to investigate the relationship between AI accuracy and educational outcomes.

课堂对话对于有效的教与学至关重要,这促使许多专业发展(PD)项目关注对话教学法。传统上,这些项目依赖于对课堂实践的人工分析,这限制了对教师的及时反馈。为了解决这个问题,人工智能(AI)被用于快速对话分析。然而,人工智能模型的实际应用仍然有限,往往优先考虑最先进的性能,而不是教育影响。这项研究探讨了人工智能模型的更高准确性是否与更好的教育成果相关。我们评估了bert和llama3两种语言模型在对话分析中的表现,并评估了它们的表现差异对PD项目中教师学习的影响。通过微调BERT和Llama3的工程提示,我们发现BERT在分析对话动作方面表现出更高的准确性。60名职前教师被随机分配到BERT组或Llama3组,他们都参加了一个关于学术生产性谈话(APT)框架的研讨会。BERT组使用微调的BERT模型来促进他们的学习,而Llama3组使用Llama3模型。统计分析显示,两组学习APT框架的知识和动机均有显著改善,满意度较高。值得注意的是,两组在测试后知识、动机和满意度方面没有显著差异。访谈进一步阐明了这两种模式如何促进教师对APT框架的学习。这项研究验证了人工智能在教师培训中的应用,并且是第一批研究人工智能准确性与教育成果之间关系的研究之一。
{"title":"Evaluating the use of BERT and Llama to analyse classroom dialogue for teachers' learning of dialogic pedagogy","authors":"Deliang Wang,&nbsp;Gaowei Chen","doi":"10.1111/bjet.13604","DOIUrl":"https://doi.org/10.1111/bjet.13604","url":null,"abstract":"<p>Classroom dialogue is crucial for effective teaching and learning, prompting many professional development (PD) programs to focus on dialogic pedagogy. Traditionally, these programs rely on manual analysis of classroom practices, which limits timely feedback to teachers. To address this, artificial intelligence (AI) has been employed for rapid dialogue analysis. However, practical applications of AI models remain limited, often prioritising state-of-the-art performance over educational impact. This study explores whether higher accuracy in AI models correlates with better educational outcomes. We evaluated the performance of two language models—BERT and Llama3—in dialogic analysis and assessed the impact of their performance differences on teachers' learning within a PD program. By fine-tuning BERT and engineering prompts for Llama3, we found that BERT exhibited substantially higher accuracy in analysing dialogic moves. Sixty preservice teachers were randomly assigned to either the BERT or Llama3 group, both participating in a workshop on the academically productive talk (APT) framework. The BERT group utilized the fine-tuned BERT model to facilitate their learning, while the Llama3 group employed the Llama3 model. Statistical analysis showed significant improvements in both groups' knowledge and motivation to learn the APT framework, with high levels of satisfaction reported. Notably, no significant differences were found between the two groups in posttest knowledge, motivation, and satisfaction. Interviews further elucidated how both models facilitated teachers' learning of the APT framework. This study validates the use of AI in teacher training and is among the first to investigate the relationship between AI accuracy and educational outcomes.</p><p>\u0000 \u0000 </p>","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"56 6","pages":"2671-2704"},"PeriodicalIF":8.1,"publicationDate":"2025-05-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://bera-journals.onlinelibrary.wiley.com/doi/epdf/10.1111/bjet.13604","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145248638","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Ending well: Values in concluding or transitioning community educational technology projects 善终:社区教育技术项目结束或过渡的价值
IF 8.1 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2025-05-09 DOI: 10.1111/bjet.13598
Caroline R. Pitt

Community-partnered educational research projects exist in a complex network of stakeholders, values, time constraints and funding limitations. Many researchers are beholden to mandates around their funding, as well as the tenure clock and the ‘publish or perish’ mindset. However, building rapport and trust with communities takes time and resource investment that is not always prioritized in academia, and the ending process of a project is rarely explored. In this study, the educational technology project ecosystem and power dynamics in which researchers and participants exist is examined, drawing on the stakeholder analysis and value tensions of Value Sensitive Design to focus on the endings of such projects. Using a cross-case analysis of two long-term educational technology projects, the case study data corpus was qualitatively analysed to identify key themes involved in the ending process, based around retrospective interviews with participants from multiple stakeholder groups. This work identifies types of and strategies for ending, including individual endings and transitions, and develops recommendations for equitable ending processes in the context of educational technology projects. The study explores the dimensions and considerations in ending a project that involves a long-term partnership with a community, developing ways to understand, navigate and plan for the closing process and facilitating less extractive and more mutually beneficial community research partnerships.

社区合作的教育研究项目存在于利益相关者、价值观、时间限制和资金限制的复杂网络中。许多研究人员对他们的资金、任期和“不发表就灭亡”的心态都心存义务。然而,与社区建立融洽的关系和信任需要时间和资源投资,这在学术界并不总是优先考虑的,而且很少探索项目的结束过程。在本研究中,研究人员和参与者存在的教育技术项目生态系统和权力动态,利用利益相关者分析和价值敏感设计的价值张力来关注这些项目的结局。通过对两个长期教育技术项目的跨案例分析,对案例研究数据语料库进行定性分析,以确定结束过程中涉及的关键主题,基于对来自多个利益相关者群体的参与者的回顾性访谈。这项工作确定了结束的类型和策略,包括个别结束和过渡,并提出了在教育技术项目背景下公平结束过程的建议。本研究探讨了结束与社区长期合作伙伴关系的项目的维度和考虑因素,开发了理解、导航和计划结束过程的方法,并促进了较少的采掘和更多互利的社区研究伙伴关系。
{"title":"Ending well: Values in concluding or transitioning community educational technology projects","authors":"Caroline R. Pitt","doi":"10.1111/bjet.13598","DOIUrl":"10.1111/bjet.13598","url":null,"abstract":"<p>Community-partnered educational research projects exist in a complex network of stakeholders, values, time constraints and funding limitations. Many researchers are beholden to mandates around their funding, as well as the tenure clock and the ‘publish or perish’ mindset. However, building rapport and trust with communities takes time and resource investment that is not always prioritized in academia, and the ending process of a project is rarely explored. In this study, the educational technology project ecosystem and power dynamics in which researchers and participants exist is examined, drawing on the stakeholder analysis and value tensions of Value Sensitive Design to focus on the endings of such projects. Using a cross-case analysis of two long-term educational technology projects, the case study data corpus was qualitatively analysed to identify key themes involved in the ending process, based around retrospective interviews with participants from multiple stakeholder groups. This work identifies <i>types of</i> and <i>strategies for ending</i>, including individual endings and transitions, and develops recommendations for equitable ending processes in the context of educational technology projects. The study explores the dimensions and considerations in ending a project that involves a long-term partnership with a community, developing ways to understand, navigate and plan for the closing process and facilitating less extractive and more mutually beneficial community research partnerships.</p>","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"56 4","pages":"1415-1437"},"PeriodicalIF":8.1,"publicationDate":"2025-05-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144273197","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Aligning human values and educational technologies with value-sensitive design 将人的价值和教育技术与价值敏感的设计结合起来
IF 8.1 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2025-05-06 DOI: 10.1111/bjet.13602
Luis P. Prieto, Olga Viberg, Jason C. Yip, Paraskevi Topali
{"title":"Aligning human values and educational technologies with value-sensitive design","authors":"Luis P. Prieto,&nbsp;Olga Viberg,&nbsp;Jason C. Yip,&nbsp;Paraskevi Topali","doi":"10.1111/bjet.13602","DOIUrl":"10.1111/bjet.13602","url":null,"abstract":"","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"56 4","pages":"1299-1310"},"PeriodicalIF":8.1,"publicationDate":"2025-05-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/bjet.13602","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144273373","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The roles of technology efficacy and networking agency in elementary students' engagement in online and face-to-face technology-mediated learning 技术效能和网络代理在小学生在线和面对面技术中介学习参与中的作用
IF 8.1 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2025-05-06 DOI: 10.1111/bjet.13597
Wonjoon Cha, Minxuan Hong, Michael Glassman, Eric M. Anderman, Tzu-Jung Lin
<div> <section> <p>Despite the growing use of learning technology in classrooms, factors predicting young students' engagement in contexts fully or partially mediated by technology remain understudied. This study investigated how fourth and fifth grade students' technology self-efficacy (ie, confidence in utilizing learning management systems) and networking agency (ie, comfort in collaborating and communicating with others online) predicted students' engagement in technology-mediated instruction in online and face-to-face environments. Hierarchical regression and moderation analyses were employed to examine the independent and joint effects of technology self-efficacy and networking agency in two cohorts of public elementary school students from a Midwestern US city. For Cohort 1 students primarily receiving synchronous online instruction in 2020–2021, higher networking agency predicted greater engagement in online learning. For Cohort 2 students primarily receiving face-to-face instruction in 2021–2022, only technology efficacy significantly predicted student engagement. As for task-specific engagement in small group activities, however, which involved heavier use of the learning management systems and applications, networking agency was a significant moderator. Notably, as students felt less comfortable with online collaboration/communication (ie, lower networking agency), technology self-efficacy had a stronger association with students' engagement. These findings suggest that while technology self-efficacy is crucial, it alone does not ensure engagement. Educators should cultivate both technical skills and a supportive, collaborative online environment to enhance engagement across technology-mediated learning contexts.</p> </section> <section> <div> <div> <h3>Practitioner notes</h3> <p>What is already known about this topic </p><ul> <li>Technology (self-)efficacy, or students' confidence in using online learning tools, is crucial for their engagement in technology-mediated learning.</li> <li>Student engagement in technology-mediated learning varies between online and face-to-face environments.</li> </ul> <p>What this paper adds </p><ul> <li>In online environments, networking agency or comfort in online collaboration and communication predicts engagement more strongly than technology efficacy.</li> <li>Technology efficacy consistently predicts young learners' engagement in technology-mediated learning in face-to-face classroom
尽管在课堂上越来越多地使用学习技术,但预测年轻学生在完全或部分由技术介导的环境中参与的因素仍未得到充分研究。本研究调查了四年级和五年级学生的技术自我效能(即使用学习管理系统的信心)和网络代理(即与他人在线协作和交流的舒适度)如何预测学生在在线和面对面环境中对技术介导的教学的参与。本研究以美国中西部某城市公立小学两组学生为研究对象,采用层次回归和调节分析,考察技术自我效能感和网络代理的独立效应和联合效应。对于2020-2021年主要接受同步在线教学的队列1学生来说,更高的网络代理意味着更大的在线学习参与度。对于2021-2022年主要接受面对面教学的队列2学生,只有技术效能显著预测学生的参与度。然而,在涉及更多地使用学习管理系统和应用程序的小组活动中具体任务的参与方面,联网机构是一个重要的调节因素。值得注意的是,由于学生对在线协作/交流感到不太舒服(即较低的网络代理),技术自我效能感与学生的参与度有更强的关联。这些发现表明,虽然技术自我效能感至关重要,但仅凭它并不能确保参与。教育工作者应该同时培养技术技能和支持性、协作性的在线环境,以提高技术介导的学习环境的参与度。技术(自我)效能,或学生使用在线学习工具的信心,对于他们参与以技术为媒介的学习至关重要。学生在技术中介学习中的参与度在在线和面对面环境中有所不同。在网络环境中,网络代理或在线协作和交流的舒适度比技术效能更能预测用户粘性。技术效能持续预测年轻学习者在面对面课堂中以技术为媒介的学习的参与。网络代理与技术效能在预测小学生在面对面课堂中对技术中介活动的参与上有交互作用。对实践和/或政策的启示教师应考虑学生的技术能力,以及他们如何理解在线协作和互动,以有效地使他们参与以技术为媒介的教学。在实施技术时,教师应该帮助学生将在线学习环境视为一个安全和协作的空间。让小学生等年轻学习者熟悉数字工具和在线空间,可以提高他们对以技术为媒介的教学的参与度。
{"title":"The roles of technology efficacy and networking agency in elementary students' engagement in online and face-to-face technology-mediated learning","authors":"Wonjoon Cha,&nbsp;Minxuan Hong,&nbsp;Michael Glassman,&nbsp;Eric M. Anderman,&nbsp;Tzu-Jung Lin","doi":"10.1111/bjet.13597","DOIUrl":"https://doi.org/10.1111/bjet.13597","url":null,"abstract":"&lt;div&gt;\u0000 \u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;p&gt;Despite the growing use of learning technology in classrooms, factors predicting young students' engagement in contexts fully or partially mediated by technology remain understudied. This study investigated how fourth and fifth grade students' technology self-efficacy (ie, confidence in utilizing learning management systems) and networking agency (ie, comfort in collaborating and communicating with others online) predicted students' engagement in technology-mediated instruction in online and face-to-face environments. Hierarchical regression and moderation analyses were employed to examine the independent and joint effects of technology self-efficacy and networking agency in two cohorts of public elementary school students from a Midwestern US city. For Cohort 1 students primarily receiving synchronous online instruction in 2020–2021, higher networking agency predicted greater engagement in online learning. For Cohort 2 students primarily receiving face-to-face instruction in 2021–2022, only technology efficacy significantly predicted student engagement. As for task-specific engagement in small group activities, however, which involved heavier use of the learning management systems and applications, networking agency was a significant moderator. Notably, as students felt less comfortable with online collaboration/communication (ie, lower networking agency), technology self-efficacy had a stronger association with students' engagement. These findings suggest that while technology self-efficacy is crucial, it alone does not ensure engagement. Educators should cultivate both technical skills and a supportive, collaborative online environment to enhance engagement across technology-mediated learning contexts.&lt;/p&gt;\u0000 &lt;/section&gt;\u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;div&gt;\u0000 \u0000 &lt;div&gt;\u0000 \u0000 &lt;h3&gt;Practitioner notes&lt;/h3&gt;\u0000 &lt;p&gt;What is already known about this topic\u0000\u0000 &lt;/p&gt;&lt;ul&gt;\u0000 \u0000 &lt;li&gt;Technology (self-)efficacy, or students' confidence in using online learning tools, is crucial for their engagement in technology-mediated learning.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;Student engagement in technology-mediated learning varies between online and face-to-face environments.&lt;/li&gt;\u0000 &lt;/ul&gt;\u0000 &lt;p&gt;What this paper adds\u0000\u0000 &lt;/p&gt;&lt;ul&gt;\u0000 \u0000 &lt;li&gt;In online environments, networking agency or comfort in online collaboration and communication predicts engagement more strongly than technology efficacy.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;Technology efficacy consistently predicts young learners' engagement in technology-mediated learning in face-to-face classroom","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"56 6","pages":"2623-2646"},"PeriodicalIF":8.1,"publicationDate":"2025-05-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://bera-journals.onlinelibrary.wiley.com/doi/epdf/10.1111/bjet.13597","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145248520","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Enhancing self-regulated learning and learning experience in generative AI environments: The critical role of metacognitive support 在生成式人工智能环境中增强自我调节学习和学习体验:元认知支持的关键作用
IF 8.1 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2025-05-05 DOI: 10.1111/bjet.13599
Xiaoqing Xu, Lifang Qiao, Nuo Cheng, Hongxia Liu, Wei Zhao
<div> <section> <p>The rapid development of generative artificial intelligence (GenAI) has brought opportunities and new challenges to higher education. Students need a high level of self-regulated learning to adapt to this change. However, it is difficult for students to persist in self-regulation without guidance. Metacognitive support has a significant advantage in enhancing self-regulated learning, but fewer studies have explored the effects of its role in GenAI environments. The purpose of this study was to investigate the impacts of metacognitive support on college students' self-regulated learning and learning experiences in a GenAI environment. A quasi-experiment was designed in which 68 college students were divided into two groups. The experimental group (<i>N</i> = 35) received explicit metacognitive support, while the control group (<i>N</i> = 33) did not receive any metacognitive prompts. The experiment lasted 4 weeks. The study measured students' academic performance, self-regulated learning ability and learning experiences (including cognitive load and technology acceptance). The results indicate that in the GenAI environment, metacognitive support, while not producing significant between-group differences in achievement, enhances students' self-regulated learning abilities particularly in terms of task strategy and self-evaluation, as well as optimizing their learning experience. The study also found that students were at risk of decreasing their level of self-regulated learning if they lacked metacognitive support in the GenAI environment. The conclusion points out that GenAI supports learners to accomplish learning tasks while potentially reducing self-regulated learning effectiveness, and that metacognitive support is key to supporting effective regulation in learners' GenAI environments. This study provides an important theoretical and practical basis for how to better support learners' learning in GenAI environments.</p> </section> <section> <div> <div> <h3>Practitioner notes</h3> <p>What is already known about this topic </p><ul> <li>SRL is vital for effective learning in digital environments.</li> <li>Generative AI tools, like ChatGPT, can enhance learning but require support.</li> <li>Learners often struggle to apply SRL strategies without guidance.</li> </ul> <p>What this paper adds </p><ul> <li>Metacognitive support improves SRL in Generative AI environments.</li> <li>It reduces cognitive load and increases the perceived usefulness of AI tools.</li>
生成式人工智能(GenAI)的快速发展给高等教育带来了机遇和新的挑战。学生需要高水平的自我调节学习来适应这种变化。然而,如果没有指导,学生很难坚持自我调节。元认知支持在增强自我调节学习方面具有显著优势,但很少有研究探索其在GenAI环境中的作用。本研究旨在探讨元认知支持对GenAI环境下大学生自我调节学习和学习体验的影响。设计了一个准实验,将68名大学生分为两组。实验组(N = 35)接受外显元认知支持,对照组(N = 33)不接受任何元认知提示。试验期4周。本研究测量了学生的学业成绩、自主学习能力和学习体验(包括认知负荷和技术接受度)。结果表明,在GenAI环境下,元认知支持在不产生显著组间成绩差异的情况下,提高了学生的自我调节学习能力,特别是在任务策略和自我评价方面,并优化了学生的学习体验。该研究还发现,如果学生在GenAI环境中缺乏元认知支持,他们的自我调节学习水平就有降低的风险。结论指出,GenAI支持学习者完成学习任务,但可能会降低自我调节的学习效率,元认知支持是支持学习者在GenAI环境中有效调节的关键。该研究为如何更好地支持GenAI环境下学习者的学习提供了重要的理论和实践依据。从业者注意到,关于这个主题,我们已经知道SRL对于在数字环境中有效学习至关重要。像ChatGPT这样的生成式人工智能工具可以增强学习,但需要支持。在没有指导的情况下,学习者常常难以应用SRL策略。本文添加的元认知支持改进了生成式AI环境中的SRL。它减少了认知负荷,增加了人工智能工具的感知有用性。结构化的支持会带来更好的学术成果。教师在使用人工智能工具时应整合元认知支持。在技术丰富的环境中,教师培训应侧重于SRL策略。政策应促进在教育中道德和有效地使用人工智能。
{"title":"Enhancing self-regulated learning and learning experience in generative AI environments: The critical role of metacognitive support","authors":"Xiaoqing Xu,&nbsp;Lifang Qiao,&nbsp;Nuo Cheng,&nbsp;Hongxia Liu,&nbsp;Wei Zhao","doi":"10.1111/bjet.13599","DOIUrl":"10.1111/bjet.13599","url":null,"abstract":"&lt;div&gt;\u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;p&gt;The rapid development of generative artificial intelligence (GenAI) has brought opportunities and new challenges to higher education. Students need a high level of self-regulated learning to adapt to this change. However, it is difficult for students to persist in self-regulation without guidance. Metacognitive support has a significant advantage in enhancing self-regulated learning, but fewer studies have explored the effects of its role in GenAI environments. The purpose of this study was to investigate the impacts of metacognitive support on college students' self-regulated learning and learning experiences in a GenAI environment. A quasi-experiment was designed in which 68 college students were divided into two groups. The experimental group (&lt;i&gt;N&lt;/i&gt; = 35) received explicit metacognitive support, while the control group (&lt;i&gt;N&lt;/i&gt; = 33) did not receive any metacognitive prompts. The experiment lasted 4 weeks. The study measured students' academic performance, self-regulated learning ability and learning experiences (including cognitive load and technology acceptance). The results indicate that in the GenAI environment, metacognitive support, while not producing significant between-group differences in achievement, enhances students' self-regulated learning abilities particularly in terms of task strategy and self-evaluation, as well as optimizing their learning experience. The study also found that students were at risk of decreasing their level of self-regulated learning if they lacked metacognitive support in the GenAI environment. The conclusion points out that GenAI supports learners to accomplish learning tasks while potentially reducing self-regulated learning effectiveness, and that metacognitive support is key to supporting effective regulation in learners' GenAI environments. This study provides an important theoretical and practical basis for how to better support learners' learning in GenAI environments.&lt;/p&gt;\u0000 &lt;/section&gt;\u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;div&gt;\u0000 \u0000 &lt;div&gt;\u0000 \u0000 &lt;h3&gt;Practitioner notes&lt;/h3&gt;\u0000 &lt;p&gt;What is already known about this topic\u0000\u0000 &lt;/p&gt;&lt;ul&gt;\u0000 \u0000 &lt;li&gt;SRL is vital for effective learning in digital environments.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;Generative AI tools, like ChatGPT, can enhance learning but require support.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;Learners often struggle to apply SRL strategies without guidance.&lt;/li&gt;\u0000 &lt;/ul&gt;\u0000 &lt;p&gt;What this paper adds\u0000\u0000 &lt;/p&gt;&lt;ul&gt;\u0000 \u0000 &lt;li&gt;Metacognitive support improves SRL in Generative AI environments.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;It reduces cognitive load and increases the perceived usefulness of AI tools.&lt;/li&gt;\u0000 ","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"56 5","pages":"1842-1863"},"PeriodicalIF":8.1,"publicationDate":"2025-05-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144811293","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Supporting teachers' value-sensitive reflections on the cost–benefit dynamics of technology in educational practices 支持教师对教育实践中技术成本效益动态的价值敏感反思
IF 8.1 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2025-04-29 DOI: 10.1111/bjet.13592
Davinia Hernández-Leo, Karina Ginoyan

This paper explores the application of a benefits versus costs reflection approach within non-university teaching environments, grounded in the principles of Value-Sensitive Design. Aimed at integrating human values systematically into the adoption of digital educational tools, this study involved 136 in-service school teachers across various workshops in Catalonia. Through the use of a structured customisable worksheet, educators critically self-evaluated their feelings about both the benefits and costs associated with the use of digital technologies in their teaching practices. The study found that the approach was meaningful to the teachers, who were able to adapt the use of the workshop to their cases. The positive reception by teachers suggests not only a satisfactory level of usability and utility of the approach but also their agreement with the need to integrate related strategies in their training, learning design and community debate processes.

本文以价值敏感设计原则为基础,探讨了效益与成本反映方法在非大学教学环境中的应用。为了将人的价值系统地整合到数字教育工具的采用中,这项研究涉及了加泰罗尼亚各个讲习班的136名在职学校教师。通过使用结构化的可定制工作表,教育工作者批判性地自我评估了他们对在教学实践中使用数字技术的收益和成本的感受。研究发现,这种方法对教师来说是有意义的,他们能够根据自己的情况调整研讨会的使用。教师的积极接受不仅表明该方法的可用性和效用达到令人满意的程度,而且表明他们同意有必要将相关策略纳入其培训、学习设计和社区辩论过程。
{"title":"Supporting teachers' value-sensitive reflections on the cost–benefit dynamics of technology in educational practices","authors":"Davinia Hernández-Leo,&nbsp;Karina Ginoyan","doi":"10.1111/bjet.13592","DOIUrl":"10.1111/bjet.13592","url":null,"abstract":"<p>This paper explores the application of a benefits versus costs reflection approach within non-university teaching environments, grounded in the principles of Value-Sensitive Design. Aimed at integrating human values systematically into the adoption of digital educational tools, this study involved 136 in-service school teachers across various workshops in Catalonia. Through the use of a structured customisable worksheet, educators critically self-evaluated their feelings about both the benefits and costs associated with the use of digital technologies in their teaching practices. The study found that the approach was meaningful to the teachers, who were able to adapt the use of the workshop to their cases. The positive reception by teachers suggests not only a satisfactory level of usability and utility of the approach but also their agreement with the need to integrate related strategies in their training, learning design and community debate processes.</p><p>\u0000 \u0000 </p>","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"56 4","pages":"1350-1369"},"PeriodicalIF":8.1,"publicationDate":"2025-04-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/bjet.13592","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144273195","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The dark side of affinity spaces for teacher professional learning 亲和空间对教师专业学习的阴暗面
IF 8.1 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2025-04-29 DOI: 10.1111/bjet.13593
Daniel G. Krutka, Spencer P. Greenhalgh

The affinity space framework has proven useful for explaining and understanding teacher activity on social media platforms. In this study, we explore the ‘dark side’ of teacher affinity spaces by documenting a partisan teachers' group on an alternative social media platform. We used a mix of a priori and emergent coding to analyse screenshots of posts and comments from a public teachers' group and group administrators' activity on the broader platform. Findings indicate that although the group administrators began with a focus on teachers, most participants were non-teachers with political (rather than professional) concerns about US education. Furthermore, administrators both freely engaged with political talking points in their activity outside the teachers' group and allowed the broader platform culture—including conspiratorial thinking, explicit racism and out-group villainization—to seep in. We conclude by describing how these findings correspond with the key characteristics of an affinity space, including an overlapping of affinities, a lack of concern for professional qualifications, and influence from the broader platform. These findings provide an illustrative example of how teacher affinity spaces can drift from their stated intention within the larger platform context.

Practitioner notes

What is already known about this topic

  • Social media spaces have been conceptualized as affinity spaces for educators.
  • Most studies provide optimistic accounts of teacher professional learning on social media.
  • Most research has analysed teachers' use of mainstream platforms.

What this paper adds

  • We offer a detailed analysis of a partisan US teacher group on an alternative platform.
  • Initial efforts to focus on teaching devolved into in-group identification and out-group villainization.
  • This study highlights how the characteristics of affinity spaces can be detrimental to teacher professional learning.

Implications for practice and/or policy

  • Administrators of online groups should recognize their important role in ensuring group purposes are enacted.
  • Educators should assess whether the larger platform is conducive to cultivatin
亲和力空间框架已被证明有助于解释和理解教师在社交媒体平台上的活动。在这项研究中,我们通过在另一个社交媒体平台上记录一个党派教师群体来探索教师亲和力空间的“阴暗面”。我们混合使用先验和紧急编码来分析来自公共教师小组和小组管理员在更广泛的平台上的活动的帖子和评论的截图。调查结果表明,尽管小组管理员开始关注教师,但大多数参与者都是非教师,他们对美国教育有政治(而不是专业)关注。此外,管理人员在教师小组之外的活动中自由地参与政治话题,并允许更广泛的平台文化——包括阴谋论思维、明确的种族主义和群体外的邪恶——渗透进来。最后,我们描述了这些发现如何与亲和力空间的关键特征相对应,包括亲和力的重叠,对专业资格的缺乏关注,以及来自更广泛平台的影响。这些发现提供了一个说明性的例子,说明教师亲和力空间如何在更大的平台背景下偏离他们所陈述的意图。社会媒体空间已经被概念化为教育者的亲和力空间。大多数研究对教师在社交媒体上的专业学习持乐观态度。大多数研究都分析了教师对主流平台的使用情况。我们在另一个平台上对一个党派化的美国教师团体进行了详细分析。最初把重点放在教学上的努力变成了群体内的认同和群体外的邪恶化。本研究强调了亲和性空间的特征对教师专业学习的不利影响。对实践和/或策略的启示在线组的管理员应该认识到他们在确保组目的实现方面的重要作用。教育者应该评估更大的平台是否有助于培养围绕群体目标的亲和力。学者和教育工作者应该考虑到亲和性空间的特征对教师专业学习既可以是积极的也可以是消极的。
{"title":"The dark side of affinity spaces for teacher professional learning","authors":"Daniel G. Krutka,&nbsp;Spencer P. Greenhalgh","doi":"10.1111/bjet.13593","DOIUrl":"https://doi.org/10.1111/bjet.13593","url":null,"abstract":"<div>\u0000 \u0000 <section>\u0000 \u0000 <p>The affinity space framework has proven useful for explaining and understanding teacher activity on social media platforms. In this study, we explore the ‘dark side’ of teacher affinity spaces by documenting a partisan teachers' group on an alternative social media platform. We used a mix of a priori and emergent coding to analyse screenshots of posts and comments from a public teachers' group and group administrators' activity on the broader platform. Findings indicate that although the group administrators began with a focus on teachers, most participants were non-teachers with political (rather than professional) concerns about US education. Furthermore, administrators both freely engaged with political talking points in their activity outside the teachers' group and allowed the broader platform culture—including conspiratorial thinking, explicit racism and out-group villainization—to seep in. We conclude by describing how these findings correspond with the key characteristics of an affinity space, including an overlapping of affinities, a lack of concern for professional qualifications, and influence from the broader platform. These findings provide an illustrative example of how teacher affinity spaces can drift from their stated intention within the larger platform context.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <div>\u0000 \u0000 <div>\u0000 \u0000 <h3>Practitioner notes</h3>\u0000 <p>What is already known about this topic\u0000\u0000 </p><ul>\u0000 \u0000 <li>Social media spaces have been conceptualized as affinity spaces for educators.</li>\u0000 \u0000 <li>Most studies provide optimistic accounts of teacher professional learning on social media.</li>\u0000 \u0000 <li>Most research has analysed teachers' use of mainstream platforms.</li>\u0000 </ul>\u0000 <p>What this paper adds\u0000\u0000 </p><ul>\u0000 \u0000 <li>We offer a detailed analysis of a partisan US teacher group on an alternative platform.</li>\u0000 \u0000 <li>Initial efforts to focus on teaching devolved into in-group identification and out-group villainization.</li>\u0000 \u0000 <li>This study highlights how the characteristics of affinity spaces can be detrimental to teacher professional learning.</li>\u0000 </ul>\u0000 <p>Implications for practice and/or policy\u0000\u0000 </p><ul>\u0000 \u0000 <li>Administrators of online groups should recognize their important role in ensuring group purposes are enacted.</li>\u0000 \u0000 <li>Educators should assess whether the larger platform is conducive to cultivatin","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"56 6","pages":"2573-2594"},"PeriodicalIF":8.1,"publicationDate":"2025-04-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145248710","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Teachers' digital initiatives to bridge students' in-class and out-of-class language learning and the influencing factors 教师为学生课内和课外语言学习架起桥梁的数字化举措及其影响因素
IF 8.1 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2025-04-29 DOI: 10.1111/bjet.13595
Chun Lai, Zhan Shi

Given the significant and unique contributions of both in-class and out-of-class learning, pedagogical initiatives that connect learners' experiences across these two learning spheres would bolster language development. Technology can catalyse the integration. Whether and how teachers utilize this potential of technology to engage in digital bridging initiatives, initiatives that support the connection of students' in-class and out-of-class learning experiences with digital resources, deserve attention. Thematic analysis of 13 interview responses and exploratory and confirmatory factor analyses of 1101 survey responses of primary and secondary school Chinese EFL teachers unravelled two dimensions of digital bridging initiatives: inward bridging practices and outward bridging practices. SEM analysis of the survey responses further revealed various determinants of teachers' bridging initiatives, underscoring the strong and direct influence of teachers' awareness of students' out-of-class digital behaviours and the mediated influence of school culture. The study further highlighted the prominence of teacher internal factors, such as educator-oriented identity belief, awareness of students' out-of-class digital behaviours, and TPACK, for outward bridging. The study advocates attention to the nuances of teachers' digital bridging initiatives and influencing factors across contexts.

鉴于课堂内和课外学习都有重要而独特的贡献,将学习者在这两个学习领域的经验联系起来的教学举措将促进语言的发展。技术可以促进这种整合。教师是否以及如何利用这种技术潜力参与数字桥梁倡议,支持学生将课堂内外的学习经验与数字资源联系起来的倡议,值得关注。对13个访谈回复的专题分析和对1101个中小学中国英语教师调查回复的探索性和验证性因素分析揭示了数字桥接行为的两个维度:内向桥接实践和外向桥接实践。对调查结果的SEM分析进一步揭示了教师桥接举措的各种决定因素,强调了教师对学生课外数字行为的认识和学校文化的中介影响的强烈和直接影响。研究进一步强调了教师内部因素,如教育者导向的身份信念、学生课外数字行为意识、TPACK等在外桥接中的重要性。该研究提倡关注教师数字桥梁倡议的细微差别和跨环境的影响因素。
{"title":"Teachers' digital initiatives to bridge students' in-class and out-of-class language learning and the influencing factors","authors":"Chun Lai,&nbsp;Zhan Shi","doi":"10.1111/bjet.13595","DOIUrl":"https://doi.org/10.1111/bjet.13595","url":null,"abstract":"<p>Given the significant and unique contributions of both in-class and out-of-class learning, pedagogical initiatives that connect learners' experiences across these two learning spheres would bolster language development. Technology can catalyse the integration. Whether and how teachers utilize this potential of technology to engage in digital bridging initiatives, initiatives that support the connection of students' in-class and out-of-class learning experiences with digital resources, deserve attention. Thematic analysis of 13 interview responses and exploratory and confirmatory factor analyses of 1101 survey responses of primary and secondary school Chinese EFL teachers unravelled two dimensions of digital bridging initiatives: inward bridging practices and outward bridging practices. SEM analysis of the survey responses further revealed various determinants of teachers' bridging initiatives, underscoring the strong and direct influence of teachers' awareness of students' out-of-class digital behaviours and the mediated influence of school culture. The study further highlighted the prominence of teacher internal factors, such as educator-oriented identity belief, awareness of students' out-of-class digital behaviours, and TPACK, for outward bridging. The study advocates attention to the nuances of teachers' digital bridging initiatives and influencing factors across contexts.</p>","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"56 6","pages":"2595-2622"},"PeriodicalIF":8.1,"publicationDate":"2025-04-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://bera-journals.onlinelibrary.wiley.com/doi/epdf/10.1111/bjet.13595","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145248709","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Generative AI-supported progressive prompting for professional training: Effects on learning achievement, critical thinking, and cognitive load 生成式人工智能支持的专业培训渐进式提示:对学习成就、批判性思维和认知负荷的影响
IF 8.1 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2025-04-23 DOI: 10.1111/bjet.13594
Chia-Jung Li, Gwo-Jen Hwang, Ching-Yi Chang, Hui-Chi Su

In professional training, developing critical thinking is essential for professionals to analyse problem situations and respond effectively to emergencies. Conventional professional training typically employs multimedia materials combined with progressive prompting (PP) to support trainees in constructing knowledge and solving problems on their own. However, for those trainees who have insufficient knowledge or experience, it could be challenging for them to understand and utilise the prompts for finding solutions to the problems to be dealt with. To provide a personalised advisor during the progressive prompting-based training process, this study proposed a generative artificial intelligence (GenAI)-supported PP (GenAI-PP) learning approach by employing GenAI to facilitate discussions with individual trainees regarding the prompts, thereby encouraging deeper thinking and critical analysis at each stage. This study adopted a quasi-experimental design to compare the effects of GenAI-PP and the conventional PP (C-PP) approach on students' learning outcomes. The participants were 62 newly qualified nurses with less than one year of clinical experience in Taiwan, who needed to learn to interpret electrocardiograms (ECGs) as part of their professional training. Results showed that the GenAI-PP group significantly outperformed the C-PP group on test scores (p < 0.01) and critical thinking (p < 0.01). Moreover, the GenAI-PP group experienced significantly lower extraneous cognitive load compared to the C-PP group (p < 0.001). These findings suggest the potential of GenAI-PP in professional training; that is, GenAI could serve as a learning partner to discuss with trainees the prompts provided by the instructor to help them master core concepts and develop key career competencies, especially for training programs that require in-depth analysis and decision-making.

在专业培训中,培养批判性思维对专业人员分析问题情况和有效应对紧急情况至关重要。传统的专业培训通常采用多媒体材料结合渐进式提示(PP)来支持学员自己构建知识和解决问题。然而,对于那些知识或经验不足的受训者来说,理解和利用提示来寻找解决问题的方法可能是一项挑战。为了在渐进式基于提示的培训过程中提供个性化的指导,本研究提出了一种生成式人工智能(GenAI)支持的PP (GenAI-PP)学习方法,通过使用GenAI促进与学员个人就提示进行讨论,从而鼓励在每个阶段进行更深入的思考和批判性分析。本研究采用准实验设计,比较GenAI-PP和传统PP (C-PP)方法对学生学习成果的影响。研究对象为62名台湾临床经验不足一年的新合格护士,他们需要学习解读心电图(ecg)作为其专业培训的一部分。结果显示,GenAI-PP组在测试成绩(p < 0.01)和批判性思维(p < 0.01)上显著优于C-PP组。此外,与C-PP组相比,GenAI-PP组的外部认知负荷显著降低(p < 0.001)。这些发现提示GenAI-PP在专业培训中的潜力;也就是说,GenAI可以作为一个学习伙伴,与学员讨论讲师提供的提示,帮助他们掌握核心概念和发展关键的职业能力,特别是对于需要深入分析和决策的培训项目。
{"title":"Generative AI-supported progressive prompting for professional training: Effects on learning achievement, critical thinking, and cognitive load","authors":"Chia-Jung Li,&nbsp;Gwo-Jen Hwang,&nbsp;Ching-Yi Chang,&nbsp;Hui-Chi Su","doi":"10.1111/bjet.13594","DOIUrl":"https://doi.org/10.1111/bjet.13594","url":null,"abstract":"<p>In professional training, developing critical thinking is essential for professionals to analyse problem situations and respond effectively to emergencies. Conventional professional training typically employs multimedia materials combined with progressive prompting (PP) to support trainees in constructing knowledge and solving problems on their own. However, for those trainees who have insufficient knowledge or experience, it could be challenging for them to understand and utilise the prompts for finding solutions to the problems to be dealt with. To provide a personalised advisor during the progressive prompting-based training process, this study proposed a generative artificial intelligence (GenAI)-supported PP (GenAI-PP) learning approach by employing GenAI to facilitate discussions with individual trainees regarding the prompts, thereby encouraging deeper thinking and critical analysis at each stage. This study adopted a quasi-experimental design to compare the effects of GenAI-PP and the conventional PP (C-PP) approach on students' learning outcomes. The participants were 62 newly qualified nurses with less than one year of clinical experience in Taiwan, who needed to learn to interpret electrocardiograms (ECGs) as part of their professional training. Results showed that the GenAI-PP group significantly outperformed the C-PP group on test scores (<i>p</i> &lt; 0.01) and critical thinking (<i>p</i> &lt; 0.01). Moreover, the GenAI-PP group experienced significantly lower extraneous cognitive load compared to the C-PP group (<i>p</i> &lt; 0.001). These findings suggest the potential of GenAI-PP in professional training; that is, GenAI could serve as a learning partner to discuss with trainees the prompts provided by the instructor to help them master core concepts and develop key career competencies, especially for training programs that require in-depth analysis and decision-making.</p>","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"56 6","pages":"2550-2572"},"PeriodicalIF":8.1,"publicationDate":"2025-04-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145248509","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Cognitive Echo: Enhancing think-aloud protocols with LLM-based simulated students 认知回声:增强以法学硕士为基础的模拟学生的有声思考协议
IF 8.1 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2025-04-22 DOI: 10.1111/bjet.13590
Longwei Zheng, Anna He, Changyong Qi, Haomin Zhang, Xiaoqing Gu
<div> <section> <p>In the field of education, the think-aloud protocol is commonly used to encourage learners to articulate their thoughts during the learning process, providing observers with valuable insights into learners' cognitive processes beyond the final learning outcomes. However, the implementation of think-aloud protocols faces challenges such as task interference and limitations in completeness and authenticity of verbal reports. This study proposes a method called Cognitive Echo, which leverages large language models (LLMs) trained with simulated student experiences to enhance the completeness and authenticity of think-aloud verbalizations. LLMs have been demonstrated to simulate human-like behaviour more effectively by memorizing experiences. In this work, we introduce specific learner roles and train the LLMs to act as distinct learners. Our method involves integrating transaction data from learners' interactions with a tutoring system and the tutor's content to create interactive experiences between learners and teachers, thereby training the model to become simulated students with learning experiences. To investigate the effectiveness of this approach, we designed a test playground based on the retrospective think-aloud protocol and examined how LLM-trained simulated students improve cognitive process transparency and generalization of learning strategies. The study found that Cognitive Echo not only reveals what simulated students genuinely think about their learning experiences but also enables them to transfer their different cognitive strategies to new tasks. By training simulated students on real learning behaviour data to ensure their cognitive processes reflect authentic learner experiences, this approach will extend think-aloud protocols to more practice-oriented applications.</p> </section> <section> <div> <div> <h3>Practitioner notes</h3> <p>What is already known about this topic </p><ul> <li>Think-aloud protocols are widely used in educational settings to explore students' cognitive processes by asking them to verbalize their thoughts while solving problems, but they are prone to issues like task interference and incomplete data reporting.</li> <li>Existed applications of simulating student cognition in educational research are rigid and less adaptive to individual learner characteristics.</li> <li>Artificial intelligences, especially large language models, have shown promise in educational contexts, particularly for simulating human-like behaviours.</li> </ul> <p>What this paper adds </p><ul>
在教育领域,有声思维通常用于鼓励学习者在学习过程中表达自己的想法,为观察者提供了对学习者认知过程的宝贵见解,而不仅仅是最终的学习结果。然而,有声思考协议的实现面临着任务干扰和口头报告完整性和真实性的限制等挑战。本研究提出了一种称为认知回声的方法,该方法利用模拟学生经历训练的大型语言模型(llm)来增强有声思维语言的完整性和真实性。法学硕士已经被证明可以通过记忆经验更有效地模拟类似人类的行为。在这项工作中,我们引入了特定的学习者角色,并训练法学硕士作为不同的学习者。我们的方法包括整合学习者与辅导系统互动的交易数据和导师的内容,在学习者和教师之间创造互动体验,从而训练模型成为具有学习体验的模拟学生。为了研究这种方法的有效性,我们设计了一个基于回溯性有声思考协议的测试场地,并研究了法学硕士训练的模拟学生如何提高认知过程的透明度和学习策略的泛化。研究发现,认知回声不仅揭示了模拟学生对自己学习经历的真实想法,还使他们能够将不同的认知策略转移到新的任务中。通过训练模拟学生真实的学习行为数据,以确保他们的认知过程反映真实的学习者体验,这种方法将把有声思维协议扩展到更多面向实践的应用中。关于这个话题我们已经知道的是,有声思考协议被广泛应用于教育环境中,通过要求学生在解决问题时用语言表达他们的想法来探索学生的认知过程,但他们容易出现任务干扰和数据报告不完整等问题。现有的模拟学生认知在教育研究中的应用比较死板,对学习者个体特征的适应性较差。人工智能,特别是大型语言模型,已经在教育环境中显示出前景,特别是在模拟类人行为方面。本文介绍了认知回声的概念,这是一种将法学硕士支持的模拟学生集成到有声思考协议中的方法,它通过利用回顾性数据解决了传统基于语言的方法的局限性。研究表明,法学硕士课程,当与真实的学习者体验进行微调时,可以复制独特的人类认知过程,使学生如何思考和解决问题的模拟更加完整和真实。它展示了如何使用法学硕士来模拟学生的认知过程,通过允许研究人员捕捉认知策略和行为,从而提高“有声思考”协议的透明度和完整性,否则这些策略和行为将无法说出口。教师培训项目可以从整合基于法学硕士的模拟学生中受益,这使职前教师能够在没有实时思考任务限制的情况下练习应对广泛的认知过程和挑战。认知回声法提供了一种更真实、更少干扰的方式来捕捉学生的认知,可以应用于教师培训场景,在这些场景中,模拟真实世界的课堂动态对培养教学技能至关重要。使用认知回声可以帮助创建教育场景的数字双胞胎,通过模拟现实世界的互动,促进对复杂教育问题(例如,欺凌和学习障碍)的研究。
{"title":"Cognitive Echo: Enhancing think-aloud protocols with LLM-based simulated students","authors":"Longwei Zheng,&nbsp;Anna He,&nbsp;Changyong Qi,&nbsp;Haomin Zhang,&nbsp;Xiaoqing Gu","doi":"10.1111/bjet.13590","DOIUrl":"10.1111/bjet.13590","url":null,"abstract":"&lt;div&gt;\u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;p&gt;In the field of education, the think-aloud protocol is commonly used to encourage learners to articulate their thoughts during the learning process, providing observers with valuable insights into learners' cognitive processes beyond the final learning outcomes. However, the implementation of think-aloud protocols faces challenges such as task interference and limitations in completeness and authenticity of verbal reports. This study proposes a method called Cognitive Echo, which leverages large language models (LLMs) trained with simulated student experiences to enhance the completeness and authenticity of think-aloud verbalizations. LLMs have been demonstrated to simulate human-like behaviour more effectively by memorizing experiences. In this work, we introduce specific learner roles and train the LLMs to act as distinct learners. Our method involves integrating transaction data from learners' interactions with a tutoring system and the tutor's content to create interactive experiences between learners and teachers, thereby training the model to become simulated students with learning experiences. To investigate the effectiveness of this approach, we designed a test playground based on the retrospective think-aloud protocol and examined how LLM-trained simulated students improve cognitive process transparency and generalization of learning strategies. The study found that Cognitive Echo not only reveals what simulated students genuinely think about their learning experiences but also enables them to transfer their different cognitive strategies to new tasks. By training simulated students on real learning behaviour data to ensure their cognitive processes reflect authentic learner experiences, this approach will extend think-aloud protocols to more practice-oriented applications.&lt;/p&gt;\u0000 &lt;/section&gt;\u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;div&gt;\u0000 \u0000 &lt;div&gt;\u0000 \u0000 &lt;h3&gt;Practitioner notes&lt;/h3&gt;\u0000 &lt;p&gt;What is already known about this topic\u0000\u0000 &lt;/p&gt;&lt;ul&gt;\u0000 \u0000 &lt;li&gt;Think-aloud protocols are widely used in educational settings to explore students' cognitive processes by asking them to verbalize their thoughts while solving problems, but they are prone to issues like task interference and incomplete data reporting.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;Existed applications of simulating student cognition in educational research are rigid and less adaptive to individual learner characteristics.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;Artificial intelligences, especially large language models, have shown promise in educational contexts, particularly for simulating human-like behaviours.&lt;/li&gt;\u0000 &lt;/ul&gt;\u0000 &lt;p&gt;What this paper adds\u0000\u0000 &lt;/p&gt;&lt;ul&gt;\u0000 \u0000 ","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"56 5","pages":"2019-2042"},"PeriodicalIF":8.1,"publicationDate":"2025-04-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144811128","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
British Journal of Educational Technology
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1