首页 > 最新文献

British Journal of Educational Technology最新文献

英文 中文
Vulnerable student digital well-being in AI-powered educational decision support systems (AI-EDSS) in higher education 高等教育中由人工智能驱动的教育决策支持系统(AI-EDSS)中的弱势学生数字福祉
IF 6.7 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-07-16 DOI: 10.1111/bjet.13508
Paul Prinsloo, Mohammad Khalil, Sharon Slade
<div> <section> <p>Students' physical and digital lives are increasingly entangled. It is difficult to separate students' <i>digital</i> well-being from their offline well-being given that artificial intelligence increasingly shapes both. Within the context of education's fiduciary and moral duty to ensure safe, appropriate and effective digital learning spaces for students, the continuing merger between artificial intelligence and learning analytics not only opens up many opportunities for more responsive teaching and learning but also raises concerns, specifically for previously disadvantaged and vulnerable students. While digital well-being is a well-established research focus, it is not clear how AI-Powered Educational Decision Support Systems (AI-EDSS) might impact on the inherent, situational and pathogenic vulnerability of students. In this conceptual paper, we map the digital well-being of previously disadvantaged and vulnerable students in four overlapping fields, namely (1) digital well-being research; (2) digital well-being research in education; (3) digital well-being research in learning analytics; and (4) digital well-being in AI-informed educational contexts. With this as the basis, we engage with six domains from the <i>IEEE standard 7010–2020</i>—<i>IEEE Recommended Practice for Assessing the Impact of Autonomous and Intelligent Systems on Human Well-Being</i> and provide pointers for safeguarding and enhancing disadvantaged and vulnerable student digital well-being in AI-EDSS.</p> </section> <section> <div> <div> <h3>Practitioner notes</h3> <p>What is already known about this topic </p><ul> <li>Digital well-being research is a well-established focus referring to the impact of digital engagement on human well-being.</li> <li>Digital well-being is effectively inseparable from general well-being as it is increasingly difficult to disentangle our online and offline lives and, as such, inherently intersectional.</li> <li>Artificial Intelligence shows promise for enhancing human digital well-being, but there are concerns about issues such as privacy, bias, transparency, fairness and accountability.</li> <li>The notion of ‘vulnerable individuals’ includes individuals who were previously disadvantaged, and those with inherent, situational and/or pathogenic vulnerabilities.</li> <li>While current advances in AI-EDSS may support identification of digital wellness, proxies for digital wellness should be used with care.</li>
学生的物质生活和数字生活越来越紧密地联系在一起。鉴于人工智能越来越多地影响着学生的数字生活和线下生活,很难将两者分开。在教育承担着确保学生安全、适当和有效的数字学习空间的信托和道德责任的背景下,人工智能与学习分析之间的持续融合不仅为更有针对性的教学提供了许多机会,而且也引起了人们的关注,特别是对以前处于不利地位和弱势的学生而言。虽然数字福祉是一个成熟的研究重点,但人工智能驱动的教育决策支持系统(AI-EDSS)会如何影响学生固有的、情境性的和病因性的脆弱性,目前尚不清楚。在这篇概念性论文中,我们从四个相互重叠的领域,即(1) 数字福祉研究;(2) 教育中的数字福祉研究;(3) 学习分析中的数字福祉研究;(4) 人工智能教育背景下的数字福祉,来描绘以往处于不利地位和弱势的学生的数字福祉。在此基础上,我们参与了 IEEE 标准 7010-2020-IEEEE Recommended Practice for Assessing the Impact of Autonomous and Intelligent Systems on Human Well-Being 中的六个领域,并为保障和提高 AI-EDSS 中弱势和易受伤害学生的数字福祉提供了指导。人工智能在提高人类数字福祉方面大有可为,但也存在隐私、偏见、透明度、公平性和问责制等问题。"弱势个体 "的概念包括以前处于不利地位的个体,以及那些具有内在、情景和/或病因脆弱性的个体。虽然人工智能-教育与健康调查(AI-EDSS)的当前进展可能有助于识别数字福祉,但应谨慎使用数字福祉的替代指标。本研究的贡献概述了数字健康研究,特别提到了它可能对弱势学生产生的影响。说明了IEEE标准7010-2020--IEEE《评估自主和智能系统对人类健康影响的推荐实践》中五个领域的具体脆弱性,这些脆弱性因其在在线学习环境中的重要性而被选中。为设计和实施公平、道德、负责和透明的AI-EDSS提供了指导,特别提到了弱势学生。对实践和/或政策的启示人工智能教育与发展系统的公平、公正、透明和问责会影响到所有学生,但可能会对弱势学生产生更大的(积极或消极)影响。批判性地了解学生的弱势性质--无论是固有的、情境的和/或致病的,以及时间性/永久性的--是至关重要的。由于人工智能教育与发展系统可能会加剧现有的弱势,导致致病的弱势,因此在设计人工智能教育与发展系统时需要谨慎。
{"title":"Vulnerable student digital well-being in AI-powered educational decision support systems (AI-EDSS) in higher education","authors":"Paul Prinsloo,&nbsp;Mohammad Khalil,&nbsp;Sharon Slade","doi":"10.1111/bjet.13508","DOIUrl":"10.1111/bjet.13508","url":null,"abstract":"&lt;div&gt;\u0000 \u0000 &lt;section&gt;\u0000 \u0000 \u0000 &lt;p&gt;Students' physical and digital lives are increasingly entangled. It is difficult to separate students' &lt;i&gt;digital&lt;/i&gt; well-being from their offline well-being given that artificial intelligence increasingly shapes both. Within the context of education's fiduciary and moral duty to ensure safe, appropriate and effective digital learning spaces for students, the continuing merger between artificial intelligence and learning analytics not only opens up many opportunities for more responsive teaching and learning but also raises concerns, specifically for previously disadvantaged and vulnerable students. While digital well-being is a well-established research focus, it is not clear how AI-Powered Educational Decision Support Systems (AI-EDSS) might impact on the inherent, situational and pathogenic vulnerability of students. In this conceptual paper, we map the digital well-being of previously disadvantaged and vulnerable students in four overlapping fields, namely (1) digital well-being research; (2) digital well-being research in education; (3) digital well-being research in learning analytics; and (4) digital well-being in AI-informed educational contexts. With this as the basis, we engage with six domains from the &lt;i&gt;IEEE standard 7010–2020&lt;/i&gt;—&lt;i&gt;IEEE Recommended Practice for Assessing the Impact of Autonomous and Intelligent Systems on Human Well-Being&lt;/i&gt; and provide pointers for safeguarding and enhancing disadvantaged and vulnerable student digital well-being in AI-EDSS.&lt;/p&gt;\u0000 &lt;/section&gt;\u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;div&gt;\u0000 \u0000 &lt;div&gt;\u0000 \u0000 &lt;h3&gt;Practitioner notes&lt;/h3&gt;\u0000 &lt;p&gt;What is already known about this topic\u0000\u0000 &lt;/p&gt;&lt;ul&gt;\u0000 \u0000 &lt;li&gt;Digital well-being research is a well-established focus referring to the impact of digital engagement on human well-being.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;Digital well-being is effectively inseparable from general well-being as it is increasingly difficult to disentangle our online and offline lives and, as such, inherently intersectional.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;Artificial Intelligence shows promise for enhancing human digital well-being, but there are concerns about issues such as privacy, bias, transparency, fairness and accountability.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;The notion of ‘vulnerable individuals’ includes individuals who were previously disadvantaged, and those with inherent, situational and/or pathogenic vulnerabilities.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;While current advances in AI-EDSS may support identification of digital wellness, proxies for digital wellness should be used with care.&lt;/li&gt;\u0000 ","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"55 5","pages":"2075-2092"},"PeriodicalIF":6.7,"publicationDate":"2024-07-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/bjet.13508","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141640531","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Co-creating an equality diversity and inclusion learning analytics dashboard for addressing awarding gaps in higher education 共同创建平等、多样性和包容性学习分析仪表板,以解决高等教育中的奖励差距问题
IF 6.7 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-07-12 DOI: 10.1111/bjet.13509
Vaclav Bayer, Paul Mulholland, Martin Hlosta, Tracie Farrell, Christothea Herodotou, Miriam Fernandez
<div> <section> <p>Educational outcomes from traditionally underrepresented groups are generally worse than for their more advantaged peers. This problem is typically known as the awarding gap (we use the term awarding gap over ‘attainment gap’ as attainment places the responsibility on students to attain at equal levels) and continues to pose a challenge for educational systems across the world. While Learning Analytics (LA) dashboards help identify patterns contributing to the awarding gap, they often lack stakeholder involvement, offering very little support to institutional Equality, Diversity and Inclusion (EDI) leads or educators to pinpoint and address these gaps. This paper introduces an innovative EDI LA dashboard, co-created with diverse stakeholders. Rigorously evaluated, the dashboard provides fine-grained insights and course-level analysis, empowering institutions to effectively address awarding gaps and contribute to a diverse and inclusive higher education landscape.</p> </section> <section> <div> <div> <h3>Practitioners notes</h3> <p>What is already known about this topic </p><ul> <li>Traditionally underrepresented groups face educational disparities, commonly known as the awarding gap.</li> <li>Underachievement is a complex multi-dimensional problem and cannot be solely attributable to individual student deficiencies.</li> <li>LA dashboards targeting this specific problem are often not public, there is little research about them, and are frequently designed with little involvement of educational stakeholders.</li> </ul> <p>What this paper adds </p><ul> <li>Pioneers the introduction of a dashboard specifically designed to address the awarding gap problem.</li> <li>Emphasises the significant data needs of educational stakeholders in tackling awarding gaps.</li> <li>Expands the design dimensions of Learning Analytics (LA) by introducing a specific design approach rooted in established user experience (UX) design methods.</li> </ul> <p>Implications for practice and/or policy </p><ul> <li>Insights from this study will guide practitioners, designers, and developers in creating AI-based educational systems to effectively target the awarding gap problem.</li> </ul> </
传统上代表性不足的群体的教育成果通常不如条件较好的同龄人。这一问题通常被称为 "获奖差距"(我们使用 "获奖差距 "一词,而不是 "成绩差距",因为 "成绩差距 "要求学生承担达到同等水平的责任),并继续对世界各地的教育系统构成挑战。虽然学习分析(LA)仪表板有助于识别造成奖励差距的模式,但它们往往缺乏利益相关者的参与,对机构的平等、多样性和包容性(EDI)领导或教育工作者提供的支持很少,无法准确定位和解决这些差距。本文介绍了与不同利益相关者共同创建的创新性 EDI LA 仪表盘。经过严格评估,该仪表板提供了精细的洞察力和课程层面的分析,使各机构能够有效地解决奖励差距问题,为实现多元化和全纳高等教育做出贡献。成绩不佳是一个复杂的多维问题,不能完全归咎于个别学生的不足。针对这一具体问题的洛杉矶仪表板往往不公开,相关研究也很少,而且在设计时往往很少有教育利益相关者的参与。本文的新增内容 率先推出了专门用于解决奖励差距问题的仪表板。强调教育利益相关者在解决获奖差距问题时对数据的重大需求。通过引入植根于成熟的用户体验 (UX) 设计方法的特定设计方法,扩展了学习分析 (LA) 的设计维度。对实践和/或政策的启示 本研究的启示将指导实践者、设计者和开发者创建基于人工智能的教育系统,以有效解决获奖差距问题。
{"title":"Co-creating an equality diversity and inclusion learning analytics dashboard for addressing awarding gaps in higher education","authors":"Vaclav Bayer,&nbsp;Paul Mulholland,&nbsp;Martin Hlosta,&nbsp;Tracie Farrell,&nbsp;Christothea Herodotou,&nbsp;Miriam Fernandez","doi":"10.1111/bjet.13509","DOIUrl":"10.1111/bjet.13509","url":null,"abstract":"&lt;div&gt;\u0000 \u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;p&gt;Educational outcomes from traditionally underrepresented groups are generally worse than for their more advantaged peers. This problem is typically known as the awarding gap (we use the term awarding gap over ‘attainment gap’ as attainment places the responsibility on students to attain at equal levels) and continues to pose a challenge for educational systems across the world. While Learning Analytics (LA) dashboards help identify patterns contributing to the awarding gap, they often lack stakeholder involvement, offering very little support to institutional Equality, Diversity and Inclusion (EDI) leads or educators to pinpoint and address these gaps. This paper introduces an innovative EDI LA dashboard, co-created with diverse stakeholders. Rigorously evaluated, the dashboard provides fine-grained insights and course-level analysis, empowering institutions to effectively address awarding gaps and contribute to a diverse and inclusive higher education landscape.&lt;/p&gt;\u0000 &lt;/section&gt;\u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;div&gt;\u0000 \u0000 &lt;div&gt;\u0000 \u0000 &lt;h3&gt;Practitioners notes&lt;/h3&gt;\u0000 &lt;p&gt;What is already known about this topic\u0000\u0000 &lt;/p&gt;&lt;ul&gt;\u0000 \u0000 &lt;li&gt;Traditionally underrepresented groups face educational disparities, commonly known as the awarding gap.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;Underachievement is a complex multi-dimensional problem and cannot be solely attributable to individual student deficiencies.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;LA dashboards targeting this specific problem are often not public, there is little research about them, and are frequently designed with little involvement of educational stakeholders.&lt;/li&gt;\u0000 &lt;/ul&gt;\u0000 &lt;p&gt;What this paper adds\u0000\u0000 &lt;/p&gt;&lt;ul&gt;\u0000 \u0000 &lt;li&gt;Pioneers the introduction of a dashboard specifically designed to address the awarding gap problem.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;Emphasises the significant data needs of educational stakeholders in tackling awarding gaps.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;Expands the design dimensions of Learning Analytics (LA) by introducing a specific design approach rooted in established user experience (UX) design methods.&lt;/li&gt;\u0000 &lt;/ul&gt;\u0000 &lt;p&gt;Implications for practice and/or policy\u0000\u0000 &lt;/p&gt;&lt;ul&gt;\u0000 \u0000 &lt;li&gt;Insights from this study will guide practitioners, designers, and developers in creating AI-based educational systems to effectively target the awarding gap problem.&lt;/li&gt;\u0000 &lt;/ul&gt;\u0000 &lt;/","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"55 5","pages":"2058-2074"},"PeriodicalIF":6.7,"publicationDate":"2024-07-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/bjet.13509","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141614031","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The life cycle of large language models in education: A framework for understanding sources of bias 教育领域大型语言模型的生命周期:了解偏见来源的框架
IF 6.7 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-07-12 DOI: 10.1111/bjet.13505
Jinsook Lee, Yann Hicke, Renzhe Yu, Christopher Brooks, René F. Kizilcec
<div> <section> <p>Large language models (LLMs) are increasingly adopted in educational contexts to provide personalized support to students and teachers. The unprecedented capacity of LLM-based applications to understand and generate natural language can potentially improve instructional effectiveness and learning outcomes, but the integration of LLMs in education technology has renewed concerns over algorithmic bias, which may exacerbate educational inequalities. Building on prior work that mapped the traditional machine learning life cycle, we provide a framework of the LLM life cycle from the initial development of LLMs to customizing pre-trained models for various applications in educational settings. We explain each step in the LLM life cycle and identify potential sources of bias that may arise in the context of education. We discuss why current measures of bias from traditional machine learning fail to transfer to LLM-generated text (eg, tutoring conversations) because text encodings are high-dimensional, there can be multiple correct responses, and tailoring responses may be pedagogically desirable rather than unfair. The proposed framework clarifies the complex nature of bias in LLM applications and provides practical guidance for their evaluation to promote educational equity.</p> </section> <section> <div> <div> <h3>Practitioner notes</h3> <p>What is already known about this topic </p><ul> <li>The life cycle of traditional machine learning (ML) applications which focus on predicting labels is well understood.</li> <li>Biases are known to enter in traditional ML applications at various points in the life cycle, and methods to measure and mitigate these biases have been developed and tested.</li> <li>Large language models (LLMs) and other forms of generative artificial intelligence (GenAI) are increasingly adopted in education technologies (EdTech), but current evaluation approaches are not specific to the domain of education.</li> </ul> <p>What this paper adds </p><ul> <li>A holistic perspective of the LLM life cycle with domain-specific examples in education to highlight opportunities and challenges for incorporating natural language understanding (NLU) and natural language generation (NLG) into EdTech.</li> <li>Potential sources of bias are identified in each step of the LLM life cycle and discussed in the context of education.</li> <li>A framework for understanding where to expect potential harms of LLMs for
大语言模型(LLM)越来越多地被应用于教育领域,为学生和教师提供个性化支持。基于 LLM 的应用程序具有前所未有的理解和生成自然语言的能力,有可能提高教学效果和学习成果,但将 LLM 整合到教育技术中再次引发了对算法偏见的担忧,因为这可能会加剧教育不平等。在之前绘制传统机器学习生命周期图的工作基础上,我们提供了一个 LLM 生命周期框架,从 LLM 的初始开发到为教育环境中的各种应用定制预训练模型。我们解释了 LLM 生命周期中的每个步骤,并确定了教育背景下可能出现的潜在偏差来源。我们讨论了为什么目前传统机器学习的偏差测量方法无法应用于 LLM 生成的文本(如辅导对话),因为文本编码是高维的,可能存在多个正确的回答,而且定制回答可能在教学上是可取的,而不是不公平的。所提出的框架澄清了 LLM 应用程序中偏见的复杂性质,并为其评估提供了实用指导,以促进教育公平。众所周知,传统的机器学习应用在生命周期的不同阶段会出现偏差,而测量和减轻这些偏差的方法已经开发出来并经过了测试。大型语言模型(LLM)和其他形式的生成式人工智能(GenAI)越来越多地被教育技术(EdTech)所采用,但目前的评估方法并不是专门针对教育领域的。本文的补充内容 从整体上透视 LLM 的生命周期,并结合教育领域的具体实例,强调将自然语言理解(NLU)和自然语言生成(NLG)纳入教育技术的机遇和挑战。在 LLM 生命周期的每个步骤中确定潜在的偏差来源,并结合教育进行讨论。了解 LLM 对学生、教师和 GenAI 技术在教育领域的其他用户的潜在危害的框架,该框架可指导偏差测量和缓解方法。对实践和/或政策的启示 教育从业者和政策制定者应该意识到,偏差可能源于LLM生命周期中的多个步骤,而生命周期视角为他们提供了一种启发式方法,可以要求技术开发者解释每个步骤,以评估偏差风险。与传统的 ML 相比,测量教育领域中使用 LLM 的系统的偏差更为复杂,这在很大程度上是因为对自然语言生成的评估高度依赖于上下文(例如,什么算作作业的良好反馈各不相同)。教育技术开发人员可以在收集和整理数据集方面发挥重要作用,以便对 LLM 应用程序进行评估和基准测试。
{"title":"The life cycle of large language models in education: A framework for understanding sources of bias","authors":"Jinsook Lee,&nbsp;Yann Hicke,&nbsp;Renzhe Yu,&nbsp;Christopher Brooks,&nbsp;René F. Kizilcec","doi":"10.1111/bjet.13505","DOIUrl":"10.1111/bjet.13505","url":null,"abstract":"&lt;div&gt;\u0000 \u0000 &lt;section&gt;\u0000 \u0000 \u0000 &lt;p&gt;Large language models (LLMs) are increasingly adopted in educational contexts to provide personalized support to students and teachers. The unprecedented capacity of LLM-based applications to understand and generate natural language can potentially improve instructional effectiveness and learning outcomes, but the integration of LLMs in education technology has renewed concerns over algorithmic bias, which may exacerbate educational inequalities. Building on prior work that mapped the traditional machine learning life cycle, we provide a framework of the LLM life cycle from the initial development of LLMs to customizing pre-trained models for various applications in educational settings. We explain each step in the LLM life cycle and identify potential sources of bias that may arise in the context of education. We discuss why current measures of bias from traditional machine learning fail to transfer to LLM-generated text (eg, tutoring conversations) because text encodings are high-dimensional, there can be multiple correct responses, and tailoring responses may be pedagogically desirable rather than unfair. The proposed framework clarifies the complex nature of bias in LLM applications and provides practical guidance for their evaluation to promote educational equity.&lt;/p&gt;\u0000 &lt;/section&gt;\u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;div&gt;\u0000 \u0000 &lt;div&gt;\u0000 \u0000 &lt;h3&gt;Practitioner notes&lt;/h3&gt;\u0000 &lt;p&gt;What is already known about this topic\u0000\u0000 &lt;/p&gt;&lt;ul&gt;\u0000 \u0000 &lt;li&gt;The life cycle of traditional machine learning (ML) applications which focus on predicting labels is well understood.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;Biases are known to enter in traditional ML applications at various points in the life cycle, and methods to measure and mitigate these biases have been developed and tested.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;Large language models (LLMs) and other forms of generative artificial intelligence (GenAI) are increasingly adopted in education technologies (EdTech), but current evaluation approaches are not specific to the domain of education.&lt;/li&gt;\u0000 &lt;/ul&gt;\u0000 &lt;p&gt;What this paper adds\u0000\u0000 &lt;/p&gt;&lt;ul&gt;\u0000 \u0000 &lt;li&gt;A holistic perspective of the LLM life cycle with domain-specific examples in education to highlight opportunities and challenges for incorporating natural language understanding (NLU) and natural language generation (NLG) into EdTech.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;Potential sources of bias are identified in each step of the LLM life cycle and discussed in the context of education.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;A framework for understanding where to expect potential harms of LLMs for ","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"55 5","pages":"1982-2002"},"PeriodicalIF":6.7,"publicationDate":"2024-07-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141614158","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Advancing equity and inclusion in educational practices with AI-powered educational decision support systems (AI-EDSS) 利用人工智能驱动的教育决策支持系统(AI-EDSS)促进教育实践中的公平与全纳
IF 6.7 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-07-10 DOI: 10.1111/bjet.13507
Olga Viberg, René F. Kizilcec, Alyssa Friend Wise, Ioana Jivet, Nia Nixon

A key goal of educational institutions around the world is to provide inclusive, equitable quality education and lifelong learning opportunities for all learners. Achieving this requires contextualized approaches to accommodate diverse global values and promote learning opportunities that best meet the needs and goals of all learners as individuals and members of different communities. Advances in learning analytics (LA), natural language processes (NLP), and artificial intelligence (AI), especially generative AI technologies, offer potential to aid educational decision making by supporting analytic insights and personalized recommendations. However, these technologies also raise serious risks for reinforcing or exacerbating existing inequalities; these dangers arise from multiple factors including biases represented in training datasets, the technologies' abilities to take autonomous decisions, and processes for tool development that do not centre the needs and concerns of historically marginalized groups. To ensure that Educational Decision Support Systems (EDSS), particularly AI-powered ones, are equipped to promote equity, they must be created and evaluated holistically, considering their potential for both targeted and systemic impacts on all learners, especially members of historically marginalized groups. Adopting a socio-technical and cultural perspective is crucial for designing, deploying, and evaluating AI-EDSS that truly advance educational equity and inclusion. This editorial introduces the contributions of five papers for the special section on advancing equity and inclusion in educational practices with AI-EDSS. These papers focus on (i) a review of biases in large language models (LLMs) applications offers practical guidelines for their evaluation to promote educational equity, (ii) techniques to mitigate disparities across countries and languages in LLMs representation of educationally relevant knowledge, (iii) implementing equitable and intersectionality-aware machine learning applications in education, (iv) introducing a LA dashboard that aims to promote institutional equality, diversity, and inclusion, and (v) vulnerable student digital well-being in AI-EDSS. Together, these contributions underscore the importance of an interdisciplinary approach in developing and utilizing AI-EDSS to not only foster a more inclusive and equitable educational landscape worldwide but also reveal a critical need for a broader contextualization of equity that incorporates the socio-technical questions of what kinds of decisions AI is being used to support, for what purposes, and whose goals are prioritized in this process.

世界各地教育机构的一个主要目标是为所有学习者提供全纳、公平的优质教育和终身学习机会。要实现这一目标,就必须采取因地制宜的方法,以适应全球不同的价值观,并提供最能满足所有学习者作为个人和不同社区成员的需求和目标的学习机会。学习分析(LA)、自然语言处理(NLP)和人工智能(AI),特别是生成式人工智能技术的进步,通过支持分析洞察力和个性化建议,为辅助教育决策提供了潜力。然而,这些技术也带来了强化或加剧现有不平等现象的严重风险;这些危险来自多个因素,包括训练数据集中的偏见、技术自主决策的能力,以及工具开发过程没有将历史上被边缘化群体的需求和关切作为中心。为了确保教育决策支持系统(EDSS),特别是人工智能驱动的系统,能够促进公平,必须全面地创建和评估这些系统,考虑其对所有学习者,特别是历史上被边缘化的群体成员产生针对性和系统性影响的潜力。采用社会技术和文化视角对于设计、部署和评估真正促进教育公平和全纳的人工智能教育与发展系统至关重要。这篇社论介绍了五篇论文为 "在教育实践中利用人工智能教育与数据采集系统促进公平与全纳 "专题部分所做的贡献。这些论文的重点是:(i) 评述大型语言模型(LLMs)应用中的偏差,为其评估提供实用指南,以促进教育公平;(ii) 在 LLMs 代表教育相关知识时,减少不同国家和语言之间差异的技术;(iii) 在教育中实施公平和具有交叉意识的机器学习应用;(iv) 引入旨在促进机构平等、多样性和包容性的洛杉矶仪表板;(v) AI-EDSS 中脆弱的学生数字福祉。这些贡献共同强调了跨学科方法在开发和利用 AI-EDSS 方面的重要性,这不仅能在全球范围内促进更具包容性和公平性的教育景观,而且还揭示了对更广泛的公平背景的迫切需要,这种公平背景包括以下社会技术问题:AI 被用于支持何种决策、出于何种目的,以及在此过程中谁的目标被优先考虑。
{"title":"Advancing equity and inclusion in educational practices with AI-powered educational decision support systems (AI-EDSS)","authors":"Olga Viberg,&nbsp;René F. Kizilcec,&nbsp;Alyssa Friend Wise,&nbsp;Ioana Jivet,&nbsp;Nia Nixon","doi":"10.1111/bjet.13507","DOIUrl":"10.1111/bjet.13507","url":null,"abstract":"<p>A key goal of educational institutions around the world is to provide inclusive, equitable quality education and lifelong learning opportunities for all learners. Achieving this requires contextualized approaches to accommodate diverse global values and promote learning opportunities that best meet the needs and goals of all learners as individuals and members of different communities. Advances in learning analytics (LA), natural language processes (NLP), and artificial intelligence (AI), especially generative AI technologies, offer potential to aid educational decision making by supporting analytic insights and personalized recommendations. However, these technologies also raise serious risks for reinforcing or exacerbating existing inequalities; these dangers arise from multiple factors including biases represented in training datasets, the technologies' abilities to take autonomous decisions, and processes for tool development that do not centre the needs and concerns of historically marginalized groups. To ensure that Educational Decision Support Systems (EDSS), particularly AI-powered ones, are equipped to promote equity, they must be created and evaluated holistically, considering their potential for both targeted and systemic impacts on all learners, especially members of historically marginalized groups. Adopting a socio-technical and cultural perspective is crucial for designing, deploying, and evaluating AI-EDSS that truly advance educational equity and inclusion. This editorial introduces the contributions of five papers for the special section on advancing equity and inclusion in educational practices with AI-EDSS. These papers focus on (i) a review of biases in large language models (LLMs) applications offers practical guidelines for their evaluation to promote educational equity, (ii) techniques to mitigate disparities across countries and languages in LLMs representation of educationally relevant knowledge, (iii) implementing equitable and intersectionality-aware machine learning applications in education, (iv) introducing a LA dashboard that aims to promote institutional equality, diversity, and inclusion, and (v) vulnerable student digital well-being in AI-EDSS. Together, these contributions underscore the importance of an interdisciplinary approach in developing and utilizing AI-EDSS to not only foster a more inclusive and equitable educational landscape worldwide but also reveal a critical need for a broader contextualization of equity that incorporates the socio-technical questions of what kinds of decisions AI is being used to support, for what purposes, and whose goals are prioritized in this process.</p>","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"55 5","pages":"1974-1981"},"PeriodicalIF":6.7,"publicationDate":"2024-07-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/bjet.13507","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141614159","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evidence-based learning analytics: Reusing and reapplying successful methods and techniques in real learning settings 循证学习分析:在实际学习环境中重复使用和重新应用成功的方法和技术
IF 6.7 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-07-10 DOI: 10.1111/bjet.13506
Cristian Cechinel, Jorge Maldonado-Mahauad, Roberto Munoz, Xavier Ochoa
{"title":"Evidence-based learning analytics: Reusing and reapplying successful methods and techniques in real learning settings","authors":"Cristian Cechinel,&nbsp;Jorge Maldonado-Mahauad,&nbsp;Roberto Munoz,&nbsp;Xavier Ochoa","doi":"10.1111/bjet.13506","DOIUrl":"10.1111/bjet.13506","url":null,"abstract":"","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"55 5","pages":"1837-1840"},"PeriodicalIF":6.7,"publicationDate":"2024-07-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/bjet.13506","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141614029","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Investigating teacher orchestration load in scripted CSCL: A multimodal data analysis perspective 调查脚本化 CSCL 中的教师协调负荷:多模态数据分析视角
IF 6.7 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-06-26 DOI: 10.1111/bjet.13500
Lubna Hakami, Davinia Hernández-Leo, Ishari Amarasinghe, Batuhan Sayis

Despite the growing interest in using multimodal data to analyse students' actions in Computers-Supported Collaborative Learning (CSCL) settings, studying teacher's orchestration load in such settings remains overlooked. The notion of classroom orchestration, and orchestration load, offer a lens to study the implications of increasingly complex technology-supported learning environments on teacher performance. A combination of multimodal data may aid in understanding teachers' orchestration actions and, as a result, gain insights regarding the orchestration load teachers perceive in scripted CSCL situations. Studying teacher orchestration load in CSCL helps understand the workload teachers experience while facilitating student collaboration and assists in informing design decisions for teacher supporting tools. In this paper, we collect and analyse data from different modalities (i.e. electrodermal activity, observation notes, log data, dashboard screen recordings and responses to self-reported questionnaires) to study teachers' orchestration load in scripted CSCL. A tool called PyramidApp was used to deploy CSCL activities and a teacher-facing dashboard was used to facilitate teachers in managing collaboration in real time. The findings of the study show the potential of multimodal data analysis in investigating and estimating the orchestration load experienced by teachers in scripted CSCL activities. Study findings further demonstrate factors emerging from multimodal data such as task type, activity duration, and number of students influenced teachers' orchestration load.

尽管人们对使用多模态数据分析学生在计算机支持的协作学习(CSCL)环境中的行为越来越感兴趣,但对教师在这种环境中的协调负荷的研究仍然被忽视。课堂协调和协调负荷的概念为研究日益复杂的技术支持学习环境对教师绩效的影响提供了一个视角。多模态数据的结合可能有助于理解教师的协调行为,从而深入了解教师在脚本化 CSCL 情境中感知到的协调负荷。研究教师在 CSCL 中的协调负荷有助于了解教师在促进学生合作时的工作量,并有助于为教师辅助工具的设计决策提供信息。在本文中,我们收集并分析了来自不同模式的数据(即电皮活动、观察记录、日志数据、仪表盘屏幕记录和对自我报告问卷的答复),以研究教师在脚本化 CSCL 中的协调负荷。一个名为 X 的工具被用来部署 CSCL 活动,一个面向教师的仪表板被用来帮助教师实时管理协作。研究结果表明,多模态数据分析在调查和估计教师在脚本化 CSCL 活动中的协调负荷方面具有潜力。研究结果进一步表明,任务类型、活动持续时间和学生人数等多模态数据中出现的因素影响了教师的协调负荷。
{"title":"Investigating teacher orchestration load in scripted CSCL: A multimodal data analysis perspective","authors":"Lubna Hakami,&nbsp;Davinia Hernández-Leo,&nbsp;Ishari Amarasinghe,&nbsp;Batuhan Sayis","doi":"10.1111/bjet.13500","DOIUrl":"10.1111/bjet.13500","url":null,"abstract":"<p>Despite the growing interest in using multimodal data to analyse students' actions in Computers-Supported Collaborative Learning (CSCL) settings, studying teacher's orchestration load in such settings remains overlooked. The notion of classroom orchestration, and orchestration load, offer a lens to study the implications of increasingly complex technology-supported learning environments on teacher performance. A combination of multimodal data may aid in understanding teachers' orchestration actions and, as a result, gain insights regarding the orchestration load teachers perceive in scripted CSCL situations. Studying teacher orchestration load in CSCL helps understand the workload teachers experience while facilitating student collaboration and assists in informing design decisions for teacher supporting tools. In this paper, we collect and analyse data from different modalities (i.e. electrodermal activity, observation notes, log data, dashboard screen recordings and responses to self-reported questionnaires) to study teachers' orchestration load in scripted CSCL. A tool called PyramidApp was used to deploy CSCL activities and a teacher-facing dashboard was used to facilitate teachers in managing collaboration in real time. The findings of the study show the potential of multimodal data analysis in investigating and estimating the orchestration load experienced by teachers in scripted CSCL activities. Study findings further demonstrate factors emerging from multimodal data such as task type, activity duration, and number of students influenced teachers' orchestration load.</p>","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"55 5","pages":"1926-1949"},"PeriodicalIF":6.7,"publicationDate":"2024-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/bjet.13500","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141528964","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evidence-based multimodal learning analytics for feedback and reflection in collaborative learning 以证据为基础的多模态学习分析,用于协作学习中的反馈和反思
IF 6.7 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-06-22 DOI: 10.1111/bjet.13498
Lixiang Yan, Vanessa Echeverria, Yueqiao Jin, Gloria Fernandez-Nieto, Linxuan Zhao, Xinyu Li, Riordan Alfredo, Zachari Swiecki, Dragan Gašević, Roberto Martinez-Maldonado
<div> <section> <p>Multimodal learning analytics (MMLA) offers the potential to provide evidence-based insights into complex learning phenomena such as collaborative learning. Yet, few MMLA applications have closed the learning analytics loop by being evaluated in real-world educational settings. This study evaluates the effectiveness of an MMLA solution in enhancing feedback and reflection within a complex and highly dynamic collaborative learning environment. A two-year longitudinal study was conducted with 399 students and 17 teachers, utilising an MMLA system in reflective debriefings in the context of healthcare education. We analysed the survey data of 74 students and 11 teachers regarding their perceptions of the MMLA system. We applied the Evaluation Framework for Learning Analytics, augmented by complexity, accuracy and trust measures, to assess both teachers' and students' perspectives. The findings illustrated that teachers and students both had generally positive perceptions of the MMLA solution. Teachers found the MMLA solution helpful in facilitating feedback provision and reflection during debriefing sessions. Similarly, students found the MMLA solution effective in providing clarity on the data collected, stimulating reflection on their learning behaviours, and prompting considerations for adaptation in their learning behaviours. However, the complexity of the MMLA solution and the need for qualitative measures of communication emerged as areas for improvement. Additionally, the study highlighted the importance of data accuracy, transparency, and privacy protection to maintain user trust. The findings provide valuable contributions to advancing our understanding of the use of MMLA in supporting feedback and reflection practices in intricate collaborative learning while identifying avenues for further research and improvement. We also provided several insights and practical recommendations for successful MMLA implementation in authentic learning contexts.</p> </section> <section> <div> <div> <h3>Practitioner notes</h3> <p>What is currently known about this topic </p><ul> <li>Multimodal learning analytics (MMLA) seeks to generate data-informed insights about learners' metacognitive and emotional states as well as their learning behaviours, by utilising intricate physical and physiological signals.</li> <li>MMLA has not only pioneered novel data analytic methods but also aspired to complete the learning analytics loop by crafting innovative, tangible solutions that relay these insights to the concerned stakeholders.</li> <li>A prominent directi
多模态学习分析(MMLA)可以为协作学习等复杂的学习现象提供基于证据的见解。然而,很少有 MMLA 应用程序通过在真实的教育环境中进行评估来实现学习分析的闭环。本研究评估了 MMLA 解决方案在复杂和高度动态的协作学习环境中加强反馈和反思的有效性。我们对 399 名学生和 17 名教师进行了为期两年的纵向研究,在医疗保健教育背景下的反思性汇报中使用了 MMLA 系统。我们分析了 74 名学生和 11 名教师对 MMLA 系统看法的调查数据。我们采用了学习分析评估框架,并辅以复杂性、准确性和信任度测量方法,对教师和学生的观点进行了评估。研究结果表明,教师和学生对 MMLA 解决方案的看法总体上都是积极的。教师认为 MMLA 解决方案有助于在汇报课上提供反馈和进行反思。同样,学生们也认为 MMLA 解决方案能有效地澄清所收集的数据,激发他们对自己学习行为的反思,并促使他们考虑调整自己的学习行为。然而,MMLA 解决方案的复杂性和对交流的定性测量的需求成为需要改进的方面。此外,研究还强调了数据准确性、透明度和隐私保护对于维护用户信任的重要性。研究结果为加深我们对使用 MMLA 支持错综复杂的协作学习中的反馈和反思实践的理解做出了宝贵贡献,同时也确定了进一步研究和改进的途径。我们还为在真实学习环境中成功实施 MMLA 提供了一些见解和实用建议。 多模态学习分析(MMLA)旨在通过利用复杂的物理和生理信号,对学习者的元认知和情感状态以及学习行为进行数据化分析。MMLA 不仅开创了新颖的数据分析方法,而且还希望通过制定创新的、有形的解决方案,将这些见解传递给相关利益方,从而完成学习分析循环。鉴于 MMLA 能够辨别错综复杂的动态学习行为,MMLA 研究的一个突出方向是开发工具,以支持协作学习场景中的反馈和反思。本文的补充 教师和学生对实施 MMLA 的积极看法分别激发了他们对教学实践和学习行为调整的考虑。经验证据证明,在错综复杂的协作学习情景中,多媒体课件可以帮助教师促进学生的反思实践。解决与设计复杂性、残疾用户的可解释性、汇总数据表示以及与信任有关的问题对于在实际学习环境中建立实用的 MMLA 解决方案的重要性。对实践和/或政策的影响 MMLA 解决方案可让教师全面了解学生的表现,指出需要改进的地方,并确认学习情景的结果。MMLA 解决方案可激发学生对其学习行为的反思,并促进学生考虑调整其学习行为。就如何解释分析结果提供清晰的解释和指导,以及解决与数据完整性和代表性有关的问题,对于最大限度地发挥效用至关重要。
{"title":"Evidence-based multimodal learning analytics for feedback and reflection in collaborative learning","authors":"Lixiang Yan,&nbsp;Vanessa Echeverria,&nbsp;Yueqiao Jin,&nbsp;Gloria Fernandez-Nieto,&nbsp;Linxuan Zhao,&nbsp;Xinyu Li,&nbsp;Riordan Alfredo,&nbsp;Zachari Swiecki,&nbsp;Dragan Gašević,&nbsp;Roberto Martinez-Maldonado","doi":"10.1111/bjet.13498","DOIUrl":"10.1111/bjet.13498","url":null,"abstract":"&lt;div&gt;\u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;p&gt;Multimodal learning analytics (MMLA) offers the potential to provide evidence-based insights into complex learning phenomena such as collaborative learning. Yet, few MMLA applications have closed the learning analytics loop by being evaluated in real-world educational settings. This study evaluates the effectiveness of an MMLA solution in enhancing feedback and reflection within a complex and highly dynamic collaborative learning environment. A two-year longitudinal study was conducted with 399 students and 17 teachers, utilising an MMLA system in reflective debriefings in the context of healthcare education. We analysed the survey data of 74 students and 11 teachers regarding their perceptions of the MMLA system. We applied the Evaluation Framework for Learning Analytics, augmented by complexity, accuracy and trust measures, to assess both teachers' and students' perspectives. The findings illustrated that teachers and students both had generally positive perceptions of the MMLA solution. Teachers found the MMLA solution helpful in facilitating feedback provision and reflection during debriefing sessions. Similarly, students found the MMLA solution effective in providing clarity on the data collected, stimulating reflection on their learning behaviours, and prompting considerations for adaptation in their learning behaviours. However, the complexity of the MMLA solution and the need for qualitative measures of communication emerged as areas for improvement. Additionally, the study highlighted the importance of data accuracy, transparency, and privacy protection to maintain user trust. The findings provide valuable contributions to advancing our understanding of the use of MMLA in supporting feedback and reflection practices in intricate collaborative learning while identifying avenues for further research and improvement. We also provided several insights and practical recommendations for successful MMLA implementation in authentic learning contexts.&lt;/p&gt;\u0000 &lt;/section&gt;\u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;div&gt;\u0000 \u0000 &lt;div&gt;\u0000 \u0000 &lt;h3&gt;Practitioner notes&lt;/h3&gt;\u0000 &lt;p&gt;What is currently known about this topic\u0000\u0000 &lt;/p&gt;&lt;ul&gt;\u0000 \u0000 &lt;li&gt;Multimodal learning analytics (MMLA) seeks to generate data-informed insights about learners' metacognitive and emotional states as well as their learning behaviours, by utilising intricate physical and physiological signals.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;MMLA has not only pioneered novel data analytic methods but also aspired to complete the learning analytics loop by crafting innovative, tangible solutions that relay these insights to the concerned stakeholders.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;A prominent directi","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"55 5","pages":"1900-1925"},"PeriodicalIF":6.7,"publicationDate":"2024-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/bjet.13498","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141504759","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Towards automated transcribing and coding of embodied teamwork communication through multimodal learning analytics 通过多模态学习分析实现体现式团队合作交流的自动转录和编码
IF 6.6 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-05-30 DOI: 10.1111/bjet.13476
Linxuan Zhao, Dragan Gašević, Zachari Swiecki, Yuheng Li, Jionghao Lin, Lele Sha, Lixiang Yan, Riordan Alfredo, Xinyu Li, Roberto Martinez-Maldonado

Effective collaboration and teamwork skills are critical in high-risk sectors, as deficiencies in these areas can result in injuries and risk of death. To foster the growth of these vital skills, immersive learning spaces have been created to simulate real-world scenarios, enabling students to safely improve their teamwork abilities. In such learning environments, multiple dialogue segments can occur concurrently as students independently organise themselves to tackle tasks in parallel across diverse spatial locations. This complex situation creates challenges for educators in assessing teamwork and for students in reflecting on their performance, especially considering the importance of effective communication in embodied teamwork. To address this, we propose an automated approach for generating teamwork analytics based on spatial and speech data. We illustrate this approach within a dynamic, immersive healthcare learning environment centred on embodied teamwork. Moreover, we evaluated whether the automated approach can produce transcriptions and epistemic networks of spatially distributed dialogue segments with a quality comparable to those generated manually for research objectives. This paper makes two key contributions: (1) it proposes an approach that integrates automated speech recognition and natural language processing techniques to automate the transcription and coding of team communication and generate analytics; and (2) it provides analyses of the errors in outputs generated by those techniques, offering insights for researchers and practitioners involved in the design of similar systems.

在高风险行业,有效的协作和团队合作技能至关重要,因为这些方面的缺陷可能导致伤害和死亡风险。为了促进这些重要技能的发展,人们创建了沉浸式学习空间来模拟真实世界的场景,使学生能够安全地提高团队协作能力。在这样的学习环境中,学生们可以同时进行多个对话环节,在不同的空间位置独立组织起来并行处理任务。这种复杂的情况给教育者评估团队合作和学生反思自己的表现带来了挑战,特别是考虑到有效沟通在体现团队合作中的重要性。为此,我们提出了一种基于空间和语音数据生成团队合作分析的自动化方法。我们在以体现式团队合作为中心的动态、沉浸式医疗保健学习环境中演示了这种方法。此外,我们还评估了该自动方法能否生成空间分布对话片段的转录和认识论网络,其质量是否可与人工生成的质量相媲美,以实现研究目标。本文有两大贡献:(1) 本文提出了一种方法,该方法整合了自动语音识别和自然语言处理技术,可自动转录和编码团队交流并生成分析结果;(2) 本文对这些技术生成的输出结果中的错误进行了分析,为参与类似系统设计的研究人员和从业人员提供了启示。在这些环境中,学生可以同时进行多个对话,同时在不同的物理位置共同完成任务。这些互动的动态性质使得教师很难评估团队合作和交流,学生也很难反思自己的表现。本文的贡献 我们提出了一种采用多模态学习分析的方法,用于自动生成对学生对话内容的团队合作相关见解。这种数据处理方法可以自动转录和编码在沉浸式学习环境中团队合作的学生所产生的空间分布对话片段,并进行下游分析。这种方法使用了空间分析、自然语言处理和自动语音识别技术。对从业人员的启示 对团队成员之间的对话片段进行自动编码,有助于创建分析工具,协助评估和反思团队工作。通过分析空间和语音数据,可以应用先进的学习分析技术,为快节奏的物理学习空间中的教学提供支持,让学生可以自由地相互交流。
{"title":"Towards automated transcribing and coding of embodied teamwork communication through multimodal learning analytics","authors":"Linxuan Zhao,&nbsp;Dragan Gašević,&nbsp;Zachari Swiecki,&nbsp;Yuheng Li,&nbsp;Jionghao Lin,&nbsp;Lele Sha,&nbsp;Lixiang Yan,&nbsp;Riordan Alfredo,&nbsp;Xinyu Li,&nbsp;Roberto Martinez-Maldonado","doi":"10.1111/bjet.13476","DOIUrl":"10.1111/bjet.13476","url":null,"abstract":"<p>Effective collaboration and teamwork skills are critical in high-risk sectors, as deficiencies in these areas can result in injuries and risk of death. To foster the growth of these vital skills, immersive learning spaces have been created to simulate real-world scenarios, enabling students to safely improve their teamwork abilities. In such learning environments, multiple dialogue segments can occur concurrently as students independently organise themselves to tackle tasks in parallel across diverse spatial locations. This complex situation creates challenges for educators in assessing teamwork and for students in reflecting on their performance, especially considering the importance of effective communication in embodied teamwork. To address this, we propose an automated approach for generating teamwork analytics based on spatial and speech data. We illustrate this approach within a dynamic, immersive healthcare learning environment centred on embodied teamwork. Moreover, we evaluated whether the automated approach can produce transcriptions and epistemic networks of spatially distributed dialogue segments with a quality comparable to those generated manually for research objectives. This paper makes two key contributions: (1) it proposes an approach that integrates automated speech recognition and natural language processing techniques to automate the transcription and coding of team communication and generate analytics; and (2) it provides analyses of the errors in outputs generated by those techniques, offering insights for researchers and practitioners involved in the design of similar systems.\u0000 </p>","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"55 4","pages":"1673-1702"},"PeriodicalIF":6.6,"publicationDate":"2024-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/bjet.13476","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141197445","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Implementing equitable and intersectionality-aware ML in education: A practical guide 在教育中实施公平和具有跨学科意识的多语言教学:实用指南
IF 6.7 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-05-23 DOI: 10.1111/bjet.13484
Mudit Mangal, Zachary A. Pardos
<div> <section> <p>The greater the proliferation of AI in educational contexts, the more important it becomes to ensure that AI adheres to the equity and inclusion values of an educational system or institution. Given that modern AI is based on historic datasets, mitigating historic biases with respect to protected classes (ie, fairness) is an important component of this value alignment. Although extensive research has been done on AI fairness in education, there has been a lack of guidance for practitioners, which could enhance the practical uptake of these methods. In this work, we present a practitioner-oriented, step-by-step framework, based on findings from the field, to implement AI fairness techniques. We also present an empirical case study that applies this framework in the context of a grade prediction task using data from a large public university. Our novel findings from the case study and extended analyses underscore the importance of incorporating intersectionality (such as race and gender) as central equity and inclusion institution values. Moreover, our research demonstrates the effectiveness of bias mitigation techniques, like adversarial learning, in enhancing fairness, particularly for intersectional categories like race–gender and race–income.</p> </section> <section> <div> <div> <h3>Practitioner notes</h3> <p>What is already known about this topic </p><ul> <li>AI-powered Educational Decision Support Systems (EDSS) are increasingly used in various educational contexts, such as course selection, admissions, scholarship allocation and identifying at-risk students.</li> <li>There are known challenges with AI in education, particularly around the reinforcement of existing biases, leading to unfair outcomes.</li> <li>The machine learning community has developed metrics and methods to measure and mitigate biases, which have been effectively applied to education as seen in the AI in education literature.</li> </ul> <p>What this paper adds </p><ul> <li>Introduces a comprehensive technical framework for equity and inclusion, specifically for machine learning practitioners in AI education systems.</li> <li>Presents a novel modification to the ABROCA fairness metric to better represent disparities among multiple subgroups within a protected class.</li> <li>Empirical analysis of the effectiveness of bias-mitigating techniqu
人工智能在教育领域的普及程度越高,确保人工智能符合教育系统或机构的公平和包容价值观就越重要。鉴于现代人工智能是以历史数据集为基础的,减少受保护群体的历史偏见(即公平性)是这种价值一致性的重要组成部分。虽然对人工智能在教育领域的公平性进行了广泛研究,但一直缺乏对从业人员的指导,而这种指导可以加强这些方法的实际应用。在这项工作中,我们基于实地研究成果,提出了一个以实践者为导向、循序渐进的框架,以实施人工智能公平技术。我们还介绍了一个实证案例研究,在使用一所大型公立大学数据的成绩预测任务中应用了这一框架。我们从案例研究和扩展分析中得出的新发现强调了将交叉性(如种族和性别)作为公平和包容机构的核心价值的重要性。此外,我们的研究还证明了减轻偏见技术(如对抗性学习)在提高公平性方面的有效性,特别是在种族-性别和种族-收入等交叉类别方面。关于本主题的已知信息 人工智能驱动的教育决策支持系统(EDSS)越来越多地应用于各种教育环境,如选课、招生、奖学金分配和识别问题学生。众所周知,人工智能在教育领域存在一些挑战,特别是在强化现有偏见方面,从而导致不公平的结果。机器学习界已经开发出衡量和减轻偏见的指标和方法,这些指标和方法已有效地应用于教育领域,正如人工智能在教育领域的文献所显示的那样。本文的补充内容专门为人工智能教育系统中的机器学习从业人员介绍了一个全面的公平性和包容性技术框架。对 ABROCA 公平性指标进行了新颖的修改,以更好地体现受保护类别中多个子群体之间的差异。对减轻偏见技术(如对抗学习)在减少交叉类别(如种族-性别、种族-收入)偏见方面的有效性进行了实证分析。以模型卡的形式进行模型报告,可促进开发人员、用户和利益相关者之间的透明交流。对实践和/或政策的影响公平性框架可作为从业人员的系统指南,帮助他们设计公平、包容的人工智能电子数据系统。公平性框架可作为从业人员的系统指南,帮助他们更容易地遵守新兴的人工智能法规。利益相关者可更多地参与调整公平性和公正性模型的过程,使之符合他们的价值观。
{"title":"Implementing equitable and intersectionality-aware ML in education: A practical guide","authors":"Mudit Mangal,&nbsp;Zachary A. Pardos","doi":"10.1111/bjet.13484","DOIUrl":"10.1111/bjet.13484","url":null,"abstract":"&lt;div&gt;\u0000 \u0000 &lt;section&gt;\u0000 \u0000 \u0000 &lt;p&gt;The greater the proliferation of AI in educational contexts, the more important it becomes to ensure that AI adheres to the equity and inclusion values of an educational system or institution. Given that modern AI is based on historic datasets, mitigating historic biases with respect to protected classes (ie, fairness) is an important component of this value alignment. Although extensive research has been done on AI fairness in education, there has been a lack of guidance for practitioners, which could enhance the practical uptake of these methods. In this work, we present a practitioner-oriented, step-by-step framework, based on findings from the field, to implement AI fairness techniques. We also present an empirical case study that applies this framework in the context of a grade prediction task using data from a large public university. Our novel findings from the case study and extended analyses underscore the importance of incorporating intersectionality (such as race and gender) as central equity and inclusion institution values. Moreover, our research demonstrates the effectiveness of bias mitigation techniques, like adversarial learning, in enhancing fairness, particularly for intersectional categories like race–gender and race–income.&lt;/p&gt;\u0000 &lt;/section&gt;\u0000 \u0000 &lt;section&gt;\u0000 \u0000 &lt;div&gt;\u0000 \u0000 &lt;div&gt;\u0000 \u0000 &lt;h3&gt;Practitioner notes&lt;/h3&gt;\u0000 &lt;p&gt;What is already known about this topic\u0000\u0000 &lt;/p&gt;&lt;ul&gt;\u0000 \u0000 &lt;li&gt;AI-powered Educational Decision Support Systems (EDSS) are increasingly used in various educational contexts, such as course selection, admissions, scholarship allocation and identifying at-risk students.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;There are known challenges with AI in education, particularly around the reinforcement of existing biases, leading to unfair outcomes.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;The machine learning community has developed metrics and methods to measure and mitigate biases, which have been effectively applied to education as seen in the AI in education literature.&lt;/li&gt;\u0000 &lt;/ul&gt;\u0000 &lt;p&gt;What this paper adds\u0000\u0000 &lt;/p&gt;&lt;ul&gt;\u0000 \u0000 &lt;li&gt;Introduces a comprehensive technical framework for equity and inclusion, specifically for machine learning practitioners in AI education systems.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;Presents a novel modification to the ABROCA fairness metric to better represent disparities among multiple subgroups within a protected class.&lt;/li&gt;\u0000 \u0000 &lt;li&gt;Empirical analysis of the effectiveness of bias-mitigating techniqu","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"55 5","pages":"2003-2038"},"PeriodicalIF":6.7,"publicationDate":"2024-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/bjet.13484","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141105237","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Multimodal and immersive systems for skills development and education 用于技能开发和教育的多模态和沉浸式系统
IF 6.6 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-05-15 DOI: 10.1111/bjet.13483
Daniele Di Mitri, Bibeg Limbu, Jan Schneider, Deniz Iren, Michail Giannakos, Roland Klemke
{"title":"Multimodal and immersive systems for skills development and education","authors":"Daniele Di Mitri,&nbsp;Bibeg Limbu,&nbsp;Jan Schneider,&nbsp;Deniz Iren,&nbsp;Michail Giannakos,&nbsp;Roland Klemke","doi":"10.1111/bjet.13483","DOIUrl":"10.1111/bjet.13483","url":null,"abstract":"","PeriodicalId":48315,"journal":{"name":"British Journal of Educational Technology","volume":"55 4","pages":"1456-1464"},"PeriodicalIF":6.6,"publicationDate":"2024-05-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/bjet.13483","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140975559","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
British Journal of Educational Technology
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1