首页 > 最新文献

International Journal of Educational Technology in Higher Education最新文献

英文 中文
Integrating chatbots in education: insights from the Chatbot-Human Interaction Satisfaction Model (CHISM) 将聊天机器人融入教育:聊天机器人-人机交互满意度模型(CHISM)的启示
IF 8.6 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2023-12-19 DOI: 10.1186/s41239-023-00432-3
Jose Belda-Medina, Vendula Kokošková

Recent advances in Artificial Intelligence (AI) have paved the way for the integration of text-based and voice-enabled chatbots as adaptive virtual tutors in education. Despite the increasing use of AI-powered chatbots in language learning, there is a lack of studies exploring the attitudes and perceptions of teachers and students towards these intelligent tutors. This study aims to compare several linguistic and technological aspects of four App-Integrated Chatbots (AICs) and to examine the perceptions among English as a Foreign Language (EFL) teacher candidates. In this mixed-methods research based on convenience sampling, 237 college students from Spain (n = 155) and the Czech Republic (n = 82) interacted with four AICs over a month, and evaluated them following a rubric based on the Chatbot-Human Interaction Satisfaction Model. This scale was specifically designed to assess different linguistic and technological features of AICs such as response interval, semantic coherence, sentence length, and user interface. Quantitative and qualitative data were gathered through a pre-post-survey, based on the CHISM model and student assessment reports. Quantitative data were analyzed using SPSS statistics software, while qualitative data were examined using QDA Miner software, focusing on identifying recurring themes through frequency analysis. The findings indicated a moderate level of satisfaction with AICs, suggesting that enhancements in areas such as better adapting to learner needs, integrating interactive multimedia, and improving speech technologies are necessary for a more human-like user interaction.

人工智能(AI)的最新进展为将基于文本和语音的聊天机器人整合为教育中的自适应虚拟辅导员铺平了道路。尽管人工智能驱动的聊天机器人在语言学习中的使用越来越多,但却缺乏探讨教师和学生对这些智能辅导员的态度和看法的研究。本研究旨在比较四个应用程序集成聊天机器人(AIC)的语言和技术方面,并考察英语作为外语(EFL)的教师候选人的看法。在这项基于便利抽样的混合方法研究中,来自西班牙(n = 155)和捷克共和国(n = 82)的 237 名大学生在一个月内与四款 AIC 进行了互动,并根据基于聊天机器人-人机交互满意度模型的评分标准对它们进行了评估。该量表专门用于评估 AIC 的不同语言和技术特征,如响应间隔、语义连贯性、句子长度和用户界面。根据 CHISM 模型和学生评估报告,通过前后调查收集了定量和定性数据。定量数据使用 SPSS 统计软件进行分析,定性数据则使用 QDA Miner 软件进行检查,重点是通过频率分析确定重复出现的主题。研究结果表明,学生对 AIC 的满意度处于中等水平,这表明有必要在更好地适应学习者需求、整合交互式多媒体和改进语音技术等方面进行改进,以实现更加人性化的用户交互。
{"title":"Integrating chatbots in education: insights from the Chatbot-Human Interaction Satisfaction Model (CHISM)","authors":"Jose Belda-Medina, Vendula Kokošková","doi":"10.1186/s41239-023-00432-3","DOIUrl":"https://doi.org/10.1186/s41239-023-00432-3","url":null,"abstract":"<p>Recent advances in Artificial Intelligence (AI) have paved the way for the integration of text-based and voice-enabled chatbots as adaptive virtual tutors in education. Despite the increasing use of AI-powered chatbots in language learning, there is a lack of studies exploring the attitudes and perceptions of teachers and students towards these intelligent tutors. This study aims to compare several linguistic and technological aspects of four App-Integrated Chatbots (AICs) and to examine the perceptions among English as a Foreign Language (EFL) teacher candidates. In this mixed-methods research based on convenience sampling, 237 college students from Spain (n = 155) and the Czech Republic (n = 82) interacted with four AICs over a month, and evaluated them following a rubric based on the Chatbot-Human Interaction Satisfaction Model. This scale was specifically designed to assess different linguistic and technological features of AICs such as response interval, semantic coherence, sentence length, and user interface. Quantitative and qualitative data were gathered through a pre-post-survey, based on the CHISM model and student assessment reports. Quantitative data were analyzed using SPSS statistics software, while qualitative data were examined using QDA Miner software, focusing on identifying recurring themes through frequency analysis. The findings indicated a moderate level of satisfaction with AICs, suggesting that enhancements in areas such as better adapting to learner needs, integrating interactive multimedia, and improving speech technologies are necessary for a more human-like user interaction.</p>","PeriodicalId":13871,"journal":{"name":"International Journal of Educational Technology in Higher Education","volume":"56 1","pages":""},"PeriodicalIF":8.6,"publicationDate":"2023-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138743237","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Flipped classroom in higher education: a systematic literature review and research challenges 高等教育中的翻转课堂:系统的文献回顾与研究挑战
IF 8.6 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2023-11-30 DOI: 10.1186/s41239-023-00430-5
Maria Ijaz Baig, Elaheh Yadegaridehkordi

Flipped learning has garnered substantial attention as a potential means to enhance student engagement, improve learning outcomes, and adapt to the evolving educational landscape. However, despite the growing interest and potential benefits of flipped learning, several challenges and areas of concern persist. This systematic literature review critically examines the implementation of the flipped classroom in higher education by focusing on the role of technologies and tools, pedagogical activities and courses, and existing challenges. Using a systematic approach, a total of 30 research articles published between 2014 and 2023 were chosen for the review. This study identified video creation tools, learning management systems (LMS), content repositories, collaborative platforms, podcasts, and online assessment tools as technologies that play a central role in the flipped classroom. Moreover, this study identifies specific pedagogical activities within different courses that contribute to the effectiveness of flipped learning in higher education. The implementation challenges that teachers and students may face in the flipped classroom were presented, and potential strategies to alleviate these challenges were provided. This study will contribute to a more comprehensive understanding of flipped learning's benefits, technologies and tools, challenges, and potential to improve higher education.

翻转学习作为一种提高学生参与度、改善学习成果和适应不断变化的教育环境的潜在手段,已经引起了人们的广泛关注。然而,尽管翻转学习的兴趣和潜在的好处越来越多,一些挑战和关注领域仍然存在。这篇系统的文献综述通过关注技术和工具的作用、教学活动和课程以及现有的挑战,批判性地考察了翻转课堂在高等教育中的实施。采用系统方法,共选择了2014年至2023年间发表的30篇研究论文进行审查。本研究确定了视频制作工具、学习管理系统(LMS)、内容存储库、协作平台、播客和在线评估工具作为在翻转课堂中发挥核心作用的技术。此外,本研究确定了不同课程中的具体教学活动,这些活动有助于高等教育中翻转学习的有效性。提出了教师和学生在实施翻转课堂时可能面临的挑战,并提出了缓解这些挑战的潜在策略。本研究将有助于更全面地了解翻转学习的好处、技术和工具、挑战以及改善高等教育的潜力。
{"title":"Flipped classroom in higher education: a systematic literature review and research challenges","authors":"Maria Ijaz Baig, Elaheh Yadegaridehkordi","doi":"10.1186/s41239-023-00430-5","DOIUrl":"https://doi.org/10.1186/s41239-023-00430-5","url":null,"abstract":"<p>Flipped learning has garnered substantial attention as a potential means to enhance student engagement, improve learning outcomes, and adapt to the evolving educational landscape. However, despite the growing interest and potential benefits of flipped learning, several challenges and areas of concern persist. This systematic literature review critically examines the implementation of the flipped classroom in higher education by focusing on the role of technologies and tools, pedagogical activities and courses, and existing challenges. Using a systematic approach, a total of 30 research articles published between 2014 and 2023 were chosen for the review. This study identified video creation tools, learning management systems (LMS), content repositories, collaborative platforms, podcasts, and online assessment tools as technologies that play a central role in the flipped classroom. Moreover, this study identifies specific pedagogical activities within different courses that contribute to the effectiveness of flipped learning in higher education. The implementation challenges that teachers and students may face in the flipped classroom were presented, and potential strategies to alleviate these challenges were provided. This study will contribute to a more comprehensive understanding of flipped learning's benefits, technologies and tools, challenges, and potential to improve higher education.</p>","PeriodicalId":13871,"journal":{"name":"International Journal of Educational Technology in Higher Education","volume":"28 1","pages":""},"PeriodicalIF":8.6,"publicationDate":"2023-11-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138538594","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exploring language needs of college transfer students with learning analytics: towards a more equitable experience 通过学习分析探索大学转学生的语言需求:实现更公平的体验
IF 8.6 1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2023-11-17 DOI: 10.1186/s41239-023-00429-y
D. Foung, Julia Chen, Kin Cheung
{"title":"Exploring language needs of college transfer students with learning analytics: towards a more equitable experience","authors":"D. Foung, Julia Chen, Kin Cheung","doi":"10.1186/s41239-023-00429-y","DOIUrl":"https://doi.org/10.1186/s41239-023-00429-y","url":null,"abstract":"","PeriodicalId":13871,"journal":{"name":"International Journal of Educational Technology in Higher Education","volume":"42 12","pages":"1-15"},"PeriodicalIF":8.6,"publicationDate":"2023-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139264568","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Beyond emergency remote teaching: did the pandemic lead to lasting change in university courses? 除了紧急远程教学:大流行是否导致了大学课程的持久变化?
1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2023-11-13 DOI: 10.1186/s41239-023-00428-z
J. Broadbent, R. Ajjawi, M. Bearman, D. Boud, P. Dawson
Abstract The COVID-19 pandemic significantly disrupted traditional methods of teaching and learning within higher education. But what remained when the pandemic passed? While the majority of the literature explores the shifts during the pandemic, with much speculation about post-pandemic futures, a clear understanding of lasting implications remains elusive. To illuminate this knowledge gap, our study contrasts pedagogical practices in matched courses from the pre-pandemic year (2019) to the post-pandemic phase (2022/2023). We also investigate the factors influencing these changes and the perceptions of academics on these shifts. Data were gathered from academics in a large comprehensive Australian university of varying disciplines through a mixed-methods approach, collecting 67 survey responses and conducting 21 interviews. Findings indicate a notable increase in online learning activities, authentic and scaffolded assessments, and online unsupervised exams post-pandemic. These changes were primarily driven by university-guided adaptations, time and workload pressures, continued COVID-19 challenges, local leadership, an individual desire to innovate, and concerns about academic integrity. While most changes were seen as favourable by academics, perceptions were less positive concerning online examinations. These findings illuminate the enduring effects of the pandemic on higher education, suggesting longer-term implications than previous studies conducted during the acute phase of the pandemic.
新冠肺炎疫情严重破坏了传统的高等教育教学方式。但大流行过去后还剩下什么呢?虽然大多数文献探讨了大流行期间的变化,并对大流行后的未来进行了许多猜测,但对持久影响的清晰理解仍然难以捉摸。为了阐明这一知识差距,我们的研究对比了从大流行前一年(2019年)到大流行后阶段(2022/2023年)的匹配课程的教学实践。我们还调查了影响这些变化的因素以及学术界对这些变化的看法。数据通过混合方法从澳大利亚一所大型综合性大学的不同学科的学者中收集,收集了67份调查回复,进行了21次访谈。调查结果表明,大流行后,在线学习活动、真实和框架评估以及在线无监督考试显著增加。这些变化主要是由大学引导的适应、时间和工作量压力、持续的COVID-19挑战、地方领导、个人创新的愿望以及对学术诚信的关注所驱动的。虽然学术界认为大多数变化是有利的,但对在线考试的看法却不那么积极。这些发现阐明了大流行对高等教育的持久影响,表明了比以往在大流行急性阶段进行的研究更长期的影响。
{"title":"Beyond emergency remote teaching: did the pandemic lead to lasting change in university courses?","authors":"J. Broadbent, R. Ajjawi, M. Bearman, D. Boud, P. Dawson","doi":"10.1186/s41239-023-00428-z","DOIUrl":"https://doi.org/10.1186/s41239-023-00428-z","url":null,"abstract":"Abstract The COVID-19 pandemic significantly disrupted traditional methods of teaching and learning within higher education. But what remained when the pandemic passed? While the majority of the literature explores the shifts during the pandemic, with much speculation about post-pandemic futures, a clear understanding of lasting implications remains elusive. To illuminate this knowledge gap, our study contrasts pedagogical practices in matched courses from the pre-pandemic year (2019) to the post-pandemic phase (2022/2023). We also investigate the factors influencing these changes and the perceptions of academics on these shifts. Data were gathered from academics in a large comprehensive Australian university of varying disciplines through a mixed-methods approach, collecting 67 survey responses and conducting 21 interviews. Findings indicate a notable increase in online learning activities, authentic and scaffolded assessments, and online unsupervised exams post-pandemic. These changes were primarily driven by university-guided adaptations, time and workload pressures, continued COVID-19 challenges, local leadership, an individual desire to innovate, and concerns about academic integrity. While most changes were seen as favourable by academics, perceptions were less positive concerning online examinations. These findings illuminate the enduring effects of the pandemic on higher education, suggesting longer-term implications than previous studies conducted during the acute phase of the pandemic.","PeriodicalId":13871,"journal":{"name":"International Journal of Educational Technology in Higher Education","volume":"46 13","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136281604","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Not quite eye to A.I.: student and teacher perspectives on the use of generative artificial intelligence in the writing process 不完全关注人工智能:学生和教师对在写作过程中使用生成式人工智能的看法
1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2023-11-10 DOI: 10.1186/s41239-023-00427-0
Alex Barrett, Austin Pack
Abstract Generative artificial intelligence (GenAI) can be used to author academic texts at a similar level to what humans are capable of, causing concern about its misuse in education. Addressing the role of GenAI in teaching and learning has become an urgent task. This study reports the results of a survey comparing educators’ (n = 68) and university students’ (n = 158) perceptions on the appropriate use of GenAI in the writing process. The survey included representations of user prompts and output from ChatGPT, a GenAI chatbot, for each of six tasks of the writing process (brainstorming, outlining, writing, revising, feedback, and evaluating). Survey respondents were asked to differentiate between various uses of GenAI for these tasks, which were divided between student and teacher use. Results indicate minor disagreement between students and teachers on acceptable use of GenAI tools in the writing process, as well as classroom and institutional-level lack of preparedness for GenAI. These results imply the need for explicit guidelines and teacher professional development on the use of GenAI in educational contexts. This study can contribute to evidence-based guidelines on the integration of GenAI in teaching and learning.
生成式人工智能(GenAI)可以用于编写与人类能力相似的学术文本,这引起了人们对其在教育中滥用的担忧。解决基因人工智能在教与学中的作用已成为一项紧迫的任务。本研究报告了一项比较教育工作者(n = 68)和大学生(n = 158)对在写作过程中适当使用GenAI的看法的调查结果。该调查包括用户提示和ChatGPT (GenAI聊天机器人)的输出,用于写作过程中的六个任务(头脑风暴、概述、写作、修改、反馈和评估)。调查对象被要求区分GenAI用于这些任务的各种用途,这些任务分为学生和教师使用。结果表明,学生和教师在写作过程中对GenAI工具的可接受使用方面存在轻微分歧,课堂和机构层面缺乏对GenAI的准备。这些结果意味着需要明确的指导方针和教师在教育环境中使用GenAI的专业发展。本研究可为GenAI在教与学中的整合提供循证指导。
{"title":"Not quite eye to A.I.: student and teacher perspectives on the use of generative artificial intelligence in the writing process","authors":"Alex Barrett, Austin Pack","doi":"10.1186/s41239-023-00427-0","DOIUrl":"https://doi.org/10.1186/s41239-023-00427-0","url":null,"abstract":"Abstract Generative artificial intelligence (GenAI) can be used to author academic texts at a similar level to what humans are capable of, causing concern about its misuse in education. Addressing the role of GenAI in teaching and learning has become an urgent task. This study reports the results of a survey comparing educators’ (n = 68) and university students’ (n = 158) perceptions on the appropriate use of GenAI in the writing process. The survey included representations of user prompts and output from ChatGPT, a GenAI chatbot, for each of six tasks of the writing process (brainstorming, outlining, writing, revising, feedback, and evaluating). Survey respondents were asked to differentiate between various uses of GenAI for these tasks, which were divided between student and teacher use. Results indicate minor disagreement between students and teachers on acceptable use of GenAI tools in the writing process, as well as classroom and institutional-level lack of preparedness for GenAI. These results imply the need for explicit guidelines and teacher professional development on the use of GenAI in educational contexts. This study can contribute to evidence-based guidelines on the integration of GenAI in teaching and learning.","PeriodicalId":13871,"journal":{"name":"International Journal of Educational Technology in Higher Education","volume":"100 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135092029","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Role of AI chatbots in education: systematic literature review 人工智能聊天机器人在教育中的作用:系统文献综述
1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2023-10-31 DOI: 10.1186/s41239-023-00426-1
Lasha Labadze, Maya Grigolia, Lela Machaidze
Abstract AI chatbots shook the world not long ago with their potential to revolutionize education systems in a myriad of ways. AI chatbots can provide immediate support by answering questions, offering explanations, and providing additional resources. Chatbots can also act as virtual teaching assistants, supporting educators through various means. In this paper, we try to understand the full benefits of AI chatbots in education, their opportunities, challenges, potential limitations, concerns, and prospects of using AI chatbots in educational settings. We conducted an extensive search across various academic databases, and after applying specific predefined criteria, we selected a final set of 67 relevant studies for review. The research findings emphasize the numerous benefits of integrating AI chatbots in education, as seen from both students' and educators' perspectives. We found that students primarily gain from AI-powered chatbots in three key areas: homework and study assistance, a personalized learning experience, and the development of various skills. For educators, the main advantages are the time-saving assistance and improved pedagogy. However, our research also emphasizes significant challenges and critical factors that educators need to handle diligently. These include concerns related to AI applications such as reliability, accuracy, and ethical considerations.
不久前,人工智能聊天机器人以其以无数种方式彻底改变教育系统的潜力震撼了世界。人工智能聊天机器人可以通过回答问题、提供解释和提供额外资源来提供即时支持。聊天机器人还可以充当虚拟助教,通过各种方式支持教育工作者。在本文中,我们试图了解人工智能聊天机器人在教育中的全部好处,它们的机遇、挑战、潜在的限制、关注和在教育环境中使用人工智能聊天机器人的前景。我们在各种学术数据库中进行了广泛的搜索,并在应用特定的预定义标准后,我们选择了67项相关研究的最终组进行审查。从学生和教育工作者的角度来看,研究结果强调了将人工智能聊天机器人融入教育的诸多好处。我们发现,学生主要从人工智能聊天机器人中获益于三个关键领域:家庭作业和学习辅助、个性化学习体验以及各种技能的发展。对于教育工作者来说,主要的好处是节省时间的帮助和改进的教学方法。然而,我们的研究也强调了教育工作者需要努力应对的重大挑战和关键因素。这些问题包括与人工智能应用相关的问题,如可靠性、准确性和道德考虑。
{"title":"Role of AI chatbots in education: systematic literature review","authors":"Lasha Labadze, Maya Grigolia, Lela Machaidze","doi":"10.1186/s41239-023-00426-1","DOIUrl":"https://doi.org/10.1186/s41239-023-00426-1","url":null,"abstract":"Abstract AI chatbots shook the world not long ago with their potential to revolutionize education systems in a myriad of ways. AI chatbots can provide immediate support by answering questions, offering explanations, and providing additional resources. Chatbots can also act as virtual teaching assistants, supporting educators through various means. In this paper, we try to understand the full benefits of AI chatbots in education, their opportunities, challenges, potential limitations, concerns, and prospects of using AI chatbots in educational settings. We conducted an extensive search across various academic databases, and after applying specific predefined criteria, we selected a final set of 67 relevant studies for review. The research findings emphasize the numerous benefits of integrating AI chatbots in education, as seen from both students' and educators' perspectives. We found that students primarily gain from AI-powered chatbots in three key areas: homework and study assistance, a personalized learning experience, and the development of various skills. For educators, the main advantages are the time-saving assistance and improved pedagogy. However, our research also emphasizes significant challenges and critical factors that educators need to handle diligently. These include concerns related to AI applications such as reliability, accuracy, and ethical considerations.","PeriodicalId":13871,"journal":{"name":"International Journal of Educational Technology in Higher Education","volume":"25 3","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135871937","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
AI-generated feedback on writing: insights into efficacy and ENL student preference 人工智能生成的写作反馈:对效能和ENL学生偏好的洞察
1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2023-10-27 DOI: 10.1186/s41239-023-00425-2
Juan Escalante, Austin Pack, Alex Barrett
Abstract The question of how generative AI tools, such as large language models and chatbots, can be leveraged ethically and effectively in education is ongoing. Given the critical role that writing plays in learning and assessment within educational institutions, it is of growing importance for educators to make thoughtful and informed decisions as to how and in what capacity generative AI tools should be leveraged to assist in the development of students’ writing skills. This paper reports on two longitudinal studies. Study 1 examined learning outcomes of 48 university English as a new language (ENL) learners in a six-week long repeated measures quasi experimental design where the experimental group received writing feedback generated from ChatGPT (GPT-4) and the control group received feedback from their human tutor. Study 2 analyzed the perceptions of a different group of 43 ENLs who received feedback from both ChatGPT and their tutor. Results of study 1 showed no difference in learning outcomes between the two groups. Study 2 results revealed a near even split in preference for AI-generated or human-generated feedback, with clear advantages to both forms of feedback apparent from the data. The main implication of these studies is that the use of AI-generated feedback can likely be incorporated into ENL essay evaluation without affecting learning outcomes, although we recommend a blended approach that utilizes the strengths of both forms of feedback. The main contribution of this paper is in addressing generative AI as an automatic essay evaluator while incorporating learner perspectives.
如何在教育中有效地利用大型语言模型和聊天机器人等生成式人工智能工具的问题正在进行中。鉴于写作在教育机构的学习和评估中发挥着至关重要的作用,对于教育者来说,就如何以及以何种能力利用生成式人工智能工具来帮助培养学生的写作技能,做出深思熟虑和明智的决定就变得越来越重要。本文报告了两项纵向研究。研究1在为期六周的重复测量准实验设计中检查了48名大学英语作为一门新语言(ENL)学习者的学习成果,实验组收到由ChatGPT (GPT-4)生成的写作反馈,对照组收到来自他们的人类导师的反馈。研究2分析了另一组43名enl的看法,他们从ChatGPT和他们的导师那里得到反馈。研究1的结果显示,两组之间的学习成果没有差异。研究2的结果显示,人们对人工智能生成的反馈和人工生成的反馈的偏好几乎持平,从数据中可以明显看出,这两种反馈形式都有明显的优势。这些研究的主要含义是,使用人工智能生成的反馈可能会被纳入ENL论文评估,而不会影响学习结果,尽管我们推荐一种利用两种反馈形式优势的混合方法。本文的主要贡献在于将生成式人工智能作为自动论文评估器,同时结合学习者的观点。
{"title":"AI-generated feedback on writing: insights into efficacy and ENL student preference","authors":"Juan Escalante, Austin Pack, Alex Barrett","doi":"10.1186/s41239-023-00425-2","DOIUrl":"https://doi.org/10.1186/s41239-023-00425-2","url":null,"abstract":"Abstract The question of how generative AI tools, such as large language models and chatbots, can be leveraged ethically and effectively in education is ongoing. Given the critical role that writing plays in learning and assessment within educational institutions, it is of growing importance for educators to make thoughtful and informed decisions as to how and in what capacity generative AI tools should be leveraged to assist in the development of students’ writing skills. This paper reports on two longitudinal studies. Study 1 examined learning outcomes of 48 university English as a new language (ENL) learners in a six-week long repeated measures quasi experimental design where the experimental group received writing feedback generated from ChatGPT (GPT-4) and the control group received feedback from their human tutor. Study 2 analyzed the perceptions of a different group of 43 ENLs who received feedback from both ChatGPT and their tutor. Results of study 1 showed no difference in learning outcomes between the two groups. Study 2 results revealed a near even split in preference for AI-generated or human-generated feedback, with clear advantages to both forms of feedback apparent from the data. The main implication of these studies is that the use of AI-generated feedback can likely be incorporated into ENL essay evaluation without affecting learning outcomes, although we recommend a blended approach that utilizes the strengths of both forms of feedback. The main contribution of this paper is in addressing generative AI as an automatic essay evaluator while incorporating learner perspectives.","PeriodicalId":13871,"journal":{"name":"International Journal of Educational Technology in Higher Education","volume":"79 9","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136234372","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Integrating Digital Storytelling into STEAM Teaching: Examining Young Language Learners’ Development of Self-regulation and English Literacy 将数字讲故事融入STEAM教学:考察青少年语言学习者自我调节和英语读写能力的发展
1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2023-10-23 DOI: 10.46328/ijte.551
Maryam Amirinejad, Mehrak Rahimi
As an innovative pedagogical approach, STEAM Education uses science, technology, engineering, the arts, and mathematics to spark students’ learning motivation, problem-solving skills, and cognitive development. Despite widespread literature on STEAM pedagogy, evidence on the benefit of integrating STEAM with technology-enhanced language learning at elementary levels is insufficient. This study thus inspects the impact of incorporating digital storytelling (DST) into STEAM teaching on young language learners' development of self-regulation and English literacy. Thirty-three schoolchildren participated in the study as the experimental and control groups. Their English literacy and self-regulation were examined before and after the study. Both groups received STEAM instructional content in English for one semester. The DST group worked with the online platform StoryJumper to make digital books for their projects; meanwhile, the control group prepared their projects by reports and presentations. At the end of the experiment, the DST group’s academic self-regulation improved significantly which was the result of their enhanced introjected and external regulation. Also, the DST group outperformed the control group in English literacy. Due to the key role of STEAM education in making students interested in STEAM disciplines at elementary levels, planning and implementing best practices of STEAM pedagogy for schoolchildren is recommended.
作为一种创新的教学方法,STEAM教育运用科学、技术、工程、艺术和数学来激发学生的学习动机、解决问题的能力和认知发展。尽管关于STEAM教学法的文献很多,但在小学阶段将STEAM与技术增强的语言学习结合起来的好处的证据还不够。因此,本研究考察了将数字讲故事(DST)纳入STEAM教学对年轻语言学习者自我调节和英语读写能力发展的影响。33名小学生作为实验组和对照组参加了这项研究。在研究前后对他们的英语读写能力和自我调节能力进行了测试。两组都接受了一个学期的STEAM英语教学内容。DST小组与在线平台StoryJumper合作,为他们的项目制作电子书;与此同时,对照组通过报告和演示来准备他们的项目。在实验结束时,DST组的学术自我监管显著提高,这是他们的内部和外部监管加强的结果。此外,DST组在英语读写能力方面的表现优于对照组。由于STEAM教育在使学生对初级STEAM学科感兴趣方面的关键作用,建议为学童规划和实施STEAM教学法的最佳实践。
{"title":"Integrating Digital Storytelling into STEAM Teaching: Examining Young Language Learners’ Development of Self-regulation and English Literacy","authors":"Maryam Amirinejad, Mehrak Rahimi","doi":"10.46328/ijte.551","DOIUrl":"https://doi.org/10.46328/ijte.551","url":null,"abstract":"As an innovative pedagogical approach, STEAM Education uses science, technology, engineering, the arts, and mathematics to spark students’ learning motivation, problem-solving skills, and cognitive development. Despite widespread literature on STEAM pedagogy, evidence on the benefit of integrating STEAM with technology-enhanced language learning at elementary levels is insufficient. This study thus inspects the impact of incorporating digital storytelling (DST) into STEAM teaching on young language learners' development of self-regulation and English literacy. Thirty-three schoolchildren participated in the study as the experimental and control groups. Their English literacy and self-regulation were examined before and after the study. Both groups received STEAM instructional content in English for one semester. The DST group worked with the online platform StoryJumper to make digital books for their projects; meanwhile, the control group prepared their projects by reports and presentations. At the end of the experiment, the DST group’s academic self-regulation improved significantly which was the result of their enhanced introjected and external regulation. Also, the DST group outperformed the control group in English literacy. Due to the key role of STEAM education in making students interested in STEAM disciplines at elementary levels, planning and implementing best practices of STEAM pedagogy for schoolchildren is recommended.","PeriodicalId":13871,"journal":{"name":"International Journal of Educational Technology in Higher Education","volume":"47 7","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135367180","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using a Survey and Discussion Forums on Students’ Satisfaction and Experience to inform the Development of a New Virtual Leaning Environment (VLE): A Data-driven Approach to Technology Use in Learning and Teaching 利用学生满意度和经验的调查和讨论论坛为新的虚拟学习环境(VLE)的开发提供信息:一种数据驱动的学习和教学技术使用方法
1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2023-10-23 DOI: 10.46328/ijte.540
Stephanie Baines, Sofia Barbosa Boucas, Pauldy C.J. Otermans
The virtual learning environment (VLE) is of great importance in Higher Education as a repository for course content, communication and student support. Students’ satisfaction with the VLE may impact greatly on their engagement with the VLE itself, and, consequently, module content and learning more widely. In moving to a new VLE we wished to optimise its design for our students’ needs by determining features that impact students’ usage. As such, in this study we tested the satisfaction of psychology students with the layout used in our current VLE, Blackboard Learn (BbL). Using an online survey, students rated their satisfaction for each element of the BbL template on a 7-point Likert-type scale, from 1 (‘extremely dissatisfied)’ to 7 (‘extremely satisfied’). Eighty-seven students enrolled in the BSc Psychology (N = 68) and BSc Psychology (Sport, Health and Exercise) (N = 19) programmes completed the survey. Results showed that, overall, students were very satisfied with their BbL structure. Open-text comments indicated students appreciated the clear, organised structure, making it very easy to navigate. However, students suggested clearer labelling and greater consistency across modules would improve their learning. These findings will be used to inform the template of our new VLE.
虚拟学习环境(VLE)作为课程内容、交流和学生支持的存储库,在高等教育中具有重要意义。学生对VLE的满意度可能会极大地影响他们对VLE本身的参与,从而影响模块内容和更广泛的学习。在迁移到新的VLE时,我们希望通过确定影响学生使用的功能来优化其设计,以满足学生的需求。因此,在本研究中,我们测试了心理学专业学生对我们目前的VLE - Blackboard Learn (BbL)中使用的布局的满意度。通过一项在线调查,学生们对BbL模板中每个元素的满意度进行了打分,李克特量表为7分,从1(“非常不满意”)到7(“非常满意”)。87名参加心理学理学士(N = 68)和心理学理学士(运动、健康和运动)课程的学生完成了调查。结果显示,总体而言,学生对他们的BbL结构非常满意。开放文本的评论表明,学生们喜欢清晰、有组织的结构,这使得阅读非常容易。然而,学生们表示,更清晰的标签和更大的模块一致性将改善他们的学习。这些发现将用于通知我们的新VLE模板。
{"title":"Using a Survey and Discussion Forums on Students’ Satisfaction and Experience to inform the Development of a New Virtual Leaning Environment (VLE): A Data-driven Approach to Technology Use in Learning and Teaching","authors":"Stephanie Baines, Sofia Barbosa Boucas, Pauldy C.J. Otermans","doi":"10.46328/ijte.540","DOIUrl":"https://doi.org/10.46328/ijte.540","url":null,"abstract":"The virtual learning environment (VLE) is of great importance in Higher Education as a repository for course content, communication and student support. Students’ satisfaction with the VLE may impact greatly on their engagement with the VLE itself, and, consequently, module content and learning more widely. In moving to a new VLE we wished to optimise its design for our students’ needs by determining features that impact students’ usage. As such, in this study we tested the satisfaction of psychology students with the layout used in our current VLE, Blackboard Learn (BbL). Using an online survey, students rated their satisfaction for each element of the BbL template on a 7-point Likert-type scale, from 1 (‘extremely dissatisfied)’ to 7 (‘extremely satisfied’). Eighty-seven students enrolled in the BSc Psychology (N = 68) and BSc Psychology (Sport, Health and Exercise) (N = 19) programmes completed the survey. Results showed that, overall, students were very satisfied with their BbL structure. Open-text comments indicated students appreciated the clear, organised structure, making it very easy to navigate. However, students suggested clearer labelling and greater consistency across modules would improve their learning. These findings will be used to inform the template of our new VLE.","PeriodicalId":13871,"journal":{"name":"International Journal of Educational Technology in Higher Education","volume":"75 6","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135413358","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Effectiveness of Using Memrise Application to Learn Chinese Characters by American Middle School Students - A Pilot Study 美国中学生使用记忆软件学习汉字的有效性——一项初步研究
1区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2023-10-23 DOI: 10.46328/ijte.423
Lih-Ching Chen Wang, Eddie T. C. Lam, Chong Xiao
This study examined the effectiveness of Memrise application in motivating American middle school students to learn Chinese as a foreign language (CFL). Participants (N = 27) in the study were middle school students enrolled in CFL courses in an urban public middle school in the Midwestern region of the United States. During the study, the experimental group used the Memrise application while the control group used the traditional paper-made flashcards to learn new Chinese characters. Results of the mixed-design ANOVA indicated that there was no significant (p .05) difference in the scores between students in the experimental and control groups on Chinese characters acquisition. However, the Group main effect was significant (p .001), indicating that the students in the experimental group had stronger motivation in learning CFL than those in the control group. It is suggested that further research should include a larger sample size and other types of CFL learning applications.
本研究考察了Memrise应用在激励美国中学生学习汉语的有效性。本研究的参与者(N = 27)为美国中西部地区一所城市公立中学CFL课程的中学生。在学习过程中,实验组使用Memrise软件学习汉字,对照组使用传统的纸质抽认卡学习汉字。混合设计方差分析结果显示,实验组学生与对照组学生汉字习得成绩差异无统计学意义(p . 0.05)。然而,组主效应显著(p .001),表明实验组学生学习CFL的动机比对照组学生强。建议进一步的研究应包括更大的样本量和其他类型的CFL学习应用。
{"title":"The Effectiveness of Using Memrise Application to Learn Chinese Characters by American Middle School Students - A Pilot Study","authors":"Lih-Ching Chen Wang, Eddie T. C. Lam, Chong Xiao","doi":"10.46328/ijte.423","DOIUrl":"https://doi.org/10.46328/ijte.423","url":null,"abstract":"This study examined the effectiveness of Memrise application in motivating American middle school students to learn Chinese as a foreign language (CFL). Participants (N = 27) in the study were middle school students enrolled in CFL courses in an urban public middle school in the Midwestern region of the United States. During the study, the experimental group used the Memrise application while the control group used the traditional paper-made flashcards to learn new Chinese characters. Results of the mixed-design ANOVA indicated that there was no significant (p .05) difference in the scores between students in the experimental and control groups on Chinese characters acquisition. However, the Group main effect was significant (p .001), indicating that the students in the experimental group had stronger motivation in learning CFL than those in the control group. It is suggested that further research should include a larger sample size and other types of CFL learning applications.","PeriodicalId":13871,"journal":{"name":"International Journal of Educational Technology in Higher Education","volume":"10 2","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135367172","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
International Journal of Educational Technology in Higher Education
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1