Effects of Artificial Intelligence-Powered Virtual Agents on Learning Outcomes in Computer-Based Simulations: A Meta-Analysis

IF 10.1 1区 心理学 Q1 PSYCHOLOGY, EDUCATIONAL Educational Psychology Review Pub Date : 2024-03-01 DOI:10.1007/s10648-024-09855-4
{"title":"Effects of Artificial Intelligence-Powered Virtual Agents on Learning Outcomes in Computer-Based Simulations: A Meta-Analysis","authors":"","doi":"10.1007/s10648-024-09855-4","DOIUrl":null,"url":null,"abstract":"<h3>Abstract</h3> <p>Computer-based simulations for learning offer affordances for advanced capabilities and expansive possibilities for knowledge construction and skills application. Virtual agents, when powered by artificial intelligence (AI), can be used to scaffold personalized and adaptive learning processes. However, a synthesis or a systematic evaluation of the learning effectiveness of AI-powered virtual agents in computer-based simulations for learning is still lacking. Therefore, this meta-analysis is aimed at evaluating the effects of AI-powered virtual agents in computer-based simulations for learning. The analysis of 49 effect sizes derived from 22 empirical studies suggested a medium positive overall effect, <span> <span>\\(\\overline{g }=0.43\\)</span> </span>, SE = 0.08, 95% C.I. [0.27, 0.59], favoring the use of AI-powered virtual agents over the non-AI-powered virtual agent condition in computer-based simulations for learning. Further, moderator analyses revealed that intervention length, AI technologies, and the representation of AI-powered virtual agents significantly explain the heterogeneity of the overall effects. Conversely, other moderators, including education level, domain, the role of AI-powered virtual agents, the modality of AI-powered virtual agents, and learning environment, appeared to be universally effective among the studies of AI-powered virtual agents in computer-based simulations for learning. Overall, this meta-analysis provides systematic and existing evidence supporting the adoption of AI-powered virtual agents in computer-based simulations for learning. The findings also inform about evidence-based design decisions on the moderators analyzed.</p>","PeriodicalId":48344,"journal":{"name":"Educational Psychology Review","volume":"1 1","pages":""},"PeriodicalIF":10.1000,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Educational Psychology Review","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1007/s10648-024-09855-4","RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, EDUCATIONAL","Score":null,"Total":0}
引用次数: 0

Abstract

Computer-based simulations for learning offer affordances for advanced capabilities and expansive possibilities for knowledge construction and skills application. Virtual agents, when powered by artificial intelligence (AI), can be used to scaffold personalized and adaptive learning processes. However, a synthesis or a systematic evaluation of the learning effectiveness of AI-powered virtual agents in computer-based simulations for learning is still lacking. Therefore, this meta-analysis is aimed at evaluating the effects of AI-powered virtual agents in computer-based simulations for learning. The analysis of 49 effect sizes derived from 22 empirical studies suggested a medium positive overall effect, \(\overline{g }=0.43\) , SE = 0.08, 95% C.I. [0.27, 0.59], favoring the use of AI-powered virtual agents over the non-AI-powered virtual agent condition in computer-based simulations for learning. Further, moderator analyses revealed that intervention length, AI technologies, and the representation of AI-powered virtual agents significantly explain the heterogeneity of the overall effects. Conversely, other moderators, including education level, domain, the role of AI-powered virtual agents, the modality of AI-powered virtual agents, and learning environment, appeared to be universally effective among the studies of AI-powered virtual agents in computer-based simulations for learning. Overall, this meta-analysis provides systematic and existing evidence supporting the adoption of AI-powered virtual agents in computer-based simulations for learning. The findings also inform about evidence-based design decisions on the moderators analyzed.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
人工智能驱动的虚拟代理对计算机模拟学习成果的影响:元分析
摘要 基于计算机的模拟学习为知识构建和技能应用提供了先进的能力和广阔的可能性。由人工智能(AI)驱动的虚拟代理可用于构建个性化和自适应的学习过程。然而,目前仍缺乏对基于计算机的模拟学习中由人工智能驱动的虚拟代理的学习效果进行综合或系统评估。因此,本荟萃分析旨在评估人工智能驱动的虚拟代理在基于计算机的模拟学习中的效果。对来自22项实证研究的49个效应大小的分析表明,在基于计算机的模拟学习中,使用人工智能驱动的虚拟代理比不使用人工智能驱动的虚拟代理更有利于学习,总体效应为中等正效应((\overline{g }=0.43\) , SE = 0.08, 95% C.I. [0.27, 0.59])。此外,调节因素分析表明,干预时间长短、人工智能技术和人工智能驱动的虚拟代理的代表性能显著解释总体效应的异质性。相反,其他调节因素,包括教育水平、领域、人工智能驱动的虚拟代理的作用、人工智能驱动的虚拟代理的模式和学习环境,似乎在人工智能驱动的虚拟代理在基于计算机的模拟学习中的研究中普遍有效。总之,这项荟萃分析提供了系统的现有证据,支持在基于计算机的模拟学习中采用人工智能驱动的虚拟代理。研究结果还为所分析的调节因素提供了基于证据的设计决策依据。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Educational Psychology Review
Educational Psychology Review PSYCHOLOGY, EDUCATIONAL-
CiteScore
15.70
自引率
3.00%
发文量
62
期刊介绍: Educational Psychology Review aims to disseminate knowledge and promote dialogue within the field of educational psychology. It serves as a platform for the publication of various types of articles, including peer-reviewed integrative reviews, special thematic issues, reflections on previous research or new research directions, interviews, and research-based advice for practitioners. The journal caters to a diverse readership, ranging from generalists in educational psychology to experts in specific areas of the discipline. The content offers a comprehensive coverage of topics and provides in-depth information to meet the needs of both specialized researchers and practitioners.
期刊最新文献
On Being Accepted: Interrogating How University Cultural Scripts Shape Personal and Political Facets of Belonging Linking Disparate Strands: A Critical Review of the Relationship Between Creativity and Education Exploring the Nature-Creativity Connection Across Different Settings: A Scoping Review Bold, Humble, Collaborative, and Virtuous: The Future of Theory Development in Educational Psychology Effects of School-led Greenspace Interventions on Mental, Physical and Social Wellbeing in Children and Adolescents: A Systematic Review
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1