{"title":"The effect of chatbots on learning: a meta-analysis of empirical research","authors":"Ecenaz Alemdag","doi":"10.1080/15391523.2023.2255698","DOIUrl":null,"url":null,"abstract":"This meta-analysis aimed to comprehensively review empirical studies on the effect of chatbots on learning and quantitatively synthesize their findings to produce an overall effect size. Searching several databases yielded 28 eligible reports with 31 individual effect sizes. The results revealed a significant and medium effect (g = .48) of chatbots on learning. Further analyses indicated four significant moderators: the type of instruction in the comparison group, experimental duration, chatbot type, and chatbot tasks. The highest effect sizes emerged when the comparison group had no specific support, the experiment lasted only one session, and chatbots were task-focused and took care of frequently asked questions. These results suggest that chatbots can be more effective in certain cases within their overall contribution area to learning.","PeriodicalId":47444,"journal":{"name":"Journal of Research on Technology in Education","volume":"24 1","pages":"0"},"PeriodicalIF":5.1000,"publicationDate":"2023-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Research on Technology in Education","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/15391523.2023.2255698","RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"Social Sciences","Score":null,"Total":0}
引用次数: 1
Abstract
This meta-analysis aimed to comprehensively review empirical studies on the effect of chatbots on learning and quantitatively synthesize their findings to produce an overall effect size. Searching several databases yielded 28 eligible reports with 31 individual effect sizes. The results revealed a significant and medium effect (g = .48) of chatbots on learning. Further analyses indicated four significant moderators: the type of instruction in the comparison group, experimental duration, chatbot type, and chatbot tasks. The highest effect sizes emerged when the comparison group had no specific support, the experiment lasted only one session, and chatbots were task-focused and took care of frequently asked questions. These results suggest that chatbots can be more effective in certain cases within their overall contribution area to learning.
期刊介绍:
The Journal of Research on Technology in Education (JRTE) is a premier source for high-quality, peer-reviewed research that defines the state of the art, and future horizons, of teaching and learning with technology. The terms "education" and "technology" are broadly defined. Education is inclusive of formal educational environments ranging from PK-12 to higher education, and informal learning environments, such as museums, community centers, and after-school programs. Technology refers to both software and hardware innovations, and more broadly, the application of technological processes to education.