Exploring the Feasibility and Efficacy of ChatGPT3 for Personalized Feedback in Teaching

IF 4.7 Q2 MATERIALS SCIENCE, BIOMATERIALS ACS Applied Bio Materials Pub Date : 2024-04-22 DOI:10.34190/ejel.22.2.3345
Irum Naz, Rodney Robertson
{"title":"Exploring the Feasibility and Efficacy of ChatGPT3 for Personalized Feedback in Teaching","authors":"Irum Naz, Rodney Robertson","doi":"10.34190/ejel.22.2.3345","DOIUrl":null,"url":null,"abstract":"This study explores the feasibility of using AI technology, specifically ChatGPT-3, to provide reliable, meaningful, and personalized feedback. Specifically, the study explores the benefits and limitations of using AI-based feedback in language learning; the pedagogical frameworks that underpin the effective use of AI-based feedback; the reliability of ChatGPT-3’s feedback; and the potential implications of AI integration in language instruction. A review of existing literature identifies key themes and findings related to AI-based teaching practices. The study found that social cognitive theory (SCT) supports the potential use of AI chatbots in the learning process as AI can provide students with instant guidance and support that fosters personalized, independent learning experiences. Similarly, Krashen’s second language acquisition theory (SLA) was found to support the hypothesis that AI use can enhance student learning by creating meaningful interaction in the target language wherein learners engage in genuine communication rather than focusing solely on linguistic form. To determine the reliability of AI-generated feedback, an analysis was performed on student writing. First, two rubrics were created by ChatGPT-3; AI then graded the papers, and the results were compared with human graded results using the same rubrics. The study concludes that e-Learning arning certainly has great potential; besides providing timely, personalized learning support, AI feedback can increase student motivation and foster learning independence. Not surprisingly, though, several caveats exist. It was found that ChatGPT-3 is prone to error and hallucination in providing student feedback, especially when presented with longer texts. To avoid this, rubrics must be carefully constructed, and teacher oversight is still very much required. This study will help educators transition to the new era of AI-assisted e-Learning by helping them make informed decisions about how to provide useful AI feedback that is underpinned by sound pedagogical principles.","PeriodicalId":2,"journal":{"name":"ACS Applied Bio Materials","volume":"46 4","pages":""},"PeriodicalIF":4.7000,"publicationDate":"2024-04-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Applied Bio Materials","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.34190/ejel.22.2.3345","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATERIALS SCIENCE, BIOMATERIALS","Score":null,"Total":0}
引用次数: 0

Abstract

This study explores the feasibility of using AI technology, specifically ChatGPT-3, to provide reliable, meaningful, and personalized feedback. Specifically, the study explores the benefits and limitations of using AI-based feedback in language learning; the pedagogical frameworks that underpin the effective use of AI-based feedback; the reliability of ChatGPT-3’s feedback; and the potential implications of AI integration in language instruction. A review of existing literature identifies key themes and findings related to AI-based teaching practices. The study found that social cognitive theory (SCT) supports the potential use of AI chatbots in the learning process as AI can provide students with instant guidance and support that fosters personalized, independent learning experiences. Similarly, Krashen’s second language acquisition theory (SLA) was found to support the hypothesis that AI use can enhance student learning by creating meaningful interaction in the target language wherein learners engage in genuine communication rather than focusing solely on linguistic form. To determine the reliability of AI-generated feedback, an analysis was performed on student writing. First, two rubrics were created by ChatGPT-3; AI then graded the papers, and the results were compared with human graded results using the same rubrics. The study concludes that e-Learning arning certainly has great potential; besides providing timely, personalized learning support, AI feedback can increase student motivation and foster learning independence. Not surprisingly, though, several caveats exist. It was found that ChatGPT-3 is prone to error and hallucination in providing student feedback, especially when presented with longer texts. To avoid this, rubrics must be carefully constructed, and teacher oversight is still very much required. This study will help educators transition to the new era of AI-assisted e-Learning by helping them make informed decisions about how to provide useful AI feedback that is underpinned by sound pedagogical principles.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
探索 ChatGPT3 在个性化教学反馈中的可行性和有效性
本研究探讨了使用人工智能技术(特别是 ChatGPT-3)提供可靠、有意义和个性化反馈的可行性。具体来说,本研究探讨了在语言学习中使用基于人工智能的反馈的好处和局限性;有效使用基于人工智能的反馈的教学框架;ChatGPT-3 的反馈可靠性;以及将人工智能整合到语言教学中的潜在影响。对现有文献的回顾确定了与基于人工智能的教学实践相关的关键主题和发现。研究发现,社会认知理论(SCT)支持人工智能聊天机器人在学习过程中的潜在应用,因为人工智能可以为学生提供即时指导和支持,促进个性化、独立的学习体验。同样,克拉申(Krashen)的第二语言习得理论(SLA)也支持这样的假设,即使用人工智能可以在目标语言中创造有意义的互动,让学习者参与真正的交流,而不是仅仅关注语言形式,从而提高学生的学习效果。为了确定人工智能生成的反馈的可靠性,我们对学生的写作进行了分析。首先,通过 ChatGPT-3 创建了两个评分标准;然后,人工智能对论文进行评分,并将评分结果与使用相同评分标准的人工评分结果进行比较。研究得出结论,电子学习反馈无疑具有巨大的潜力;除了提供及时、个性化的学习支持外,人工智能反馈还能提高学生的学习积极性,培养学习自主性。不过,也存在一些值得注意的问题,这也不足为奇。研究发现,ChatGPT-3 在向学生提供反馈时容易出现错误和幻觉,尤其是在呈现较长文本时。为避免出现这种情况,必须精心设计评分标准,而且仍然需要教师的监督。这项研究将帮助教育工作者过渡到人工智能辅助电子学习的新时代,帮助他们就如何在合理的教学原则基础上提供有用的人工智能反馈做出明智的决定。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
ACS Applied Bio Materials
ACS Applied Bio Materials Chemistry-Chemistry (all)
CiteScore
9.40
自引率
2.10%
发文量
464
期刊介绍: ACS Applied Bio Materials is an interdisciplinary journal publishing original research covering all aspects of biomaterials and biointerfaces including and beyond the traditional biosensing, biomedical and therapeutic applications. The journal is devoted to reports of new and original experimental and theoretical research of an applied nature that integrates knowledge in the areas of materials, engineering, physics, bioscience, and chemistry into important bio applications. The journal is specifically interested in work that addresses the relationship between structure and function and assesses the stability and degradation of materials under relevant environmental and biological conditions.
期刊最新文献
Digitally Customized 3D PCL/β-TCP Scaffold for Precise Reconstruction of Alveolar Crest Defects. Sensitive On-Site Detection of Antibiotic Resistance Genes in Aquatic Products by aPCR-LFA Leveraging AuNPs for Amplification Specificity and Hybrid Probes for Structural Control. A Biodegradable, Self-Gelling Protease-Grafted Alginate Dressing for Efficient Control of Non-Compressible Hemorrhage. Biomimetic Metal-Organic Framework Decorated by Artificial Bacterium-Binding Protein and Apamin for Treatment of Acute Enteritis. Composite 3D-Printed Scaffold Based on Glucosamine-Loaded Hyaluronic Acid Methacrylate for Osteochondral Regeneration.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1