Language Models in Automated Essay Scoring: Insights for the Turkish Language

IF 0.8 Q3 EDUCATION & EDUCATIONAL RESEARCH International Journal of Assessment Tools in Education Pub Date : 2023-12-17 DOI:10.21449/ijate.1394194
Tahereh Firoozi, Okan Bulut, Mark J. Gierl
{"title":"Language Models in Automated Essay Scoring: Insights for the Turkish Language","authors":"Tahereh Firoozi, Okan Bulut, Mark J. Gierl","doi":"10.21449/ijate.1394194","DOIUrl":null,"url":null,"abstract":"The proliferation of large language models represents a paradigm shift in the landscape of automated essay scoring (AES) systems, fundamentally elevating their accuracy and efficacy. This study presents an extensive examination of large language models, with a particular emphasis on the transformative influence of transformer-based models, such as BERT, mBERT, LaBSE, and GPT, in augmenting the accuracy of multilingual AES systems. The exploration of these advancements within the context of the Turkish language serves as a compelling illustration of the potential for harnessing large language models to elevate AES performance in in low-resource linguistic environments. Our study provides valuable insights for the ongoing discourse on the intersection of artificial intelligence and educational assessment.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":"2 6","pages":""},"PeriodicalIF":0.8000,"publicationDate":"2023-12-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Assessment Tools in Education","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.21449/ijate.1394194","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0

Abstract

The proliferation of large language models represents a paradigm shift in the landscape of automated essay scoring (AES) systems, fundamentally elevating their accuracy and efficacy. This study presents an extensive examination of large language models, with a particular emphasis on the transformative influence of transformer-based models, such as BERT, mBERT, LaBSE, and GPT, in augmenting the accuracy of multilingual AES systems. The exploration of these advancements within the context of the Turkish language serves as a compelling illustration of the potential for harnessing large language models to elevate AES performance in in low-resource linguistic environments. Our study provides valuable insights for the ongoing discourse on the intersection of artificial intelligence and educational assessment.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
自动作文评分中的语言模型:对土耳其语的启示
大型语言模型的普及代表了自动作文评分(AES)系统的范式转变,从根本上提高了其准确性和有效性。本研究对大型语言模型进行了广泛的研究,特别强调了基于转换器的模型(如 BERT、mBERT、LaBSE 和 GPT)在提高多语言 AES 系统准确性方面的变革性影响。在土耳其语背景下对这些进步的探索,有力地说明了在低资源语言环境中利用大型语言模型提升 AES 性能的潜力。我们的研究为正在进行的人工智能与教育评估交叉领域的讨论提供了宝贵的见解。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
International Journal of Assessment Tools in Education
International Journal of Assessment Tools in Education EDUCATION & EDUCATIONAL RESEARCH-
自引率
11.10%
发文量
40
期刊最新文献
The complexity of the grading system in Turkish higher education Global competence scale: An adaptation to measure pre-service English teachers’ global competences Language Models in Automated Essay Scoring: Insights for the Turkish Language Type I error and power rates: A comparative analysis of techniques in differential item functioning A data pipeline for e-large-scale assessments: Better automation, quality assurance, and efficiency
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1