{"title":"Errors in Errors","authors":"Joshua Kloppers","doi":"10.4018/ijcallt.325792","DOIUrl":null,"url":null,"abstract":"Automated writing evaluation (AWE) software is an increasingly popular tool for English second language learners. However, research on the accuracy of such software has been both scarce and largely limited in its scope. As such, this article broadens the field of research on AWE accuracy by using a mixed design to holistically evaluate the accuracy of the corrective feedback of the leading AWE program Grammarly. 1136 Grammarly-identified errors related to style, lexis, and form were graded and discussed by two native English speakers. An overall accuracy rate of 78.86% and an accuracy rate of 91.60% when excluding style-related errors were found. However, several issues relating to the promotion of a set writing style, variance in feedback quality, and accuracy of style-related corrective feedback were also identified.","PeriodicalId":43610,"journal":{"name":"International Journal of Computer-Assisted Language Learning and Teaching","volume":null,"pages":null},"PeriodicalIF":0.7000,"publicationDate":"2023-07-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Computer-Assisted Language Learning and Teaching","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.4018/ijcallt.325792","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0
Abstract
Automated writing evaluation (AWE) software is an increasingly popular tool for English second language learners. However, research on the accuracy of such software has been both scarce and largely limited in its scope. As such, this article broadens the field of research on AWE accuracy by using a mixed design to holistically evaluate the accuracy of the corrective feedback of the leading AWE program Grammarly. 1136 Grammarly-identified errors related to style, lexis, and form were graded and discussed by two native English speakers. An overall accuracy rate of 78.86% and an accuracy rate of 91.60% when excluding style-related errors were found. However, several issues relating to the promotion of a set writing style, variance in feedback quality, and accuracy of style-related corrective feedback were also identified.
期刊介绍:
The mission of the International Journal of Computer-Assisted Language Learning and Teaching (IJCALLT) is to publish research, theory, and conceptually-based papers that address the use and impact of and innovations in education technologies in advancing foreign/second language learning and teaching. This journal expands on the principles, theories, designs, discussion, and implementations of computer-assisted language learning. In addition to original research papers and submissions on theory and concept development and systematic reports of practice, this journal welcomes theory-based CALL-related book and software/application reviews.