The effectiveness of automated writing evaluation: a structural analysis approach

Abstract

Modern advancement in learning technologies and tools has presented innovative written corrective feedback (WCF) methods based on artificial intelligence (AI) and existing corpora. Research has shown that these tools are perceived as exciting and useful by students, yet studies on their effectiveness and impact on students’ writing are relatively insufficient. To this end, the present study investigated the effectiveness of Grammarly writing assistant as perceived by 98 undergraduates who used the tool for a 14-week semester. The study adopted a questionnaire based on a modified technology acceptance model (TAM). The gathered data was analyzed using SmartPLS 3 software. The results revealed that different factors predict students’ perceptions about Grammarly and their intention to use it. Some of these factors were not presupposed. The findings imply using Grammarly as an extra learning tool rather than a basic one. It is suggested that future research on the efficacy of Grammarly should adopt longitudinal and experimental approaches.