Using grammar checkers in the ESL classroom: the adequacy of automatic corrective feedback

Abstract

Our study assessed the performance of two Grammar Checkers (GCs), Grammarly and Virtual Writing Tutor, and the grammar checking function in Microsoft Word on a broad range of grammatical errors. The errors occurred in both authentic English as a Second Language (ESL) compositions and simple sentences we generated ourselves. We verified the performance in terms of (1) coverage (rates of error detection), (2) accuracy of proposed replacement forms, and (3) ‘false alarms’ (forms mistakenly flagged as incorrect). To the extent GCs provide accurate and comprehensive corrective feedback, they could relieve teachers of the time-consuming task of providing written feedback themselves. While inaccurate replacement forms and false alarms are relatively rare, we found GCs to have poor overall coverage (total error detection rates under 50%). Grammarly and Virtual Writing Tutor, however, outperform Microsoft Word. Coverage is also higher both for certain categories of error and for the sentences rather than the authentic compositions. Finally, although GCs do not provide comprehensive feedback, we suggest designing special activities that target select error types.