‘When most I wink, then’ – what? Assessing the comprehension of literary texts in university students of English as a second language

Abstract

This article introduces a test for literary text comprehension in university students of English as a second language. Poetry is especially suited for our purpose since it frequently shows features that offer challenges to comprehension in a limited space. An example is Shakespeare’s Sonnet 43, on which our test is based: it is suited for assessing not only if a text has been understood but also the ability of respondents to reflect on their own comprehension skills. We show that the test’s psychometric properties are satisfactory, and we demonstrate its validity by analysing relevant external indicators. Thus, we can show a direct link between general reading experience and text comprehension as tested: the more students read, the better do they perform. The collaboration of literary studies with psychometrics moreover allows for a statistically valid identification of specific challenges to comprehension and thus advance our knowledge of what readers find difficult. This will be of interest not only in a hermeneutic and linguistic perspective but also with a view to addressing those difficulties in an educational context. For example, asking someone whether they have understood an utterance (in this case: a line of poetry) does not elicit reliable answers. Being able to say how one has established the meaning of a line seems to be a more reliable indicator of actually having understood it.