The Path in Behind and the Challenges in Front: A Methodological Synthesis of Iranian L2 Papers

Abstract

The present study is a methodological synthesis aiming to evaluate the adherence of Iranian L2 papers to the study quality standards. Ten Iranian journals were selected based on the latest ranking of Iran’s Ministry of Science, Research, and Technology (MSRT), and all experimental papers (N = 367) published from their beginnings were explored for study quality with regards to sampling, design, statistical tests, reporting practices and data sharing, and visual presentation. In the evaluation of the papers, the protocols proposed by Gass and Plonsky (2011) and Pagout and Plonsky (2017) were moderated and some recent issues proposed by APA’s (2018) Journal Article Reporting Standards and some scholars (e.g., Hu & Plonsky, 2019; Khany & Tazik, 2019; Larson-Hall, 2017) were added. The results showed that while there were issues, like acceptable sample size, use of pre-testing, reporting descriptive and inferential statistics, and ensuring the reliability of instruments, that were acceptably adhered to quality standards, problematic areas existed in all five facets of quality, and the majority of them stayed constant or changed slightly over time. The shortcomings caused by such lack of adherence are discussed to identify the challenges in the way of improving the papers’ quality. Although the results are obtained from a specific context, the implications may be generalizable to other contexts where English is taught and researched as a foreign language.