{"title":"应用语言学研究中具有教学意义的问题:混合方法系统评估","authors":"Matthew D. Coss , Hyun-Bin Hwang","doi":"10.1016/j.rmal.2023.100094","DOIUrl":null,"url":null,"abstract":"<div><p>Applied linguists often aim to conduct research with implications for practitioners (widely construed), but only recently has a research agenda emerged which empirically investigates whether this aim is being regularly met (see <span>Sato, 2023</span>). While multiple survey studies (e.g., <span>Marsden & Kasprowicz, 2017</span>; <span>Sato et al., 2021</span>) have made important contributions to this literature, no study has systematically examined <em>how</em> researchers offer implications to intended practitioner audiences. To explore this topic, we conducted a systematic analysis of 118 empirical studies published in <em>TESOL Quarterly</em>. We developed highly reliable scales (avg. IRR = 0.88) to assess the quantity, salience, and quality of pedagogical implications (PIs). Qualitative genre analysis further allowed us to synthesize the features of highly informative PIs. Based on these findings, we offer concrete recommendations for maximizing PI quality for researchers, editors, and reviewers.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 1","pages":"Article 100094"},"PeriodicalIF":0.0000,"publicationDate":"2024-01-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S277276612300054X/pdfft?md5=cd8b1dd29bb7786ece22e48fc1135a73&pid=1-s2.0-S277276612300054X-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Issues with pedagogical implications in applied linguistics research: A mixed-methods systematic evaluation\",\"authors\":\"Matthew D. Coss , Hyun-Bin Hwang\",\"doi\":\"10.1016/j.rmal.2023.100094\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Applied linguists often aim to conduct research with implications for practitioners (widely construed), but only recently has a research agenda emerged which empirically investigates whether this aim is being regularly met (see <span>Sato, 2023</span>). While multiple survey studies (e.g., <span>Marsden & Kasprowicz, 2017</span>; <span>Sato et al., 2021</span>) have made important contributions to this literature, no study has systematically examined <em>how</em> researchers offer implications to intended practitioner audiences. To explore this topic, we conducted a systematic analysis of 118 empirical studies published in <em>TESOL Quarterly</em>. We developed highly reliable scales (avg. IRR = 0.88) to assess the quantity, salience, and quality of pedagogical implications (PIs). Qualitative genre analysis further allowed us to synthesize the features of highly informative PIs. Based on these findings, we offer concrete recommendations for maximizing PI quality for researchers, editors, and reviewers.</p></div>\",\"PeriodicalId\":101075,\"journal\":{\"name\":\"Research Methods in Applied Linguistics\",\"volume\":\"3 1\",\"pages\":\"Article 100094\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-01-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S277276612300054X/pdfft?md5=cd8b1dd29bb7786ece22e48fc1135a73&pid=1-s2.0-S277276612300054X-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Research Methods in Applied Linguistics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S277276612300054X\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Research Methods in Applied Linguistics","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S277276612300054X","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
应用语言学家通常致力于开展对实践者有影响的研究(广泛理解),但直到最近才出现了一个研究议程,对这一目标是否定期得到实现进行实证调查(见 Sato, 2023)。虽然多项调查研究(如 Marsden & Kasprowicz, 2017; Sato et al.为了探讨这一主题,我们对发表在《TESOL 季刊》上的 118 篇实证研究进行了系统分析。我们开发了高度可靠的量表(平均 IRR = 0.88)来评估教学启示 (PI) 的数量、显著性和质量。通过定性体裁分析,我们进一步归纳出了信息量大的 PIs 的特征。基于这些发现,我们为研究人员、编辑和审稿人最大限度地提高 PI 质量提出了具体建议。
Issues with pedagogical implications in applied linguistics research: A mixed-methods systematic evaluation
Applied linguists often aim to conduct research with implications for practitioners (widely construed), but only recently has a research agenda emerged which empirically investigates whether this aim is being regularly met (see Sato, 2023). While multiple survey studies (e.g., Marsden & Kasprowicz, 2017; Sato et al., 2021) have made important contributions to this literature, no study has systematically examined how researchers offer implications to intended practitioner audiences. To explore this topic, we conducted a systematic analysis of 118 empirical studies published in TESOL Quarterly. We developed highly reliable scales (avg. IRR = 0.88) to assess the quantity, salience, and quality of pedagogical implications (PIs). Qualitative genre analysis further allowed us to synthesize the features of highly informative PIs. Based on these findings, we offer concrete recommendations for maximizing PI quality for researchers, editors, and reviewers.