{"title":"三位青年学者的声音——评“(为什么)开放研究实践是语言学习研究的未来?”","authors":"Bronson Hui, he/him, Joanne Koh, she/her, Sanshiroh Ogawa, he/him","doi":"10.1111/lang.12571","DOIUrl":null,"url":null,"abstract":"<p>Open research can (soon) become the norm in language sciences. Major funders and journals have begun to encourage or require more open and transparent research practices, from making materials and data available to disseminating results. Marsden and Morgan-Short closed their review article by suggesting that open research practices are the future. As junior researchers (an early-career scholar and two graduate students), we, too, are sometimes referred to as the future of the field. For some of us as junior researchers, there are no nonopen research practices to abandon because we have already been encouraged to carry out research in an open and transparent manner thanks to our mentors who have wholeheartedly supported open scholarship. Thus, junior scholars going through research training during the open research movement can provide insights and drive important changes in the field. We begin this commentary by illustrating how junior scholars can benefit from open research practices as an integral part of research training. We then discuss what junior scholars can offer. We conclude by extending Marsden and Morgan-Short's call for an incentive structure that will move the field toward openness and transparency.</p><p>Junior scholars can learn about and take advantage of various open research practices, including those identified by Marsden and Morgan-Short, as part of their research training. For example, new data analysis techniques and methods are uncovered when analytical code is shared. Furthermore, preregistration obliges researchers to lay out methodological details, including the more practical aspects of data collection, processing, and analysis. Perhaps the most important advantage for junior scholars practicing open scholarship comes through their being pushed to critically examine various aspects of a study more thoroughly than they would normally do. For example, when considering a replication attempt, researchers should decide which variable changes might have the greatest theoretical implications. They must also assess the extent to which the methodology of the initial study is appropriate for new study participants and provide evaluations of the validity and reliability of the instrument(s). These opportunities extended by open research practices can allow junior researchers to sharpen their critical thinking and analytical skills that are indispensable for an academic career.</p><p>Time is the first challenge to open research that Marsden and Morgan-Short discussed. As junior researchers call for more training in open research practices (Zečević et al., <span>2021</span>), we argue that strong mentorship practices, including hands-on experience provided by established researchers, are warranted. In no way are we arguing that senior researchers should exploit their junior colleagues to perform tedious tasks. On the contrary, mutually beneficial relationships between more and less experienced researchers can facilitate crucial knowledge transfer and development of ideas. In some cases, junior scholars might possess the critical open research skills (e.g., coding) that will facilitate certain laborious tasks in efficient and reproducible ways. We stress that established researchers must shoulder the responsibilities of not letting this labor be invisible (e.g., Pownall et al., <span>2021</span>). Potential co-authorship, along with accurate and detailed description of junior scholars’ contributions (e.g., CRediT statement), should be discussed when they are significant enough. These discussions would also be a powerful motivator for junior researchers’ participation in the research (Kathawalla et al., <span>2021</span>).</p><p>In addition, junior researchers are valuable assets in the open scholarship movement. Many not only support open research but feel enthusiastic about it (e.g., Pownall et al., <span>2021</span>). This is critically important because mentorship is a two-way street. Although many discussions have focused on how advisors shape the research practices of their students, we argue that students and early-career researchers can also influence their advisors and mentors. For example, advisors are often listed as secondary authors in a student's publication. When that is the case, the student may take the lead in practicing open scholarship by, for example, sharing their materials, data, and analysis code or by choosing to publish the research in a journal that supports such practices. In fact, such a process can create significant learning opportunities for both senior and junior researchers.</p><p>Notwithstanding the positive role that junior scholars can play, we need support. We need an incentive structure that provides a safe space for us to practice open scholarship. However, junior scholars are not in a position to create such an incentive structure ourselves, at least not directly. Faculty research positions provide an example. The ability to carry out original research is often listed as a desired qualification for a position. In the United States, for instance, graduate students may have only one or two publications when entering the job market. If their publications include replication studies, these students’ support for open research practices might put them at a disadvantage because replications might not be considered as original research. For promotion, too, open scholarship is seldom included as a criterion. This is where junior scholars need support from professional bodies such as the American Association for Applied Linguistics, the British Association for Applied Linguistics, the European Second Language Association, and others. If leaders in the field provide clearer promotion guidelines for open scholarship, junior scholars would be in a better position to practice open research without reluctance. With such efforts, professional bodies could establish systematic guidelines that, for example, specify what research is worth replicating that is independent of the research outcome (Romero, <span>2018</span>). Changing the incentive structure should also be supported by research funders. As securing funding is sometimes considered a promotion criterion, allocating funding to open science projects can further encourage junior scholars to engage in open research. Finally, faculty members will more likely use open scholarship in their research when academic publishing requires it.</p><p>We began this commentary by suggesting that open scholarship can soon become the norm. We believe that many of our peers share our excitement about and support for open practices. As junior scholars, we have undoubtedly benefited from the work of other researchers practicing open scholarship, and we hope to continue this move toward openness and transparency. However, there are issues that junior researchers are also not in a position to address. Therefore, we call for an incentive structure that can protect and expand open scholarship, including for early-career scholars and graduate students.</p>","PeriodicalId":51371,"journal":{"name":"Language Learning","volume":"73 S2","pages":"414-417"},"PeriodicalIF":3.5000,"publicationDate":"2023-04-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/lang.12571","citationCount":"1","resultStr":"{\"title\":\"Voices of Three Junior Scholars: A Commentary on “(Why) Are Open Research Practices the Future for the Study of Language Learning?”\",\"authors\":\"Bronson Hui, he/him, Joanne Koh, she/her, Sanshiroh Ogawa, he/him\",\"doi\":\"10.1111/lang.12571\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Open research can (soon) become the norm in language sciences. Major funders and journals have begun to encourage or require more open and transparent research practices, from making materials and data available to disseminating results. Marsden and Morgan-Short closed their review article by suggesting that open research practices are the future. As junior researchers (an early-career scholar and two graduate students), we, too, are sometimes referred to as the future of the field. For some of us as junior researchers, there are no nonopen research practices to abandon because we have already been encouraged to carry out research in an open and transparent manner thanks to our mentors who have wholeheartedly supported open scholarship. Thus, junior scholars going through research training during the open research movement can provide insights and drive important changes in the field. We begin this commentary by illustrating how junior scholars can benefit from open research practices as an integral part of research training. We then discuss what junior scholars can offer. We conclude by extending Marsden and Morgan-Short's call for an incentive structure that will move the field toward openness and transparency.</p><p>Junior scholars can learn about and take advantage of various open research practices, including those identified by Marsden and Morgan-Short, as part of their research training. For example, new data analysis techniques and methods are uncovered when analytical code is shared. Furthermore, preregistration obliges researchers to lay out methodological details, including the more practical aspects of data collection, processing, and analysis. Perhaps the most important advantage for junior scholars practicing open scholarship comes through their being pushed to critically examine various aspects of a study more thoroughly than they would normally do. For example, when considering a replication attempt, researchers should decide which variable changes might have the greatest theoretical implications. They must also assess the extent to which the methodology of the initial study is appropriate for new study participants and provide evaluations of the validity and reliability of the instrument(s). These opportunities extended by open research practices can allow junior researchers to sharpen their critical thinking and analytical skills that are indispensable for an academic career.</p><p>Time is the first challenge to open research that Marsden and Morgan-Short discussed. As junior researchers call for more training in open research practices (Zečević et al., <span>2021</span>), we argue that strong mentorship practices, including hands-on experience provided by established researchers, are warranted. In no way are we arguing that senior researchers should exploit their junior colleagues to perform tedious tasks. On the contrary, mutually beneficial relationships between more and less experienced researchers can facilitate crucial knowledge transfer and development of ideas. In some cases, junior scholars might possess the critical open research skills (e.g., coding) that will facilitate certain laborious tasks in efficient and reproducible ways. We stress that established researchers must shoulder the responsibilities of not letting this labor be invisible (e.g., Pownall et al., <span>2021</span>). Potential co-authorship, along with accurate and detailed description of junior scholars’ contributions (e.g., CRediT statement), should be discussed when they are significant enough. These discussions would also be a powerful motivator for junior researchers’ participation in the research (Kathawalla et al., <span>2021</span>).</p><p>In addition, junior researchers are valuable assets in the open scholarship movement. Many not only support open research but feel enthusiastic about it (e.g., Pownall et al., <span>2021</span>). This is critically important because mentorship is a two-way street. Although many discussions have focused on how advisors shape the research practices of their students, we argue that students and early-career researchers can also influence their advisors and mentors. For example, advisors are often listed as secondary authors in a student's publication. When that is the case, the student may take the lead in practicing open scholarship by, for example, sharing their materials, data, and analysis code or by choosing to publish the research in a journal that supports such practices. In fact, such a process can create significant learning opportunities for both senior and junior researchers.</p><p>Notwithstanding the positive role that junior scholars can play, we need support. We need an incentive structure that provides a safe space for us to practice open scholarship. However, junior scholars are not in a position to create such an incentive structure ourselves, at least not directly. Faculty research positions provide an example. The ability to carry out original research is often listed as a desired qualification for a position. In the United States, for instance, graduate students may have only one or two publications when entering the job market. If their publications include replication studies, these students’ support for open research practices might put them at a disadvantage because replications might not be considered as original research. For promotion, too, open scholarship is seldom included as a criterion. This is where junior scholars need support from professional bodies such as the American Association for Applied Linguistics, the British Association for Applied Linguistics, the European Second Language Association, and others. If leaders in the field provide clearer promotion guidelines for open scholarship, junior scholars would be in a better position to practice open research without reluctance. With such efforts, professional bodies could establish systematic guidelines that, for example, specify what research is worth replicating that is independent of the research outcome (Romero, <span>2018</span>). Changing the incentive structure should also be supported by research funders. As securing funding is sometimes considered a promotion criterion, allocating funding to open science projects can further encourage junior scholars to engage in open research. Finally, faculty members will more likely use open scholarship in their research when academic publishing requires it.</p><p>We began this commentary by suggesting that open scholarship can soon become the norm. We believe that many of our peers share our excitement about and support for open practices. As junior scholars, we have undoubtedly benefited from the work of other researchers practicing open scholarship, and we hope to continue this move toward openness and transparency. However, there are issues that junior researchers are also not in a position to address. Therefore, we call for an incentive structure that can protect and expand open scholarship, including for early-career scholars and graduate students.</p>\",\"PeriodicalId\":51371,\"journal\":{\"name\":\"Language Learning\",\"volume\":\"73 S2\",\"pages\":\"414-417\"},\"PeriodicalIF\":3.5000,\"publicationDate\":\"2023-04-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1111/lang.12571\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Language Learning\",\"FirstCategoryId\":\"98\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1111/lang.12571\",\"RegionNum\":1,\"RegionCategory\":\"文学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"EDUCATION & EDUCATIONAL RESEARCH\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Language Learning","FirstCategoryId":"98","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/lang.12571","RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 1
摘要
开放研究可以(很快)成为语言科学的规范。主要资助者和期刊已经开始鼓励或要求更加开放和透明的研究实践,从提供材料和数据到传播结果。马斯登和摩根-肖特在他们的评论文章的结尾处提出,开放的研究实践是未来的趋势。作为初级研究人员(一名早期职业学者和两名研究生),我们有时也被称为该领域的未来。对于我们这些初级研究人员来说,没有什么非开放的研究实践可以放弃,因为我们已经被鼓励以开放和透明的方式进行研究,这要感谢我们全心全意支持开放奖学金的导师。因此,在开放研究运动中接受研究训练的青年学者可以提供见解并推动该领域的重要变革。我们首先说明,作为研究训练的一个组成部分,初级学者如何从开放的研究实践中受益。然后我们讨论初级学者能提供什么。最后,我们扩展了马斯登和摩根-肖特对激励结构的呼吁,该结构将推动该领域走向开放和透明。初级学者可以学习和利用各种开放研究实践,包括马斯登和摩根-肖特所确定的实践,作为他们研究培训的一部分。例如,当分析代码被共享时,新的数据分析技术和方法就会被发现。此外,预注册要求研究人员列出方法上的细节,包括数据收集、处理和分析等更实际的方面。也许,对于实行开放学术的初级学者来说,最重要的优势在于,他们被要求比平时更彻底地批判性地审视一项研究的各个方面。例如,当考虑复制尝试时,研究人员应该决定哪些变量变化可能具有最大的理论含义。他们还必须评估初始研究的方法在多大程度上适合新的研究参与者,并对工具的有效性和可靠性进行评估。这些开放研究实践所带来的机会可以让初级研究人员提高他们的批判性思维和分析能力,这是学术生涯中不可或缺的。时间是马斯登和摩根-肖特讨论的开放研究面临的第一个挑战。由于初级研究人员呼吁在开放的研究实践中进行更多的培训(ze<e:1> eviki等人,2021),我们认为有必要进行强有力的指导实践,包括由成熟的研究人员提供的实践经验。我们绝不主张高级研究人员应该利用他们的初级同事来完成乏味的任务。相反,经验丰富和经验不足的研究人员之间的互利关系可以促进关键知识的转移和思想的发展。在某些情况下,初级学者可能拥有关键的开放式研究技能(例如,编码),这将以有效和可重复的方式促进某些繁重的任务。我们强调,成熟的研究人员必须承担起不让这种劳动被忽视的责任(例如,Pownall等人,2021)。潜在的共同作者,以及对年轻学者贡献的准确和详细的描述(例如,信用声明),应该在他们足够重要时进行讨论。这些讨论也将成为初级研究人员参与研究的有力动力(Kathawalla et al., 2021)。此外,初级研究人员是开放奖学金运动的宝贵资产。许多人不仅支持开放研究,而且对其充满热情(例如,Pownall et al., 2021)。这一点非常重要,因为师徒关系是双向的。尽管许多讨论都集中在导师如何影响学生的研究实践上,但我们认为,学生和早期职业研究人员也可以影响他们的导师和导师。例如,在学生的论文中,顾问通常被列为第二作者。在这种情况下,学生可以带头实践开放奖学金,例如,通过分享他们的材料、数据和分析代码,或者通过选择在支持此类实践的期刊上发表研究。事实上,这样一个过程可以为高级和初级研究人员创造重要的学习机会。尽管青年学者可以发挥积极作用,但我们需要支持。我们需要一个激励机制,为我们提供一个安全的空间来实践开放的学术。然而,年轻的学者并没有能力自己创造这样的激励结构,至少不能直接创造。教师研究职位就是一个例子。进行原创性研究的能力通常被列为一个职位的必备条件。 例如,在美国,研究生在进入就业市场时可能只有一两篇出版物。如果他们的出版物包括复制研究,这些学生对开放研究实践的支持可能会使他们处于不利地位,因为复制可能不被视为原创研究。在晋升方面,公开奖学金也很少作为一个标准。在这方面,初级学者需要专业团体的支持,如美国应用语言学协会、英国应用语言学协会、欧洲第二语言协会等。如果该领域的领导者为开放奖学金提供更清晰的晋升指南,那么初级学者将更有可能毫无顾忌地实践开放研究。通过这样的努力,专业机构可以建立系统的指导方针,例如,指定哪些研究值得复制,而不依赖于研究结果(Romero, 2018)。改变激励结构也应该得到研究资助者的支持。由于获得资助有时被认为是一种晋升标准,为开放科学项目分配资金可以进一步鼓励年轻学者从事开放研究。最后,当学术出版需要时,教职员工将更有可能在他们的研究中使用开放式奖学金。我们在开始这篇评论时暗示,开放学术很快就会成为常态。我们相信许多同行和我们一样对开放实践感到兴奋和支持。作为初级学者,我们无疑受益于其他研究人员实践开放学术的工作,我们希望继续朝着开放和透明的方向发展。然而,也有一些问题是初级研究人员无法解决的。因此,我们呼吁建立一种激励机制,以保护和扩大开放奖学金,包括对早期职业学者和研究生。
Voices of Three Junior Scholars: A Commentary on “(Why) Are Open Research Practices the Future for the Study of Language Learning?”
Open research can (soon) become the norm in language sciences. Major funders and journals have begun to encourage or require more open and transparent research practices, from making materials and data available to disseminating results. Marsden and Morgan-Short closed their review article by suggesting that open research practices are the future. As junior researchers (an early-career scholar and two graduate students), we, too, are sometimes referred to as the future of the field. For some of us as junior researchers, there are no nonopen research practices to abandon because we have already been encouraged to carry out research in an open and transparent manner thanks to our mentors who have wholeheartedly supported open scholarship. Thus, junior scholars going through research training during the open research movement can provide insights and drive important changes in the field. We begin this commentary by illustrating how junior scholars can benefit from open research practices as an integral part of research training. We then discuss what junior scholars can offer. We conclude by extending Marsden and Morgan-Short's call for an incentive structure that will move the field toward openness and transparency.
Junior scholars can learn about and take advantage of various open research practices, including those identified by Marsden and Morgan-Short, as part of their research training. For example, new data analysis techniques and methods are uncovered when analytical code is shared. Furthermore, preregistration obliges researchers to lay out methodological details, including the more practical aspects of data collection, processing, and analysis. Perhaps the most important advantage for junior scholars practicing open scholarship comes through their being pushed to critically examine various aspects of a study more thoroughly than they would normally do. For example, when considering a replication attempt, researchers should decide which variable changes might have the greatest theoretical implications. They must also assess the extent to which the methodology of the initial study is appropriate for new study participants and provide evaluations of the validity and reliability of the instrument(s). These opportunities extended by open research practices can allow junior researchers to sharpen their critical thinking and analytical skills that are indispensable for an academic career.
Time is the first challenge to open research that Marsden and Morgan-Short discussed. As junior researchers call for more training in open research practices (Zečević et al., 2021), we argue that strong mentorship practices, including hands-on experience provided by established researchers, are warranted. In no way are we arguing that senior researchers should exploit their junior colleagues to perform tedious tasks. On the contrary, mutually beneficial relationships between more and less experienced researchers can facilitate crucial knowledge transfer and development of ideas. In some cases, junior scholars might possess the critical open research skills (e.g., coding) that will facilitate certain laborious tasks in efficient and reproducible ways. We stress that established researchers must shoulder the responsibilities of not letting this labor be invisible (e.g., Pownall et al., 2021). Potential co-authorship, along with accurate and detailed description of junior scholars’ contributions (e.g., CRediT statement), should be discussed when they are significant enough. These discussions would also be a powerful motivator for junior researchers’ participation in the research (Kathawalla et al., 2021).
In addition, junior researchers are valuable assets in the open scholarship movement. Many not only support open research but feel enthusiastic about it (e.g., Pownall et al., 2021). This is critically important because mentorship is a two-way street. Although many discussions have focused on how advisors shape the research practices of their students, we argue that students and early-career researchers can also influence their advisors and mentors. For example, advisors are often listed as secondary authors in a student's publication. When that is the case, the student may take the lead in practicing open scholarship by, for example, sharing their materials, data, and analysis code or by choosing to publish the research in a journal that supports such practices. In fact, such a process can create significant learning opportunities for both senior and junior researchers.
Notwithstanding the positive role that junior scholars can play, we need support. We need an incentive structure that provides a safe space for us to practice open scholarship. However, junior scholars are not in a position to create such an incentive structure ourselves, at least not directly. Faculty research positions provide an example. The ability to carry out original research is often listed as a desired qualification for a position. In the United States, for instance, graduate students may have only one or two publications when entering the job market. If their publications include replication studies, these students’ support for open research practices might put them at a disadvantage because replications might not be considered as original research. For promotion, too, open scholarship is seldom included as a criterion. This is where junior scholars need support from professional bodies such as the American Association for Applied Linguistics, the British Association for Applied Linguistics, the European Second Language Association, and others. If leaders in the field provide clearer promotion guidelines for open scholarship, junior scholars would be in a better position to practice open research without reluctance. With such efforts, professional bodies could establish systematic guidelines that, for example, specify what research is worth replicating that is independent of the research outcome (Romero, 2018). Changing the incentive structure should also be supported by research funders. As securing funding is sometimes considered a promotion criterion, allocating funding to open science projects can further encourage junior scholars to engage in open research. Finally, faculty members will more likely use open scholarship in their research when academic publishing requires it.
We began this commentary by suggesting that open scholarship can soon become the norm. We believe that many of our peers share our excitement about and support for open practices. As junior scholars, we have undoubtedly benefited from the work of other researchers practicing open scholarship, and we hope to continue this move toward openness and transparency. However, there are issues that junior researchers are also not in a position to address. Therefore, we call for an incentive structure that can protect and expand open scholarship, including for early-career scholars and graduate students.
期刊介绍:
Language Learning is a scientific journal dedicated to the understanding of language learning broadly defined. It publishes research articles that systematically apply methods of inquiry from disciplines including psychology, linguistics, cognitive science, educational inquiry, neuroscience, ethnography, sociolinguistics, sociology, and anthropology. It is concerned with fundamental theoretical issues in language learning such as child, second, and foreign language acquisition, language education, bilingualism, literacy, language representation in mind and brain, culture, cognition, pragmatics, and intergroup relations. A subscription includes one or two annual supplements, alternating among a volume from the Language Learning Cognitive Neuroscience Series, the Currents in Language Learning Series or the Language Learning Special Issue Series.