首页 > 最新文献

Learned Publishing最新文献

英文 中文
Review Articles, Generative AI and the Remaking of Scholarly Infrastructure 综述文章,生成人工智能和学术基础设施的重塑
IF 2.4 3区 管理学 Q2 INFORMATION SCIENCE & LIBRARY SCIENCE Pub Date : 2026-02-05 DOI: 10.1002/leap.2045
Serhii Nazarovets, Yana Suchikova
<p>In late 2024, arXiv decisively revised its moderation policy for computer science submissions. Review papers, once a routine part of the repository's content, became subject to stricter screening following a noticeable surge of low-quality, AI-generated manuscripts (Castelvecchi <span>2025</span>). The rationale was not framed as a rejection of genAI per se, but as a response to a growing infrastructural problem: certain categories of submissions were no longer serving their intended signalling function within the platform.</p><p>Importantly, arXiv did not ban review articles outright, nor did it question their intellectual legitimacy. Instead, it drew a boundary around formats that increasingly resembled generic summaries: textually plausible, syntactically correct, but lacking interpretive depth. In practice, such submissions strained moderation capacity and weakened trust in the repository as a filter for meaningful scientific communication.</p><p>This intervention reflects a broader transformation driven by genAI. Large language models (LLMs) can now produce convincing literature overviews at scale, rapidly and at minimal cost. At the same time, tools supporting ranking, filtering and synthesising research outputs, such as multi-criteria review pipelines and semiautomated workflows, are becoming increasingly sophisticated (Wagner et al. <span>2022</span>; Leite Junior et al. <span>2025</span>). In parallel, the tempo of scholarly communication is accelerating. Early-access articles are read, cited and circulated before formal publication, reshaping how visibility and priority are established, particularly in AI-related fields (Xu et al. <span>2025</span>).</p><p>These shifts place review articles in a uniquely exposed position. Historically, reviews have combined synthesis with interpretation, helping research communities stabilise concepts, identify gaps and set agendas. Recent empirical studies confirm that the most valued review articles are not exhaustive summaries, but reflexive contributions that position a field and articulate future directions (Krlev et al. <span>2025</span>; Block et al. <span>2025</span>). Yet it is precisely descriptive, template-driven review formats that are easiest for genAI to imitate, and therefore most likely to proliferate at scale.</p><p>The infrastructural implications of this asymmetry are already visible. Alongside arXiv's restrictive response, other platforms are experimenting with the opposite strategy. In 2025, <i>Science</i> reported on the launch of a preprint server that explicitly welcomes papers written and reviewed by AI, relying on automated evaluation rather than community-based judgment (Zhao <span>2025</span>). These developments do not indicate confusion, but divergence: different infrastructures are testing contrasting assumptions about authorship, review and quality control in an AI-mediated environment.</p><p>From this perspective, arXiv's policy change is best understood not as a ver
在2024年末,arXiv果断地修改了其计算机科学提交的审核政策。评论论文曾经是知识库内容的常规组成部分,但在人工智能生成的低质量手稿明显激增之后,它们受到了更严格的筛选(Castelvecchi 2025)。其理由不是拒绝genAI本身,而是对日益严重的基础设施问题的回应:某些类别的提交内容不再在平台内发挥其预期的信号功能。重要的是,arXiv没有直接禁止评论文章,也没有质疑它们的知识合法性。相反,它为越来越像通用摘要的格式划定了界限:文本合理,语法正确,但缺乏解释深度。实际上,这样的提交使审核能力紧张,并削弱了对知识库作为有意义的科学交流过滤器的信任。这种干预反映了基因人工智能推动的更广泛的变革。大型语言模型(llm)现在可以大规模地、快速地、以最小的成本生成令人信服的文献概述。与此同时,支持排序、过滤和综合研究成果的工具,如多标准审查管道和半自动化工作流程,正变得越来越复杂(Wagner et al. 2022; Leite Junior et al. 2025)。与此同时,学术交流的节奏也在加快。早期获取文章在正式发表之前被阅读、引用和传播,重塑了能见度和优先级的建立方式,特别是在人工智能相关领域(Xu et al. 2025)。这些变化将评论文章置于一个独特的暴露位置。从历史上看,综述将综合与解释结合起来,帮助科研团体稳定概念、确定差距和制定议程。最近的实证研究证实,最有价值的综述文章不是详尽的总结,而是定位一个领域并阐明未来方向的反思性贡献(Krlev et al. 2025; Block et al. 2025)。然而,它恰恰是描述性的、模板驱动的审查格式,最容易被genAI模仿,因此最有可能在规模上扩散。这种不对称对基础设施的影响已经显而易见。除了arXiv的限制性回应,其他平台也在尝试相反的策略。2025年,《科学》杂志报道了一个预印本服务器的推出,该服务器明确欢迎人工智能撰写和评审的论文,依靠自动评估而不是基于社区的判断(Zhao 2025)。这些发展并不表明混乱,而是分歧:在人工智能介导的环境中,不同的基础设施正在测试关于作者身份、审查和质量控制的不同假设。从这个角度来看,arXiv的政策变化最好不要被理解为对评论文章的裁决,而是作为一个基础设施的信号。它反映了一种日益增长的认识,即评审不仅仅是内容单元,而是知识基础结构的组成部分。当它们的信号功能减弱时,因为描述性格式可以大量生产,平台必须进行干预。正如Ngwenyama和Rowe(2024)所认为的那样,与人工智能的合作重塑了认知价值,使综合和判断之间的区别扁平化,除非这些区别受到制度设计的积极保护。本文以arXiv的决定为起点,研究genAI揭示了今天的评论文章。我们认为genAI并没有使评论过时。相反,它公开了哪些审查格式继续执行基础结构工作,哪些不再执行。评论文章不会因为失去了知识价值而变得脆弱。它们之所以变得脆弱,是因为它们运作的条件比它们的形式变化得更快。这里汇集了三大发展:规模化、标准化和自动化。首先,学术产出的规模已经超出了传统评审实践所能处理的范围。几十年来,科学出版在数量和学科广度上不断扩大(Mack 2015; Jinha 2010)。回顾在历史上作为对信息过载的回应而出现,帮助研究人员浏览日益复杂的文献(Abt 2018; Ghasemi et al. 2022)。然而,今天,出版物、预印本和早期获取文章的增长已经将文学从有限的语料库转变为连续的流。在人工智能等快速发展的领域,早期获取文章在期刊定稿之前就被阅读、引用和传播,重塑了优先级和相关性的建立方式(Xu et al. 2025)。相比之下,审查在结构上仍然缓慢。即使在方法论上很严谨的情况下,它们也往往是在关键辩论已经发生变化之后才出现的。第二,审查格式日益标准化。 在过去的二十年中,系统和结构化的审查方法保证了透明度、可重复性和方法控制,特别是在健康科学和应用研究中(Altman 2001; White and Schmidt 2005; Pati and Lorusso 2017; Riley et al. 2019)。有影响力的指南和类型学进一步将评论写作编纂为可识别的模板和程序步骤(Lame 2019; Snyder 2019; Paul and Criado 2020; Palmatier et al. 2018)。虽然这些发展提高了一致性,但它们也缩小了解释的差异。现在的实证分析表明,许多评论主要是“盘点”,而不是重新定位一个领域或阐明新的方向(Krlev et al. 2025; Block et al. 2025)。一旦审查被简化为筛选、排序和总结步骤,其信息结构就会密切反映自动化系统所要执行的任务。第三,基因人工智能正是利用了这种融合。早在大型语言模型兴起之前,文献筛选和合成的自动化就已经讨论了多年(Seringhaus and Gerstein 2007; van Dinter et al. 2021)。最近的进展极大地加速了这些过程。现代工具现在可以筛选大型语料库,使用多种标准对论文进行排名,并在最少的人为干预下生成流畅的叙述摘要(Wagner等人,2022;de la Torre-López等人,2023;Leite Junior等人,2025)。比较研究表明,人工智能生成的评论可以显得连贯和全面,同时在解释、语境化和概念深度方面挣扎(Jenko et al. 2024; Mostafapour et al. 2024)。最近的商业和管理研究类似地将人工智能不是作为学术判断的替代品,而是作为重新设计审查工作流程的催化剂,对编辑角色和审查格式有影响(Tomczyk et al. 2024)。从基础结构的角度来看,问题不在于这些工具的存在,而在于它们模糊了作为判断的评审和作为聚合的评审之间的界限。当描述性评论变得便宜且丰富时,它们的信号价值就会减弱。对数字弹性的研究强调了这种情况如何造成系统脆弱性:当合成内容的扩散速度超过机构调整过滤器的速度时,信任就会受到侵蚀,信号也会失去意义(Große和Sundberg, 2025)。最近人工智能辅助审查的综合明确地将这种紧张关系描述为效率和认知深度之间的权衡,并指出自动化在检索和总结方面表现出色,但在上下文解释和理论构建方面仍然薄弱(Bolaños et al. 2024)。重要的是,并非所有评论都受到同样的影响。长期以来,引文研究表明,综述文章的影响力和功能差异很大(Aksnes 2003; Miranda and Garcia-Carpintero 2018)。最近的实证研究证实,那些解释、理论化和设定议程的反思性评论,具有很高的价值和可见性(Krlev et al. 2025; Block et al. 2025)。被掏空的是主要功能是总结的描述性格式和现状格式。换句话说,脆弱性是不平衡的。评论文章已经成为一个压力点,因为它们处于规模、自动化和信任的交叉点。长期以来,评论文章在学术交流中起着基础性的作用。从科学期刊的早期历史到当代出版系统,评论有助于组织扩展的知识体系,稳定术语和定向研究社区(Ghasemi et al. 2022; Hosur et al. 2025;
{"title":"Review Articles, Generative AI and the Remaking of Scholarly Infrastructure","authors":"Serhii Nazarovets,&nbsp;Yana Suchikova","doi":"10.1002/leap.2045","DOIUrl":"https://doi.org/10.1002/leap.2045","url":null,"abstract":"&lt;p&gt;In late 2024, arXiv decisively revised its moderation policy for computer science submissions. Review papers, once a routine part of the repository's content, became subject to stricter screening following a noticeable surge of low-quality, AI-generated manuscripts (Castelvecchi &lt;span&gt;2025&lt;/span&gt;). The rationale was not framed as a rejection of genAI per se, but as a response to a growing infrastructural problem: certain categories of submissions were no longer serving their intended signalling function within the platform.&lt;/p&gt;&lt;p&gt;Importantly, arXiv did not ban review articles outright, nor did it question their intellectual legitimacy. Instead, it drew a boundary around formats that increasingly resembled generic summaries: textually plausible, syntactically correct, but lacking interpretive depth. In practice, such submissions strained moderation capacity and weakened trust in the repository as a filter for meaningful scientific communication.&lt;/p&gt;&lt;p&gt;This intervention reflects a broader transformation driven by genAI. Large language models (LLMs) can now produce convincing literature overviews at scale, rapidly and at minimal cost. At the same time, tools supporting ranking, filtering and synthesising research outputs, such as multi-criteria review pipelines and semiautomated workflows, are becoming increasingly sophisticated (Wagner et al. &lt;span&gt;2022&lt;/span&gt;; Leite Junior et al. &lt;span&gt;2025&lt;/span&gt;). In parallel, the tempo of scholarly communication is accelerating. Early-access articles are read, cited and circulated before formal publication, reshaping how visibility and priority are established, particularly in AI-related fields (Xu et al. &lt;span&gt;2025&lt;/span&gt;).&lt;/p&gt;&lt;p&gt;These shifts place review articles in a uniquely exposed position. Historically, reviews have combined synthesis with interpretation, helping research communities stabilise concepts, identify gaps and set agendas. Recent empirical studies confirm that the most valued review articles are not exhaustive summaries, but reflexive contributions that position a field and articulate future directions (Krlev et al. &lt;span&gt;2025&lt;/span&gt;; Block et al. &lt;span&gt;2025&lt;/span&gt;). Yet it is precisely descriptive, template-driven review formats that are easiest for genAI to imitate, and therefore most likely to proliferate at scale.&lt;/p&gt;&lt;p&gt;The infrastructural implications of this asymmetry are already visible. Alongside arXiv's restrictive response, other platforms are experimenting with the opposite strategy. In 2025, &lt;i&gt;Science&lt;/i&gt; reported on the launch of a preprint server that explicitly welcomes papers written and reviewed by AI, relying on automated evaluation rather than community-based judgment (Zhao &lt;span&gt;2025&lt;/span&gt;). These developments do not indicate confusion, but divergence: different infrastructures are testing contrasting assumptions about authorship, review and quality control in an AI-mediated environment.&lt;/p&gt;&lt;p&gt;From this perspective, arXiv's policy change is best understood not as a ver","PeriodicalId":51636,"journal":{"name":"Learned Publishing","volume":"39 2","pages":""},"PeriodicalIF":2.4,"publicationDate":"2026-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/leap.2045","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146136107","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Recognition, Workload and Sustainability: Perspectives of Australian Journal Editors 认可、工作量和可持续性:澳大利亚期刊编辑的视角
IF 2.4 3区 管理学 Q2 INFORMATION SCIENCE & LIBRARY SCIENCE Pub Date : 2026-01-29 DOI: 10.1002/leap.2041
Edward J. Luca, Simon Wakeling, Hamid R. Jamali

This study explores the experiences and perspectives of journal editors in Australia, focusing on their pathways into editorship, required skills, challenges and issues relating to recognition, workload and succession planning. Based on in-depth qualitative interviews with 27 editors across a range of disciplines and publishing models, we analyse the critical yet often undervalued role of editors in the scholarly publishing landscape. While editors acknowledged the professional benefits of the role, they also highlighted substantial challenges, including struggles with workload, limited institutional support or recognition and the continued reliance on volunteer labour. The findings reveal tensions arising from the increasing commercialisation of academic publishing, research metrics and the changing demands of academic work. Through a focus on individual experiences, this study contributes new insights into the realities of journal editorship and its implications for academic careers, university workload management and the sustainability of Australian journal publishing.

本研究探讨了澳大利亚期刊编辑的经验和观点,重点关注他们进入编辑的途径、所需技能、挑战和与认可、工作量和继任计划相关的问题。基于对不同学科和出版模式的27位编辑的深度定性访谈,我们分析了编辑在学术出版领域的关键作用,但往往被低估。虽然编辑们承认这一角色的专业好处,但他们也强调了实质性的挑战,包括工作量的斗争,有限的机构支持或认可以及继续依赖志愿劳动。调查结果揭示了学术出版、研究指标日益商业化以及学术工作需求不断变化所带来的紧张关系。通过对个人经历的关注,本研究为期刊编辑的现实及其对学术生涯、大学工作量管理和澳大利亚期刊出版的可持续性的影响提供了新的见解。
{"title":"Recognition, Workload and Sustainability: Perspectives of Australian Journal Editors","authors":"Edward J. Luca,&nbsp;Simon Wakeling,&nbsp;Hamid R. Jamali","doi":"10.1002/leap.2041","DOIUrl":"https://doi.org/10.1002/leap.2041","url":null,"abstract":"<p>This study explores the experiences and perspectives of journal editors in Australia, focusing on their pathways into editorship, required skills, challenges and issues relating to recognition, workload and succession planning. Based on in-depth qualitative interviews with 27 editors across a range of disciplines and publishing models, we analyse the critical yet often undervalued role of editors in the scholarly publishing landscape. While editors acknowledged the professional benefits of the role, they also highlighted substantial challenges, including struggles with workload, limited institutional support or recognition and the continued reliance on volunteer labour. The findings reveal tensions arising from the increasing commercialisation of academic publishing, research metrics and the changing demands of academic work. Through a focus on individual experiences, this study contributes new insights into the realities of journal editorship and its implications for academic careers, university workload management and the sustainability of Australian journal publishing.</p>","PeriodicalId":51636,"journal":{"name":"Learned Publishing","volume":"39 2","pages":""},"PeriodicalIF":2.4,"publicationDate":"2026-01-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/leap.2041","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146136553","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Multilingual Scholarly Journal Publishing in Iran 伊朗多语种学术期刊出版
IF 2.4 3区 管理学 Q2 INFORMATION SCIENCE & LIBRARY SCIENCE Pub Date : 2026-01-26 DOI: 10.1002/leap.2043
Hamid R. Jamali, Majid Nabavi, Mozhgan Oroji, Ebrahim Emrani

Despite the dominance of English-language journals in international databases, the global scholarly publishing ecosystem is far more multilingual. This study presents the first comprehensive analysis of Iran's journal publishing landscape, uncovering a complex ecosystem of 3250 active and 639 discontinued journals published in English, Persian and Arabic. Drawing on multiple national databases and journal websites, we examine language, subject area, ownership, publishing platforms, open access models and indexation status. Our findings reveal distinct patterns: Persian-language journals dominate in social sciences and humanities, while English-language journals are concentrated in medical and STEM fields. All journals are locally owned and use domestically developed journal platforms with right-to-left language support. The vast majority (99.2%) are open access. Sanctions have limited access to international infrastructure, prompting local innovations such as the Digital Object Recognizer (DOR), a national alternative to DOI. In contrast to mainstream practice, most Iranian journals pay peer reviewers and use a two-part article processing charge (APC): a non-refundable fee at submission to cover peer review and a second payment upon acceptance. This study shows the scale and specificity of scholarly publishing in a non-Western context and challenges the database-centric view of global publishing by foregrounding local responses to structural constraints.

尽管英语期刊在国际数据库中占主导地位,但全球学术出版生态系统的多语种程度要高得多。本研究首次对伊朗期刊出版格局进行了全面分析,揭示了一个复杂的生态系统,包括3250种活跃期刊和639种已停止出版的英文、波斯语和阿拉伯语期刊。利用多个国家数据库和期刊网站,我们研究了语言、学科领域、所有权、出版平台、开放获取模式和索引状态。我们的研究结果揭示了不同的模式:波斯语期刊在社会科学和人文科学领域占主导地位,而英语期刊则集中在医学和STEM领域。所有期刊均为本地所有,使用国内开发的期刊平台,支持从右到左的语言。绝大多数(99.2%)是开放获取的。制裁限制了对国际基础设施的访问,促使当地创新,如数字对象识别器(DOR),这是DOI的国家替代品。与主流做法相反,大多数伊朗期刊向同行审稿人付费,并采用两部分文章处理费(APC):在投稿时支付一笔不可退还的费用,用于同行审稿,在接受时支付第二笔费用。本研究显示了非西方背景下学术出版的规模和特殊性,并通过突出地方对结构约束的反应,挑战了以数据库为中心的全球出版观点。
{"title":"Multilingual Scholarly Journal Publishing in Iran","authors":"Hamid R. Jamali,&nbsp;Majid Nabavi,&nbsp;Mozhgan Oroji,&nbsp;Ebrahim Emrani","doi":"10.1002/leap.2043","DOIUrl":"https://doi.org/10.1002/leap.2043","url":null,"abstract":"<p>Despite the dominance of English-language journals in international databases, the global scholarly publishing ecosystem is far more multilingual. This study presents the first comprehensive analysis of Iran's journal publishing landscape, uncovering a complex ecosystem of 3250 active and 639 discontinued journals published in English, Persian and Arabic. Drawing on multiple national databases and journal websites, we examine language, subject area, ownership, publishing platforms, open access models and indexation status. Our findings reveal distinct patterns: Persian-language journals dominate in social sciences and humanities, while English-language journals are concentrated in medical and STEM fields. All journals are locally owned and use domestically developed journal platforms with right-to-left language support. The vast majority (99.2%) are open access. Sanctions have limited access to international infrastructure, prompting local innovations such as the Digital Object Recognizer (DOR), a national alternative to DOI. In contrast to mainstream practice, most Iranian journals pay peer reviewers and use a two-part article processing charge (APC): a non-refundable fee at submission to cover peer review and a second payment upon acceptance. This study shows the scale and specificity of scholarly publishing in a non-Western context and challenges the database-centric view of global publishing by foregrounding local responses to structural constraints.</p>","PeriodicalId":51636,"journal":{"name":"Learned Publishing","volume":"39 1","pages":""},"PeriodicalIF":2.4,"publicationDate":"2026-01-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/leap.2043","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146130344","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Researchers' Views on Preprints and Open Access Publishing: Results From a Free-Answer Survey of Japanese Molecular Biologists 研究者对预印本和开放获取出版的看法:来自日本分子生物学家自由回答调查的结果
IF 2.4 3区 管理学 Q2 INFORMATION SCIENCE & LIBRARY SCIENCE Pub Date : 2026-01-19 DOI: 10.1002/leap.2039
Harufumi Tamazawa, Kazuki Ide, Kazuhisa Kamegai

A survey conducted in 2022 amongst members of the Molecular Biology Society of Japan (n = 633) about preprints and open access journals included qualitative data from free-response answers (n = 161). Analysis of the free-form responses suggests that researchers believe that peer review of papers is the foundation for ensuring the credibility of research content. The trust-building mechanism achieved through peer review shapes the research community. For this reason, researchers are extremely cautious about preprints that have not undergone peer review within their own fields. This foundation has fostered a sense of responsibility within the community, and this sense of responsibility, which is being fulfilled by ensuring the quality of research, is a mixture of both a sense of responsibility towards the community itself and a sense of responsibility towards the outside world, namely the relationship between researchers and society. Researchers also appear to view the rise in Article Processing Charges (APCs) as a problem for the entire community, rather than simply an issue for individual researchers. In the field of molecular biology, where collaborative research between universities and companies is common, differences in normative awareness based on position are reflected in the various attitudes towards preprints and open access.

2022年,日本分子生物学学会(Molecular Biology Society of Japan)成员(n = 633)对预印本和开放获取期刊进行了一项调查,其中包括来自自由回答的定性数据(n = 161)。对自由形式回复的分析表明,研究人员认为论文的同行评议是确保研究内容可信度的基础。通过同行评议实现的信任建立机制塑造了研究界。由于这个原因,研究人员对在他们自己的领域内没有经过同行评审的预印本非常谨慎。这个基金会培养了一种社会责任感,而这种通过确保研究质量来实现的责任感,是对社会本身的责任感和对外部世界,即研究人员与社会之间关系的责任感的混合体。研究人员似乎还将文章处理费(apc)的上涨视为整个社会的问题,而不仅仅是单个研究人员的问题。在分子生物学领域,大学和公司之间的合作研究是常见的,基于立场的规范意识的差异反映在对预印本和开放获取的不同态度上。
{"title":"Researchers' Views on Preprints and Open Access Publishing: Results From a Free-Answer Survey of Japanese Molecular Biologists","authors":"Harufumi Tamazawa,&nbsp;Kazuki Ide,&nbsp;Kazuhisa Kamegai","doi":"10.1002/leap.2039","DOIUrl":"https://doi.org/10.1002/leap.2039","url":null,"abstract":"<p>A survey conducted in 2022 amongst members of the Molecular Biology Society of Japan (<i>n</i> = 633) about preprints and open access journals included qualitative data from free-response answers (<i>n</i> = 161). Analysis of the free-form responses suggests that researchers believe that peer review of papers is the foundation for ensuring the credibility of research content. The trust-building mechanism achieved through peer review shapes the research community. For this reason, researchers are extremely cautious about preprints that have not undergone peer review within their own fields. This foundation has fostered a sense of responsibility within the community, and this sense of responsibility, which is being fulfilled by ensuring the quality of research, is a mixture of both a sense of responsibility towards the community itself and a sense of responsibility towards the outside world, namely the relationship between researchers and society. Researchers also appear to view the rise in Article Processing Charges (APCs) as a problem for the entire community, rather than simply an issue for individual researchers. In the field of molecular biology, where collaborative research between universities and companies is common, differences in normative awareness based on position are reflected in the various attitudes towards preprints and open access.</p>","PeriodicalId":51636,"journal":{"name":"Learned Publishing","volume":"39 1","pages":""},"PeriodicalIF":2.4,"publicationDate":"2026-01-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/leap.2039","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146091166","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Academic Peer Review: Eliminating the Option of ‘Reject’ Without Author Response 学术同行评议:消除没有作者回复的“拒绝”选项
IF 2.4 3区 管理学 Q2 INFORMATION SCIENCE & LIBRARY SCIENCE Pub Date : 2026-01-09 DOI: 10.1002/leap.2038
Alya A. Arabi, Ahmed H. AlMarzouqi
<p>The scientific publishing process includes several well-documented challenges, but one issue stands out as particularly harmful to fairness and progress: the lack of an author's right to respond to reviewers' critiques before a manuscript is rejected. After navigating the long and competitive road of securing funding, conducting research, and preparing a manuscript, authors often face extended delays (Greener <span>2021</span>) only to receive reviews that may be unconstructive, inconsistent, or even biased. Yet, despite the significant impact such reviews have on publication outcomes and careers, authors are frequently denied the opportunity to engage with or rebut them before a rejection decision is made. This absence of dialogue not only risks unfair dismissals of sound science but also undermines transparency and accountability in peer review. To address this specific and actionable gap, we propose a clear solution: journals should institute a formal mechanism that allows authors to respond to reviewer critiques prior to rejection decisions.</p><p>Authors should be granted the right to respond to reviewers' comments before editorial decisions are made, particularly given that peer manuscript evaluations are often subject to systemic issues, as discussed in this section. Reviewers can make mistakes. They may lack expertise in a given topic in interdisciplinary fields or misinterpret the content of a manuscript. Reviewers may also harbour reputational considerations, competing interests, personal biases, institutional or geopolitical biases, or personal animosities. For instance, it was found that double-blind peer review reduces bias (Moustafa <span>2014</span>), yet many journals still use single-blind or open peer review, where such biases can unduly influence decisions (Lee et al. <span>2012</span>), even though each approach could have its own advantages, e.g., open peer review might be potentially beneficial in terms of accountability (Ross-Hellauer and Horbach <span>2024</span>). Additionally, the peer review process remains highly subjective with potential low agreement levels among reviewers on whether to accept or reject a manuscript (Kravitz et al. <span>2010</span>). Some reviewers are far stricter than others, leading to inconsistencies in manuscript evaluations, with papers receiving contradictory recommendations from different reviewers (Bolek et al. <span>2022</span>; Kumar et al. <span>2023</span>). While the handling editor may request an additional expert review to resolve reviewer discrepancies, this does not substitute for allowing authors to respond to all reviewer comments before a rejection decision is made. Moreover, even reviewers and editors frequently disagree on what qualifies for publication (Howard and Wilkinson <span>1998</span>). A systematic review identified 24 tools for assessing peer review quality in biomedical research, highlighting the need for a validated, standardised approach to define and measure q
科学出版过程包括几个有充分证据的挑战,但有一个问题对公平和进步尤其有害:作者在手稿被拒绝之前缺乏回应审稿人批评的权利。在经历了获得资金、进行研究和准备手稿的漫长而竞争的道路之后,作者经常面临延长的延迟(绿色2021),结果却收到了可能没有建设性、不一致甚至有偏见的评论。然而,尽管此类审稿对出版成果和职业生涯有重大影响,但在做出拒绝决定之前,作者经常被剥夺与审稿接触或反驳审稿的机会。缺乏对话不仅有可能不公平地否定可靠的科学,还会破坏同行评议的透明度和问责制。为了解决这一具体而可行的差距,我们提出了一个明确的解决方案:期刊应该建立一个正式的机制,允许作者在拒绝决定之前回应审稿人的批评。在做出编辑决定之前,作者应该被授予回应审稿人评论的权利,特别是考虑到同行手稿评估经常受到系统性问题的影响,如本节所讨论的那样。审稿人可能会犯错误。他们可能在跨学科领域缺乏特定主题的专业知识,或者误解了手稿的内容。审稿人也可能怀有声誉考虑、竞争利益、个人偏见、制度或地缘政治偏见,或个人仇恨。例如,研究发现双盲同行评议减少了偏见(Moustafa 2014),然而许多期刊仍然使用单盲或开放同行评议,这种偏见可能会过度影响决策(Lee et al. 2012),尽管每种方法都有其自身的优势,例如,开放同行评议可能在问责制方面有潜在的好处(Ross-Hellauer and Horbach 2024)。此外,同行评议过程仍然是高度主观的,审稿人之间对是否接受或拒绝稿件的一致性可能很低(Kravitz et al. 2010)。一些审稿人比其他审稿人严格得多,导致稿件评估不一致,论文收到不同审稿人的相互矛盾的建议(Bolek et al. 2022; Kumar et al. 2023)。虽然处理编辑可能会要求额外的专家评审来解决审稿人的分歧,但这并不能代替允许作者在做出拒绝决定之前回复所有审稿人的意见。此外,甚至审稿人和编辑也经常对什么有资格发表意见不一(Howard and Wilkinson 1998)。一项系统综述确定了24种评估生物医学研究同行评审质量的工具,强调需要一种经过验证的标准化方法来定义和衡量质量(Superchi et al. 2019, 2020)。审查过程因评估原创性的不一致而进一步复杂化。我(指的是阿拉比博士,这篇文章的作者之一)提交的一篇论文因“缺乏原创性”而被拒绝,但同样的工作后来获得了不仅一项,而是两项美国专利,其中“新颖性”是批准的主要和严格定义的标准。虽然专利的授予是基于正式的、成文的标准,通常涉及全面的现有技术搜索和对新技术的严格定义,但许多学术期刊缺乏这样的清晰度,导致了人们对审稿过程的不一致和信心的破坏。因此,除非期刊明确定义其标准,否则期望专利制度认为新颖的作品也满足学术独创性标准似乎是合理的。即使是后来获得诺贝尔奖的开创性研究也面临着拒绝(Campanario 1995; Gans and Shepherd 1994; Noble 2012; Shanmugham 2022; Sternberg 2003)。这些突出了个人判断在评估科学价值方面的局限性。因此,“我们”是谁,“作为审稿人”可以拒绝其他科学家的工作?这一观点与“发表、审查、管理”模式的原则相呼应,该模式承认个人判断在评估科学价值方面的局限性(Waltman et al. 2023)。审稿人可以在某些领域拥有专业知识,这可以赋予他们提供反馈和评论的特权,但我们认为应该在提供建设性反馈时划出限制。任何审稿人都不应该有单方面的权力,有效地建议拒绝其他科学家/思想家/作者的科学贡献。 最多,审稿人应该提供尽可能多的评论,以加强稿件,同时,如果作者认为修改过度或不可行,他们可以选择发表评论或撤回提交的文章(前提是在这一阶段没有发现明显的故意不遵守研究诚信标准的情况,在这种情况下,期刊可以合理地选择将该问题标记给作者所在机构进行调查)。专业是必不可少的;应该鼓励建设性的反馈,而无论如何都应该禁止咄咄逼人或不屑一顾的评论。同行评议应该是一种旨在改进研究的建设性对话。审稿人应该为评论提供详细的理由,编辑必须评估反馈的有效性。GIVE框架(Trimmer和Guest 2020)强调提供敏感和建设性的反馈。此外,在生态学、经济学、医学、物理学和心理学等高影响力期刊中,有19%的编辑表示,如果他们不同意审稿人的建议,他们愿意编辑审稿人的报告,其中近一半的人愿意在未经审稿人同意的情况下这样做(Hamilton et al. 2020)。这凸显了改革的必要性,即优先考虑公平和严格(Crawford 2022)。也许现在是时候完全消除“拒绝”的选项了,一旦手稿被传递给审稿人。如果作者决定不回应评论,另一种选择是为作者提供“撤回”或“拒绝修改”的选择。另一个重要的注意是,许多作者正在转向开放获取平台,如arXiv(物理,数学,CS,生物学等),bioRxiv(生物学),chemRxiv(化学),medRxiv(医学科学),PsyArXiv(心理学)。这样的平台可以更快地传播研究成果,并邀请更广泛的读者和专家提供反馈(即使这些反馈并不总是可行的)。开放获取的出版物可以比拒绝情景更好地服务于科学界。直接的发表后批评允许作者澄清误解并为其工作辩护,这对于维护科学诚信和丰富学术研究至关重要(Kinne 2002)。就连美国国立卫生研究院也强调了公众评论的重要性(Ervin et al. 2018)。这可以是一个自我驱动的过程,特别是内在动机,如为科学界做出贡献的愿望,被证明对许多审稿人来说是足够的(Zollman et al. 2023)。此外,随着提交的论文数量不断增加,同行评议的质量也日益受到审查。许多期刊可能会邀请在稿件特定领域没有足够专业知识的研究人员或教职员工(Gerwing et al. 2020; Marcoci et al. 2022; Mulligan et al. 2012; Schoen 2020)。这最终会导致肤浅、不正确或不相关的反馈。研究表明,更高的薪酬可以提高审稿人的绩效(Collier-Spruel 2020; Garcia et al. 2021)。这就是为什么现在有很多人建议采用奖励模式,比如通过支付或代金券来获得更多积分(Ordak 2022),或者通过颁发证书来提高职业声誉(Lala and Mentz 2022)。然而,保障措施必须防止激励措施损害质量。除非该模型优先考虑高质量的审稿人(Collier-Spruel 2020; Garcia et al. 2021; Zollman et al. 2023),或者为彻底和有意义的审稿设定明确的期望(而不仅仅是跟踪审稿数量或遵守截止日期),否则这种激励制度可能会鼓励审稿人接受超过他们能够正确评估的论文。这可能会损害审查质量或导致依赖于通过人工智能工具等简单方法获得报告,这些工具在目前的发展阶段缺乏足够的科学严谨性来确保可信的评估(Adam 2025; Maturo et al. 2025)。在编辑对稿件做出最终决定之前,作者应该有机会对审稿人的任何反馈做出回应,这是显而易见的原因。虽然将人工智能工具集成到同行评审过程中有可能简化评审过程的某些方面,如手稿筛选、
{"title":"Academic Peer Review: Eliminating the Option of ‘Reject’ Without Author Response","authors":"Alya A. Arabi,&nbsp;Ahmed H. AlMarzouqi","doi":"10.1002/leap.2038","DOIUrl":"https://doi.org/10.1002/leap.2038","url":null,"abstract":"&lt;p&gt;The scientific publishing process includes several well-documented challenges, but one issue stands out as particularly harmful to fairness and progress: the lack of an author's right to respond to reviewers' critiques before a manuscript is rejected. After navigating the long and competitive road of securing funding, conducting research, and preparing a manuscript, authors often face extended delays (Greener &lt;span&gt;2021&lt;/span&gt;) only to receive reviews that may be unconstructive, inconsistent, or even biased. Yet, despite the significant impact such reviews have on publication outcomes and careers, authors are frequently denied the opportunity to engage with or rebut them before a rejection decision is made. This absence of dialogue not only risks unfair dismissals of sound science but also undermines transparency and accountability in peer review. To address this specific and actionable gap, we propose a clear solution: journals should institute a formal mechanism that allows authors to respond to reviewer critiques prior to rejection decisions.&lt;/p&gt;&lt;p&gt;Authors should be granted the right to respond to reviewers' comments before editorial decisions are made, particularly given that peer manuscript evaluations are often subject to systemic issues, as discussed in this section. Reviewers can make mistakes. They may lack expertise in a given topic in interdisciplinary fields or misinterpret the content of a manuscript. Reviewers may also harbour reputational considerations, competing interests, personal biases, institutional or geopolitical biases, or personal animosities. For instance, it was found that double-blind peer review reduces bias (Moustafa &lt;span&gt;2014&lt;/span&gt;), yet many journals still use single-blind or open peer review, where such biases can unduly influence decisions (Lee et al. &lt;span&gt;2012&lt;/span&gt;), even though each approach could have its own advantages, e.g., open peer review might be potentially beneficial in terms of accountability (Ross-Hellauer and Horbach &lt;span&gt;2024&lt;/span&gt;). Additionally, the peer review process remains highly subjective with potential low agreement levels among reviewers on whether to accept or reject a manuscript (Kravitz et al. &lt;span&gt;2010&lt;/span&gt;). Some reviewers are far stricter than others, leading to inconsistencies in manuscript evaluations, with papers receiving contradictory recommendations from different reviewers (Bolek et al. &lt;span&gt;2022&lt;/span&gt;; Kumar et al. &lt;span&gt;2023&lt;/span&gt;). While the handling editor may request an additional expert review to resolve reviewer discrepancies, this does not substitute for allowing authors to respond to all reviewer comments before a rejection decision is made. Moreover, even reviewers and editors frequently disagree on what qualifies for publication (Howard and Wilkinson &lt;span&gt;1998&lt;/span&gt;). A systematic review identified 24 tools for assessing peer review quality in biomedical research, highlighting the need for a validated, standardised approach to define and measure q","PeriodicalId":51636,"journal":{"name":"Learned Publishing","volume":"39 1","pages":""},"PeriodicalIF":2.4,"publicationDate":"2026-01-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/leap.2038","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145986832","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Cross-Disciplinary Analysis of AI Policies in Academic Peer Review 学术同行评议中人工智能政策的跨学科分析
IF 2.4 3区 管理学 Q2 INFORMATION SCIENCE & LIBRARY SCIENCE Pub Date : 2025-12-23 DOI: 10.1002/leap.2035
Zhongshi Wang, Mengyue Gong

Rapid advances of artificial intelligence (AI) have substantially impacted the field of academic publishing. This study examines AI integration in peer review by analysing policies from 439 high- and 363 middle-impact factor (IF) journals across disciplines. Using grounded theory, we identify patterns in AI policy adoption. Results show 83% of high-IF journals have AI guidelines, with varying stringency across disciplines. Meanwhile, only 75% of middle-IF journals have AI guidelines. Science, technology, and medicine (STM) disciplines exhibit stricter regulations, while humanities and social sciences adopt more lenient approaches. Key ethical concerns focus on confidentiality risks, accountability gaps, and AI's inability to replicate critical human judgement. Publisher policies emphasise transparency, human oversight, and restricted AI usage for auxiliary tasks only, such as grammar checks or reviewer finding. Disciplinary differences highlight the need for tailored guidelines that balance efficiency gains with research integrity. This study proposes collaborative frameworks for responsible AI integration. It focuses on accountability, transparency, and interdisciplinary policy development to address peer review challenges.

人工智能(AI)的快速发展对学术出版领域产生了实质性的影响。本研究通过分析439种高影响因子(IF)期刊和363种中等影响因子(IF)期刊的政策,考察了人工智能在同行评议中的整合。利用扎根理论,我们确定了人工智能政策采用的模式。结果显示,83%的高影响因子期刊有人工智能指南,不同学科的严格程度不同。与此同时,只有75%的中级if期刊有人工智能指南。科学、技术和医学(STM)学科表现出更严格的规定,而人文和社会科学则采用更宽松的方法。关键的伦理问题集中在保密风险、问责差距以及人工智能无法复制关键的人类判断。出版商政策强调透明度、人工监督,并限制人工智能仅用于辅助任务,如语法检查或审稿人查找。学科差异突出了需要有针对性的指导方针来平衡效率的提高和研究的完整性。本研究提出了负责任的人工智能集成的协作框架。它侧重于问责制、透明度和跨学科政策制定,以应对同行评议的挑战。
{"title":"A Cross-Disciplinary Analysis of AI Policies in Academic Peer Review","authors":"Zhongshi Wang,&nbsp;Mengyue Gong","doi":"10.1002/leap.2035","DOIUrl":"https://doi.org/10.1002/leap.2035","url":null,"abstract":"<p>Rapid advances of artificial intelligence (AI) have substantially impacted the field of academic publishing. This study examines AI integration in peer review by analysing policies from 439 high- and 363 middle-impact factor (IF) journals across disciplines. Using grounded theory, we identify patterns in AI policy adoption. Results show 83% of high-IF journals have AI guidelines, with varying stringency across disciplines. Meanwhile, only 75% of middle-IF journals have AI guidelines. Science, technology, and medicine (STM) disciplines exhibit stricter regulations, while humanities and social sciences adopt more lenient approaches. Key ethical concerns focus on confidentiality risks, accountability gaps, and AI's inability to replicate critical human judgement. Publisher policies emphasise transparency, human oversight, and restricted AI usage for auxiliary tasks only, such as grammar checks or reviewer finding. Disciplinary differences highlight the need for tailored guidelines that balance efficiency gains with research integrity. This study proposes collaborative frameworks for responsible AI integration. It focuses on accountability, transparency, and interdisciplinary policy development to address peer review challenges.</p>","PeriodicalId":51636,"journal":{"name":"Learned Publishing","volume":"39 1","pages":""},"PeriodicalIF":2.4,"publicationDate":"2025-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/leap.2035","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145824963","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Challenges and Strategies in Local Journal Publishing: Perspectives of Australian Journal Editors 地方期刊出版的挑战与策略:澳大利亚期刊编辑的视角
IF 2.4 3区 管理学 Q2 INFORMATION SCIENCE & LIBRARY SCIENCE Pub Date : 2025-12-23 DOI: 10.1002/leap.2034
Hamid R. Jamali, Simon Wakeling, Edward J. Luca

This study investigates the operational and strategic challenges faced by Australian journal editors. Interviews with 27 editors reveal a complex publishing ecosystem shaped by tensions around editorial independence, financial viability, and scholarly impact. Operational challenges include securing qualified peer reviewers and attracting quality submissions; the latter is considerably influenced by journal ranking, indexation, and reputation. Many editors seek stronger support from publishers, emphasising a need for shared goals, mutual trust, and editorial independence. Successful relationships with publishers often require editors to be proactive and assertive. Strategic challenges include balancing international recognition and local relevance, which leads some journals to remove ‘Australian’ from their titles and diversify editorial boards to attract global submissions. Publishing models vary, with some journals transitioning to commercial publishers for financial and technical support, while others prioritise independence despite operational challenges. Open Access (OA) remains a contested issue, particularly regarding the role of commercial publishers, though many journals have reached a degree of stability in their OA policies. This study also examines the role of editorial boards, the use of journal management systems, relationships with parent bodies, and the strategies editors adopt to navigate these challenges.

本研究调查了澳大利亚期刊编辑面临的业务和战略挑战。对27位编辑的采访揭示了一个复杂的出版生态系统,它由围绕编辑独立性、财务可行性和学术影响的紧张关系形成。运营方面的挑战包括确保合格的同行审稿人和吸引高质量的提交;后者很大程度上受到期刊排名、索引和声誉的影响。许多编辑向出版商寻求更强有力的支持,强调共同目标、相互信任和编辑独立性的必要性。与出版商的成功关系通常需要编辑积极主动和自信。战略挑战包括平衡国际认知度和本地相关性,这导致一些期刊将“澳大利亚”从标题中删除,并使编辑委员会多样化,以吸引全球投稿。出版模式各不相同,一些期刊转向商业出版商以获得资金和技术支持,而另一些期刊尽管面临运营挑战,仍优先考虑独立。开放获取(OA)仍然是一个有争议的问题,特别是关于商业出版商的角色,尽管许多期刊的OA政策已经达到了一定程度的稳定。本研究还考察了编辑委员会的角色、期刊管理系统的使用、与家长机构的关系,以及编辑为应对这些挑战所采取的策略。
{"title":"Challenges and Strategies in Local Journal Publishing: Perspectives of Australian Journal Editors","authors":"Hamid R. Jamali,&nbsp;Simon Wakeling,&nbsp;Edward J. Luca","doi":"10.1002/leap.2034","DOIUrl":"https://doi.org/10.1002/leap.2034","url":null,"abstract":"<p>This study investigates the operational and strategic challenges faced by Australian journal editors. Interviews with 27 editors reveal a complex publishing ecosystem shaped by tensions around editorial independence, financial viability, and scholarly impact. Operational challenges include securing qualified peer reviewers and attracting quality submissions; the latter is considerably influenced by journal ranking, indexation, and reputation. Many editors seek stronger support from publishers, emphasising a need for shared goals, mutual trust, and editorial independence. Successful relationships with publishers often require editors to be proactive and assertive. Strategic challenges include balancing international recognition and local relevance, which leads some journals to remove ‘Australian’ from their titles and diversify editorial boards to attract global submissions. Publishing models vary, with some journals transitioning to commercial publishers for financial and technical support, while others prioritise independence despite operational challenges. Open Access (OA) remains a contested issue, particularly regarding the role of commercial publishers, though many journals have reached a degree of stability in their OA policies. This study also examines the role of editorial boards, the use of journal management systems, relationships with parent bodies, and the strategies editors adopt to navigate these challenges.</p>","PeriodicalId":51636,"journal":{"name":"Learned Publishing","volume":"39 1","pages":""},"PeriodicalIF":2.4,"publicationDate":"2025-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/leap.2034","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145824962","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Mapping Scholarly Identities: A Descriptive Study of Spanish ORCID Records at the Spanish National Research Council (CSIC) 绘制学术身份:西班牙国家研究委员会(CSIC)对西班牙ORCID记录的描述性研究
IF 2.4 3区 管理学 Q2 INFORMATION SCIENCE & LIBRARY SCIENCE Pub Date : 2025-12-17 DOI: 10.1002/leap.2037
Bruno Penadés, Teresa Muñoz-Écija, Benjamín Vargas-Quesada, Zaida Chinchilla-Rodríguez

This study analyses the adoption and use of ORCID compared to other researcher profile systems across research domains and job categories at the Spanish National Research Council (CSIC). The sample consists of authors affiliated with CSIC who published at least one publication between 2013 and 2022. The results reveal that the adoption rate of ORCID was higher than that for public Google Scholar profiles. The ORCID profiles show a gender gap, with men registering more profiles and completing more fields. Permanent researchers adopted ORCID to a greater extent and were among those who completed the most sections. Natural Resources and Social Science had the highest profile number, while Humanities displayed the most complete profiles. In addition, a rapid increase in ORCID registrations was observed in the early years following its implementation, followed by a gradual decline, while ORCID profile updates remained consistent over time. We hope our findings could inform researchers and institutional strategies to enhance the use of persistent identifiers, strengthen data completeness, and address the gender gap in ORCID adoption, ultimately supporting the CSIC's commitment to open science and research integrity.

本研究分析了西班牙国家研究委员会(CSIC)跨研究领域和工作类别的其他研究人员档案系统对ORCID的采用和使用情况。样本由隶属于CSIC的作者组成,他们在2013年至2022年间至少发表了一篇论文。结果表明,ORCID的采用率高于公共b谷歌学者档案的采用率。ORCID的个人资料显示出性别差异,男性注册的个人资料更多,填写的字段也更多。长期研究人员更大程度上采用了ORCID,并且是完成部分最多的人之一。自然资源和社会科学的学生人数最多,而人文学科的学生人数最多。此外,在实施后的最初几年,观察到ORCID注册量迅速增加,随后逐渐下降,而ORCID剖面更新保持一致。我们希望我们的研究结果可以为研究人员和机构提供信息,以加强持久标识符的使用,加强数据完整性,并解决ORCID采用中的性别差异,最终支持CSIC对开放科学和研究诚信的承诺。
{"title":"Mapping Scholarly Identities: A Descriptive Study of Spanish ORCID Records at the Spanish National Research Council (CSIC)","authors":"Bruno Penadés,&nbsp;Teresa Muñoz-Écija,&nbsp;Benjamín Vargas-Quesada,&nbsp;Zaida Chinchilla-Rodríguez","doi":"10.1002/leap.2037","DOIUrl":"https://doi.org/10.1002/leap.2037","url":null,"abstract":"<p>This study analyses the adoption and use of ORCID compared to other researcher profile systems across research domains and job categories at the Spanish National Research Council (CSIC). The sample consists of authors affiliated with CSIC who published at least one publication between 2013 and 2022. The results reveal that the adoption rate of ORCID was higher than that for public Google Scholar profiles. The ORCID profiles show a gender gap, with men registering more profiles and completing more fields. Permanent researchers adopted ORCID to a greater extent and were among those who completed the most sections. Natural Resources and Social Science had the highest profile number, while Humanities displayed the most complete profiles. In addition, a rapid increase in ORCID registrations was observed in the early years following its implementation, followed by a gradual decline, while ORCID profile updates remained consistent over time. We hope our findings could inform researchers and institutional strategies to enhance the use of persistent identifiers, strengthen data completeness, and address the gender gap in ORCID adoption, ultimately supporting the CSIC's commitment to open science and research integrity.</p>","PeriodicalId":51636,"journal":{"name":"Learned Publishing","volume":"39 1","pages":""},"PeriodicalIF":2.4,"publicationDate":"2025-12-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/leap.2037","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145824593","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Beyond the Map: Considering Reporting Quality to Strengthen Scoping Reviews 超越地图:考虑报告质量以加强范围审查
IF 2.4 3区 管理学 Q2 INFORMATION SCIENCE & LIBRARY SCIENCE Pub Date : 2025-12-13 DOI: 10.1002/leap.2036
Chin-Siang Ang, Sakura Ito, Jennifer Cleland
<p>The rapid expansion of academic research presents challenges for those responsible for maintaining the quality and integrity of published literature. This is particularly evident in medical education, where innovations such as eLearning and digital assessments are reshaping teaching and assessment practices (Maggio et al. <span>2021</span>). As the volume of research grows, synthesis methods like scoping reviews play an increasingly vital role in mapping emerging topics and providing comprehensive overviews for researchers, educators and policymakers (Pollock et al. <span>2021</span>). However, their utility and by extension, their credibility, depends on the transparency and rigour of the studies they synthesise.</p><p>Unlike systematic reviews, which critically evaluate evidence quality, scoping reviews typically prioritise breadth over depth and rarely assess the reporting quality of individual studies, that is, how clearly and transparently their methods are described (Munn et al. <span>2018</span>). This omission has prompted discussions within the publishing industry about whether scoping reviews should integrate reporting quality assessments (Peters et al. <span>2021</span>). While some argue that such assessments enhance transparency and reliability, others contend that the primary function of scoping reviews is to map literature rather than evaluate methodological rigour (Khalil et al. <span>2025</span>).</p><p>For publishers, editors and other stakeholders in scholarly communication, reporting quality is a critical concern. Transparent and well-documented research underpins the credibility of academic publishing, ensuring that literature reviews, especially those used to inform policy, practice and future research, are based on rigorously reported evidence (Page et al. <span>2021</span>; Tong et al. <span>2012</span>). Poorly described methods not only compromise reproducibility but also obscure potential biases, making it difficult for readers to interpret findings accurately. From an editorial standpoint, assessing reporting quality in scoping reviews offers a pragmatic means of strengthening research integrity and enhancing the reliability of published work.</p><p>Efforts to improve scoping reviews have largely focused on standardising reporting practices through frameworks such as the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews (Tricco et al. <span>2018</span>). However, these frameworks rarely address the transparency of individual studies (Tricco et al. <span>2016</span>). In cases where reporting quality has been assessed, tools adapted from systematic reviews often prove inadequate, as they are designed for different research objectives and may not accommodate the methodological diversity found in scoping reviews (Sirriyeh et al. <span>2012</span>). Recently, structured tools like the Quality Assessment with Diverse Studies (QuADS) have been developed to fill this gap by of
合并报告质量评估直接解决了这些问题,为范围审查和编辑监督提供了实际的好处(Khalil et al. 2025)。例如,从认知到教育影响的五个研究领域对定量方法(78项研究)和问卷调查(62项研究)的压倒性依赖表明了方法的同质性。没有明确的基本原理,这些方法论选择缺乏深度。评估报告质量确保研究明确地证明其方法决策是合理的,不仅揭示了研究的内容,而且揭示了研究的方式和原因,从而加强了绘制过程。这种透明度提高了综合:明确记录研究方法和局限性,如样本量的变化(从2到7353名参与者)或测量挑战(28个实例),使编辑能够评估汇总结果的一致性。像QuADS这样的工具提供了一个结构化的框架来检测同行评议过程中的这些差距,促使作者通过证明问卷的使用或阐明其理论基础来证实他们的方法选择。对于出版专业人士来说,这种方法提高了研究的完整性,简化了编辑决策。透明报告对学术可信度至关重要(Tricco et al. 2018),然而,当研究忽略关键的方法细节时,编辑团队在确保质量方面面临困难,这可以从研究优势(20.2%)和理由的低报告率中看出。通过整合报告质量评估,期刊可以提高范围评估的可信度(Lockwood et al. 2019)。修订编辑指南以要求透明度,特别是在描述性分析占主导地位(67项研究)或有限的新颖性声明(9%)等领域,确保范围界定审查提供可靠的见解。加强报告要求不仅可以改善编辑监督,还可以加强范围审查在推进知识方面的作用。这种转变保留了范围审查的探索性力量,同时解决了它们的透明度缺陷。虽然我们的研究结果来源于医学教育,但对报告质量的方法关注在各个学科之间具有更广泛的相关性。编辑可以通过改进提交标准和加强学术交流中范围审查的作用来引领这一演变。范围评估指导研究和政策,但是它们的影响由于缺乏透明度而被削弱。本研究表明,评估报告质量,不同于证据评估,提高了它们的可靠性,解决了当前实践中的一个关键差距。对于编辑来说,这提供了一个维护诚信的实际机会,确保范围审查提供清晰、可信的见解——这是对学术出版的重要贡献。本研究的一个关键优势是它系统地应用了QuADS工具,为评估不同研究的透明度提供了一个可复制的框架。这种方法突出了可操作的差距,使范围界定审查超越了单纯的映射。然而,该研究对单一回顾的依赖限制了其普遍性,可能忽略了其他情况下的变化。尽管如此,该方法仍然可以跨领域转移,从而加强了其更广泛的适用性。所有作者都对研究的构思和设计做出了贡献。文献检索和数据分析由c.s.s.a.和S.I.进行。稿件由c.s.s.a.和S.I.起草。所有作者审阅并通过最终稿件。作者没有什么可报告的。作者声明无利益冲突。作者声明,支持本研究结果的所有数据均可在文章中获得。
{"title":"Beyond the Map: Considering Reporting Quality to Strengthen Scoping Reviews","authors":"Chin-Siang Ang,&nbsp;Sakura Ito,&nbsp;Jennifer Cleland","doi":"10.1002/leap.2036","DOIUrl":"https://doi.org/10.1002/leap.2036","url":null,"abstract":"&lt;p&gt;The rapid expansion of academic research presents challenges for those responsible for maintaining the quality and integrity of published literature. This is particularly evident in medical education, where innovations such as eLearning and digital assessments are reshaping teaching and assessment practices (Maggio et al. &lt;span&gt;2021&lt;/span&gt;). As the volume of research grows, synthesis methods like scoping reviews play an increasingly vital role in mapping emerging topics and providing comprehensive overviews for researchers, educators and policymakers (Pollock et al. &lt;span&gt;2021&lt;/span&gt;). However, their utility and by extension, their credibility, depends on the transparency and rigour of the studies they synthesise.&lt;/p&gt;&lt;p&gt;Unlike systematic reviews, which critically evaluate evidence quality, scoping reviews typically prioritise breadth over depth and rarely assess the reporting quality of individual studies, that is, how clearly and transparently their methods are described (Munn et al. &lt;span&gt;2018&lt;/span&gt;). This omission has prompted discussions within the publishing industry about whether scoping reviews should integrate reporting quality assessments (Peters et al. &lt;span&gt;2021&lt;/span&gt;). While some argue that such assessments enhance transparency and reliability, others contend that the primary function of scoping reviews is to map literature rather than evaluate methodological rigour (Khalil et al. &lt;span&gt;2025&lt;/span&gt;).&lt;/p&gt;&lt;p&gt;For publishers, editors and other stakeholders in scholarly communication, reporting quality is a critical concern. Transparent and well-documented research underpins the credibility of academic publishing, ensuring that literature reviews, especially those used to inform policy, practice and future research, are based on rigorously reported evidence (Page et al. &lt;span&gt;2021&lt;/span&gt;; Tong et al. &lt;span&gt;2012&lt;/span&gt;). Poorly described methods not only compromise reproducibility but also obscure potential biases, making it difficult for readers to interpret findings accurately. From an editorial standpoint, assessing reporting quality in scoping reviews offers a pragmatic means of strengthening research integrity and enhancing the reliability of published work.&lt;/p&gt;&lt;p&gt;Efforts to improve scoping reviews have largely focused on standardising reporting practices through frameworks such as the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews (Tricco et al. &lt;span&gt;2018&lt;/span&gt;). However, these frameworks rarely address the transparency of individual studies (Tricco et al. &lt;span&gt;2016&lt;/span&gt;). In cases where reporting quality has been assessed, tools adapted from systematic reviews often prove inadequate, as they are designed for different research objectives and may not accommodate the methodological diversity found in scoping reviews (Sirriyeh et al. &lt;span&gt;2012&lt;/span&gt;). Recently, structured tools like the Quality Assessment with Diverse Studies (QuADS) have been developed to fill this gap by of","PeriodicalId":51636,"journal":{"name":"Learned Publishing","volume":"39 1","pages":""},"PeriodicalIF":2.4,"publicationDate":"2025-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/leap.2036","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145751096","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Enhancing Consistency in Peer Review: A Statistical Analysis of Discrepancies and Proposals for Improvement 加强同行评议的一致性:差异的统计分析及改进建议
IF 2.4 3区 管理学 Q2 INFORMATION SCIENCE & LIBRARY SCIENCE Pub Date : 2025-11-24 DOI: 10.1002/leap.2033
Maher M. Alarfaj

This paper investigates the inconsistencies present in peer review by analysing the evaluation patterns of reviewers involved in an educational award in the Arab Gulf Country States. A statistical approach was used to assess the degree of variation in scores assigned to 270 manuscripts reviewed by three different groups of reviewers. The study revealed significant differences in the evaluations, suggesting that at least two reviewers often showed discrepancies in their assessments despite using the standardised evaluation form. The observed discrepancies appear to reflect underlying complexities related to reviewer perspectives and evaluation standards, highlighting challenges in achieving uniformity across assessments. Additionally, it proposes a model to enhance peer review consistency, including methods for score adjustment and calibration to mitigate reviewer differences. The goal is to offer practical recommendations for improving the fairness, transparency and reliability of peer review systems, contributing to the ongoing development of academic publishing practices. For audiences beyond the academic community including publishers, editors and academic librarians, these findings show how practical statistical tools can strengthen peer review and build greater trust in academic publishing.

本文通过分析阿拉伯海湾国家教育奖评审人员的评估模式,调查了同行评审中存在的不一致性。采用统计方法评估由三组不同的审稿人评审的270篇手稿的评分差异程度。该研究揭示了评估的显著差异,这表明尽管使用了标准化的评估表格,但至少有两名审稿人的评估经常出现差异。观察到的差异似乎反映了与审稿人观点和评价标准相关的潜在复杂性,突出了在实现评估一致性方面的挑战。此外,本文还提出了一个提高同行评审一致性的模型,包括分数调整和校准方法,以减轻审稿人的差异。其目标是为提高同行评审系统的公平性、透明度和可靠性提供切实可行的建议,为学术出版实践的持续发展做出贡献。对于包括出版商、编辑和学术图书馆员在内的学术界以外的受众来说,这些发现显示了实用的统计工具如何加强同行评审,并在学术出版中建立更大的信任。
{"title":"Enhancing Consistency in Peer Review: A Statistical Analysis of Discrepancies and Proposals for Improvement","authors":"Maher M. Alarfaj","doi":"10.1002/leap.2033","DOIUrl":"https://doi.org/10.1002/leap.2033","url":null,"abstract":"<p>This paper investigates the inconsistencies present in peer review by analysing the evaluation patterns of reviewers involved in an educational award in the Arab Gulf Country States. A statistical approach was used to assess the degree of variation in scores assigned to 270 manuscripts reviewed by three different groups of reviewers. The study revealed significant differences in the evaluations, suggesting that at least two reviewers often showed discrepancies in their assessments despite using the standardised evaluation form. The observed discrepancies appear to reflect underlying complexities related to reviewer perspectives and evaluation standards, highlighting challenges in achieving uniformity across assessments. Additionally, it proposes a model to enhance peer review consistency, including methods for score adjustment and calibration to mitigate reviewer differences. The goal is to offer practical recommendations for improving the fairness, transparency and reliability of peer review systems, contributing to the ongoing development of academic publishing practices. For audiences beyond the academic community including publishers, editors and academic librarians, these findings show how practical statistical tools can strengthen peer review and build greater trust in academic publishing.</p>","PeriodicalId":51636,"journal":{"name":"Learned Publishing","volume":"39 1","pages":""},"PeriodicalIF":2.4,"publicationDate":"2025-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/leap.2033","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145626043","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Learned Publishing
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1