首页 > 最新文献

Quantitative Science Studies最新文献

英文 中文
How reliable are unsupervised author disambiguation algorithms in the assessment of research organization performance? 在评估研究机构绩效时,无监督作者消歧算法的可靠性如何?
IF 6.4 Q1 INFORMATION SCIENCE & LIBRARY SCIENCE Pub Date : 2022-09-07 DOI: 10.1162/qss_a_00236
G. Abramo, Ciriaco Andrea D’Angelo
Abstract Assessing the performance of universities by output to input indicators requires knowledge of the individual researchers working within them. Although in Italy the Ministry of University and Research updates a database of university professors, in all those countries where such databases are not available, measuring research performance is a formidable task. One possibility is to trace the research personnel of institutions indirectly through their publications, using bibliographic repertories together with author names disambiguation algorithms. This work evaluates the goodness-of-fit of the Caron and van Eck, CvE unsupervised algorithm by comparing the research performance of Italian universities resulting from its application for the derivation of the universities’ research staff, with that resulting from the supervised algorithm of D’Angelo, Giuffrida, and Abramo (2011), which avails of input data. Results show that the CvE algorithm overestimates the size of the research staff of organizations by 56%. Nonetheless, the performance scores and ranks recorded in the two compared modes show a significant and high correlation. Still, nine out of 69 universities show rank deviations of two quartiles. Measuring the extent of distortions inherent in any evaluation exercises using unsupervised algorithms, can inform policymakers’ decisions on building national research staff databases, instead of settling for the unsupervised approaches.
摘要通过产出与投入指标评估大学的绩效需要了解在大学内部工作的研究人员。尽管在意大利,大学和研究部更新了一个大学教授数据库,但在所有没有此类数据库的国家,衡量研究业绩是一项艰巨的任务。一种可能性是通过机构的出版物间接追踪研究人员,使用书目库和作者姓名消歧算法。这项工作通过比较意大利大学应用Caron和van Eck,CvE无监督算法推导大学研究人员的研究表现,与D’Angelo、Giuffrida和Abramo(2011)的监督算法(利用输入数据)的研究表现来评估其拟合优度。结果表明,CvE算法高估了组织研究人员的规模56%。尽管如此,在两种比较模式中记录的表现分数和排名显示出显著且高度的相关性。尽管如此,69所大学中有9所的排名偏差为两个四分位数。使用无监督算法测量任何评估工作中固有的扭曲程度,可以为决策者建立国家研究人员数据库的决定提供信息,而不是满足于无监督方法。
{"title":"How reliable are unsupervised author disambiguation algorithms in the assessment of research organization performance?","authors":"G. Abramo, Ciriaco Andrea D’Angelo","doi":"10.1162/qss_a_00236","DOIUrl":"https://doi.org/10.1162/qss_a_00236","url":null,"abstract":"Abstract Assessing the performance of universities by output to input indicators requires knowledge of the individual researchers working within them. Although in Italy the Ministry of University and Research updates a database of university professors, in all those countries where such databases are not available, measuring research performance is a formidable task. One possibility is to trace the research personnel of institutions indirectly through their publications, using bibliographic repertories together with author names disambiguation algorithms. This work evaluates the goodness-of-fit of the Caron and van Eck, CvE unsupervised algorithm by comparing the research performance of Italian universities resulting from its application for the derivation of the universities’ research staff, with that resulting from the supervised algorithm of D’Angelo, Giuffrida, and Abramo (2011), which avails of input data. Results show that the CvE algorithm overestimates the size of the research staff of organizations by 56%. Nonetheless, the performance scores and ranks recorded in the two compared modes show a significant and high correlation. Still, nine out of 69 universities show rank deviations of two quartiles. Measuring the extent of distortions inherent in any evaluation exercises using unsupervised algorithms, can inform policymakers’ decisions on building national research staff databases, instead of settling for the unsupervised approaches.","PeriodicalId":34021,"journal":{"name":"Quantitative Science Studies","volume":"4 1","pages":"144-166"},"PeriodicalIF":6.4,"publicationDate":"2022-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45627516","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
A converging global research system 一个融合的全球研究体系
IF 6.4 Q1 INFORMATION SCIENCE & LIBRARY SCIENCE Pub Date : 2022-09-06 DOI: 10.1162/qss_a_00208
Jonathan Adams, M. Szomszor
Abstract We examine the hypothesis that research collaboration has enabled a global research network to evolve, with self-organizing properties transcending national research policy. We examine research output, bilateral and multilateral collaboration, subject diversity, and citation impact over 40 years, in detail for the G7 and BRICK groups of countries and in summary for 26 other nations. We find that the rise in national output was strongly associated with bilateral collaboration until the 2000s but after that by multilateral partnerships, with the shift happening at much the same time across countries. There was a general increase in research subject diversity, with evenness across subjects converging on a similar index value for many countries. Similar diversity is not the same as actual similarity but, in fact, the G7 countries became increasingly similar. National average citation impact (CNCI) rose and groups converged on similar impact values. The impact of the largest economies is above world average, which is a phenomenon we discuss separately. The similarities in patterns and timing occur across countries despite variance in their research policies, such as research assessment. We suggest that the key agent facilitating global network self-organization is a shared concept of best practice in research.
摘要我们检验了一个假设,即研究合作使全球研究网络得以发展,其自组织特性超越了国家研究政策。我们详细研究了40年来的研究成果、双边和多边合作、主题多样性和引文影响,包括七国集团和金砖四国集团的研究成果,以及其他26个国家的研究成果。我们发现,在2000年代之前,国家产出的增长与双边合作密切相关,但在那之后,与多边伙伴关系密切相关,这种转变几乎同时发生在各国之间。研究主题的多样性普遍增加,许多国家的主题均匀性趋于相似的指数值。类似的多样性与实际的相似性并不相同,但事实上,七国集团国家变得越来越相似。全国平均引用影响(CNCI)上升,各群体的影响值趋于相似。最大经济体的影响高于世界平均水平,这是我们单独讨论的现象。尽管各国的研究政策(如研究评估)存在差异,但在模式和时间上存在相似之处。我们认为,促进全球网络自组织的关键代理是研究中最佳实践的共同概念。
{"title":"A converging global research system","authors":"Jonathan Adams, M. Szomszor","doi":"10.1162/qss_a_00208","DOIUrl":"https://doi.org/10.1162/qss_a_00208","url":null,"abstract":"Abstract We examine the hypothesis that research collaboration has enabled a global research network to evolve, with self-organizing properties transcending national research policy. We examine research output, bilateral and multilateral collaboration, subject diversity, and citation impact over 40 years, in detail for the G7 and BRICK groups of countries and in summary for 26 other nations. We find that the rise in national output was strongly associated with bilateral collaboration until the 2000s but after that by multilateral partnerships, with the shift happening at much the same time across countries. There was a general increase in research subject diversity, with evenness across subjects converging on a similar index value for many countries. Similar diversity is not the same as actual similarity but, in fact, the G7 countries became increasingly similar. National average citation impact (CNCI) rose and groups converged on similar impact values. The impact of the largest economies is above world average, which is a phenomenon we discuss separately. The similarities in patterns and timing occur across countries despite variance in their research policies, such as research assessment. We suggest that the key agent facilitating global network self-organization is a shared concept of best practice in research.","PeriodicalId":34021,"journal":{"name":"Quantitative Science Studies","volume":"3 1","pages":"715-731"},"PeriodicalIF":6.4,"publicationDate":"2022-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44132027","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Recategorising research: Mapping from FoR 2008 to FoR 2020 in Dimensions 重新分类研究:从2008年系列到2020年系列的维度映射
IF 6.4 Q1 INFORMATION SCIENCE & LIBRARY SCIENCE Pub Date : 2022-08-31 DOI: 10.1162/qss_a_00244
Simon Porter, Daniel W. Hook
Abstract In 2020 the Australia New Zealand Standard Research Classification Fields of Research Codes (ANZSRC FoR codes) were updated by their owners. This has led the sector to need to update their systems of reference and has caused suppliers working in the research information sphere to need to update both systems and data. This paper focuses on the approach developed by Digital Science’s Dimensions team to the creation of an improved machine-learning training set, and the mapping of that set from FoR 2008 codes to FoR 2020 codes so that the Dimensions classification approach for the ANZSRC codes could be improved and updated.
2020年,澳大利亚新西兰标准研究分类领域研究代码(ANZSRC FoR代码)由其所有者更新。这导致该部门需要更新其参考系统,并导致在研究信息领域工作的供应商需要更新系统和数据。本文的重点是数字科学的维度团队开发的方法,以创建一个改进的机器学习训练集,并将该集从FoR 2008代码映射到FoR 2020代码,以便ANZSRC代码的维度分类方法可以得到改进和更新。
{"title":"Recategorising research: Mapping from FoR 2008 to FoR 2020 in Dimensions","authors":"Simon Porter, Daniel W. Hook","doi":"10.1162/qss_a_00244","DOIUrl":"https://doi.org/10.1162/qss_a_00244","url":null,"abstract":"Abstract In 2020 the Australia New Zealand Standard Research Classification Fields of Research Codes (ANZSRC FoR codes) were updated by their owners. This has led the sector to need to update their systems of reference and has caused suppliers working in the research information sphere to need to update both systems and data. This paper focuses on the approach developed by Digital Science’s Dimensions team to the creation of an improved machine-learning training set, and the mapping of that set from FoR 2008 codes to FoR 2020 codes so that the Dimensions classification approach for the ANZSRC codes could be improved and updated.","PeriodicalId":34021,"journal":{"name":"Quantitative Science Studies","volume":"4 1","pages":"127-143"},"PeriodicalIF":6.4,"publicationDate":"2022-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46767203","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Peer reviewer topic choice and its impact on interrater reliability: A mixed-method study 同行评议主题选择及其对评议可信度的影响:一项混合方法研究
IF 6.4 Q1 INFORMATION SCIENCE & LIBRARY SCIENCE Pub Date : 2022-08-25 DOI: 10.1162/qss_a_00207
Thomas Feliciani, Junwen Luo, K. Shankar
Abstract One of the main critiques of academic peer review is that interrater reliability (IRR) among reviewers is low. We examine an underinvestigated factor possibly contributing to low IRR: reviewers’ diversity in their topic-criteria mapping (“TC-mapping”). It refers to differences among reviewers pertaining to which topics they choose to emphasize in their evaluations, and how they map those topics onto various evaluation criteria. In this paper we look at the review process of grant proposals in one funding agency to ask: How much do reviewers differ in TC-mapping, and do their differences contribute to low IRR? Through a content analysis of review forms submitted to a national funding agency (Science Foundation Ireland) and a survey of its reviewers, we find evidence of interreviewer differences in their TC-mapping. Using a simulation experiment we show that, under a wide range of conditions, even strong differences in TC-mapping have only a negligible impact on IRR. Although further empirical work is needed to corroborate simulation results, these tentatively suggest that reviewers’ heterogeneous TC-mappings might not be of concern for designers of peer review panels to safeguard IRR.
摘要对学术同行评议的主要批评之一是审稿人之间的互信度(IRR)低。我们研究了一个未被充分研究的可能导致低IRR的因素:审稿人在主题标准映射(“tc映射”)中的多样性。它指的是审稿人之间的差异,这些差异与他们在评估中选择强调的主题有关,以及他们如何将这些主题映射到各种评估标准上。在本文中,我们着眼于一个资助机构的拨款提案的审查过程,并提出以下问题:审稿人在tc映射方面的差异有多大,他们的差异是否导致了较低的IRR?通过对提交给国家资助机构(爱尔兰科学基金会)的审查表格的内容分析和对其审稿人的调查,我们发现了审稿人在tc映射方面存在差异的证据。通过模拟实验,我们表明,在广泛的条件下,即使tc映射的强烈差异对IRR的影响也可以忽略不计。虽然需要进一步的实证工作来证实模拟结果,但这些初步表明,审稿人的异质tc映射可能不是同行评审小组设计者为保护IRR而关注的问题。
{"title":"Peer reviewer topic choice and its impact on interrater reliability: A mixed-method study","authors":"Thomas Feliciani, Junwen Luo, K. Shankar","doi":"10.1162/qss_a_00207","DOIUrl":"https://doi.org/10.1162/qss_a_00207","url":null,"abstract":"Abstract One of the main critiques of academic peer review is that interrater reliability (IRR) among reviewers is low. We examine an underinvestigated factor possibly contributing to low IRR: reviewers’ diversity in their topic-criteria mapping (“TC-mapping”). It refers to differences among reviewers pertaining to which topics they choose to emphasize in their evaluations, and how they map those topics onto various evaluation criteria. In this paper we look at the review process of grant proposals in one funding agency to ask: How much do reviewers differ in TC-mapping, and do their differences contribute to low IRR? Through a content analysis of review forms submitted to a national funding agency (Science Foundation Ireland) and a survey of its reviewers, we find evidence of interreviewer differences in their TC-mapping. Using a simulation experiment we show that, under a wide range of conditions, even strong differences in TC-mapping have only a negligible impact on IRR. Although further empirical work is needed to corroborate simulation results, these tentatively suggest that reviewers’ heterogeneous TC-mappings might not be of concern for designers of peer review panels to safeguard IRR.","PeriodicalId":34021,"journal":{"name":"Quantitative Science Studies","volume":"3 1","pages":"832-856"},"PeriodicalIF":6.4,"publicationDate":"2022-08-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45723631","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An open data set of scholars on Twitter 推特上学者的开放数据集
IF 6.4 Q1 INFORMATION SCIENCE & LIBRARY SCIENCE Pub Date : 2022-08-23 DOI: 10.1162/qss_a_00250
P. Mongeon, T. Bowman, R. Costas
Abstract The role played by research scholars in the dissemination of scientific knowledge on social media has always been a central topic in social media metrics (altmetrics) research. Different approaches have been implemented to identify and characterize active scholars on social media platforms like Twitter. Some limitations of past approaches were their complexity and, most importantly, their reliance on licensed scientometric and altmetric data. The emergence of new open data sources such as OpenAlex or Crossref Event Data provides opportunities to identify scholars on social media using only open data. This paper presents a novel and simple approach to match authors from OpenAlex with Twitter users identified in Crossref Event Data. The matching procedure is described and validated with ORCID data. The new approach matches nearly 500,000 matched scholars with their Twitter accounts with a level of high precision and moderate recall. The data set of matched scholars is described and made openly available to the scientific community to empower more advanced studies of the interactions of research scholars on Twitter.
研究学者在社交媒体上科学知识传播中所扮演的角色一直是社交媒体度量(social media metrics, altmetrics)研究的中心话题。已经采用了不同的方法来识别和描述Twitter等社交媒体平台上活跃的学者。过去方法的一些局限性在于它们的复杂性,最重要的是,它们依赖于许可的科学计量学和替代计量学数据。新的开放数据源(如OpenAlex或Crossref Event data)的出现为仅使用开放数据在社交媒体上识别学者提供了机会。本文提出了一种新颖而简单的方法,将OpenAlex的作者与Crossref事件数据中识别的Twitter用户进行匹配。用ORCID数据描述和验证了匹配过程。这种新方法将近50万名学者与其Twitter账户匹配起来,准确率很高,记忆率适中。匹配学者的数据集被描述并公开提供给科学界,以便对研究学者在Twitter上的互动进行更高级的研究。
{"title":"An open data set of scholars on Twitter","authors":"P. Mongeon, T. Bowman, R. Costas","doi":"10.1162/qss_a_00250","DOIUrl":"https://doi.org/10.1162/qss_a_00250","url":null,"abstract":"Abstract The role played by research scholars in the dissemination of scientific knowledge on social media has always been a central topic in social media metrics (altmetrics) research. Different approaches have been implemented to identify and characterize active scholars on social media platforms like Twitter. Some limitations of past approaches were their complexity and, most importantly, their reliance on licensed scientometric and altmetric data. The emergence of new open data sources such as OpenAlex or Crossref Event Data provides opportunities to identify scholars on social media using only open data. This paper presents a novel and simple approach to match authors from OpenAlex with Twitter users identified in Crossref Event Data. The matching procedure is described and validated with ORCID data. The new approach matches nearly 500,000 matched scholars with their Twitter accounts with a level of high precision and moderate recall. The data set of matched scholars is described and made openly available to the scientific community to empower more advanced studies of the interactions of research scholars on Twitter.","PeriodicalId":34021,"journal":{"name":"Quantitative Science Studies","volume":"4 1","pages":"314-324"},"PeriodicalIF":6.4,"publicationDate":"2022-08-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48774891","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Visualizing academic descendants using modified Pavlo diagrams: Results based on five researchers in biomechanics and biomedicine 使用修改的Pavlo图可视化学术后代:基于生物力学和生物医学五位研究人员的结果
IF 6.4 Q1 INFORMATION SCIENCE & LIBRARY SCIENCE Pub Date : 2022-08-20 DOI: 10.1162/qss_a_00205
W. Lievers
Abstract Visualizing the academic descendants of prolific researchers is a challenging problem. To this end, a modified Pavlo algorithm is presented and its utility is demonstrated based on manually collected academic genealogies of five researchers in biomechanics and biomedicine. The researchers have 15–32 children each and between 93 and 384 total descendants. The graphs generated by the modified algorithm were over 97% smaller than the original. Mentorship metrics were also calculated; their hm-indices are 5–7 and the gm-indices are in the range 7–13. Of the 1,096 unique researchers across the five family trees, 153 (14%) had graduated their own PhD students by the end of 2021. It took an average of 9.6 years after their own graduation for an advisor to graduate their first PhD student, which suggests that an academic generation in this field is approximately one decade. The manually collected data sets used were also compared against the crowd-sourced academic genealogy data from the AcademicTree.org website. The latter included only 45% of the people and 34% of the connections, so this limitation must be considered when using it for analyses where completeness is required. The data sets and an implementation of the algorithm are available for reuse.
可视化高产研究者的学术后代是一个具有挑战性的问题。为此,本文提出了一种改进的Pavlo算法,并以人工收集的5位生物力学和生物医学研究人员的学术家谱为基础,论证了该算法的实用性。研究人员每人有15-32个孩子,总共有93到384个后代。改进后的算法生成的图比原来的图小97%以上。还计算了指导指标;它们的hm-指数在5-7之间,gm-指数在7-13之间。在五个家族的1096名独特的研究人员中,153名(14%)在2021年底之前从自己的博士研究生毕业。导师从自己毕业到培养第一个博士生平均需要9.6年的时间,这意味着这个领域的学术一代大约需要10年。人工收集的数据集还与学术网站上的众包学术家谱数据进行了比较。后者只包括45%的人和34%的连接,因此在使用它进行需要完整性的分析时必须考虑到这个限制。数据集和算法的实现可用于重用。
{"title":"Visualizing academic descendants using modified Pavlo diagrams: Results based on five researchers in biomechanics and biomedicine","authors":"W. Lievers","doi":"10.1162/qss_a_00205","DOIUrl":"https://doi.org/10.1162/qss_a_00205","url":null,"abstract":"Abstract Visualizing the academic descendants of prolific researchers is a challenging problem. To this end, a modified Pavlo algorithm is presented and its utility is demonstrated based on manually collected academic genealogies of five researchers in biomechanics and biomedicine. The researchers have 15–32 children each and between 93 and 384 total descendants. The graphs generated by the modified algorithm were over 97% smaller than the original. Mentorship metrics were also calculated; their hm-indices are 5–7 and the gm-indices are in the range 7–13. Of the 1,096 unique researchers across the five family trees, 153 (14%) had graduated their own PhD students by the end of 2021. It took an average of 9.6 years after their own graduation for an advisor to graduate their first PhD student, which suggests that an academic generation in this field is approximately one decade. The manually collected data sets used were also compared against the crowd-sourced academic genealogy data from the AcademicTree.org website. The latter included only 45% of the people and 34% of the connections, so this limitation must be considered when using it for analyses where completeness is required. The data sets and an implementation of the algorithm are available for reuse.","PeriodicalId":34021,"journal":{"name":"Quantitative Science Studies","volume":"3 1","pages":"489-511"},"PeriodicalIF":6.4,"publicationDate":"2022-08-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"64426870","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Measuring and interpreting the differences of the nations’ scientific specialization indexes by output and by input 以产出和投入衡量和解释各国科学专业化指标的差异
IF 6.4 Q1 INFORMATION SCIENCE & LIBRARY SCIENCE Pub Date : 2022-08-20 DOI: 10.1162/qss_a_00206
G. Abramo, Ciriaco Andrea D’Angelo, F. D. Costa
Abstract This paper compares the national scientific profiles of 199 countries in 254 fields, tracked by two indices of scientific specialization based respectively on indicators of input and output. For each country, the indicator of inputs considers the number of researchers in each field. The output indicator, named Total Fractional Impact, based on the citations of publications indexed in the Web of Science, measures the scholarly impact of knowledge produced in each field. For each country, the approach allows us to measure the deviations between the two profiles, thereby revealing potential differences in research efficiency and/or capital allocation across fields, compared to benchmark countries.
摘要本文采用分别基于投入指标和产出指标的科学专业化两个指标,比较了199个国家254个领域的国家科学概况。对于每个国家,投入指标考虑了每个领域的研究人员数量。这一产出指标名为“总分数影响”(Total Fractional Impact),它基于在科学网(Web of Science)上索引的出版物被引用的次数,衡量每个领域产生的知识的学术影响。对于每个国家,该方法使我们能够衡量两种概况之间的偏差,从而揭示与基准国家相比,研究效率和/或跨领域资本配置的潜在差异。
{"title":"Measuring and interpreting the differences of the nations’ scientific specialization indexes by output and by input","authors":"G. Abramo, Ciriaco Andrea D’Angelo, F. D. Costa","doi":"10.1162/qss_a_00206","DOIUrl":"https://doi.org/10.1162/qss_a_00206","url":null,"abstract":"Abstract This paper compares the national scientific profiles of 199 countries in 254 fields, tracked by two indices of scientific specialization based respectively on indicators of input and output. For each country, the indicator of inputs considers the number of researchers in each field. The output indicator, named Total Fractional Impact, based on the citations of publications indexed in the Web of Science, measures the scholarly impact of knowledge produced in each field. For each country, the approach allows us to measure the deviations between the two profiles, thereby revealing potential differences in research efficiency and/or capital allocation across fields, compared to benchmark countries.","PeriodicalId":34021,"journal":{"name":"Quantitative Science Studies","volume":"3 1","pages":"755-775"},"PeriodicalIF":6.4,"publicationDate":"2022-08-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47923680","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Which factors are associated with Open Access publishing? A Springer Nature case study 哪些因素与开放获取出版有关?b施普林格自然案例研究
IF 6.4 Q1 INFORMATION SCIENCE & LIBRARY SCIENCE Pub Date : 2022-08-17 DOI: 10.1162/qss_a_00253
Fakhri Momeni, S. Dietze, Philipp Mayr, Kristin Biesenbender, Isabella Peters
Abstract Open Access (OA) facilitates access to research articles. However, authors or funders often must pay the publishing costs, preventing authors who do not receive financial support from participating in OA publishing and gaining citation advantage for OA articles. OA may exacerbate existing inequalities in the publication system rather than overcome them. To investigate this, we studied 522,411 articles published by Springer Nature. Employing correlation and regression analyses, we describe the relationship between authors affiliated with countries from different income levels, their choice of publishing model, and the citation impact of their papers. A machine learning classification method helped us to explore the importance of different features in predicting the publishing model. The results show that authors eligible for article processing charge (APC) waivers publish more in gold OA journals than others. In contrast, authors eligible for an APC discount have the lowest ratio of OA publications, leading to the assumption that this discount insufficiently motivates authors to publish in gold OA journals. We found a strong correlation between the journal rank and the publishing model in gold OA journals, whereas the OA option is mostly avoided in hybrid journals. Also, results show that the countries’ income level, seniority, and experience with OA publications are the most predictive factors for OA publishing in hybrid journals.
开放获取(OA)促进了对研究论文的访问。然而,作者或资助者往往必须支付出版费用,这使得没有获得资金支持的作者无法参与OA出版,无法获得OA文章的被引优势。开放获取可能会加剧而不是克服出版系统中存在的不平等。为了调查这个问题,我们研究了b施普林格Nature发表的522,411篇文章。采用相关分析和回归分析,我们描述了来自不同收入水平国家的作者、他们选择的出版模式和他们论文的被引影响之间的关系。机器学习分类方法帮助我们探索不同特征在预测出版模型中的重要性。结果表明,符合文章处理费(APC)豁免条件的作者在金牌开放获取期刊上发表的文章比其他作者多。相比之下,有资格获得APC折扣的作者的OA出版物比例最低,这导致人们认为这种折扣不足以激励作者在金牌OA期刊上发表文章。我们发现,在金牌开放获取期刊中,期刊排名与出版模式之间存在很强的相关性,而在混合型期刊中,OA选项大多被避免。此外,研究结果表明,国家的收入水平、资历和开放获取出版物的经验是混合期刊开放获取出版的最具预测性的因素。
{"title":"Which factors are associated with Open Access publishing? A Springer Nature case study","authors":"Fakhri Momeni, S. Dietze, Philipp Mayr, Kristin Biesenbender, Isabella Peters","doi":"10.1162/qss_a_00253","DOIUrl":"https://doi.org/10.1162/qss_a_00253","url":null,"abstract":"Abstract Open Access (OA) facilitates access to research articles. However, authors or funders often must pay the publishing costs, preventing authors who do not receive financial support from participating in OA publishing and gaining citation advantage for OA articles. OA may exacerbate existing inequalities in the publication system rather than overcome them. To investigate this, we studied 522,411 articles published by Springer Nature. Employing correlation and regression analyses, we describe the relationship between authors affiliated with countries from different income levels, their choice of publishing model, and the citation impact of their papers. A machine learning classification method helped us to explore the importance of different features in predicting the publishing model. The results show that authors eligible for article processing charge (APC) waivers publish more in gold OA journals than others. In contrast, authors eligible for an APC discount have the lowest ratio of OA publications, leading to the assumption that this discount insufficiently motivates authors to publish in gold OA journals. We found a strong correlation between the journal rank and the publishing model in gold OA journals, whereas the OA option is mostly avoided in hybrid journals. Also, results show that the countries’ income level, seniority, and experience with OA publications are the most predictive factors for OA publishing in hybrid journals.","PeriodicalId":34021,"journal":{"name":"Quantitative Science Studies","volume":"4 1","pages":"353-371"},"PeriodicalIF":6.4,"publicationDate":"2022-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48857752","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
An improved practical approach to forecasting exceptional growth in research 一种改进的预测研究异常增长的实用方法
IF 6.4 Q1 INFORMATION SCIENCE & LIBRARY SCIENCE Pub Date : 2022-08-16 DOI: 10.1162/qss_a_00202
K. Boyack, R. Klavans
Abstract The accurate forecasting of exceptional growth in research areas has been an extremely difficult problem to solve. In a previous study we introduced an approach to forecasting which research clusters in a global model of the scientific literature would have an annual growth rate of 8% annually over a 3-year period. In this study we (a) introduce a much more robust method of creating and updating global models of research, (b) introduce new indicators based on author publication patterns, (c) test a much larger set (81) of indicators to forecast exceptional growth, and (d) expand the forecast horizon from 3 to 4 years. Forecast accuracy increased dramatically (threat score increased from 20 to 32) from our previous study. Most of this gain is surprisingly due to the advances in model robustness rather than the indicators used for forecasting. We also provide evidence that most indicators (including popular network indicators) do not improve the ability to forecast growth in research above the baseline provided by indicators associated with the vitality of a research cluster.
研究领域异常增长的准确预测一直是一个极难解决的问题。在之前的一项研究中,我们介绍了一种方法来预测在科学文献的全球模型中,哪些研究集群在3年内的年增长率为8%。在这项研究中,我们(a)引入了一种更稳健的方法来创建和更新全球研究模型,(b)引入了基于作者出版模式的新指标,(c)测试了一组更大的指标(81)来预测异常增长,(d)将预测范围从3年扩展到4年。与我们之前的研究相比,预测准确性显著提高(威胁得分从20分提高到32分)。令人惊讶的是,这种增长大部分是由于模型稳健性的进步,而不是用于预测的指标。我们还提供了证据表明,大多数指标(包括流行网络指标)并没有提高预测研究增长的能力,超出了与研究集群活力相关的指标所提供的基线。
{"title":"An improved practical approach to forecasting exceptional growth in research","authors":"K. Boyack, R. Klavans","doi":"10.1162/qss_a_00202","DOIUrl":"https://doi.org/10.1162/qss_a_00202","url":null,"abstract":"Abstract The accurate forecasting of exceptional growth in research areas has been an extremely difficult problem to solve. In a previous study we introduced an approach to forecasting which research clusters in a global model of the scientific literature would have an annual growth rate of 8% annually over a 3-year period. In this study we (a) introduce a much more robust method of creating and updating global models of research, (b) introduce new indicators based on author publication patterns, (c) test a much larger set (81) of indicators to forecast exceptional growth, and (d) expand the forecast horizon from 3 to 4 years. Forecast accuracy increased dramatically (threat score increased from 20 to 32) from our previous study. Most of this gain is surprisingly due to the advances in model robustness rather than the indicators used for forecasting. We also provide evidence that most indicators (including popular network indicators) do not improve the ability to forecast growth in research above the baseline provided by indicators associated with the vitality of a research cluster.","PeriodicalId":34021,"journal":{"name":"Quantitative Science Studies","volume":"3 1","pages":"672-693"},"PeriodicalIF":6.4,"publicationDate":"2022-08-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41576552","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
AOC: Assembling overlapping communities AOC:组装重叠的社区
IF 6.4 Q1 INFORMATION SCIENCE & LIBRARY SCIENCE Pub Date : 2022-08-05 DOI: 10.1162/qss_a_00227
Akhil Jakatdar, T. Warnow, George Chacko
Abstract Through discovery of mesoscale structures, community detection methods contribute to the understanding of complex networks. Many community finding methods, however, rely on disjoint clustering techniques, in which node membership is restricted to one community or cluster. This strict requirement limits the ability to inclusively describe communities because some nodes may reasonably be assigned to multiple communities. We have previously reported Iterative K-core Clustering, a scalable and modular pipeline that discovers disjoint research communities from the scientific literature. We now present Assembling Overlapping Clusters (AOC), a complementary metamethod for overlapping communities, as an option that addresses the disjoint clustering problem. We present findings from the use of AOC on a network of over 13 million nodes that captures recent research in the very rapidly growing field of extracellular vesicles in biology.
通过发现中尺度结构,群落检测方法有助于理解复杂网络。然而,许多社区查找方法依赖于不相交聚类技术,其中节点成员仅限于一个社区或集群。这种严格的要求限制了包容性描述社区的能力,因为一些节点可能被合理地分配给多个社区。我们之前报道过迭代K-core集群,这是一个可扩展的模块化管道,可以从科学文献中发现不一致的研究社区。我们现在提出装配重叠集群(AOC),这是重叠社区的一种补充元方法,作为解决不相交聚类问题的一种选择。我们展示了在超过1300万个节点的网络上使用AOC的发现,该网络捕获了生物学中非常快速发展的细胞外囊泡领域的最新研究。
{"title":"AOC: Assembling overlapping communities","authors":"Akhil Jakatdar, T. Warnow, George Chacko","doi":"10.1162/qss_a_00227","DOIUrl":"https://doi.org/10.1162/qss_a_00227","url":null,"abstract":"Abstract Through discovery of mesoscale structures, community detection methods contribute to the understanding of complex networks. Many community finding methods, however, rely on disjoint clustering techniques, in which node membership is restricted to one community or cluster. This strict requirement limits the ability to inclusively describe communities because some nodes may reasonably be assigned to multiple communities. We have previously reported Iterative K-core Clustering, a scalable and modular pipeline that discovers disjoint research communities from the scientific literature. We now present Assembling Overlapping Clusters (AOC), a complementary metamethod for overlapping communities, as an option that addresses the disjoint clustering problem. We present findings from the use of AOC on a network of over 13 million nodes that captures recent research in the very rapidly growing field of extracellular vesicles in biology.","PeriodicalId":34021,"journal":{"name":"Quantitative Science Studies","volume":"3 1","pages":"1079-1096"},"PeriodicalIF":6.4,"publicationDate":"2022-08-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45319612","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
期刊
Quantitative Science Studies
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1