Abhirup Nandy, Hiran H. Lathabai, Vivek Kumar Singh
{"title":"$${\\varvec{x}}_{\\varvec{d}}$ -指数及其变体:一套用于院校研究组合管理的整体学术专长多样性指数","authors":"Abhirup Nandy, Hiran H. Lathabai, Vivek Kumar Singh","doi":"10.1007/s11192-024-05131-y","DOIUrl":null,"url":null,"abstract":"<p>During last several decades, various indicators and proxies to measure research output and their impact for different units have been proposed. These measurements may be targeted at individuals, institutions, journals, countries etc. Institutional level assessment is one such area that has always been and will remain a key challenge to a multitude of stakeholders. Various international rankings as well as different bibliometric indicators have been explored in the context of institutional assessments, though each of them has certain criticisms associated. Most of the existing indicators, including <i>h</i>-type indicators, mainly focus on research output and/ or citations to the research output. They do not reveal the expertise of institutions in different subject areas, which is crucial to know the research portfolio of an institution. Recently, a set of expertise measures such as <i>x</i> and <i>x(g)</i> indices were introduced to determine the expertise of institutions with respect to a specific discipline/field considering strengths in different finer level thematic areas of that discipline/field. In this work, an adaptation of the <i>x</i>-index, namely the <span>\\(x_{d}\\)</span>-index is proposed to determine the overall scholarly expertise of an institution considering its publication pattern and strength in different coarse thematic areas. This indicator helps to identify the core expertise areas and the diversity of the research portfolio of the institution. Further, two variants of the indicator, namely field normalized indicator or <span>\\(x_{d}\\)</span> (FN)-index and fractional indicator <span>\\(x_{d} \\left( f \\right)\\)</span>-index are also introduced to address the effect of field bias and collaborations on the computation of the expertise diversity. The framework can determine the most suitable version of the indicator to use for research portfolio management with the help of correlation analysis. These indicators and the associated framework are demonstrated on a dataset of 136 institutions. Upon rank correlation analysis, no significant difference is noticed between <span>\\(x_{d}\\)</span> and its variants computed using different publication counting, in this particular dataset, making <span>\\(x_{d}\\)</span> the most suitable indicator in this case. The possibilities offered by the framework for effective management of the research portfolio of an institution by expanding its diversity and its ability to aid national level policymakers for the effective management of scholarly ecosystem of the country is discussed.</p>","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"31 1","pages":""},"PeriodicalIF":3.5000,"publicationDate":"2024-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"$${\\\\varvec{x}}_{{\\\\varvec{d}}}$$ -index and its variants: a set of overall scholarly expertise diversity indices for the research portfolio management of institutions\",\"authors\":\"Abhirup Nandy, Hiran H. Lathabai, Vivek Kumar Singh\",\"doi\":\"10.1007/s11192-024-05131-y\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>During last several decades, various indicators and proxies to measure research output and their impact for different units have been proposed. These measurements may be targeted at individuals, institutions, journals, countries etc. Institutional level assessment is one such area that has always been and will remain a key challenge to a multitude of stakeholders. Various international rankings as well as different bibliometric indicators have been explored in the context of institutional assessments, though each of them has certain criticisms associated. Most of the existing indicators, including <i>h</i>-type indicators, mainly focus on research output and/ or citations to the research output. They do not reveal the expertise of institutions in different subject areas, which is crucial to know the research portfolio of an institution. Recently, a set of expertise measures such as <i>x</i> and <i>x(g)</i> indices were introduced to determine the expertise of institutions with respect to a specific discipline/field considering strengths in different finer level thematic areas of that discipline/field. In this work, an adaptation of the <i>x</i>-index, namely the <span>\\\\(x_{d}\\\\)</span>-index is proposed to determine the overall scholarly expertise of an institution considering its publication pattern and strength in different coarse thematic areas. This indicator helps to identify the core expertise areas and the diversity of the research portfolio of the institution. Further, two variants of the indicator, namely field normalized indicator or <span>\\\\(x_{d}\\\\)</span> (FN)-index and fractional indicator <span>\\\\(x_{d} \\\\left( f \\\\right)\\\\)</span>-index are also introduced to address the effect of field bias and collaborations on the computation of the expertise diversity. The framework can determine the most suitable version of the indicator to use for research portfolio management with the help of correlation analysis. These indicators and the associated framework are demonstrated on a dataset of 136 institutions. Upon rank correlation analysis, no significant difference is noticed between <span>\\\\(x_{d}\\\\)</span> and its variants computed using different publication counting, in this particular dataset, making <span>\\\\(x_{d}\\\\)</span> the most suitable indicator in this case. The possibilities offered by the framework for effective management of the research portfolio of an institution by expanding its diversity and its ability to aid national level policymakers for the effective management of scholarly ecosystem of the country is discussed.</p>\",\"PeriodicalId\":21755,\"journal\":{\"name\":\"Scientometrics\",\"volume\":\"31 1\",\"pages\":\"\"},\"PeriodicalIF\":3.5000,\"publicationDate\":\"2024-08-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Scientometrics\",\"FirstCategoryId\":\"91\",\"ListUrlMain\":\"https://doi.org/10.1007/s11192-024-05131-y\",\"RegionNum\":3,\"RegionCategory\":\"管理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Scientometrics","FirstCategoryId":"91","ListUrlMain":"https://doi.org/10.1007/s11192-024-05131-y","RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0
摘要
过去几十年间,人们提出了各种指标和代用指标,用于衡量不同单位的研究成果及其影响。这些衡量指标可能针对个人、机构、期刊、国家等。机构层面的评估一直是并将继续是众多利益相关者面临的主要挑战之一。在机构评估方面,已经探讨了各种国际排名和不同的文献计量指标,尽管每种指标都有一些相关的批评意见。现有的大多数指标,包括 h 型指标,主要侧重于研究成果和/或研究成果的引用情况。这些指标并不能揭示院校在不同学科领域的专长,而这对了解院校的研究组合至关重要。最近,研究人员引入了一套专业知识衡量指标,如 x 指数和 x(g)指数,以确定院校在特定学科/领域的专业知识,同时考虑到院校在该学科/领域不同细分主题领域的优势。在这项工作中,我们提出了对 x 指数的一种调整,即 \(x_{d}\)-index 指数,以确定一个机构的整体学术专长,其中考虑到其在不同粗略主题领域的出版模式和实力。这一指标有助于确定院校的核心专业领域和研究组合的多样性。此外,该指标还有两个变体,即领域归一化指标或 \(x_{d}\) (FN)-index 和分数指标 \(x_{d}left( f \{d})。\(FN)-指标和分数指标(x_{d}left( f \right))-指标,以解决领域偏差和合作对专业知识多样性计算的影响。在相关性分析的帮助下,该框架可以确定最适合用于研究组合管理的指标版本。这些指标和相关框架在 136 个机构的数据集上得到了验证。通过等级相关性分析,我们发现在这个特定的数据集中,\(x_{d}\)和使用不同出版计数法计算出来的变体之间没有明显差异,因此\(x_{d}\)在这种情况下是最合适的指标。本文讨论了该框架为有效管理一个机构的研究组合提供的可能性,即通过扩大其多样性及其帮助国家级决策者有效管理国家学术生态系统的能力。
$${\varvec{x}}_{{\varvec{d}}}$$ -index and its variants: a set of overall scholarly expertise diversity indices for the research portfolio management of institutions
During last several decades, various indicators and proxies to measure research output and their impact for different units have been proposed. These measurements may be targeted at individuals, institutions, journals, countries etc. Institutional level assessment is one such area that has always been and will remain a key challenge to a multitude of stakeholders. Various international rankings as well as different bibliometric indicators have been explored in the context of institutional assessments, though each of them has certain criticisms associated. Most of the existing indicators, including h-type indicators, mainly focus on research output and/ or citations to the research output. They do not reveal the expertise of institutions in different subject areas, which is crucial to know the research portfolio of an institution. Recently, a set of expertise measures such as x and x(g) indices were introduced to determine the expertise of institutions with respect to a specific discipline/field considering strengths in different finer level thematic areas of that discipline/field. In this work, an adaptation of the x-index, namely the \(x_{d}\)-index is proposed to determine the overall scholarly expertise of an institution considering its publication pattern and strength in different coarse thematic areas. This indicator helps to identify the core expertise areas and the diversity of the research portfolio of the institution. Further, two variants of the indicator, namely field normalized indicator or \(x_{d}\) (FN)-index and fractional indicator \(x_{d} \left( f \right)\)-index are also introduced to address the effect of field bias and collaborations on the computation of the expertise diversity. The framework can determine the most suitable version of the indicator to use for research portfolio management with the help of correlation analysis. These indicators and the associated framework are demonstrated on a dataset of 136 institutions. Upon rank correlation analysis, no significant difference is noticed between \(x_{d}\) and its variants computed using different publication counting, in this particular dataset, making \(x_{d}\) the most suitable indicator in this case. The possibilities offered by the framework for effective management of the research portfolio of an institution by expanding its diversity and its ability to aid national level policymakers for the effective management of scholarly ecosystem of the country is discussed.
期刊介绍:
Scientometrics aims at publishing original studies, short communications, preliminary reports, review papers, letters to the editor and book reviews on scientometrics. The topics covered are results of research concerned with the quantitative features and characteristics of science. Emphasis is placed on investigations in which the development and mechanism of science are studied by means of (statistical) mathematical methods.
The Journal also provides the reader with important up-to-date information about international meetings and events in scientometrics and related fields. Appropriate bibliographic compilations are published as a separate section. Due to its fully interdisciplinary character, Scientometrics is indispensable to research workers and research administrators throughout the world. It provides valuable assistance to librarians and documentalists in central scientific agencies, ministries, research institutes and laboratories.
Scientometrics includes the Journal of Research Communication Studies. Consequently its aims and scope cover that of the latter, namely, to bring the results of research investigations together in one place, in such a form that they will be of use not only to the investigators themselves but also to the entrepreneurs and research workers who form the object of these studies.