{"title":"Analysing the relationship between altmetric attention score (AAS) and citation: a correlational study","authors":"Dhrubajyoti Borgohain, M. Yuvaraj, M. Verma","doi":"10.1108/idd-05-2022-0035","DOIUrl":null,"url":null,"abstract":"\nPurpose\nThe purpose of this study is to assess the value of altmetrics or other indicators, showcasing the impact of academic output, which is seen too often correlated with the citation count.\n\n\nDesign/methodology/approach\nThis study considered three reputed journals of Library and Information Science (LIS) published by Elsevier. A total of 1,164 articles were found in these journals from 2016 to 2020 and the relationships between altmetric attention scores (AAS) and citations were examined. The analysis was extended to compare the grouped data set based on percentile ranks of AAS like top 50%, top 25%, top 10% and top 1%.\n\n\nFindings\nUsing Spearman correlation analysis, the findings reveal a positive correlation between AAS and citations with different significant levels for all articles, and articles with AAS, as well as for normalized AAS in the top 50%, top 25%, top 10% and top 1% data set. For the three journals International Journal of Information Management (IJIM), Journal of Informetrics (JIF) and Library and Information Science Research (LISR), a significant positive correlation is observed across all data sets. But an unexpected result was observed: in the case of the top 50% of articles for the IJIM and JIF showed no significant correlation but the LISR journal showed a positive correlation for the whole data set. This journal though has fewer articles in comparison to the other two.\n\n\nResearch limitations/implications\nA source item that is highly cited may not be having high social media attention as reflected in the findings. This demarcates AAS with citations implying various factors on which these measurements are dependent. The study distinguishes these metrics lucidly. There is not a single guideline or uniformity in assessing the correlation found. But the problem is that the interpretation of the correlation strength affects the conclusion of the study. Moreover, this study will be a role model as a draft for librarians to select relevant journals for their libraries and will facilitate authors in the choice of the publication outlets for their papers, particularly concerning the journals that have both visibility and research impact.\n\n\nOriginality/value\nThe study reported devising a comprehensive tool to validate AAS as a measure of scholarly impact to include appropriate social media sources and verify its relationship with other metrics. To the best of the authors’ knowledge, this paper is the first attempt to discover the correlation between AAS and citations for the highly impactful LIS journal published by Elsevier. The empirical evidence lies in the citation and altmetric data extracted from the dimension database.\n","PeriodicalId":43488,"journal":{"name":"Information Discovery and Delivery","volume":" ","pages":""},"PeriodicalIF":2.1000,"publicationDate":"2023-03-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Discovery and Delivery","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1108/idd-05-2022-0035","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"INFORMATION SCIENCE & LIBRARY SCIENCE","Score":null,"Total":0}
引用次数: 1
Abstract
Purpose
The purpose of this study is to assess the value of altmetrics or other indicators, showcasing the impact of academic output, which is seen too often correlated with the citation count.
Design/methodology/approach
This study considered three reputed journals of Library and Information Science (LIS) published by Elsevier. A total of 1,164 articles were found in these journals from 2016 to 2020 and the relationships between altmetric attention scores (AAS) and citations were examined. The analysis was extended to compare the grouped data set based on percentile ranks of AAS like top 50%, top 25%, top 10% and top 1%.
Findings
Using Spearman correlation analysis, the findings reveal a positive correlation between AAS and citations with different significant levels for all articles, and articles with AAS, as well as for normalized AAS in the top 50%, top 25%, top 10% and top 1% data set. For the three journals International Journal of Information Management (IJIM), Journal of Informetrics (JIF) and Library and Information Science Research (LISR), a significant positive correlation is observed across all data sets. But an unexpected result was observed: in the case of the top 50% of articles for the IJIM and JIF showed no significant correlation but the LISR journal showed a positive correlation for the whole data set. This journal though has fewer articles in comparison to the other two.
Research limitations/implications
A source item that is highly cited may not be having high social media attention as reflected in the findings. This demarcates AAS with citations implying various factors on which these measurements are dependent. The study distinguishes these metrics lucidly. There is not a single guideline or uniformity in assessing the correlation found. But the problem is that the interpretation of the correlation strength affects the conclusion of the study. Moreover, this study will be a role model as a draft for librarians to select relevant journals for their libraries and will facilitate authors in the choice of the publication outlets for their papers, particularly concerning the journals that have both visibility and research impact.
Originality/value
The study reported devising a comprehensive tool to validate AAS as a measure of scholarly impact to include appropriate social media sources and verify its relationship with other metrics. To the best of the authors’ knowledge, this paper is the first attempt to discover the correlation between AAS and citations for the highly impactful LIS journal published by Elsevier. The empirical evidence lies in the citation and altmetric data extracted from the dimension database.
期刊介绍:
Information Discovery and Delivery covers information discovery and access for digital information researchers. This includes educators, knowledge professionals in education and cultural organisations, knowledge managers in media, health care and government, as well as librarians. The journal publishes research and practice which explores the digital information supply chain ie transport, flows, tracking, exchange and sharing, including within and between libraries. It is also interested in digital information capture, packaging and storage by ‘collectors’ of all kinds. Information is widely defined, including but not limited to: Records, Documents, Learning objects, Visual and sound files, Data and metadata and , User-generated content.