Manuel Marques-Cruz, Daniel Martinho Dias, João A. Fonseca, Bernardo Sousa-Pinto
{"title":"利用早年引文数据建立系统综述十年引文预测模型","authors":"Manuel Marques-Cruz, Daniel Martinho Dias, João A. Fonseca, Bernardo Sousa-Pinto","doi":"10.1007/s11192-024-05105-0","DOIUrl":null,"url":null,"abstract":"<p>Citation counts are frequently used for assessing the scientific impact of articles. Current approaches for forecasting future citations counts have important limitations. This study aims to analyse and predict the trajectories of citation counts of systematic reviews (SR) based on their citation profiles in the previous years and predict quantiles of future citation counts. We included all SR published between 2010 and 2012 in medical journals indexed in the Web of Science. A longitudinal k-means (KML) clustering approach was applied to identify trajectories of citations counts 10 years after publication, according to the yearly citation count, the proportion of all cites attained in a specific year and the annual variation in citation counts. Finally, we built multinomial logistic regression models aiming to predict in what tercile or quartile of citation counts a SR would be 10 years after publication. Using clustering approaches, we obtained 24 groups of SR. Two groups (7.9% of the articles) had an average of > 200 citations, while two other groups (10.4% of the articles) presented an average of < 10 citations. The model predicting terciles of citation counts attained an accuracy of 72.8% (95%CI = 71.1–74.3%) and a kappa coefficient of 0.59 (95%CI = 0.57–0.62). Prediction of citation quartiles (combining the second and third quartiles into a single group) attained a accuracy of 76.2% (95%CI = 74.7–77.8%) and a kappa coefficient of 0.62 (95%CI = 0.59–0.64). This study provides an approach for predicting of future citations of SR based exclusively on citation counts from the previous years, with the models developed displaying an encouraging accuracy and agreement.</p>","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"42 1","pages":""},"PeriodicalIF":3.5000,"publicationDate":"2024-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Ten year citation prediction model for systematic reviews using early years citation data\",\"authors\":\"Manuel Marques-Cruz, Daniel Martinho Dias, João A. Fonseca, Bernardo Sousa-Pinto\",\"doi\":\"10.1007/s11192-024-05105-0\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Citation counts are frequently used for assessing the scientific impact of articles. Current approaches for forecasting future citations counts have important limitations. This study aims to analyse and predict the trajectories of citation counts of systematic reviews (SR) based on their citation profiles in the previous years and predict quantiles of future citation counts. We included all SR published between 2010 and 2012 in medical journals indexed in the Web of Science. A longitudinal k-means (KML) clustering approach was applied to identify trajectories of citations counts 10 years after publication, according to the yearly citation count, the proportion of all cites attained in a specific year and the annual variation in citation counts. Finally, we built multinomial logistic regression models aiming to predict in what tercile or quartile of citation counts a SR would be 10 years after publication. Using clustering approaches, we obtained 24 groups of SR. Two groups (7.9% of the articles) had an average of > 200 citations, while two other groups (10.4% of the articles) presented an average of < 10 citations. The model predicting terciles of citation counts attained an accuracy of 72.8% (95%CI = 71.1–74.3%) and a kappa coefficient of 0.59 (95%CI = 0.57–0.62). Prediction of citation quartiles (combining the second and third quartiles into a single group) attained a accuracy of 76.2% (95%CI = 74.7–77.8%) and a kappa coefficient of 0.62 (95%CI = 0.59–0.64). This study provides an approach for predicting of future citations of SR based exclusively on citation counts from the previous years, with the models developed displaying an encouraging accuracy and agreement.</p>\",\"PeriodicalId\":21755,\"journal\":{\"name\":\"Scientometrics\",\"volume\":\"42 1\",\"pages\":\"\"},\"PeriodicalIF\":3.5000,\"publicationDate\":\"2024-07-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Scientometrics\",\"FirstCategoryId\":\"91\",\"ListUrlMain\":\"https://doi.org/10.1007/s11192-024-05105-0\",\"RegionNum\":3,\"RegionCategory\":\"管理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Scientometrics","FirstCategoryId":"91","ListUrlMain":"https://doi.org/10.1007/s11192-024-05105-0","RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
Ten year citation prediction model for systematic reviews using early years citation data
Citation counts are frequently used for assessing the scientific impact of articles. Current approaches for forecasting future citations counts have important limitations. This study aims to analyse and predict the trajectories of citation counts of systematic reviews (SR) based on their citation profiles in the previous years and predict quantiles of future citation counts. We included all SR published between 2010 and 2012 in medical journals indexed in the Web of Science. A longitudinal k-means (KML) clustering approach was applied to identify trajectories of citations counts 10 years after publication, according to the yearly citation count, the proportion of all cites attained in a specific year and the annual variation in citation counts. Finally, we built multinomial logistic regression models aiming to predict in what tercile or quartile of citation counts a SR would be 10 years after publication. Using clustering approaches, we obtained 24 groups of SR. Two groups (7.9% of the articles) had an average of > 200 citations, while two other groups (10.4% of the articles) presented an average of < 10 citations. The model predicting terciles of citation counts attained an accuracy of 72.8% (95%CI = 71.1–74.3%) and a kappa coefficient of 0.59 (95%CI = 0.57–0.62). Prediction of citation quartiles (combining the second and third quartiles into a single group) attained a accuracy of 76.2% (95%CI = 74.7–77.8%) and a kappa coefficient of 0.62 (95%CI = 0.59–0.64). This study provides an approach for predicting of future citations of SR based exclusively on citation counts from the previous years, with the models developed displaying an encouraging accuracy and agreement.
期刊介绍:
Scientometrics aims at publishing original studies, short communications, preliminary reports, review papers, letters to the editor and book reviews on scientometrics. The topics covered are results of research concerned with the quantitative features and characteristics of science. Emphasis is placed on investigations in which the development and mechanism of science are studied by means of (statistical) mathematical methods.
The Journal also provides the reader with important up-to-date information about international meetings and events in scientometrics and related fields. Appropriate bibliographic compilations are published as a separate section. Due to its fully interdisciplinary character, Scientometrics is indispensable to research workers and research administrators throughout the world. It provides valuable assistance to librarians and documentalists in central scientific agencies, ministries, research institutes and laboratories.
Scientometrics includes the Journal of Research Communication Studies. Consequently its aims and scope cover that of the latter, namely, to bring the results of research investigations together in one place, in such a form that they will be of use not only to the investigators themselves but also to the entrepreneurs and research workers who form the object of these studies.