The price of quality: Scholarly publishing business is the primary predictor of citation-based indicators of journal performance in ecology and evolutionary biology
{"title":"The price of quality: Scholarly publishing business is the primary predictor of citation-based indicators of journal performance in ecology and evolutionary biology","authors":"A. Ruggiero","doi":"10.1093/reseval/rvad012","DOIUrl":null,"url":null,"abstract":"\n Citation-based indicators of journals’ performance are often assumed to offer an objective, albeit indirect, way of measuring research quality. However, recent concerns about their applicability for research evaluation suggested these indicators could depend on historical and socioeconomic factors associated with scholarly publishing tradition and business, respectively. The present study addressed this issue quantitatively, using data on h-index and Scimago Journal Rank (SJR) for 566 journals within the fields of ecology and evolutionary biology, and applying Partial Least Squared Structural Equation Modelling. The Tradition Model accounted for <50% of the variation in h-index and SJR, showing that journals’ performance increased with an increase in articles’ international collaboration, and decreased for journals published by non-profit organizations. The Business Model accounted for >60% of the variation in h-index and SJR, showing that journals’ performance increased in association with the global50 ranking of publishers and high article processing charges. Countries recognized as world science centres, the use of English, the journal’s, and publisher’s year of origin, and the increase in science investment and scientific production promoted by the richest economies worldwide had no impact on journal performance. Results suggest that the h-index for journals and the SJR reflect multi-dimensional aspects of scholarly publishing, potentially affected by marketing strategies boosted by the biggest commercial publishers. Given the limitations of poor scientific communities in terms of publication costs, uncritical application of these indexes for research evaluation worldwide may reinforce the idea that high quality research is produced only by rich scientific societies.","PeriodicalId":47668,"journal":{"name":"Research Evaluation","volume":" ","pages":""},"PeriodicalIF":2.9000,"publicationDate":"2023-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Research Evaluation","FirstCategoryId":"91","ListUrlMain":"https://doi.org/10.1093/reseval/rvad012","RegionNum":4,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"INFORMATION SCIENCE & LIBRARY SCIENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Citation-based indicators of journals’ performance are often assumed to offer an objective, albeit indirect, way of measuring research quality. However, recent concerns about their applicability for research evaluation suggested these indicators could depend on historical and socioeconomic factors associated with scholarly publishing tradition and business, respectively. The present study addressed this issue quantitatively, using data on h-index and Scimago Journal Rank (SJR) for 566 journals within the fields of ecology and evolutionary biology, and applying Partial Least Squared Structural Equation Modelling. The Tradition Model accounted for <50% of the variation in h-index and SJR, showing that journals’ performance increased with an increase in articles’ international collaboration, and decreased for journals published by non-profit organizations. The Business Model accounted for >60% of the variation in h-index and SJR, showing that journals’ performance increased in association with the global50 ranking of publishers and high article processing charges. Countries recognized as world science centres, the use of English, the journal’s, and publisher’s year of origin, and the increase in science investment and scientific production promoted by the richest economies worldwide had no impact on journal performance. Results suggest that the h-index for journals and the SJR reflect multi-dimensional aspects of scholarly publishing, potentially affected by marketing strategies boosted by the biggest commercial publishers. Given the limitations of poor scientific communities in terms of publication costs, uncritical application of these indexes for research evaluation worldwide may reinforce the idea that high quality research is produced only by rich scientific societies.
期刊介绍:
Research Evaluation is a peer-reviewed, international journal. It ranges from the individual research project up to inter-country comparisons of research performance. Research projects, researchers, research centres, and the types of research output are all relevant. It includes public and private sectors, natural and social sciences. The term "evaluation" applies to all stages from priorities and proposals, through the monitoring of on-going projects and programmes, to the use of the results of research.