Comparison of datasets citation coverage in Google Scholar, Web of Science, Scopus, Crossref, and DataCite

Abstract

The rapid increase of Earth science data from remote sensing, models, and ground-based observations highlights an urgent need for effective data management practices. Data repositories track provenance and usage metrics which are crucial for ensuring data integrity and scientific reproducibility. Although the introduction of Digital Object Identifiers (DOIs) for datasets in the late 1990s has significantly aided in crediting creators and enhancing dataset discoverability (akin to traditional research citations), considerable challenges persist in establishing linkage of datasets used with scholarly documents. This study evaluates the citation coverage of datasets from NASA’s Earth Observing System Data and Information System (EOSDIS) across several major bibliographic sources ‒ namely Google Scholar (GS), Web of Science (WoS), Scopus, Crossref, and DataCite—which helps data managers in making informed decisions when selecting bibliographic sources. We provide a robust and comprehensive understanding of the citation landscape, crucial for advancing data management practices and advancing open science. Our study searched and analyzed temporal trends across the bibliographic sources for publications that cite approximately 11,000 DOIs associated with EOSDIS datasets, yielding 17,000 unique journal and conference articles, reports, and book records linked to 3,000 dataset DOIs. GS emerged as the most comprehensive source while Crossref lagged significantly behind the other major sources. Crossref’s record references revealed that the absence of dataset DOIs and shortcomings in the Crossref Event data interface likely contributed to its underperformance. Scopus initially outperformed WoS until 2020, after which WoS began to show superior performance. Overall, our study underscores the necessity of utilizing multiple bibliographic sources for citation analysis, particularly for exploring dataset-to-document connections.