This paper proposes a method to evaluate academic impact that focuses on spatial context in which citations occur in sections of citing papers. Previous studies measured impact of papers using external factors such as journals, time, and authors. However, these methods overlooks context of citations, leading to problem of treating papers with same citation counts equivalently. To overcome this issue, we designed a citation network by reflecting on the spatial context in which cited papers are cited in the citing paper and measured their impact. Spatial context is defined by the specific section of the citing paper (Introduction, Method, Result, Discussion, Conclusion) where the citation appears. We collected 818 citing papers and 13,257 cited papers from 2013–2022 from Journal of Informetrics and constructed a context-reflected citation network. Further, we utilized CRITIC method and weighted PageRank algorithm for measuring section-specific weights and impact. Results obtained in this study suggest that the impact of cited papers varies significantly depending on the section context in which they appear. We use Kendall τ coefficient for analyzing correlation between “times cited” rankings and contextual PageRank. The Kendall τ coefficient between two ranks for entire dataset is 0.473. This study provides a multidimensional framework to assess the impact of academic papers, suggesting that future evaluations should consider not only the number of citations but also their context.
Conference-journal articles, which are expanded versions of conference proceedings papers, play an essential role in disseminating scientific knowledge but remain understudied. In the context of increasingly stringent research evaluation systems, this study focuses on conference-journal articles, examining the effectiveness of journals in selecting conference-derived publications. We also explore the factors influencing the citations of conference-journal articles. Here, we focused on Physics, analyzing 59,329 conference-journal articles published between 2012 and 2020, matched with general journal articles and conference proceedings papers based on the conference and journal. Results show that conference-journal articles receive significantly more citations than conference proceedings papers but fewer than general journal articles. Conference-journal articles in special issues receive fewer citations than those in regular issues. A U-shaped pattern emerges between the duration from the conference convening to the journal publication and the citation. We also found that conferences with sponsorship and those held in OECD member countries are more likely to produce highly cited conference-journal articles. Additionally, results indicate that conferences held in the USA, Japan, France, China, and Poland produce the most conference-journal articles, with articles from conferences in the USA, Japan, and France receiving relatively high citation counts. In contrast, articles from conferences held in China and Poland receive relatively low citation counts. This research provides valuable insights for academic conference committees, journal managers, and conference participants.
Novelty is a critical characteristic of innovative scientific articles, and accurately identifying novelty can facilitate the early detection of scientific breakthroughs. However, existing methods for measuring novelty have two main limitations: (1) Metadata-based approaches, such as citation analysis, are retrospective and do not alleviate the pressures of the peer review process or enable timely tracking of scientific progress; (2) Content-based methods have not adequately addressed the inherent uncertainty between the qualitative concept of novelty and the textual representation of papers. To address these issues, we propose a practical and effective framework for measuring the novelty of scientific articles through integrated topic modeling and cloud model, referred to as MNSA-ITMCM. In this framework, papers are represented as topic combinations, and novelty is reflected in the organic reorganization of these topics. We use the BERTopic model to generate semantically informed topics, and then apply a topic selection algorithm based on maximum marginal relevance to obtain a topic combination that balances similarity and diversity. Furthermore, we leverage the cloud model from fuzzy mathematics to quantify novelty, overcoming the uncertainty inherent in natural language expression and topic modeling to improve the accuracy of novelty measurement. To validate the effectiveness of our framework, we conducted empirical evaluations on papers from the Cell 2021 journal (biomedical domain) and the ICLR 2023 conference (computer science domain). Through correlation analysis and prediction error analysis, our framework demonstrated the ability to identify different types of novel papers and accurately predict their novelty levels. The proposed framework is applicable across diverse scientific disciplines and publication venues, benefiting researchers, librarians, science evaluation agencies, policymakers, and funding organizations by improving the efficiency and comprehensiveness of identifying novelty research.
Scientific innovation serves as the driving force behind societal progress. In contrast to conservative innovation, disruptive innovation reshapes scientific paradigms and trajectories, significantly influencing both the scientific community and societal development. This study employs an extensive empirical dataset to explore the potential of disruptive innovation to enhance the societal visibility of scientific research. Our research reveals that disruptive innovation significantly enhances societal visibility, increasing it by 11.96% compared to consolidating innovation. Furthermore, disruptive innovation does not directly lead to early-stage "breakthroughs" in scientific endeavors, but it does have a notable "acceleration" effect on societal visibility. Particularly striking is its ability to promote visibility of scientific research on social media platforms such as Twitter and blogs. However, its influence is insignificant in news articles and policy documents. This phenomenon may be attributed to the high-risk nature of disruptive innovation, which conflicts with the high level of trust, professionalism, and certainty sought in news and policy. This study carries essential implications for selecting innovative directions, the channels through which innovation is disseminated, and the formulation of science policies.