Journal of Computational Social Science最新文献

This paper studies the performance of open-source Large Language Models (LLMs) in text classification tasks typical for political science research. By examining tasks like stance, topic, and relevance classification, we aim to guide scholars in making informed decisions about their use of LLMs for text analysis and to establish a baseline performance benchmark that demonstrates the models' effectiveness. Specifically, we conduct an assessment of both zero-shot and fine-tuned LLMs across a range of text annotation tasks using news articles and tweets datasets. Our analysis shows that fine-tuning improves the performance of open-source LLMs, allowing them to match or even surpass zero-shot GPT $-$ 3.5 and GPT-4, though still lagging behind fine-tuned GPT $-$ 3.5. We further establish that fine-tuning is preferable to few-shot training with a relatively modest quantity of annotated text. Our findings show that fine-tuned open-source LLMs can be effectively deployed in a broad spectrum of text annotation applications. We provide a Python notebook facilitating the application of LLMs in text annotation for other researchers.

Supplementary information: The online version contains supplementary material available at 10.1007/s42001-024-00345-9.

A network analysis approach, complemented by machine learning (ML) techniques, is applied to analyse the factors influencing Bilateral Investment Treaties (BITs) at the country level. Using the Electronic Database of Investment Treaties, BITs with health safeguards from 167 countries were charted, resulting in 534 connections with countries as nodes and their BITs as edges. Network analysis found that, on average, a country established BITs with six other nations. Additionally, we used node embedding techniques to generate features from the network, such as the Jaccard coefficient, resource allocation, and Adamic Adar for downstream link prediction. This study employed five tree-based ML models to predict future BIT formations with health inclusion. The eXtreme Gradient Boosting model proved to be superior, achieving a 64.02% accuracy rate. Notably, the Common Neighbor centrality feature and the Capital Account Balance Ratio emerged as influential factors in creating new BITs with health inclusions. Beyond economic considerations, our study highlighted a vital intersection: the nexus between BITs, economic growth, and public health policies. In essence, this research underscores the importance of safeguarding public health in BITs and showcases the potential of ML in understanding the intricacies of international treaties.

Epidemics, apart from affecting the health of populations, can have large impacts on their social and economic behavior and subsequently feed back to and influence the spreading of the disease. This calls for systematic investigation which factors affect significantly and either beneficially or adversely the disease spreading and regional socio-economics. Based on our recently developed hybrid agent-based socio-economy and epidemic spreading model we perform extensive exploration of its six-dimensional parameter space of the socio-economic part of the model, namely, the attitudes towards the spread of the pandemic, health and the economic situation for both, the population and government agents who impose regulations. We search for significant patterns from the resulting simulated data using basic classification tools, such as self-organizing maps and principal component analysis, and we monitor different quantities of the model output, such as infection rates, the propagation speed of the epidemic, economic activity, government regulations, and the compliance of population on government restrictions. Out of these, the ones describing the epidemic spreading were resulting in the most distinctive clustering of the data, and they were selected as the basis of the remaining analysis. We relate the found clusters to three distinct types of disease spreading: wave-like, chaotic, and transitional spreading patterns. The most important value parameter contributing to phase changes and the speed of the epidemic was found to be the compliance of the population agents towards the government regulations. We conclude that in compliant populations, the infection rates are significantly lower and the infection spreading is slower, while the population agents' health and economical attitudes show a weaker effect.

Large relational-event history data stemming from large networks are becoming increasingly available due to recent technological developments (e.g. digital communication, online databases, etc). This opens many new doors to learn about complex interaction behavior between actors in temporal social networks. The relational event model has become the gold standard for relational event history analysis. Currently, however, the main bottleneck to fit relational events models is of computational nature in the form of memory storage limitations and computational complexity. Relational event models are therefore mainly used for relatively small data sets while larger, more interesting datasets, including multilevel data structures and relational event data streams, cannot be analyzed on standard desktop computers. This paper addresses this problem by developing approximation algorithms based on meta-analysis methods that can fit relational event models significantly faster while avoiding the computational issues. In particular, meta-analytic approximations are proposed for analyzing streams of relational event data, multilevel relational event data and potentially combinations thereof. The accuracy and the statistical properties of the methods are assessed using numerical simulations. Furthermore, real-world data are used to illustrate the potential of the methodology to study social interaction behavior in an organizational network and interaction behavior among political actors. The algorithms are implemented in the publicly available R package 'remx'.

Policy decisions concerning housing, transportation, and resource allocation would all benefit from accurate small-area population forecasts. However, despite the success of regional-scale migration models, developing neighborhood-scale forecasts remains a challenge due to the complex nature of residential choice. Here, we introduce an innovative approach to this challenge by extending density-functional fluctuation theory (DFFT), a proven approach for modeling group spatial behavior in biological systems, to predict small-area population shifts over time. The DFFT method uses observed fluctuations in small-area populations to disentangle and extract effective social and spatial drivers of segregation, and then uses this information to forecast intra-regional migration. To demonstrate the efficacy of our approach in a controlled setting, we consider a simulated city constructed from a Schelling-type model. Our findings indicate that even without direct access to the underlying agent preferences, DFFT accurately predicts how broader demographic changes at the city scale percolate to small-area populations. In particular, our results demonstrate the ability of DFFT to incorporate the impacts of segregation into small-area population forecasting using interactions inferred solely from steady-state population count data.