New methodologies for the digital age? How methods (re-)organize research using social media data

Abstract

Abstract As “big and broad” social media data continues to expand and become a more prevalent source for research, much remains to be understood about its epistemological and methodological implications. Drawing on an original dataset of 12,732 research articles using social media data, we employ a novel dictionary-based approach to map the use of methods. Specifically, our approach draws on a combination of manual coding and embedding-enhanced query expansion. We cluster journals in groups of densely connected research communities to investigate how heterogeneous these groups are in terms of the methods used. First, our results indicate that research in this domain is largely organized by methods. Some communities tend to have a mono-method culture, while others combine methods in novel ways. Comparing practices across communities, we observe that computational methods have penetrated many research areas but not the research space surrounding ethnography. Second, we identify two core axes of variation—social sciences vs. computer science and methodological individualism vs. relationalism—that organize the domain as a whole, suggesting new methodological divisions and debates. Peer Review https://www.webofscience.com/api/gateway/wos/peer-review/10.1162/qss_a_00271