Ria H A Hoekstra, S. Epskamp, Andrew A. Nierenberg, D. Borsboom, Richard J. McNally
{"title":"Testing similarity in longitudinal networks: The Individual Network Invariance Test.","authors":"Ria H A Hoekstra, S. Epskamp, Andrew A. Nierenberg, D. Borsboom, Richard J. McNally","doi":"10.1037/met0000638","DOIUrl":null,"url":null,"abstract":"The comparison of idiographic network structures to determine the presence of heterogeneity is a challenging endeavor in many applied settings. Previously, researchers eyeballed idiographic networks, computed correlations, and used techniques that make use of the multilevel structure of the data (e.g., group iterative multiple model estimation and multilevel vector autoregressive) to investigate individual differences. However, these methods do not allow for testing the (in)equality of idiographic network structures directly. In this article, we propose the Individual Network Invariance Test (INIT), which we implemented in the R package INIT. INIT extends common model comparison practices in structural equation modeling to idiographic network structures to test for (in)equality between idiographic networks. In a simulation study, we evaluated the performance of INIT on both saturated and pruned idiographic network structures by inspecting the rejection rate of the χ² difference test and model selection criteria, such as the Akaike information criterion (AIC) and Bayesian information criterion (BIC). Results show INIT performs adequately when t = 100 per individual. When applying INIT on saturated networks, the AIC performed best as a model selection criterion, while the BIC showed better results when applying INIT on pruned networks. In an empirical example, we highlight the possibilities of this new technique, illustrating how INIT provides researchers with a means of testing for (in)equality between idiographic network structures and within idiographic network structures over time. To conclude, recommendations for empirical researchers are provided. (PsycInfo Database Record (c) 2024 APA, all rights reserved).","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":null,"pages":null},"PeriodicalIF":7.6000,"publicationDate":"2024-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Psychological methods","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1037/met0000638","RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 2
Abstract
The comparison of idiographic network structures to determine the presence of heterogeneity is a challenging endeavor in many applied settings. Previously, researchers eyeballed idiographic networks, computed correlations, and used techniques that make use of the multilevel structure of the data (e.g., group iterative multiple model estimation and multilevel vector autoregressive) to investigate individual differences. However, these methods do not allow for testing the (in)equality of idiographic network structures directly. In this article, we propose the Individual Network Invariance Test (INIT), which we implemented in the R package INIT. INIT extends common model comparison practices in structural equation modeling to idiographic network structures to test for (in)equality between idiographic networks. In a simulation study, we evaluated the performance of INIT on both saturated and pruned idiographic network structures by inspecting the rejection rate of the χ² difference test and model selection criteria, such as the Akaike information criterion (AIC) and Bayesian information criterion (BIC). Results show INIT performs adequately when t = 100 per individual. When applying INIT on saturated networks, the AIC performed best as a model selection criterion, while the BIC showed better results when applying INIT on pruned networks. In an empirical example, we highlight the possibilities of this new technique, illustrating how INIT provides researchers with a means of testing for (in)equality between idiographic network structures and within idiographic network structures over time. To conclude, recommendations for empirical researchers are provided. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
期刊介绍:
Psychological Methods is devoted to the development and dissemination of methods for collecting, analyzing, understanding, and interpreting psychological data. Its purpose is the dissemination of innovations in research design, measurement, methodology, and quantitative and qualitative analysis to the psychological community; its further purpose is to promote effective communication about related substantive and methodological issues. The audience is expected to be diverse and to include those who develop new procedures, those who are responsible for undergraduate and graduate training in design, measurement, and statistics, as well as those who employ those procedures in research.