Luke J Matthews, Megan S Schuler, Raffaele Vardavas, Joshua Breslau, Ioana Popescu
{"title":"Evaluation via simulation of statistical corrections for network nonindependence.","authors":"Luke J Matthews, Megan S Schuler, Raffaele Vardavas, Joshua Breslau, Ioana Popescu","doi":"10.1007/s10742-023-00311-4","DOIUrl":null,"url":null,"abstract":"<p><p>Social processes and social context are increasingly recognized as key factors shaping health-related behaviors and outcomes. One social process that may be acting within social networks is social influence, in which an individual's characteristic (e.g., specific health behavior) is potentially impacted by the corresponding characteristic of connected individuals in the network. In the health services context, healthcare providers who work together and share patients may influence each other through the knowledge transmission or development of clinical practice norms. Although many statistical techniques assume independence of data points, when analyzing data that may reflect social processes acting across a social network, it is imperative to account for the interdependencies (i.e., non-independence) across individuals. In practice, studies account for nonindependence in the context of estimating bivariate relations (correlations or linear regression) using a variety of analytic methods (some of which have previously been shown to yield biased results). To date, it is unclear which methods yield acceptable false positive rates, unbiased coefficient estimates, and acceptable statistical power, because there have been no systematic simulation studies comparing methods for addressing network nonindependence arising from social influence. To address this gap, we compared eight commonly used methods that purport to account for nonindependence using simulated network data. While results indicated that none of the techniques reduced false positive rates to the predicted (nominal) 0.05 level, random sampling of network nodes was the method that yielded the smallest false positive rates, yet came at a price of reduced statistical power. Further methodological development is needed.</p>","PeriodicalId":45600,"journal":{"name":"Health Services and Outcomes Research Methodology","volume":"37 1","pages":"211-226"},"PeriodicalIF":1.6000,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12700765/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Health Services and Outcomes Research Methodology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/s10742-023-00311-4","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/8/12 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0
Abstract
Social processes and social context are increasingly recognized as key factors shaping health-related behaviors and outcomes. One social process that may be acting within social networks is social influence, in which an individual's characteristic (e.g., specific health behavior) is potentially impacted by the corresponding characteristic of connected individuals in the network. In the health services context, healthcare providers who work together and share patients may influence each other through the knowledge transmission or development of clinical practice norms. Although many statistical techniques assume independence of data points, when analyzing data that may reflect social processes acting across a social network, it is imperative to account for the interdependencies (i.e., non-independence) across individuals. In practice, studies account for nonindependence in the context of estimating bivariate relations (correlations or linear regression) using a variety of analytic methods (some of which have previously been shown to yield biased results). To date, it is unclear which methods yield acceptable false positive rates, unbiased coefficient estimates, and acceptable statistical power, because there have been no systematic simulation studies comparing methods for addressing network nonindependence arising from social influence. To address this gap, we compared eight commonly used methods that purport to account for nonindependence using simulated network data. While results indicated that none of the techniques reduced false positive rates to the predicted (nominal) 0.05 level, random sampling of network nodes was the method that yielded the smallest false positive rates, yet came at a price of reduced statistical power. Further methodological development is needed.
期刊介绍:
The journal reflects the multidisciplinary nature of the field of health services and outcomes research. It addresses the needs of multiple, interlocking communities, including methodologists in statistics, econometrics, social and behavioral sciences; designers and analysts of health policy and health services research projects; and health care providers and policy makers who need to properly understand and evaluate the results of published research. The journal strives to enhance the level of methodologic rigor in health services and outcomes research and contributes to the development of methodologic standards in the field. In pursuing its main objective, the journal also provides a meeting ground for researchers from a number of traditional disciplines and fosters the development of new quantitative, qualitative, and mixed methods by statisticians, econometricians, health services researchers, and methodologists in other fields. Health Services and Outcomes Research Methodology publishes: Research papers on quantitative, qualitative, and mixed methods; Case Studies describing applications of quantitative and qualitative methodology in health services and outcomes research; Review Articles synthesizing and popularizing methodologic developments; Tutorials; Articles on computational issues and software reviews; Book reviews; and Notices. Special issues will be devoted to papers presented at important workshops and conferences.