Austin S. Ferguson , Tomoyuki Nishino , Jessica B. Girault , Heather C. Hazlett , Robert T. Schultz , Natasha Marrus , Martin Styner , Santiago Torres-Gomez , Guido Gerig , Alan Evans , Stephen R. Dager , Annette M. Estes , Lonnie Zwaigenbaum , Juhi Pandey , Tanya St. John , Joseph Piven , John R. Pruett Jr. , Alexandre A. Todorov , for the IBIS Network
{"title":"Statistical properties of functional connectivity MRI enrichment analysis in school-age autism research","authors":"Austin S. Ferguson , Tomoyuki Nishino , Jessica B. Girault , Heather C. Hazlett , Robert T. Schultz , Natasha Marrus , Martin Styner , Santiago Torres-Gomez , Guido Gerig , Alan Evans , Stephen R. Dager , Annette M. Estes , Lonnie Zwaigenbaum , Juhi Pandey , Tanya St. John , Joseph Piven , John R. Pruett Jr. , Alexandre A. Todorov , for the IBIS Network","doi":"10.1016/j.dcn.2025.101534","DOIUrl":null,"url":null,"abstract":"<div><div>Mass univariate testing on functional connectivity MRI (fcMRI) data is limited by difficulties achieving experiment-wide significance. Recent work addressing this problem has used enrichment analysis, which aggregates univariate screening statistics for a set of variables into a single enrichment statistic. There have been promising results using this method to explore fcMRI-behavior associations. However, there has not yet been a rigorous examination of the statistical properties of enrichment analysis when applied to fcMRI data. Establishing power for fcMRI enrichment analysis will be important for future neuropsychiatric and cognitive neuroscience study designs that plan to include this method. Here, we use realistic simulation methods, which mimic the covariance structure of fcMRI data, to examine the false positive rate and statistical power of one technique for enrichment analysis, over-representation analysis. We find it can attain high power even for moderate effects and sample sizes, and it strongly outperforms univariate analysis. The false positive rate associated with permutation testing is robust.</div></div>","PeriodicalId":49083,"journal":{"name":"Developmental Cognitive Neuroscience","volume":"72 ","pages":"Article 101534"},"PeriodicalIF":4.6000,"publicationDate":"2025-02-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Developmental Cognitive Neuroscience","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1878929325000295","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"NEUROSCIENCES","Score":null,"Total":0}
引用次数: 0
Abstract
Mass univariate testing on functional connectivity MRI (fcMRI) data is limited by difficulties achieving experiment-wide significance. Recent work addressing this problem has used enrichment analysis, which aggregates univariate screening statistics for a set of variables into a single enrichment statistic. There have been promising results using this method to explore fcMRI-behavior associations. However, there has not yet been a rigorous examination of the statistical properties of enrichment analysis when applied to fcMRI data. Establishing power for fcMRI enrichment analysis will be important for future neuropsychiatric and cognitive neuroscience study designs that plan to include this method. Here, we use realistic simulation methods, which mimic the covariance structure of fcMRI data, to examine the false positive rate and statistical power of one technique for enrichment analysis, over-representation analysis. We find it can attain high power even for moderate effects and sample sizes, and it strongly outperforms univariate analysis. The false positive rate associated with permutation testing is robust.
期刊介绍:
The journal publishes theoretical and research papers on cognitive brain development, from infancy through childhood and adolescence and into adulthood. It covers neurocognitive development and neurocognitive processing in both typical and atypical development, including social and affective aspects. Appropriate methodologies for the journal include, but are not limited to, functional neuroimaging (fMRI and MEG), electrophysiology (EEG and ERP), NIRS and transcranial magnetic stimulation, as well as other basic neuroscience approaches using cellular and animal models that directly address cognitive brain development, patient studies, case studies, post-mortem studies and pharmacological studies.