Xuan Li, Zhuonan Wang, Haonan Zhang, Wenpu Zhao, Qiuyu Ji, Xiang Zhang, Xiaoyan Jia, Guanghui Bai, Yizhen Pan, Tingting Wu, Bo Yin, Lei Shi, Zhiqi Li, Jierui Ding, Jie Zhang, David H. Salat, Lijun Bai
Traumatic brain injury (TBI) is considered to initiate cerebrovascular pathology, involving in the development of multiple forms of neurodegeneration. However, it is unknown the relationships between imaging marker of cerebrovascular injury (white matter hyperintensity, WMH), its load on white matter tract and disrupted brain dynamics with cognitive function in mild TBI (mTBI). MRI data and neuropsychological assessments were collected from 85 mTBI patients and 52 healthy controls. Between-group difference was conducted for the tract-specific WMH volumes, white matter integrity, and dynamic brain connectivity (i.e., fractional occupancies [%], dwell times [seconds], and state transitions). Regression analysis was used to examine associations between white matter damage, brain dynamics, and cognitive function. Increased WMH volumes induced by mTBI within the thalamic radiation and corpus callosum were highest among all tract fibers, and related with altered fractional anisotropy (FA) within the same tracts. Clustering identified two brain states, segregated state characterized by the sparse inter-independent component connections, and default mode network (DMN)-centered integrated state with strongly internetwork connections between DMN and other networks. In mTBI, higher WMH loads contributed to the longer dwell time and larger fractional occupancies in DMN-centered integrated state. Every 1 mL increase in WMH volume within the left thalamic radiation was associated with a 47% increase fractional occupancies, and contributed to 65.6 s delay in completion of cognitive processing speed test. Our study provided the first evidence for the structural determinants (i.e., small vessel lesions) that mediate the spatiotemporal brain dynamics to cognitive impairments in mTBI.
{"title":"Tract-Specific White Matter Hyperintensities Disrupt Brain Networks and Associated With Cognitive Impairment in Mild Traumatic Brain Injury","authors":"Xuan Li, Zhuonan Wang, Haonan Zhang, Wenpu Zhao, Qiuyu Ji, Xiang Zhang, Xiaoyan Jia, Guanghui Bai, Yizhen Pan, Tingting Wu, Bo Yin, Lei Shi, Zhiqi Li, Jierui Ding, Jie Zhang, David H. Salat, Lijun Bai","doi":"10.1002/hbm.70050","DOIUrl":"https://doi.org/10.1002/hbm.70050","url":null,"abstract":"<p>Traumatic brain injury (TBI) is considered to initiate cerebrovascular pathology, involving in the development of multiple forms of neurodegeneration. However, it is unknown the relationships between imaging marker of cerebrovascular injury (white matter hyperintensity, WMH), its load on white matter tract and disrupted brain dynamics with cognitive function in mild TBI (mTBI). MRI data and neuropsychological assessments were collected from 85 mTBI patients and 52 healthy controls. Between-group difference was conducted for the tract-specific WMH volumes, white matter integrity, and dynamic brain connectivity (i.e., fractional occupancies [%], dwell times [seconds], and state transitions). Regression analysis was used to examine associations between white matter damage, brain dynamics, and cognitive function. Increased WMH volumes induced by mTBI within the thalamic radiation and corpus callosum were highest among all tract fibers, and related with altered fractional anisotropy (FA) within the same tracts. Clustering identified two brain states, segregated state characterized by the sparse inter-independent component connections, and default mode network (DMN)-centered integrated state with strongly internetwork connections between DMN and other networks. In mTBI, higher WMH loads contributed to the longer dwell time and larger fractional occupancies in DMN-centered integrated state. Every 1 mL increase in WMH volume within the left thalamic radiation was associated with a 47% increase fractional occupancies, and contributed to 65.6 s delay in completion of cognitive processing speed test. Our study provided the first evidence for the structural determinants (i.e., small vessel lesions) that mediate the spatiotemporal brain dynamics to cognitive impairments in mTBI.</p>","PeriodicalId":13019,"journal":{"name":"Human Brain Mapping","volume":"45 17","pages":""},"PeriodicalIF":3.5,"publicationDate":"2024-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/hbm.70050","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142749368","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Multimodal neuroimaging is an emerging field that leverages multiple sources of information to diagnose specific brain disorders, especially when deep learning-based AI algorithms are applied. The successful combination of different brain imaging modalities using deep learning remains a challenging yet crucial research topic. The integration of structural and functional modalities is particularly important for the diagnosis of various brain disorders, where structural information plays a crucial role in diseases such as Alzheimer's, while functional imaging is more critical for disorders such as schizophrenia. However, the combination of functional and structural imaging modalities can provide a more comprehensive diagnosis. In this work, we present MultiViT, a novel diagnostic deep learning model that utilizes vision transformers and cross-attention mechanisms to effectively fuse information from 3D gray matter maps derived from structural MRI with functional network connectivity matrices obtained from functional MRI using the ICA algorithm. MultiViT achieves an AUC of 0.833, outperforming both our unimodal and multimodal baselines, enabling more accurate classification and diagnosis of schizophrenia. In addition, using vision transformer's unique attentional maps in combination with cross-attentional mechanisms and brain function information, we identify critical brain regions in 3D gray matter space associated with the characteristics of schizophrenia. Our research not only significantly improves the accuracy of AI-based automated imaging diagnostics for schizophrenia, but also pioneers a rational and advanced data fusion approach by replacing complex, high-dimensional fMRI information with functional network connectivity, integrating it with representative structural data from 3D gray matter images, and further providing interpretative biomarker localization in a 3D structural space.
{"title":"A multimodal vision transformer for interpretable fusion of functional and structural neuroimaging data","authors":"Yuda Bi, Anees Abrol, Zening Fu, Vince D. Calhoun","doi":"10.1002/hbm.26783","DOIUrl":"https://doi.org/10.1002/hbm.26783","url":null,"abstract":"<p>Multimodal neuroimaging is an emerging field that leverages multiple sources of information to diagnose specific brain disorders, especially when deep learning-based AI algorithms are applied. The successful combination of different brain imaging modalities using deep learning remains a challenging yet crucial research topic. The integration of structural and functional modalities is particularly important for the diagnosis of various brain disorders, where structural information plays a crucial role in diseases such as Alzheimer's, while functional imaging is more critical for disorders such as schizophrenia. However, the combination of functional and structural imaging modalities can provide a more comprehensive diagnosis. In this work, we present MultiViT, a novel diagnostic deep learning model that utilizes vision transformers and cross-attention mechanisms to effectively fuse information from 3D gray matter maps derived from structural MRI with functional network connectivity matrices obtained from functional MRI using the ICA algorithm. MultiViT achieves an AUC of 0.833, outperforming both our unimodal and multimodal baselines, enabling more accurate classification and diagnosis of schizophrenia. In addition, using vision transformer's unique attentional maps in combination with cross-attentional mechanisms and brain function information, we identify critical brain regions in 3D gray matter space associated with the characteristics of schizophrenia. Our research not only significantly improves the accuracy of AI-based automated imaging diagnostics for schizophrenia, but also pioneers a rational and advanced data fusion approach by replacing complex, high-dimensional fMRI information with functional network connectivity, integrating it with representative structural data from 3D gray matter images, and further providing interpretative biomarker localization in a 3D structural space.</p>","PeriodicalId":13019,"journal":{"name":"Human Brain Mapping","volume":"45 17","pages":""},"PeriodicalIF":3.5,"publicationDate":"2024-11-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/hbm.26783","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142714687","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Brian Donohue, Si Gao, Thomas E. Nichols, Bhim M. Adhikari, Yizhou Ma, Neda Jahanshad, Paul M. Thompson, Francis J. McMahon, Elizabeth M. Humphries, William Burroughs, Seth A. Ament, Braxton D. Mitchell, Tianzhou Ma, Shuo Chen, Sarah E. Medland, John Blangero, L. Elliot Hong, Peter Kochunov
National and international biobanking efforts led to the collection of large and inclusive imaging genetics datasets that enable examination of the contribution of genetic and environmental factors to human brains in illness and health. High-resolution neuroimaging (~104–6 voxels) and genetic (106–8 single nucleotide polymorphic [SNP] variants) data are available in statistically powerful (N = 103–5) epidemiological and disorder-focused samples. Performing imaging genetics analyses at full resolution afforded in these datasets is a formidable computational task even under the assumption of unrelatedness among the subjects. The computational complexity rises as ~N2–3 (where N is the sample size), when accounting for relatedness among subjects. We describe fast, non-iterative simplifications to accelerate classical variance component (VC) methods including heritability, genetic correlation, and genome-wide association in dense and complex empirical pedigrees. These approaches linearize (from N2–3 to N~1) computational effort while maintaining fidelity (r ~ 0.95) with the VC results and take advantage of parallel computing provided by central and graphics processing units (CPU and GPU). We show that the new approaches lead to a 104- to 106-fold reduction in computational complexity—making voxel-wise heritability, genetic correlation, and genome-wide association studies (GWAS) analysis practical for large and complex samples such as those provided by the Amish and Human Connectome Projects (N = 406 and 1052 subjects, respectively) and UK Biobank (N = 31,681). These developments are shared in open-source, SOLAR-Eclipse software.
{"title":"Accelerating Heritability, Genetic Correlation, and Genome-Wide Association Imaging Genetic Analyses in Complex Pedigrees","authors":"Brian Donohue, Si Gao, Thomas E. Nichols, Bhim M. Adhikari, Yizhou Ma, Neda Jahanshad, Paul M. Thompson, Francis J. McMahon, Elizabeth M. Humphries, William Burroughs, Seth A. Ament, Braxton D. Mitchell, Tianzhou Ma, Shuo Chen, Sarah E. Medland, John Blangero, L. Elliot Hong, Peter Kochunov","doi":"10.1002/hbm.70044","DOIUrl":"https://doi.org/10.1002/hbm.70044","url":null,"abstract":"<p>National and international biobanking efforts led to the collection of large and inclusive imaging genetics datasets that enable examination of the contribution of genetic and environmental factors to human brains in illness and health. High-resolution neuroimaging (~10<sup>4–6</sup> voxels) and genetic (10<sup>6–8</sup> single nucleotide polymorphic [SNP] variants) data are available in statistically powerful (<i>N</i> = 10<sup>3–5</sup>) epidemiological and disorder-focused samples. Performing imaging genetics analyses at full resolution afforded in these datasets is a formidable computational task even under the assumption of <i>unrelatedness</i> among the subjects. The computational complexity rises as ~<i>N</i><sup>2–3</sup> (where <i>N</i> is the sample size), when accounting for relatedness among subjects. We describe fast, non-iterative simplifications to accelerate classical variance component (VC) methods including heritability, genetic correlation, and genome-wide association in dense and complex empirical pedigrees. These approaches linearize (from <i>N</i><sup>2–3</sup> to <i>N</i><sup>~1</sup>) computational effort while maintaining fidelity (<i>r</i> ~ 0.95) with the VC results and take advantage of parallel computing provided by central and graphics processing units (CPU and GPU). We show that the new approaches lead to a 10<sup>4</sup>- to 10<sup>6</sup>-fold reduction in computational complexity—making voxel-wise heritability, genetic correlation, and genome-wide association studies (GWAS) analysis practical for large and complex samples such as those provided by the Amish and Human Connectome Projects (<i>N</i> = 406 and 1052 subjects, respectively) and UK Biobank (<i>N</i> = 31,681). These developments are shared in open-source, SOLAR-Eclipse software.</p>","PeriodicalId":13019,"journal":{"name":"Human Brain Mapping","volume":"45 17","pages":""},"PeriodicalIF":3.5,"publicationDate":"2024-11-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/hbm.70044","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142714688","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Subcortical volumes are a promising source of biomarkers and features in biosignatures, and automated methods facilitate extracting them in large, phenotypically rich datasets. However, while extensive research has verified that the automated methods produce volumes that are similar to those generated by expert annotation; the consistency of methods with each other is understudied. Using data from the UK Biobank, we compare the estimates of subcortical volumes produced by two popular software suites: FSL and FreeSurfer. Although most subcortical volumes exhibit good to excellent consistency across the methods, the tools produce diverging estimates of amygdalar volume. Through simulation, we show that this poor consistency can lead to conflicting results, where one but not the other tool suggests statistical significance, or where both tools suggest a significant relationship but in opposite directions. Considering these issues, we discuss several ways in which care should be taken when reporting on relationships involving amygdalar volume.
{"title":"Comparing automated subcortical volume estimation methods; amygdala volumes estimated by FSL and FreeSurfer have poor consistency","authors":"Patrick Sadil, Martin A. Lindquist","doi":"10.1002/hbm.70027","DOIUrl":"https://doi.org/10.1002/hbm.70027","url":null,"abstract":"<p>Subcortical volumes are a promising source of biomarkers and features in biosignatures, and automated methods facilitate extracting them in large, phenotypically rich datasets. However, while extensive research has verified that the automated methods produce volumes that are similar to those generated by expert annotation; the consistency of methods with each other is understudied. Using data from the UK Biobank, we compare the estimates of subcortical volumes produced by two popular software suites: FSL and FreeSurfer. Although most subcortical volumes exhibit good to excellent consistency across the methods, the tools produce diverging estimates of amygdalar volume. Through simulation, we show that this poor consistency can lead to conflicting results, where one but not the other tool suggests statistical significance, or where both tools suggest a significant relationship but in opposite directions. Considering these issues, we discuss several ways in which care should be taken when reporting on relationships involving amygdalar volume.</p>","PeriodicalId":13019,"journal":{"name":"Human Brain Mapping","volume":"45 17","pages":""},"PeriodicalIF":3.5,"publicationDate":"2024-11-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/hbm.70027","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142714666","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Asymmetry in choice patterns across rewarding and punishing contexts has long been observed in behavioural economics. Within existing theories of reinforcement learning, the mechanistic account of these behavioural differences is still debated. We propose that motivational salience—the degree of bottom-up attention attracted by a stimulus with relation to motivational goals—offers a potential mechanism to modulate stimulus value updating and decision policy. In a probabilistic reversal learning task, we identified post-feedback signals from EEG and pupillometry that captured differential activity with respect to rewarding and punishing contexts. We show that the degree of between-context distinction in these signals predicts interindividual asymmetries in decision accuracy. Finally, we contextualise these effects in relation to the neural pathways that are currently centred in theories of reward and punishment learning, demonstrating how the motivational salience network could plausibly fit into a range of existing frameworks.
{"title":"Early Salience Signals Predict Interindividual Asymmetry in Decision Accuracy Across Rewarding and Punishing Contexts","authors":"Sean Westwood, Marios G. Philiastides","doi":"10.1002/hbm.70072","DOIUrl":"https://doi.org/10.1002/hbm.70072","url":null,"abstract":"<p>Asymmetry in choice patterns across rewarding and punishing contexts has long been observed in behavioural economics. Within existing theories of reinforcement learning, the mechanistic account of these behavioural differences is still debated. We propose that motivational salience—the degree of bottom-up attention attracted by a stimulus with relation to motivational goals—offers a potential mechanism to modulate stimulus value updating and decision policy. In a probabilistic reversal learning task, we identified post-feedback signals from EEG and pupillometry that captured differential activity with respect to rewarding and punishing contexts. We show that the degree of between-context distinction in these signals predicts interindividual asymmetries in decision accuracy. Finally, we contextualise these effects in relation to the neural pathways that are currently centred in theories of reward and punishment learning, demonstrating how the motivational salience network could plausibly fit into a range of existing frameworks.</p>","PeriodicalId":13019,"journal":{"name":"Human Brain Mapping","volume":"45 17","pages":""},"PeriodicalIF":3.5,"publicationDate":"2024-11-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/hbm.70072","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142708237","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
White matter hyperintensities (WMH), a common feature of cerebral small vessel disease, affect a wide range of cognitive dysfunctions, including spatial neglect. The latter is a disorder of spatial attention and exploration typically after right hemisphere brain damage. To explore the impact of WMH on neglect-related structural disconnections, the present study investigated the indirectly quantified structural disconnectome induced by either stroke lesion alone, WMH alone, or their combination. Furthermore, we compared different measures of structural disconnection—voxel-wise, pairwise, tract-wise, and parcel-wise—to identify neural correlates and predict acute neglect severity. We observed that WMH-derived disconnections alone were not associated with neglect behavior. However, when combined with disconnections derived from individual stroke lesions, pre-stroke WMH contributed to post-stroke neglect severity by affecting right frontal and subcortical substrates, like the middle frontal gyrus, basal ganglia, thalamus, and the fronto-pontine tract. Predictive modeling demonstrated that voxel-wise disconnection data outperformed other measures of structural disconnection, explaining 42% of the total variance; interestingly, the best model used predictors of stroke-based disconnections only. We conclude that prestroke alterations in the white matter microstructure due to WMH contribute to poststroke deficits in spatial attention, likely by impairing the integrity of human attention networks.
{"title":"Structural Disconnections Caused by White Matter Hyperintensities in Post-Stroke Spatial Neglect","authors":"Lisa Röhrig, Hans-Otto Karnath","doi":"10.1002/hbm.70078","DOIUrl":"https://doi.org/10.1002/hbm.70078","url":null,"abstract":"<p>White matter hyperintensities (WMH), a common feature of cerebral small vessel disease, affect a wide range of cognitive dysfunctions, including spatial neglect. The latter is a disorder of spatial attention and exploration typically after right hemisphere brain damage. To explore the impact of WMH on neglect-related structural disconnections, the present study investigated the indirectly quantified structural disconnectome induced by either stroke lesion alone, WMH alone, or their combination. Furthermore, we compared different measures of structural disconnection—voxel-wise, pairwise, tract-wise, and parcel-wise—to identify neural correlates and predict acute neglect severity. We observed that WMH-derived disconnections alone were not associated with neglect behavior. However, when combined with disconnections derived from individual stroke lesions, pre-stroke WMH contributed to post-stroke neglect severity by affecting right frontal and subcortical substrates, like the middle frontal gyrus, basal ganglia, thalamus, and the fronto-pontine tract. Predictive modeling demonstrated that voxel-wise disconnection data outperformed other measures of structural disconnection, explaining 42% of the total variance; interestingly, the best model used predictors of stroke-based disconnections only. We conclude that prestroke alterations in the white matter microstructure due to WMH contribute to poststroke deficits in spatial attention, likely by impairing the integrity of human attention networks.</p>","PeriodicalId":13019,"journal":{"name":"Human Brain Mapping","volume":"45 17","pages":""},"PeriodicalIF":3.5,"publicationDate":"2024-11-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/hbm.70078","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142708238","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Leland L. Fleming, Matthew K. Defenderfer, Pinar Demirayak, Paul Stewart, Dawn K. Decarlo, Kristina M. Visscher
Human behavior can be remarkably shaped by experience, such as the removal of sensory input. Many studies of conditions such as stroke, limb amputation, and vision loss have examined how removal of input changes brain function. However, an important question yet to be answered is: when input is lost, does the brain change its connectivity to preferentially use some remaining inputs over others? In individuals with healthy vision, the central portion of the retina is preferentially used for everyday visual tasks, due to its ability to discriminate fine details. When central vision is lost in conditions like macular degeneration, peripheral vision must be relied upon for those everyday tasks, with some portions receiving “preferential” usage over others. Using resting-state fMRI collected during total darkness, we examined how deprivation and preferential usage influence the intrinsic functional connectivity of sensory cortex by studying individuals with selective vision loss due to late stages of macular degeneration. Specifically, we examined functional connectivity between category-selective visual areas and the cortical representation of three areas of the retina: the lesioned area, a preferentially used region of the intact retina, and a non-preferentially used region. We found that cortical regions representing spared portions of the peripheral retina, regardless of whether they are preferentially used, exhibit plasticity of intrinsic functional connectivity in macular degeneration. Cortical representations of spared peripheral retinal locations showed stronger connectivity to MT, a region involved in processing motion. These results suggest that the long-term loss of central vision can produce widespread effects throughout spared representations in early visual cortex, regardless of whether those representations are preferentially used. These findings support the idea that connections to visual cortex maintain the capacity for change well after critical periods of visual development.
{"title":"Impact of Deprivation and Preferential Usage on Functional Connectivity Between Early Visual Cortex and Category-Selective Visual Regions","authors":"Leland L. Fleming, Matthew K. Defenderfer, Pinar Demirayak, Paul Stewart, Dawn K. Decarlo, Kristina M. Visscher","doi":"10.1002/hbm.70064","DOIUrl":"https://doi.org/10.1002/hbm.70064","url":null,"abstract":"<p>Human behavior can be remarkably shaped by experience, such as the removal of sensory input. Many studies of conditions such as stroke, limb amputation, and vision loss have examined how removal of input changes brain function. However, an important question yet to be answered is: when input is lost, does the brain change its connectivity to preferentially use some remaining inputs over others? In individuals with healthy vision, the central portion of the retina is preferentially used for everyday visual tasks, due to its ability to discriminate fine details. When central vision is lost in conditions like macular degeneration, peripheral vision must be relied upon for those everyday tasks, with some portions receiving “preferential” usage over others. Using resting-state fMRI collected during total darkness, we examined how deprivation and preferential usage influence the intrinsic functional connectivity of sensory cortex by studying individuals with selective vision loss due to late stages of macular degeneration. Specifically, we examined functional connectivity between category-selective visual areas and the cortical representation of three areas of the retina: the lesioned area, a preferentially used region of the intact retina, and a non-preferentially used region. We found that cortical regions representing spared portions of the peripheral retina, regardless of whether they are preferentially used, exhibit plasticity of intrinsic functional connectivity in macular degeneration. Cortical representations of spared peripheral retinal locations showed stronger connectivity to MT, a region involved in processing motion. These results suggest that the long-term loss of central vision can produce widespread effects throughout spared representations in early visual cortex, regardless of whether those representations are preferentially used. These findings support the idea that connections to visual cortex maintain the capacity for change well after critical periods of visual development.</p>","PeriodicalId":13019,"journal":{"name":"Human Brain Mapping","volume":"45 17","pages":""},"PeriodicalIF":3.5,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/hbm.70064","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142685318","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Sipei Li, Wei Zhang, Shun Yao, Jianzhong He, Jingjing Gao, Tengfei Xue, Guoqiang Xie, Yuqian Chen, Erickson F. Torio, Yuanjing Feng, Dhiego C. A. Bastos, Yogesh Rathi, Nikos Makris, Ron Kikinis, Wenya Linda Bi, Alexandra J. Golby, Lauren J. O'Donnell, Fan Zhang
The retinogeniculate visual pathway (RGVP) is responsible for carrying visual information from the retina to the lateral geniculate nucleus. Identification and visualization of the RGVP are important in studying the anatomy of the visual system and can inform the treatment of related brain diseases. Diffusion MRI (dMRI) tractography is an advanced imaging method that uniquely enables in vivo mapping of the 3D trajectory of the RGVP. Currently, identification of the RGVP from tractography data relies on expert (manual) selection of tractography streamlines, which is time-consuming, has high clinical and expert labor costs, and is affected by inter-observer variability. In this paper, we present a novel deep learning framework, DeepRGVP, to enable fast and accurate identification of the RGVP from dMRI tractography data. We design a novel microstructure-informed supervised contrastive learning method that leverages both streamline label and tissue microstructure information to determine positive and negative pairs. We propose a new streamline-level data augmentation method to address highly imbalanced training data, where the number of RGVP streamlines is much lower than that of non-RGVP streamlines. In the experiments, we perform comparisons with several state-of-the-art deep learning methods that were designed for tractography parcellation. Furthermore, to assess the generalizability of the proposed RGVP method, we apply our method to dMRI tractography data from neurosurgical patients with pituitary tumors. In comparison with the state-of-the-art methods, we show superior RGVP identification results using DeepRGVP with significantly higher accuracy and F1 scores. In the patient data experiment, we show DeepRGVP can successfully identify RGVPs despite the effect of lesions affecting the RGVPs. Overall, our study shows the high potential of using deep learning to automatically identify the RGVP.
{"title":"Tractography-Based Automated Identification of Retinogeniculate Visual Pathway With Novel Microstructure-Informed Supervised Contrastive Learning","authors":"Sipei Li, Wei Zhang, Shun Yao, Jianzhong He, Jingjing Gao, Tengfei Xue, Guoqiang Xie, Yuqian Chen, Erickson F. Torio, Yuanjing Feng, Dhiego C. A. Bastos, Yogesh Rathi, Nikos Makris, Ron Kikinis, Wenya Linda Bi, Alexandra J. Golby, Lauren J. O'Donnell, Fan Zhang","doi":"10.1002/hbm.70071","DOIUrl":"10.1002/hbm.70071","url":null,"abstract":"<p>The retinogeniculate visual pathway (RGVP) is responsible for carrying visual information from the retina to the lateral geniculate nucleus. Identification and visualization of the RGVP are important in studying the anatomy of the visual system and can inform the treatment of related brain diseases. Diffusion MRI (dMRI) tractography is an advanced imaging method that uniquely enables in vivo mapping of the 3D trajectory of the RGVP. Currently, identification of the RGVP from tractography data relies on expert (manual) selection of tractography streamlines, which is time-consuming, has high clinical and expert labor costs, and is affected by inter-observer variability. In this paper, we present a novel deep learning framework, DeepRGVP, to enable fast and accurate identification of the RGVP from dMRI tractography data. We design a novel microstructure-informed supervised contrastive learning method that leverages both streamline label and tissue microstructure information to determine positive and negative pairs. We propose a new streamline-level data augmentation method to address highly imbalanced training data, where the number of RGVP streamlines is much lower than that of non-RGVP streamlines. In the experiments, we perform comparisons with several state-of-the-art deep learning methods that were designed for tractography parcellation. Furthermore, to assess the generalizability of the proposed RGVP method, we apply our method to dMRI tractography data from neurosurgical patients with pituitary tumors. In comparison with the state-of-the-art methods, we show superior RGVP identification results using DeepRGVP with significantly higher accuracy and F1 scores. In the patient data experiment, we show DeepRGVP can successfully identify RGVPs despite the effect of lesions affecting the RGVPs. Overall, our study shows the high potential of using deep learning to automatically identify the RGVP.</p>","PeriodicalId":13019,"journal":{"name":"Human Brain Mapping","volume":"45 17","pages":""},"PeriodicalIF":3.5,"publicationDate":"2024-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/hbm.70071","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142675655","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Rogers F. Silva, Eswar Damaraju, Xinhui Li, Peter Kochunov, Judith M. Ford, Daniel H. Mathalon, Jessica A. Turner, Theo G. M. van Erp, Tulay Adali, Vince D. Calhoun
With the increasing availability of large-scale multimodal neuroimaging datasets, it is necessary to develop data fusion methods which can extract cross-modal features. A general framework, multidataset independent subspace analysis (MISA), has been developed to encompass multiple blind source separation approaches and identify linked cross-modal sources in multiple datasets. In this work, we utilized the multimodal independent vector analysis (MMIVA) model in MISA to directly identify meaningful linked features across three neuroimaging modalities—structural magnetic resonance imaging (MRI), resting state functional MRI and diffusion MRI—in two large independent datasets, one comprising of control subjects and the other including patients with schizophrenia. Results show several linked subject profiles (sources) that capture age-associated decline, schizophrenia-related biomarkers, sex effects, and cognitive performance. For sources associated with age, both shared and modality-specific brain-age deltas were evaluated for association with non-imaging variables. In addition, each set of linked sources reveals a corresponding set of cross-modal spatial patterns that can be studied jointly. We demonstrate that the MMIVA fusion model can identify linked sources across multiple modalities, and that at least one set of linked, age-related sources replicates across two independent and separately analyzed datasets. The same set also presented age-adjusted group differences, with schizophrenia patients indicating lower multimodal source levels. Linked sets associated with sex and cognition are also reported for the UK Biobank dataset.
{"title":"A Method for Multimodal IVA Fusion Within a MISA Unified Model Reveals Markers of Age, Sex, Cognition, and Schizophrenia in Large Neuroimaging Studies","authors":"Rogers F. Silva, Eswar Damaraju, Xinhui Li, Peter Kochunov, Judith M. Ford, Daniel H. Mathalon, Jessica A. Turner, Theo G. M. van Erp, Tulay Adali, Vince D. Calhoun","doi":"10.1002/hbm.70037","DOIUrl":"10.1002/hbm.70037","url":null,"abstract":"<p>With the increasing availability of large-scale multimodal neuroimaging datasets, it is necessary to develop data fusion methods which can extract cross-modal features. A general framework, multidataset independent subspace analysis (MISA), has been developed to encompass multiple blind source separation approaches and identify linked cross-modal sources in multiple datasets. In this work, we utilized the multimodal independent vector analysis (MMIVA) model in MISA to directly identify meaningful linked features across three neuroimaging modalities—structural magnetic resonance imaging (MRI), resting state functional MRI and diffusion MRI—in two large independent datasets, one comprising of control subjects and the other including patients with schizophrenia. Results show several linked subject profiles (sources) that capture age-associated decline, schizophrenia-related biomarkers, sex effects, and cognitive performance. For sources associated with age, both shared and modality-specific brain-age deltas were evaluated for association with non-imaging variables. In addition, each set of linked sources reveals a corresponding set of cross-modal spatial patterns that can be studied jointly. We demonstrate that the MMIVA fusion model can identify linked sources across multiple modalities, and that at least one set of linked, age-related sources replicates across two independent and separately analyzed datasets. The same set also presented age-adjusted group differences, with schizophrenia patients indicating lower multimodal source levels. Linked sets associated with sex and cognition are also reported for the UK Biobank dataset.</p>","PeriodicalId":13019,"journal":{"name":"Human Brain Mapping","volume":"45 17","pages":""},"PeriodicalIF":3.5,"publicationDate":"2024-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11574741/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142667510","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Arezoo Taebi, Klaus Mathiak, Benjamin Becker, Greta Kristin Klug, Jana Zweerings
One of the fundamental questions in real-time functional magnetic resonance imaging neurofeedback (rt-fMRI NF) investigations is the definition of a suitable neural target for training. Previously, we applied a meta-analytical approach to define a network-level target for connectivity-based rt-fMRI NF in substance use disorders. The analysis yielded consistent connectivity alterations between the insula and anterior cingulate cortex (ACC) as well as the dorsal striatum and the ACC. In the current investigation, we addressed the feasibility of regulating this network and its functional relevance using connectivity-based neurofeedback. In a double-blind, sham-controlled design, 60 nicotine users were randomly assigned to the experimental or sham control group for one NF training session. The preregistered primary outcome was defined as improved inhibitory control performance after regulation of the target network compared to sham control. Secondary outcomes were (1) neurofeedback-specific changes in functional connectivity of the target network; (2) changes in smoking behavior and impulsivity measures; and (3) changes in resting-state connectivity profiles. Our results indicated no differences in behavioral measures after receiving feedback from the target network compared to the sham feedback. Target network connectivity was increased during regulation blocks compared to rest blocks, however, the experimental and sham groups could regulate to a similar degree. Accordingly, the observed activation patterns may be related to the mental strategies used during regulation attempts irrespective of the group assignment. We discuss several crucial factors regarding the efficacy of a single-session connectivity-based neurofeedback for the target network. This includes high fluctuation in the connectivity values of the target network that may impact controllability of the signal. To our knowledge, this investigation is the first randomized, double-blind controlled real-time fMRI study in nicotine users. This raises the question of whether previously observed effects in nicotine users are specific to the neurofeedback signal or reflect more general self-regulation attempts.
{"title":"Connectivity-Based Real-Time Functional Magnetic Resonance Imaging Neurofeedback in Nicotine Users: Mechanistic and Clinical Effects of Regulating a Meta-Analytically Defined Target Network in a Double-Blind Controlled Trial","authors":"Arezoo Taebi, Klaus Mathiak, Benjamin Becker, Greta Kristin Klug, Jana Zweerings","doi":"10.1002/hbm.70077","DOIUrl":"10.1002/hbm.70077","url":null,"abstract":"<p>One of the fundamental questions in real-time functional magnetic resonance imaging neurofeedback (rt-fMRI NF) investigations is the definition of a suitable neural target for training. Previously, we applied a meta-analytical approach to define a network-level target for connectivity-based rt-fMRI NF in substance use disorders. The analysis yielded consistent connectivity alterations between the insula and anterior cingulate cortex (ACC) as well as the dorsal striatum and the ACC. In the current investigation, we addressed the feasibility of regulating this network and its functional relevance using connectivity-based neurofeedback. In a double-blind, sham-controlled design, 60 nicotine users were randomly assigned to the experimental or sham control group for one NF training session. The preregistered primary outcome was defined as improved inhibitory control performance after regulation of the target network compared to sham control. Secondary outcomes were (1) neurofeedback-specific changes in functional connectivity of the target network; (2) changes in smoking behavior and impulsivity measures; and (3) changes in resting-state connectivity profiles. Our results indicated no differences in behavioral measures after receiving feedback from the target network compared to the sham feedback. Target network connectivity was increased during regulation blocks compared to rest blocks, however, the experimental and sham groups could regulate to a similar degree. Accordingly, the observed activation patterns may be related to the mental strategies used during regulation attempts irrespective of the group assignment. We discuss several crucial factors regarding the efficacy of a single-session connectivity-based neurofeedback for the target network. This includes high fluctuation in the connectivity values of the target network that may impact controllability of the signal. To our knowledge, this investigation is the first randomized, double-blind controlled real-time fMRI study in nicotine users. This raises the question of whether previously observed effects in nicotine users are specific to the neurofeedback signal or reflect more general self-regulation attempts.</p>","PeriodicalId":13019,"journal":{"name":"Human Brain Mapping","volume":"45 17","pages":""},"PeriodicalIF":3.5,"publicationDate":"2024-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11574450/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142667516","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}