首页 > 最新文献

PRedictive Intelligence in MEdicine. PRIME (Workshop)最新文献

英文 中文
Spectral Graph Sample Weighting for Interpretable Sub-cohort Analysis in Predictive Models for Neuroimaging. 光谱图样本加权,用于神经成像预测模型中可解释的子队列分析
Pub Date : 2025-01-01 Epub Date: 2024-10-18 DOI: 10.1007/978-3-031-74561-4_3
Magdalini Paschali, Yu Hang Jiang, Spencer Siegel, Camila Gonzalez, Kilian M Pohl, Akshay Chaudhari, Qingyu Zhao

Recent advancements in medicine have confirmed that brain disorders often comprise multiple subtypes of mechanisms, developmental trajectories, or severity levels. Such heterogeneity is often associated with demographic aspects (e.g., sex) or disease-related contributors (e.g., genetics). Thus, the predictive power of machine learning models used for symptom prediction varies across subjects based on such factors. To model this heterogeneity, one can assign each training sample a factor-dependent weight, which modulates the subject's contribution to the overall objective loss function. To this end, we propose to model the subject weights as a linear combination of the eigenbases of a spectral population graph that captures the similarity of factors across subjects. In doing so, the learned weights smoothly vary across the graph, highlighting sub-cohorts with high and low predictability. Our proposed sample weighting scheme is evaluated on two tasks. First, we predict initiation of heavy alcohol drinking in young adulthood from imaging and neuropsychological measures from the National Consortium on Alcohol and NeuroDevelopment in Adolescence (NCANDA). Next, we detect Dementia vs. Mild Cognitive Impairment (MCI) using imaging and demographic measurements in subjects from the Alzheimer's Disease Neuroimaging Initiative (ADNI). Compared to existing sample weighting schemes, our sample weights improve interpretability and highlight sub-cohorts with distinct characteristics and varying model accuracy.

医学的最新进展证实,脑部疾病通常由多种亚型机制、发展轨迹或严重程度组成。这种异质性通常与人口统计学方面(如性别)或疾病相关因素(如遗传学)有关。因此,基于这些因素,用于症状预测的机器学习模型对不同受试者的预测能力各不相同。为了模拟这种异质性,我们可以给每个训练样本分配一个与因素相关的权重,从而调节受试者对总体目标损失函数的贡献。为此,我们建议将受试者权重建模为光谱群体图特征基的线性组合,以捕捉不同受试者之间的因素相似性。这样,学习到的权重就会在整个图中平滑变化,从而突出具有高预测性和低预测性的子群组。我们提出的样本加权方案在两项任务中进行了评估。首先,我们通过国家青少年酒精和神经发育联盟(NCANDA)的成像和神经心理学测量来预测成年后开始大量饮酒的情况。接下来,我们利用阿尔茨海默病神经影像学倡议(ADNI)受试者的影像学和人口统计学测量结果检测痴呆症与轻度认知障碍(MCI)。与现有的样本加权方案相比,我们的样本加权提高了可解释性,并突出了具有不同特征和不同模型准确性的子队列。
{"title":"Spectral Graph Sample Weighting for Interpretable Sub-cohort Analysis in Predictive Models for Neuroimaging.","authors":"Magdalini Paschali, Yu Hang Jiang, Spencer Siegel, Camila Gonzalez, Kilian M Pohl, Akshay Chaudhari, Qingyu Zhao","doi":"10.1007/978-3-031-74561-4_3","DOIUrl":"https://doi.org/10.1007/978-3-031-74561-4_3","url":null,"abstract":"<p><p>Recent advancements in medicine have confirmed that brain disorders often comprise multiple subtypes of mechanisms, developmental trajectories, or severity levels. Such heterogeneity is often associated with demographic aspects (e.g., sex) or disease-related contributors (e.g., genetics). Thus, the predictive power of machine learning models used for symptom prediction varies across subjects based on such factors. To model this heterogeneity, one can assign each training sample a factor-dependent weight, which modulates the subject's contribution to the overall objective loss function. To this end, we propose to model the subject weights as a linear combination of the eigenbases of a spectral population graph that captures the similarity of factors across subjects. In doing so, the learned weights smoothly vary across the graph, highlighting sub-cohorts with high and low predictability. Our proposed sample weighting scheme is evaluated on two tasks. First, we predict initiation of heavy alcohol drinking in young adulthood from imaging and neuropsychological measures from the National Consortium on Alcohol and NeuroDevelopment in Adolescence (NCANDA). Next, we detect Dementia <i>vs</i>. Mild Cognitive Impairment (MCI) using imaging and demographic measurements in subjects from the Alzheimer's Disease Neuroimaging Initiative (ADNI). Compared to existing sample weighting schemes, our sample weights improve interpretability and highlight sub-cohorts with distinct characteristics and varying model accuracy.</p>","PeriodicalId":92572,"journal":{"name":"PRedictive Intelligence in MEdicine. PRIME (Workshop)","volume":"15155 ","pages":"24-34"},"PeriodicalIF":0.0,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11549025/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142633946","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
SynthA1c: Towards Clinically Interpretable Patient Representations for Diabetes Risk Stratification. SynthA1c:实现临床可解释的糖尿病风险分层患者表征。
Pub Date : 2023-10-01 DOI: 10.1007/978-3-031-46005-0_5
Michael S Yao, Allison Chae, Matthew T MacLean, Anurag Verma, Jeffrey Duda, James C Gee, Drew A Torigian, Daniel Rader, Charles E Kahn, Walter R Witschey, Hersh Sagreiya

Early diagnosis of Type 2 Diabetes Mellitus (T2DM) is crucial to enable timely therapeutic interventions and lifestyle modifications. As the time available for clinical office visits shortens and medical imaging data become more widely available, patient image data could be used to opportunistically identify patients for additional T2DM diagnostic workup by physicians. We investigated whether image-derived phenotypic data could be leveraged in tabular learning classifier models to predict T2DM risk in an automated fashion to flag high-risk patients without the need for additional blood laboratory measurements. In contrast to traditional binary classifiers, we leverage neural networks and decision tree models to represent patient data as 'SynthA1c' latent variables, which mimic blood hemoglobin A1c empirical lab measurements, that achieve sensitivities as high as 87.6%. To evaluate how SynthA1c models may generalize to other patient populations, we introduce a novel generalizable metric that uses vanilla data augmentation techniques to predict model performance on input out-of-domain covariates. We show that image-derived phenotypes and physical examination data together can accurately predict diabetes risk as a means of opportunistic risk stratification enabled by artificial intelligence and medical imaging. Our code is available at https://github.com/allisonjchae/DMT2RiskAssessment.

2 型糖尿病(T2DM)的早期诊断对于及时采取治疗干预措施和改变生活方式至关重要。随着临床就诊时间的缩短和医学影像数据的普及,患者的图像数据可用于医生对患者进行额外的 T2DM 诊断工作。我们研究了能否在表格学习分类器模型中利用图像衍生的表型数据,以自动方式预测 T2DM 风险,从而标记出高风险患者,而无需进行额外的血液实验室测量。与传统的二元分类器不同,我们利用神经网络和决策树模型将患者数据表示为 "SynthA1c "潜变量,该潜变量模仿血液血红蛋白 A1c 经验实验室测量值,灵敏度高达 87.6%。为了评估 SynthA1c 模型在其他患者群体中的通用性,我们引入了一种新的通用度量方法,该方法使用 vanilla 数据增强技术来预测输入域外协变量的模型性能。我们的研究表明,图像衍生表型和体格检查数据可共同准确预测糖尿病风险,是人工智能和医学成像技术实现机会性风险分层的一种手段。我们的代码见 https://github.com/allisonjchae/DMT2RiskAssessment。
{"title":"SynthA1c: Towards Clinically Interpretable Patient Representations for Diabetes Risk Stratification.","authors":"Michael S Yao, Allison Chae, Matthew T MacLean, Anurag Verma, Jeffrey Duda, James C Gee, Drew A Torigian, Daniel Rader, Charles E Kahn, Walter R Witschey, Hersh Sagreiya","doi":"10.1007/978-3-031-46005-0_5","DOIUrl":"10.1007/978-3-031-46005-0_5","url":null,"abstract":"<p><p>Early diagnosis of Type 2 Diabetes Mellitus (T2DM) is crucial to enable timely therapeutic interventions and lifestyle modifications. As the time available for clinical office visits shortens and medical imaging data become more widely available, patient image data could be used to opportunistically identify patients for additional T2DM diagnostic workup by physicians. We investigated whether image-derived phenotypic data could be leveraged in tabular learning classifier models to predict T2DM risk in an automated fashion to flag high-risk patients <i>without</i> the need for additional blood laboratory measurements. In contrast to traditional binary classifiers, we leverage neural networks and decision tree models to represent patient data as 'SynthA1c' latent variables, which mimic blood hemoglobin A1c empirical lab measurements, that achieve sensitivities as high as 87.6%. To evaluate how SynthA1c models may generalize to other patient populations, we introduce a novel generalizable metric that uses vanilla data augmentation techniques to predict model performance on input out-of-domain covariates. We show that image-derived phenotypes and physical examination data together can accurately predict diabetes risk as a means of opportunistic risk stratification enabled by artificial intelligence and medical imaging. Our code is available at https://github.com/allisonjchae/DMT2RiskAssessment.</p>","PeriodicalId":92572,"journal":{"name":"PRedictive Intelligence in MEdicine. PRIME (Workshop)","volume":"14277 ","pages":"46-57"},"PeriodicalIF":0.0,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11217801/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141494546","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Imputing Brain Measurements Across Data Sets via Graph Neural Networks. 通过图神经网络对数据集的大脑测量进行脉冲。
Pub Date : 2023-01-01 DOI: 10.1007/978-3-031-46005-0_15
Yixin Wang, Wei Peng, Susan F Tapert, Qingyu Zhao, Kilian M Pohl

Publicly available data sets of structural MRIs might not contain specific measurements of brain Regions of Interests (ROIs) that are important for training machine learning models. For example, the curvature scores computed by Freesurfer are not released by the Adolescent Brain Cognitive Development (ABCD) Study. One can address this issue by simply reapplying Freesurfer to the data set. However, this approach is generally computationally and labor intensive (e.g., requiring quality control). An alternative is to impute the missing measurements via a deep learning approach. However, the state-of-the-art is designed to estimate randomly missing values rather than entire measurements. We therefore propose to re-frame the imputation problem as a prediction task on another (public) data set that contains the missing measurements and shares some ROI measurements with the data sets of interest. A deep learning model is then trained to predict the missing measurements from the shared ones and afterwards is applied to the other data sets. Our proposed algorithm models the dependencies between ROI measurements via a graph neural network (GNN) and accounts for demographic differences in brain measurements (e.g. sex) by feeding the graph encoding into a parallel architecture. The architecture simultaneously optimizes a graph decoder to impute values and a classifier in predicting demographic factors. We test the approach, called Demographic Aware Graph-based Imputation (DAGI), on imputing those missing Freesurfer measurements of ABCD (N=3760; minimum age 12 years) by training the predictor on those publicly released by the National Consortium on Alcohol and Neurodevelopment in Adolescence (NCANDA, N=540). 5-fold cross-validation on NCANDA reveals that the imputed scores are more accurate than those generated by linear regressors and deep learning models. Adding them also to a classifier trained in identifying sex results in higher accuracy than only using those Freesurfer scores provided by ABCD.

公开可用的结构MRI数据集可能不包含对训练机器学习模型很重要的大脑兴趣区域(ROI)的特定测量。例如,青少年大脑认知发展研究没有公布Freesurfer计算的曲率分数。可以通过简单地将Freesurfer重新应用到数据集来解决这个问题。然而,这种方法通常是计算密集型和劳动密集型的(例如,需要质量控制)。另一种选择是通过深度学习方法估算缺失的测量值。然而,最先进的技术旨在估计随机缺失的值,而不是整个测量值。因此,我们建议将插补问题重新定义为另一个(公共)数据集的预测任务,该数据集包含缺失的测量值,并与感兴趣的数据集共享一些ROI测量值。然后训练深度学习模型以从共享的测量值中预测缺失的测量值,然后将其应用于其他数据集。我们提出的算法通过图神经网络(GNN)对ROI测量之间的依赖性进行建模,并通过将图编码输入并行架构来解释大脑测量中的人口统计学差异(例如性别)。该架构同时优化图解码器以估算值,并优化分类器以预测人口统计因素。我们测试了一种名为“基于人口统计感知图的推断”(DAGI)的方法,通过对国家青少年酒精和神经发育联合会(NCANDA,N=540)公开发布的预测因子进行训练,来推断那些缺失的ABCD自由冲浪测量值(N=3760;最低年龄12岁)。NCANDA的5倍交叉验证表明,估算的分数比线性回归和深度学习模型产生的分数更准确。将它们添加到经过性别识别训练的分类器中,比只使用ABCD提供的Freesurfer分数更准确。
{"title":"Imputing Brain Measurements Across Data Sets via Graph Neural Networks.","authors":"Yixin Wang, Wei Peng, Susan F Tapert, Qingyu Zhao, Kilian M Pohl","doi":"10.1007/978-3-031-46005-0_15","DOIUrl":"10.1007/978-3-031-46005-0_15","url":null,"abstract":"<p><p>Publicly available data sets of structural MRIs might not contain specific measurements of brain Regions of Interests (ROIs) that are important for training machine learning models. For example, the curvature scores computed by Freesurfer are not released by the Adolescent Brain Cognitive Development (ABCD) Study. One can address this issue by simply reapplying Freesurfer to the data set. However, this approach is generally computationally and labor intensive (e.g., requiring quality control). An alternative is to impute the missing measurements via a deep learning approach. However, the state-of-the-art is designed to estimate randomly missing values rather than entire measurements. We therefore propose to re-frame the imputation problem as a prediction task on another (public) data set that contains the missing measurements and shares some ROI measurements with the data sets of interest. A deep learning model is then trained to predict the missing measurements from the shared ones and afterwards is applied to the other data sets. Our proposed algorithm models the dependencies between ROI measurements via a graph neural network (GNN) and accounts for demographic differences in brain measurements (e.g. sex) by feeding the graph encoding into a parallel architecture. The architecture simultaneously optimizes a graph decoder to impute values and a classifier in predicting demographic factors. We test the approach, called <i>D</i>emographic <i>A</i>ware <i>G</i>raph-based <i>I</i>mputation (<i>DAGI</i>), on imputing those missing Freesurfer measurements of ABCD (N=3760; minimum age 12 years) by training the predictor on those publicly released by the National Consortium on Alcohol and Neurodevelopment in Adolescence (NCANDA, N=540). 5-fold cross-validation on NCANDA reveals that the imputed scores are more accurate than those generated by linear regressors and deep learning models. Adding them also to a classifier trained in identifying sex results in higher accuracy than only using those Freesurfer scores provided by ABCD.</p>","PeriodicalId":92572,"journal":{"name":"PRedictive Intelligence in MEdicine. PRIME (Workshop)","volume":"14277 ","pages":"172-183"},"PeriodicalIF":0.0,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10634632/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72016422","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Multiple Instance Neuroimage Transformer. 多实例神经图像转换器
Pub Date : 2022-09-01 Epub Date: 2022-09-16 DOI: 10.1007/978-3-031-16919-9_4
Ayush Singla, Qingyu Zhao, Daniel K Do, Yuyin Zhou, Kilian M Pohl, Ehsan Adeli

For the first time, we propose using a multiple instance learning based convolution-free transformer model, called Multiple Instance Neuroimage Transformer (MINiT), for the classification of T1-weighted (T1w) MRIs. We first present several variants of transformer models adopted for neuroimages. These models extract non-overlapping 3D blocks from the input volume and perform multi-headed self-attention on a sequence of their linear projections. MINiT, on the other hand, treats each of the non-overlapping 3D blocks of the input MRI as its own instance, splitting it further into non-overlapping 3D patches, on which multi-headed self-attention is computed. As a proof-of-concept, we evaluate the efficacy of our model by training it to identify sex from T1w-MRIs of two public datasets: Adolescent Brain Cognitive Development (ABCD) and the National Consortium on Alcohol and Neurodevelopment in Adolescence (NCANDA). The learned attention maps highlight voxels contributing to identifying sex differences in brain morphometry. The code is available at https://github.com/singlaayush/MINIT.

我们首次提出使用基于多实例学习的无卷积变换器模型(称为 "多实例神经图像变换器",Multiple Instance Neuroimage Transformer (MINiT))对 T1 加权(T1w)核磁共振成像进行分类。我们首先介绍了神经图像转换器模型的几种变体。这些模型从输入容积中提取非重叠三维块,并在其线性投影序列上执行多头自注意。另一方面,MINiT 将输入磁共振成像的每个非重叠三维块视为自己的实例,将其进一步分割为非重叠三维斑块,并在这些斑块上计算多头自注意力。作为概念验证,我们通过对两个公开数据集的 T1w-MRI 进行性别识别训练,评估了模型的有效性:这两个公开数据集分别是青少年大脑认知发展(ABCD)和国家青少年酒精与神经发育联盟(NCANDA)。学习注意力图突出显示了有助于识别大脑形态学性别差异的体素。代码见 https://github.com/singlaayush/MINIT。
{"title":"Multiple Instance Neuroimage Transformer.","authors":"Ayush Singla, Qingyu Zhao, Daniel K Do, Yuyin Zhou, Kilian M Pohl, Ehsan Adeli","doi":"10.1007/978-3-031-16919-9_4","DOIUrl":"10.1007/978-3-031-16919-9_4","url":null,"abstract":"<p><p>For the first time, we propose using a multiple instance learning based convolution-free transformer model, called Multiple Instance Neuroimage Transformer (MINiT), for the classification of T1-weighted (T1w) MRIs. We first present several variants of transformer models adopted for neuroimages. These models extract non-overlapping 3D blocks from the input volume and perform multi-headed self-attention on a sequence of their linear projections. MINiT, on the other hand, treats each of the non-overlapping 3D blocks of the input MRI as its own instance, splitting it further into non-overlapping 3D patches, on which multi-headed self-attention is computed. As a proof-of-concept, we evaluate the efficacy of our model by training it to identify sex from T1w-MRIs of two public datasets: Adolescent Brain Cognitive Development (ABCD) and the National Consortium on Alcohol and Neurodevelopment in Adolescence (NCANDA). The learned attention maps highlight voxels contributing to identifying sex differences in brain morphometry. The code is available at https://github.com/singlaayush/MINIT.</p>","PeriodicalId":92572,"journal":{"name":"PRedictive Intelligence in MEdicine. PRIME (Workshop)","volume":"13564 ","pages":"36-48"},"PeriodicalIF":0.0,"publicationDate":"2022-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9629332/pdf/nihms-1844680.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40665498","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Bridging the Gap between Deep Learning and Hypothesis-Driven Analysis via Permutation Testing. 通过置换测试弥合深度学习与假设驱动分析之间的差距。
Pub Date : 2022-09-01 Epub Date: 2022-09-16 DOI: 10.1007/978-3-031-16919-9_2
Magdalini Paschali, Qingyu Zhao, Ehsan Adeli, Kilian M Pohl

A fundamental approach in neuroscience research is to test hypotheses based on neuropsychological and behavioral measures, i.e., whether certain factors (e.g., related to life events) are associated with an outcome (e.g., depression). In recent years, deep learning has become a potential alternative approach for conducting such analyses by predicting an outcome from a collection of factors and identifying the most "informative" ones driving the prediction. However, this approach has had limited impact as its findings are not linked to statistical significance of factors supporting hypotheses. In this article, we proposed a flexible and scalable approach based on the concept of permutation testing that integrates hypothesis testing into the data-driven deep learning analysis. We apply our approach to the yearly self-reported assessments of 621 adolescent participants of the National Consortium of Alcohol and Neurodevelopment in Adolescence (NCANDA) to predict negative valence, a symptom of major depressive disorder according to the NIMH Research Domain Criteria (RDoC). Our method successfully identifies categories of risk factors that further explain the symptom.

神经科学研究的一个基本方法是根据神经心理学和行为测量来检验假设,即某些因素(如与生活事件相关的因素)是否与结果(如抑郁症)有关。近年来,深度学习已成为进行此类分析的一种潜在替代方法,它可以从一系列因素中预测结果,并找出推动预测的最 "有信息量 "的因素。然而,这种方法的影响有限,因为其研究结果与支持假设的因素的统计意义无关。在本文中,我们提出了一种基于置换检验概念的灵活且可扩展的方法,它将假设检验集成到了数据驱动的深度学习分析中。我们将这一方法应用于全国青少年酒精与神经发育联合会(NCANDA)的621名青少年参与者的年度自我报告评估,以根据美国国立卫生研究院(NIMH)研究领域标准(RDoC)预测重度抑郁障碍的症状--负情商。我们的方法成功地确定了可进一步解释该症状的风险因素类别。
{"title":"Bridging the Gap between Deep Learning and Hypothesis-Driven Analysis via Permutation Testing.","authors":"Magdalini Paschali, Qingyu Zhao, Ehsan Adeli, Kilian M Pohl","doi":"10.1007/978-3-031-16919-9_2","DOIUrl":"10.1007/978-3-031-16919-9_2","url":null,"abstract":"<p><p>A fundamental approach in neuroscience research is to test hypotheses based on neuropsychological and behavioral measures, i.e., whether certain factors (e.g., related to life events) are associated with an outcome (e.g., depression). In recent years, deep learning has become a potential alternative approach for conducting such analyses by predicting an outcome from a collection of factors and identifying the most \"informative\" ones driving the prediction. However, this approach has had limited impact as its findings are not linked to statistical significance of factors supporting hypotheses. In this article, we proposed a flexible and scalable approach based on the concept of permutation testing that integrates hypothesis testing into the data-driven deep learning analysis. We apply our approach to the yearly self-reported assessments of 621 adolescent participants of the National Consortium of Alcohol and Neurodevelopment in Adolescence (NCANDA) to predict negative valence, a symptom of major depressive disorder according to the NIMH Research Domain Criteria (RDoC). Our method successfully identifies categories of risk factors that further explain the symptom.</p>","PeriodicalId":92572,"journal":{"name":"PRedictive Intelligence in MEdicine. PRIME (Workshop)","volume":"13564 ","pages":"13-23"},"PeriodicalIF":0.0,"publicationDate":"2022-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9632755/pdf/nihms-1844547.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40671061","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Multiple Instance Neuroimage Transformer 多实例神经图像转换器
Pub Date : 2022-08-19 DOI: 10.48550/arXiv.2208.09567
Ayush Singla, Qingyu Zhao, Daniel K. Do, Yuyin Zhou, K. Pohl, E. Adeli
For the first time, we propose using a multiple instance learning based convolution-free transformer model, called Multiple Instance Neuroimage Transformer (MINiT), for the classification of T1-weighted (T1w) MRIs. We first present several variants of transformer models adopted for neuroimages. These models extract non-overlapping 3D blocks from the input volume and perform multi-headed self-attention on a sequence of their linear projections. MINiT, on the other hand, treats each of the non-overlapping 3D blocks of the input MRI as its own instance, splitting it further into non-overlapping 3D patches, on which multi-headed self-attention is computed. As a proof-of-concept, we evaluate the efficacy of our model by training it to identify sex from T1w-MRIs of two public datasets: Adolescent Brain Cognitive Development (ABCD) and the National Consortium on Alcohol and Neurodevelopment in Adolescence (NCANDA). The learned attention maps highlight voxels contributing to identifying sex differences in brain morphometry. The code is available at https://github.com/singlaayush/MINIT.
我们首次提出使用基于多实例学习的无卷积变换模型,称为多实例神经图像变换(MINiT),用于t1加权(T1w)核磁共振成像的分类。我们首先提出了用于神经图像的变压器模型的几种变体。这些模型从输入体中提取不重叠的3D块,并对其线性投影序列执行多头自关注。另一方面,MINiT将输入MRI的每个不重叠的3D块视为自己的实例,将其进一步分割为不重叠的3D块,并在其上计算多头自关注。作为概念验证,我们通过训练模型从两个公共数据集(青少年大脑认知发展(ABCD)和全国青少年酒精和神经发育协会(nanda))的t1w - mri中识别性别来评估模型的有效性。习得的注意图突出了有助于识别大脑形态计量学中的性别差异的体素。代码可在https://github.com/singlaayush/MINIT上获得。
{"title":"Multiple Instance Neuroimage Transformer","authors":"Ayush Singla, Qingyu Zhao, Daniel K. Do, Yuyin Zhou, K. Pohl, E. Adeli","doi":"10.48550/arXiv.2208.09567","DOIUrl":"https://doi.org/10.48550/arXiv.2208.09567","url":null,"abstract":"For the first time, we propose using a multiple instance learning based convolution-free transformer model, called Multiple Instance Neuroimage Transformer (MINiT), for the classification of T1-weighted (T1w) MRIs. We first present several variants of transformer models adopted for neuroimages. These models extract non-overlapping 3D blocks from the input volume and perform multi-headed self-attention on a sequence of their linear projections. MINiT, on the other hand, treats each of the non-overlapping 3D blocks of the input MRI as its own instance, splitting it further into non-overlapping 3D patches, on which multi-headed self-attention is computed. As a proof-of-concept, we evaluate the efficacy of our model by training it to identify sex from T1w-MRIs of two public datasets: Adolescent Brain Cognitive Development (ABCD) and the National Consortium on Alcohol and Neurodevelopment in Adolescence (NCANDA). The learned attention maps highlight voxels contributing to identifying sex differences in brain morphometry. The code is available at https://github.com/singlaayush/MINIT.","PeriodicalId":92572,"journal":{"name":"PRedictive Intelligence in MEdicine. PRIME (Workshop)","volume":"40 1","pages":"36-48"},"PeriodicalIF":0.0,"publicationDate":"2022-08-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90210281","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Bridging the Gap between Deep Learning and Hypothesis-Driven Analysis via Permutation Testing 通过排列测试弥合深度学习和假设驱动分析之间的差距
Pub Date : 2022-07-28 DOI: 10.48550/arXiv.2207.14349
Magdalini Paschali, Qingyu Zhao, E. Adeli, K. Pohl
A fundamental approach in neuroscience research is to test hypotheses based on neuropsychological and behavioral measures, i.e., whether certain factors (e.g., related to life events) are associated with an outcome (e.g., depression). In recent years, deep learning has become a potential alternative approach for conducting such analyses by predicting an outcome from a collection of factors and identifying the most "informative" ones driving the prediction. However, this approach has had limited impact as its findings are not linked to statistical significance of factors supporting hypotheses. In this article, we proposed a flexible and scalable approach based on the concept of permutation testing that integrates hypothesis testing into the data-driven deep learning analysis. We apply our approach to the yearly self-reported assessments of 621 adolescent participants of the National Consortium of Alcohol and Neurodevelopment in Adolescence (NCANDA) to predict negative valence, a symptom of major depressive disorder according to the NIMH Research Domain Criteria (RDoC). Our method successfully identifies categories of risk factors that further explain the symptom.
神经科学研究的一个基本方法是测试基于神经心理学和行为测量的假设,即某些因素(例如,与生活事件相关)是否与结果(例如,抑郁)相关。近年来,深度学习已经成为一种潜在的替代方法,通过从一系列因素中预测结果,并确定推动预测的最具“信息量”的因素,来进行此类分析。然而,这种方法的影响有限,因为它的发现与支持假设的因素的统计显著性无关。在本文中,我们提出了一种基于置换测试概念的灵活且可扩展的方法,将假设测试集成到数据驱动的深度学习分析中。根据NIMH研究领域标准(RDoC),我们将我们的方法应用于621名青少年参与者的年度自我报告评估,以预测负效价,这是重度抑郁症的一种症状。我们的方法成功地识别了进一步解释症状的风险因素类别。
{"title":"Bridging the Gap between Deep Learning and Hypothesis-Driven Analysis via Permutation Testing","authors":"Magdalini Paschali, Qingyu Zhao, E. Adeli, K. Pohl","doi":"10.48550/arXiv.2207.14349","DOIUrl":"https://doi.org/10.48550/arXiv.2207.14349","url":null,"abstract":"A fundamental approach in neuroscience research is to test hypotheses based on neuropsychological and behavioral measures, i.e., whether certain factors (e.g., related to life events) are associated with an outcome (e.g., depression). In recent years, deep learning has become a potential alternative approach for conducting such analyses by predicting an outcome from a collection of factors and identifying the most \"informative\" ones driving the prediction. However, this approach has had limited impact as its findings are not linked to statistical significance of factors supporting hypotheses. In this article, we proposed a flexible and scalable approach based on the concept of permutation testing that integrates hypothesis testing into the data-driven deep learning analysis. We apply our approach to the yearly self-reported assessments of 621 adolescent participants of the National Consortium of Alcohol and Neurodevelopment in Adolescence (NCANDA) to predict negative valence, a symptom of major depressive disorder according to the NIMH Research Domain Criteria (RDoC). Our method successfully identifies categories of risk factors that further explain the symptom.","PeriodicalId":92572,"journal":{"name":"PRedictive Intelligence in MEdicine. PRIME (Workshop)","volume":"3 1","pages":"13-23"},"PeriodicalIF":0.0,"publicationDate":"2022-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85637288","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Predictive Intelligence in Medicine: 5th International Workshop, PRIME 2022, Held in Conjunction with MICCAI 2022, Singapore, September 22, 2022, Proceedings 医学预测智能:第五届国际研讨会,PRIME 2022,与MICCAI 2022一起举行,新加坡,2022年9月22日,会议录
Pub Date : 2022-01-01 DOI: 10.1007/978-3-031-16919-9
{"title":"Predictive Intelligence in Medicine: 5th International Workshop, PRIME 2022, Held in Conjunction with MICCAI 2022, Singapore, September 22, 2022, Proceedings","authors":"","doi":"10.1007/978-3-031-16919-9","DOIUrl":"https://doi.org/10.1007/978-3-031-16919-9","url":null,"abstract":"","PeriodicalId":92572,"journal":{"name":"PRedictive Intelligence in MEdicine. PRIME (Workshop)","volume":"44 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78553975","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Adversarial Bayesian Optimization for Quantifying Motion Artifact Within MRI. MRI运动伪影量化的对抗贝叶斯优化。
Pub Date : 2021-10-01 Epub Date: 2021-09-25 DOI: 10.1007/978-3-030-87602-9_8
Anastasia Butskova, Rain Juhl, Dženan Zukić, Aashish Chaudhary, Kilian M Pohl, Qingyu Zhao

Subject motion during an MRI sequence can cause ghosting effects or diffuse image noise in the phase-encoding direction and hence is likely to bias findings in neuroimaging studies. Detecting motion artifacts often relies on experts visually inspecting MRIs, which is subjective and expensive. To improve this detection, we develop a framework to automatically quantify the severity of motion artifact within a brain MRI. We formulate this task as a regression problem and train the regressor from a data set of MRIs with various amounts of motion artifacts. To resolve the issue of missing fine-grained ground-truth labels (level of artifacts), we propose Adversarial Bayesian Optimization (ABO) to infer the distribution of motion parameters (i.e., rotation and translation) underlying the acquired MRI data and then inject synthetic motion artifacts sampled from that estimated distribution into motion-free MRIs. After training the regressor on the synthetic data, we applied the model to quantify the motion level in 990 MRIs collected by the National Consortium on Alcohol and Neurodevelopment in Adolescence. Results show that the motion level derived by our approach is more reliable than the traditional metric based on Entropy Focus Criterion and manually defined binary labels.

在MRI序列中,受试者的运动可能会在相位编码方向上引起重影效应或弥漫性图像噪声,因此可能会使神经影像学研究的结果产生偏差。检测运动伪影通常依赖于专家视觉检查核磁共振成像,这是主观的和昂贵的。为了改进这种检测,我们开发了一个框架来自动量化大脑MRI中运动伪影的严重程度。我们将此任务表述为一个回归问题,并从具有不同数量运动伪影的mri数据集训练回归器。为了解决缺少细粒度的真值标签(伪影水平)的问题,我们提出了对抗贝叶斯优化(ABO)来推断获得的MRI数据下的运动参数(即旋转和平移)的分布,然后将从估计分布中采样的合成运动伪影注入到无运动的MRI中。在对合成数据进行回归训练后,我们应用该模型量化了国家酒精与青少年神经发育协会收集的990张核磁共振成像的运动水平。结果表明,与基于熵焦点准则和手工定义二值标签的传统度量相比,该方法得到的运动水平更可靠。
{"title":"Adversarial Bayesian Optimization for Quantifying Motion Artifact Within MRI.","authors":"Anastasia Butskova,&nbsp;Rain Juhl,&nbsp;Dženan Zukić,&nbsp;Aashish Chaudhary,&nbsp;Kilian M Pohl,&nbsp;Qingyu Zhao","doi":"10.1007/978-3-030-87602-9_8","DOIUrl":"https://doi.org/10.1007/978-3-030-87602-9_8","url":null,"abstract":"<p><p>Subject motion during an MRI sequence can cause ghosting effects or diffuse image noise in the phase-encoding direction and hence is likely to bias findings in neuroimaging studies. Detecting motion artifacts often relies on experts visually inspecting MRIs, which is subjective and expensive. To improve this detection, we develop a framework to automatically quantify the severity of motion artifact within a brain MRI. We formulate this task as a regression problem and train the regressor from a data set of MRIs with various amounts of motion artifacts. To resolve the issue of missing fine-grained ground-truth labels (level of artifacts), we propose Adversarial Bayesian Optimization (ABO) to infer the distribution of motion parameters (i.e., rotation and translation) underlying the acquired MRI data and then inject synthetic motion artifacts sampled from that estimated distribution into motion-free MRIs. After training the regressor on the synthetic data, we applied the model to quantify the motion level in 990 MRIs collected by the National Consortium on Alcohol and Neurodevelopment in Adolescence. Results show that the motion level derived by our approach is more reliable than the traditional metric based on Entropy Focus Criterion and manually defined binary labels.</p>","PeriodicalId":92572,"journal":{"name":"PRedictive Intelligence in MEdicine. PRIME (Workshop)","volume":"12928 ","pages":"83-92"},"PeriodicalIF":0.0,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9212065/pdf/nihms-1816521.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40397338","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Predictive Intelligence in Medicine: 4th International Workshop, PRIME 2021, Held in Conjunction with MICCAI 2021, Strasbourg, France, October 1, 2021, Proceedings 医学预测智能:第四届国际研讨会,PRIME 2021,与MICCAI 2021一起举行,斯特拉斯堡,法国,2021年10月1日,论文集
Pub Date : 2021-01-01 DOI: 10.1007/978-3-030-87602-9
{"title":"Predictive Intelligence in Medicine: 4th International Workshop, PRIME 2021, Held in Conjunction with MICCAI 2021, Strasbourg, France, October 1, 2021, Proceedings","authors":"","doi":"10.1007/978-3-030-87602-9","DOIUrl":"https://doi.org/10.1007/978-3-030-87602-9","url":null,"abstract":"","PeriodicalId":92572,"journal":{"name":"PRedictive Intelligence in MEdicine. PRIME (Workshop)","volume":"13 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77626012","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
期刊
PRedictive Intelligence in MEdicine. PRIME (Workshop)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1