DreaMR: Diffusion-Driven Counterfactual Explanation for Functional MRI

Hasan A. Bedel;Tolga Çukur
{"title":"DreaMR: Diffusion-Driven Counterfactual Explanation for Functional MRI","authors":"Hasan A. Bedel;Tolga Çukur","doi":"10.1109/TMI.2024.3507008","DOIUrl":null,"url":null,"abstract":"Deep learning analyses have offered sensitivity leaps in detection of cognition-related variables from functional MRI (fMRI) measurements of brain responses. Yet, as deep models perform hierarchical nonlinear transformations on fMRI data, interpreting the association between individual brain regions and the detected variables is challenging. Among explanation approaches for deep fMRI classifiers, attribution methods show poor specificity and perturbation methods show limited sensitivity. While counterfactual generation promises to address these limitations, previous counterfactual methods based on variational or adversarial priors can yield suboptimal sample fidelity. Here, we introduce the first diffusion-driven counterfactual method, DreaMR, to enable fMRI interpretation with high fidelity. DreaMR performs diffusion-based resampling of an input fMRI sample to alter the decision of a downstream classifier, and then computes the difference between the original sample and the counterfactual sample for explanation. Unlike conventional diffusion methods, DreaMR leverages a novel fractional multi-phase-distilled diffusion prior to improve inference efficiency without compromising fidelity, and it employs a transformer architecture to account for long-range spatiotemporal context in fMRI scans. Comprehensive experiments on neuroimaging datasets demonstrate the superior fidelity and efficiency of DreaMR in sample generation over state-of-the-art counterfactual methods for fMRI explanation.","PeriodicalId":94033,"journal":{"name":"IEEE transactions on medical imaging","volume":"44 9","pages":"3654-3669"},"PeriodicalIF":0.0000,"publicationDate":"2024-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE transactions on medical imaging","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10769558/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Deep learning analyses have offered sensitivity leaps in detection of cognition-related variables from functional MRI (fMRI) measurements of brain responses. Yet, as deep models perform hierarchical nonlinear transformations on fMRI data, interpreting the association between individual brain regions and the detected variables is challenging. Among explanation approaches for deep fMRI classifiers, attribution methods show poor specificity and perturbation methods show limited sensitivity. While counterfactual generation promises to address these limitations, previous counterfactual methods based on variational or adversarial priors can yield suboptimal sample fidelity. Here, we introduce the first diffusion-driven counterfactual method, DreaMR, to enable fMRI interpretation with high fidelity. DreaMR performs diffusion-based resampling of an input fMRI sample to alter the decision of a downstream classifier, and then computes the difference between the original sample and the counterfactual sample for explanation. Unlike conventional diffusion methods, DreaMR leverages a novel fractional multi-phase-distilled diffusion prior to improve inference efficiency without compromising fidelity, and it employs a transformer architecture to account for long-range spatiotemporal context in fMRI scans. Comprehensive experiments on neuroimaging datasets demonstrate the superior fidelity and efficiency of DreaMR in sample generation over state-of-the-art counterfactual methods for fMRI explanation.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
DreaMR:功能性MRI弥散驱动的反事实解释
深度学习分析在检测大脑反应的功能性磁共振成像(fMRI)测量的认知相关变量方面提供了灵敏度上的飞跃。然而,由于深度模型对fMRI数据进行分层非线性转换,解释单个大脑区域与检测变量之间的关联是具有挑战性的。在深度fMRI分类器的解释方法中,归因方法特异性较差,微扰方法敏感性有限。虽然反事实生成有望解决这些限制,但以前基于变分或对抗性先验的反事实方法可能产生次优样本保真度。在这里,我们介绍了第一种扩散驱动的反事实方法,DreaMR,以实现高保真的功能磁共振成像解释。DreaMR对输入的fMRI样本进行基于扩散的重采样,以改变下游分类器的决策,然后计算原始样本和反事实样本之间的差异,以进行解释。与传统的扩散方法不同,DreaMR利用了一种新型的分式多相蒸馏扩散,在不影响保真度的情况下提高了推理效率,并采用了变压器架构来解释fMRI扫描中的远程时空背景。在神经成像数据集上的综合实验表明,DreaMR在样本生成方面比最先进的反事实方法具有更高的保真度和效率。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Interpretable Multimodal Learning for Cardiovascular Hemodynamics Assessment. Observer-usable Information as a Task-specific Image Quality Metric. A 3D Cross-modal Keypoint Descriptor for MR-US Matching and Registration. FairFedMed: Benchmarking Group Fairness in Federated Medical Imaging With FairLoRA. MIRROR: Multi-Modal Pathological Self-Supervised Representation Learning via Modality Alignment and Retention
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1