Learning Task-Specific Strategies for Accelerated MRI

IF 4.2 2区 计算机科学 Q2 ENGINEERING, ELECTRICAL & ELECTRONIC IEEE Transactions on Computational Imaging Pub Date : 2024-07-01 DOI:10.1109/TCI.2024.3410521
Zihui Wu;Tianwei Yin;Yu Sun;Robert Frost;Andre van der Kouwe;Adrian V. Dalca;Katherine L. Bouman
{"title":"Learning Task-Specific Strategies for Accelerated MRI","authors":"Zihui Wu;Tianwei Yin;Yu Sun;Robert Frost;Andre van der Kouwe;Adrian V. Dalca;Katherine L. Bouman","doi":"10.1109/TCI.2024.3410521","DOIUrl":null,"url":null,"abstract":"Compressed sensing magnetic resonance imaging (CS-MRI) seeks to recover visual information from subsampled measurements for diagnostic tasks. Traditional CS-MRI methods often separately address measurement subsampling, image reconstruction, and task prediction, resulting in a suboptimal end-to-end performance. In this work, we propose \n<sc>Tackle</small>\n as a unified co-design framework for jointly optimizing subsampling, reconstruction, and prediction strategies for the performance on downstream tasks. The naïve approach of simply appending a task prediction module and training with a task-specific loss leads to suboptimal downstream performance. Instead, we develop a training procedure where a backbone architecture is first trained for a generic pre-training task (image reconstruction in our case), and then fine-tuned for different downstream tasks with a prediction head. Experimental results on multiple public MRI datasets show that \n<sc>Tackle</small>\n achieves an improved performance on various tasks over traditional CS-MRI methods. We also demonstrate that \n<sc>Tackle</small>\n is robust to distribution shifts by showing that it generalizes to a new dataset we experimentally collected using different acquisition setups from the training data. Without additional fine-tuning, \n<sc>Tackle</small>\n leads to both numerical and visual improvements compared to existing baselines. We have further implemented a learned 4×-accelerated sequence on a Siemens 3T MRI Skyra scanner. Compared to the fully-sampling scan that takes 335 seconds, our optimized sequence only takes 84 seconds, achieving a four-fold time reduction as desired, while maintaining high performance.","PeriodicalId":56022,"journal":{"name":"IEEE Transactions on Computational Imaging","volume":"10 ","pages":"1040-1054"},"PeriodicalIF":4.2000,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Computational Imaging","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10578304/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Compressed sensing magnetic resonance imaging (CS-MRI) seeks to recover visual information from subsampled measurements for diagnostic tasks. Traditional CS-MRI methods often separately address measurement subsampling, image reconstruction, and task prediction, resulting in a suboptimal end-to-end performance. In this work, we propose Tackle as a unified co-design framework for jointly optimizing subsampling, reconstruction, and prediction strategies for the performance on downstream tasks. The naïve approach of simply appending a task prediction module and training with a task-specific loss leads to suboptimal downstream performance. Instead, we develop a training procedure where a backbone architecture is first trained for a generic pre-training task (image reconstruction in our case), and then fine-tuned for different downstream tasks with a prediction head. Experimental results on multiple public MRI datasets show that Tackle achieves an improved performance on various tasks over traditional CS-MRI methods. We also demonstrate that Tackle is robust to distribution shifts by showing that it generalizes to a new dataset we experimentally collected using different acquisition setups from the training data. Without additional fine-tuning, Tackle leads to both numerical and visual improvements compared to existing baselines. We have further implemented a learned 4×-accelerated sequence on a Siemens 3T MRI Skyra scanner. Compared to the fully-sampling scan that takes 335 seconds, our optimized sequence only takes 84 seconds, achieving a four-fold time reduction as desired, while maintaining high performance.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
学习针对特定任务的加速核磁共振成像策略
压缩传感磁共振成像(CS-MRI)旨在从诊断任务的子采样测量中恢复视觉信息。传统的 CS-MRI 方法通常分别处理测量子采样、图像重建和任务预测,导致端到端性能不理想。在这项工作中,我们提出了 Tackle 作为一个统一的协同设计框架,用于联合优化子采样、重建和预测策略,以提高下游任务的性能。简单地添加任务预测模块和使用特定任务损失进行训练的天真方法会导致下游性能不达标。相反,我们开发了一种训练程序,即首先针对通用预训练任务(在我们的例子中是图像重建)训练骨干架构,然后针对不同的下游任务用预测头进行微调。在多个公共核磁共振数据集上的实验结果表明,与传统的 CS-MRI 方法相比,Tackle 在各种任务上都取得了更好的性能。我们还证明了 Tackle 对分布偏移的鲁棒性,它可以泛化到我们使用不同的采集设置从训练数据中实验收集的新数据集。与现有基线相比,Tackle 无需额外的微调,就能在数值和视觉上有所改进。我们还在西门子 3T 磁共振 Skyra 扫描仪上进一步实施了经过学习的 4 倍加速序列。与耗时 335 秒的全采样扫描相比,我们的优化序列只需 84 秒,在保持高性能的同时实现了预期的四倍时间缩减。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
IEEE Transactions on Computational Imaging
IEEE Transactions on Computational Imaging Mathematics-Computational Mathematics
CiteScore
8.20
自引率
7.40%
发文量
59
期刊介绍: The IEEE Transactions on Computational Imaging will publish articles where computation plays an integral role in the image formation process. Papers will cover all areas of computational imaging ranging from fundamental theoretical methods to the latest innovative computational imaging system designs. Topics of interest will include advanced algorithms and mathematical techniques, model-based data inversion, methods for image and signal recovery from sparse and incomplete data, techniques for non-traditional sensing of image data, methods for dynamic information acquisition and extraction from imaging sensors, software and hardware for efficient computation in imaging systems, and highly novel imaging system design.
期刊最新文献
Denoising Knowledge Transfer Model for Zero-Shot MRI Reconstruction IEEE Signal Processing Society Information CSA-FCN: Channel- and Spatial-Gated Attention Mechanism Based Fully Complex-Valued Neural Network for System Matrix Calibration in Magnetic Particle Imaging Exoplanet Imaging via Differentiable Rendering List of Reviewers
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1