Leveraging Physics-Based Synthetic MR Images and Deep Transfer Learning for Artifact Reduction in Echo-Planar Imaging.

Catalina Raymond, Jingwen Yao, Bryan Clifford, Thorsten Feiweier, Sonoko Oshima, Donatello Telesca, Xiaodong Zhong, Heiko Meyer, Richard G Everson, Noriko Salamon, Timothy F Cloughesy, Benjamin M Ellingson
{"title":"Leveraging Physics-Based Synthetic MR Images and Deep Transfer Learning for Artifact Reduction in Echo-Planar Imaging.","authors":"Catalina Raymond, Jingwen Yao, Bryan Clifford, Thorsten Feiweier, Sonoko Oshima, Donatello Telesca, Xiaodong Zhong, Heiko Meyer, Richard G Everson, Noriko Salamon, Timothy F Cloughesy, Benjamin M Ellingson","doi":"10.3174/ajnr.A8566","DOIUrl":null,"url":null,"abstract":"<p><strong>Backgound and purpose: </strong>This study utilizes a physics-based approach to synthesize realistic MR artifacts and train a deep learning generative adversarial network (GAN) for use in artifact reduction on EPI, a crucial neuroimaging sequence with high acceleration that is notoriously susceptible to artifacts.</p><p><strong>Materials and methods: </strong>A total of 4,573 anatomical MR sequences from 1,392 patients undergoing clinically indicated MRI of the brain were used to create a synthetic data set using physics-based, simulated artifacts commonly found in EPI. By using multiple MRI contrasts, we hypothesized the GAN would learn to correct common artifacts while preserving the inherent contrast information, even for contrasts the network has not been trained on. A modified <i>Pix2PixGAN</i> architecture with an <i>Attention-R2UNet</i> generator was used for the model. Three training strategies were employed: (1) An \"all-in-one\" model trained on all the artifacts at once; (2) a set of \"single models\", one for each artifact; and a (3) \"stacked transfer learning\" approach where a model is first trained on one artifact set, then this learning is transferred to a new model and the process is repeated for the next artifact set. Lastly, the \"Stacked Transfer Learning\" model was tested on ADC maps from single-shot diffusion MRI data in <i>N</i> = 49 patients diagnosed with recurrent glioblastoma to compare visual quality and lesion measurements between the natively acquired images and AI-corrected images.</p><p><strong>Results: </strong>The \"stacked transfer learning\" approach had superior artifact reduction performance compared to the other approaches as measured by Mean Squared Error (MSE = 0.0016), Structural Similarity Index (SSIM = 0.92), multiscale SSIM (MS-SSIM = 0.92), peak signal-to-noise ratio (PSNR = 28.10), and Hausdorff distance (HAUS = 4.08mm), suggesting that leveraging pre-trained knowledge and sequentially training on each artifact is the best approach this application. In recurrent glioblastoma, significantly higher visual quality was observed in model predicted images compared to native images, while quantitative measurements within the tumor regions remained consistent with non-corrected images.</p><p><strong>Conclusions: </strong>The current study demonstrates the feasibility of using a physics-based method for synthesizing a large data set of images with realistic artifacts and the effectiveness of utilizing this synthetic data set in a \"stacked transfer learning\" approach to training a GAN for reduction of EPI-based artifacts.</p>","PeriodicalId":93863,"journal":{"name":"AJNR. American journal of neuroradiology","volume":" ","pages":"733-741"},"PeriodicalIF":0.0000,"publicationDate":"2025-04-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11979845/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"AJNR. American journal of neuroradiology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3174/ajnr.A8566","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Backgound and purpose: This study utilizes a physics-based approach to synthesize realistic MR artifacts and train a deep learning generative adversarial network (GAN) for use in artifact reduction on EPI, a crucial neuroimaging sequence with high acceleration that is notoriously susceptible to artifacts.

Materials and methods: A total of 4,573 anatomical MR sequences from 1,392 patients undergoing clinically indicated MRI of the brain were used to create a synthetic data set using physics-based, simulated artifacts commonly found in EPI. By using multiple MRI contrasts, we hypothesized the GAN would learn to correct common artifacts while preserving the inherent contrast information, even for contrasts the network has not been trained on. A modified Pix2PixGAN architecture with an Attention-R2UNet generator was used for the model. Three training strategies were employed: (1) An "all-in-one" model trained on all the artifacts at once; (2) a set of "single models", one for each artifact; and a (3) "stacked transfer learning" approach where a model is first trained on one artifact set, then this learning is transferred to a new model and the process is repeated for the next artifact set. Lastly, the "Stacked Transfer Learning" model was tested on ADC maps from single-shot diffusion MRI data in N = 49 patients diagnosed with recurrent glioblastoma to compare visual quality and lesion measurements between the natively acquired images and AI-corrected images.

Results: The "stacked transfer learning" approach had superior artifact reduction performance compared to the other approaches as measured by Mean Squared Error (MSE = 0.0016), Structural Similarity Index (SSIM = 0.92), multiscale SSIM (MS-SSIM = 0.92), peak signal-to-noise ratio (PSNR = 28.10), and Hausdorff distance (HAUS = 4.08mm), suggesting that leveraging pre-trained knowledge and sequentially training on each artifact is the best approach this application. In recurrent glioblastoma, significantly higher visual quality was observed in model predicted images compared to native images, while quantitative measurements within the tumor regions remained consistent with non-corrected images.

Conclusions: The current study demonstrates the feasibility of using a physics-based method for synthesizing a large data set of images with realistic artifacts and the effectiveness of utilizing this synthetic data set in a "stacked transfer learning" approach to training a GAN for reduction of EPI-based artifacts.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
利用基于物理的合成磁共振图像和深度迁移学习减少回波平面成像中的伪影。
背景和目的:本研究利用基于物理的方法来合成逼真的MR伪影,并训练一个深度学习生成对抗网络(GAN),用于EPI的伪影还原,EPI是一个具有高加速度的关键神经成像序列,众所周知,它容易受到伪影的影响。材料和方法:来自1,392名接受临床指示的脑MRI的患者的总共4,573个解剖MR序列用于使用EPI中常见的基于物理的模拟伪影创建合成数据集。通过使用多个MRI对比,我们假设GAN将学习纠正常见的伪影,同时保留固有的对比信息,即使对于尚未训练的对比网络也是如此。模型采用了改进的Pix2PixGAN架构和一个Attention-R2UNet生成器。采用了三种训练策略:(1)“all-in-one”模型一次对所有工件进行训练;(2)一组“单一模型”,每个工件一个;a (3)“堆叠迁移学习”方法,其中首先在一个工件集上训练模型,然后将此学习转移到新模型,并对下一个工件集重复该过程。最后,在N = 49例复发性胶质母细胞瘤患者的单次扩散MRI数据的ADC图上测试“堆叠迁移学习”模型,比较原生获取图像和人工智能校正图像之间的视觉质量和病变测量。结果:通过均方误差(MSE = 0.0016)、结构相似度指数(SSIM = 0.92)、多尺度SSIM (MS-SSIM = 0.92)、峰值信噪比(PSNR = 28.10)和豪斯多夫距离(HAUS = 4.08mm)等指标衡量,“堆叠迁移学习”方法在伪迹还原方面的表现优于其他方法,表明利用预先训练好的知识对每个伪迹进行顺序训练是该应用的最佳方法。在复发性胶质母细胞瘤中,与原始图像相比,模型预测图像的视觉质量明显更高,而肿瘤区域内的定量测量与未校正的图像保持一致。结论:目前的研究证明了使用基于物理的方法来合成具有逼真伪影的大型图像数据集的可行性,以及在“堆叠迁移学习”方法中利用该合成数据集来训练GAN以减少基于epi的伪影的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
The Incidence of Calcified Pituitary Macroadenomas: Challenging the Craniopharyngioma Assumption. Advanced Spine Imaging: Technical Updates and Practice Recommendations. Temporal Net Water Uptake Evolution and its Association with Functional Outcome in Acute Ischemic Stroke. MRI on a Budget: Leveraging Low- and Ultra-Low-Intensity Technology in Africa. Multimodal CT Perfusion-Based Deep Learning for Predicting Stroke Lesion Outcomes in Complete and No Recanalization Scenarios.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1