Leveraging Physics-Based Synthetic MR Images and Deep Transfer Learning for Artifact Reduction in Echo-Planar Imaging.

Catalina Raymond, Jingwen Yao, Bryan Clifford, Thorsten Feiweier, Sonoko Oshima, Donatello Telesca, Xiaodong Zhong, Heiko Meyer, Richard G Everson, Noriko Salamon, Timothy F Cloughesy, Benjamin M Ellingson
{"title":"Leveraging Physics-Based Synthetic MR Images and Deep Transfer Learning for Artifact Reduction in Echo-Planar Imaging.","authors":"Catalina Raymond, Jingwen Yao, Bryan Clifford, Thorsten Feiweier, Sonoko Oshima, Donatello Telesca, Xiaodong Zhong, Heiko Meyer, Richard G Everson, Noriko Salamon, Timothy F Cloughesy, Benjamin M Ellingson","doi":"10.3174/ajnr.A8566","DOIUrl":null,"url":null,"abstract":"<p><strong>Backgound and purpose: </strong>This study utilizes a physics-based approach to synthesize realistic MR artifacts and train a deep learning generative adversarial network (GAN) for use in artifact reduction on EPI, a crucial neuroimaging sequence with high acceleration that is notoriously susceptible to artifacts.</p><p><strong>Materials and methods: </strong>A total of 4,573 anatomical MR sequences from 1,392 patients undergoing clinically indicated MRI of the brain were used to create a synthetic data set using physics-based, simulated artifacts commonly found in EPI. By using multiple MRI contrasts, we hypothesized the GAN would learn to correct common artifacts while preserving the inherent contrast information, even for contrasts the network has not been trained on. A modified <i>Pix2PixGAN</i> architecture with an <i>Attention-R2UNet</i> generator was used for the model. Three training strategies were employed: (1) An \"all-in-one\" model trained on all the artifacts at once; (2) a set of \"single models\", one for each artifact; and a (3) \"stacked transfer learning\" approach where a model is first trained on one artifact set, then this learning is transferred to a new model and the process is repeated for the next artifact set. Lastly, the \"Stacked Transfer Learning\" model was tested on ADC maps from single-shot diffusion MRI data in <i>N</i> = 49 patients diagnosed with recurrent glioblastoma to compare visual quality and lesion measurements between the natively acquired images and AI-corrected images.</p><p><strong>Results: </strong>The \"stacked transfer learning\" approach had superior artifact reduction performance compared to the other approaches as measured by Mean Squared Error (MSE = 0.0016), Structural Similarity Index (SSIM = 0.92), multiscale SSIM (MS-SSIM = 0.92), peak signal-to-noise ratio (PSNR = 28.10), and Hausdorff distance (HAUS = 4.08mm), suggesting that leveraging pre-trained knowledge and sequentially training on each artifact is the best approach this application. In recurrent glioblastoma, significantly higher visual quality was observed in model predicted images compared to native images, while quantitative measurements within the tumor regions remained consistent with non-corrected images.</p><p><strong>Conclusions: </strong>The current study demonstrates the feasibility of using a physics-based method for synthesizing a large data set of images with realistic artifacts and the effectiveness of utilizing this synthetic data set in a \"stacked transfer learning\" approach to training a GAN for reduction of EPI-based artifacts.</p>","PeriodicalId":93863,"journal":{"name":"AJNR. American journal of neuroradiology","volume":" ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2025-02-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"AJNR. American journal of neuroradiology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3174/ajnr.A8566","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Backgound and purpose: This study utilizes a physics-based approach to synthesize realistic MR artifacts and train a deep learning generative adversarial network (GAN) for use in artifact reduction on EPI, a crucial neuroimaging sequence with high acceleration that is notoriously susceptible to artifacts.

Materials and methods: A total of 4,573 anatomical MR sequences from 1,392 patients undergoing clinically indicated MRI of the brain were used to create a synthetic data set using physics-based, simulated artifacts commonly found in EPI. By using multiple MRI contrasts, we hypothesized the GAN would learn to correct common artifacts while preserving the inherent contrast information, even for contrasts the network has not been trained on. A modified Pix2PixGAN architecture with an Attention-R2UNet generator was used for the model. Three training strategies were employed: (1) An "all-in-one" model trained on all the artifacts at once; (2) a set of "single models", one for each artifact; and a (3) "stacked transfer learning" approach where a model is first trained on one artifact set, then this learning is transferred to a new model and the process is repeated for the next artifact set. Lastly, the "Stacked Transfer Learning" model was tested on ADC maps from single-shot diffusion MRI data in N = 49 patients diagnosed with recurrent glioblastoma to compare visual quality and lesion measurements between the natively acquired images and AI-corrected images.

Results: The "stacked transfer learning" approach had superior artifact reduction performance compared to the other approaches as measured by Mean Squared Error (MSE = 0.0016), Structural Similarity Index (SSIM = 0.92), multiscale SSIM (MS-SSIM = 0.92), peak signal-to-noise ratio (PSNR = 28.10), and Hausdorff distance (HAUS = 4.08mm), suggesting that leveraging pre-trained knowledge and sequentially training on each artifact is the best approach this application. In recurrent glioblastoma, significantly higher visual quality was observed in model predicted images compared to native images, while quantitative measurements within the tumor regions remained consistent with non-corrected images.

Conclusions: The current study demonstrates the feasibility of using a physics-based method for synthesizing a large data set of images with realistic artifacts and the effectiveness of utilizing this synthetic data set in a "stacked transfer learning" approach to training a GAN for reduction of EPI-based artifacts.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Fusion of FDG and FMZ PET Reduces False Positive in Predicting Epileptogenic Zone. Safety and Effectiveness of a Novel Integrated Angiography System for Continuous Guidance and Flushing in Diagnostic Cerebral Catheter Angiography: A Randomized Controlled Trial. Imaging Clusters of Pediatric Low-Grade Glioma are Associated with Distinct Molecular Characteristics. Imaging Patterns of Neonatal Subpial Hemorrhage - Provisional Statements on Neurological Outcomes. Impact of Stenosis Degree on Outcomes of Stenting versus Medical Treatment Alone for Symptomatic Intracranial Stenosis: A Pooled Individual Patient Data Analysis.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1