{"title":"Mouse brain MR super-resolution using a deep learning network trained with optical imaging data.","authors":"Zifei Liang, Jiangyang Zhang","doi":"10.3389/fradi.2023.1155866","DOIUrl":null,"url":null,"abstract":"<p><strong>Introduction: </strong>The resolution of magnetic resonance imaging is often limited at the millimeter level due to its inherent signal-to-noise disadvantage compared to other imaging modalities. Super-resolution (SR) of MRI data aims to enhance its resolution and diagnostic value. While deep learning-based SR has shown potential, its applications in MRI remain limited, especially for preclinical MRI, where large high-resolution MRI datasets for training are often lacking.</p><p><strong>Methods: </strong>In this study, we first used high-resolution mouse brain auto-fluorescence (AF) data acquired using serial two-photon tomography (STPT) to examine the performance of deep learning-based SR for mouse brain images.</p><p><strong>Results: </strong>We found that the best SR performance was obtained when the resolutions of training and target data were matched. We then applied the network trained using AF data to MRI data of the mouse brain, and found that the performance of the SR network depended on the tissue contrast presented in the MRI data. Using transfer learning and a limited set of high-resolution mouse brain MRI data, we were able to fine-tune the initial network trained using AF to enhance the resolution of MRI data.</p><p><strong>Discussion: </strong>Our results suggest that deep learning SR networks trained using high-resolution data of a different modality can be applied to MRI data after transfer learning.</p>","PeriodicalId":73101,"journal":{"name":"Frontiers in radiology","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2023-05-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10365285/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Frontiers in radiology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3389/fradi.2023.1155866","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/1/1 0:00:00","PubModel":"eCollection","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Introduction: The resolution of magnetic resonance imaging is often limited at the millimeter level due to its inherent signal-to-noise disadvantage compared to other imaging modalities. Super-resolution (SR) of MRI data aims to enhance its resolution and diagnostic value. While deep learning-based SR has shown potential, its applications in MRI remain limited, especially for preclinical MRI, where large high-resolution MRI datasets for training are often lacking.
Methods: In this study, we first used high-resolution mouse brain auto-fluorescence (AF) data acquired using serial two-photon tomography (STPT) to examine the performance of deep learning-based SR for mouse brain images.
Results: We found that the best SR performance was obtained when the resolutions of training and target data were matched. We then applied the network trained using AF data to MRI data of the mouse brain, and found that the performance of the SR network depended on the tissue contrast presented in the MRI data. Using transfer learning and a limited set of high-resolution mouse brain MRI data, we were able to fine-tune the initial network trained using AF to enhance the resolution of MRI data.
Discussion: Our results suggest that deep learning SR networks trained using high-resolution data of a different modality can be applied to MRI data after transfer learning.
导言:与其他成像模式相比,磁共振成像的信噪比固有的劣势使其分辨率通常被限制在毫米级别。磁共振成像数据的超分辨率(SR)旨在提高其分辨率和诊断价值。虽然基于深度学习的 SR 已显示出潜力,但其在核磁共振成像中的应用仍然有限,尤其是在临床前核磁共振成像中,往往缺乏用于训练的大型高分辨率核磁共振成像数据集:在这项研究中,我们首先使用串行双光子断层扫描(STPT)获得的高分辨率小鼠大脑自动荧光(AF)数据,检验基于深度学习的 SR 在小鼠大脑图像中的性能:我们发现,当训练数据和目标数据的分辨率相匹配时,SR 性能最佳。然后,我们将使用 AF 数据训练的网络应用于小鼠大脑的 MRI 数据,发现 SR 网络的性能取决于 MRI 数据中呈现的组织对比度。利用迁移学习和有限的一组高分辨率小鼠脑部 MRI 数据,我们能够对使用 AF 数据训练的初始网络进行微调,以提高 MRI 数据的分辨率:我们的研究结果表明,使用不同模式的高分辨率数据训练的深度学习 SR 网络经过迁移学习后,可以应用于核磁共振成像数据。