Self-supervised arbitrary-scale super-angular resolution diffusion MRI reconstruction

IF 3.2 2区 医学 Q1 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Medical physics Pub Date : 2025-02-20 DOI:10.1002/mp.17691
Shuangxing Wang, Lihui Wang, Ying Cao, Zeyu Deng, Chen Ye, Rongpin Wang, Yuemin Zhu, Hongjiang Wei
{"title":"Self-supervised arbitrary-scale super-angular resolution diffusion MRI reconstruction","authors":"Shuangxing Wang,&nbsp;Lihui Wang,&nbsp;Ying Cao,&nbsp;Zeyu Deng,&nbsp;Chen Ye,&nbsp;Rongpin Wang,&nbsp;Yuemin Zhu,&nbsp;Hongjiang Wei","doi":"10.1002/mp.17691","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Background</h3>\n \n <p>Diffusion magnetic resonance imaging (dMRI) is currently the unique noninvasive imaging technique to investigate the microstructure of in vivo tissues. To fully explore the complex tissue microstructure at sub-voxel scale, diffusion weighted (DW) images along many diffusion gradient directions are usually acquired, this is undoubtedly time consuming and inhibits their clinical applications. How to estimate the tissue microstructure only from DW images acquired with few diffusion directions remains a challenge.</p>\n </section>\n \n <section>\n \n <h3> Purpose</h3>\n \n <p>To address this challenge, we propose a self-supervised arbitrary scale super-angular resolution diffusion MRI reconstruction network (SARDI-nn), which can generate DW images along any directions from few acquisitions, allowing to overcome the limits of diffusion direction number on exploring the tissue microstructure.</p>\n </section>\n \n <section>\n \n <h3> Methods</h3>\n \n <p>SARDI-nn is mainly composed of a diffusion direction-specific DW image feature extraction (DWFE) module and a physics-driven implicit expression and reconstruction (IRR) module. During training, dual downsampling operations are implemented. The first downsampling is used to produce the low-angular resolution (LAR) DW images; the second downsampling is for constructing input and learning target of SARDI-nn. The input LAR DW images pass through a DWFE module (composed of several residual blocks) to extract the feature representations of DW images along input directions, and then these features and the difference between the any querying diffusion direction and the input directions are input into a IRR module to derive the implicit representation and DW image along this query direction. Finally, based on the principle of dMRI, an adaptive weighting method is used to refine the DW image quality. During testing, given any diffusion directions, we can simply infer the corresponding DW images along these directions, accordingly, SARDI-nn can realize arbitrary scale angular super resolution. To test the effectiveness of the proposed method, we compare it with several existing methods in terms of peak signal to noise ratio (PSNR), structural similarity index measure (SSIM), and root mean square error (RMSE) of DW image and microstructure metrics derived from diffusion kurtosis imaging (DKI) and neurite orientation dispersion and density imaging (NODDI) models at different upsampling scales on Human Connectome Project (HCP) and several in-house datasets.</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>The comparison results demonstrate that our method achieves almost the best performance at all scales, with SSIM of reconstructed DW images improved by 10.04% at the upscale of 3 and 5.9% at the upscale of 15. Regarding the microstructures derived from DKI and NODDI models, when the upscale is not larger than 6, our method outperforms the best supervised learning method. In addition, the test results on external datasets show the well generality of our method.</p>\n </section>\n \n <section>\n \n <h3> Conclusions</h3>\n \n <p>SARDI-nn is currently the only method that can reconstruct high-angular resolution DW images with any upscales, which allows the variation of both input diffusion direction number and upscales, therefore, it can be easily extended to any unseen test datasets, not requiring to retrain the model. SARDI-nn provides a promising means for exploring the tissue microstructures from DW images along few diffusion gradient directions.</p>\n </section>\n </div>","PeriodicalId":18384,"journal":{"name":"Medical physics","volume":"52 5","pages":"2976-2998"},"PeriodicalIF":3.2000,"publicationDate":"2025-02-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Medical physics","FirstCategoryId":"3","ListUrlMain":"https://aapm.onlinelibrary.wiley.com/doi/10.1002/mp.17691","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}
引用次数: 0

Abstract

Background

Diffusion magnetic resonance imaging (dMRI) is currently the unique noninvasive imaging technique to investigate the microstructure of in vivo tissues. To fully explore the complex tissue microstructure at sub-voxel scale, diffusion weighted (DW) images along many diffusion gradient directions are usually acquired, this is undoubtedly time consuming and inhibits their clinical applications. How to estimate the tissue microstructure only from DW images acquired with few diffusion directions remains a challenge.

Purpose

To address this challenge, we propose a self-supervised arbitrary scale super-angular resolution diffusion MRI reconstruction network (SARDI-nn), which can generate DW images along any directions from few acquisitions, allowing to overcome the limits of diffusion direction number on exploring the tissue microstructure.

Methods

SARDI-nn is mainly composed of a diffusion direction-specific DW image feature extraction (DWFE) module and a physics-driven implicit expression and reconstruction (IRR) module. During training, dual downsampling operations are implemented. The first downsampling is used to produce the low-angular resolution (LAR) DW images; the second downsampling is for constructing input and learning target of SARDI-nn. The input LAR DW images pass through a DWFE module (composed of several residual blocks) to extract the feature representations of DW images along input directions, and then these features and the difference between the any querying diffusion direction and the input directions are input into a IRR module to derive the implicit representation and DW image along this query direction. Finally, based on the principle of dMRI, an adaptive weighting method is used to refine the DW image quality. During testing, given any diffusion directions, we can simply infer the corresponding DW images along these directions, accordingly, SARDI-nn can realize arbitrary scale angular super resolution. To test the effectiveness of the proposed method, we compare it with several existing methods in terms of peak signal to noise ratio (PSNR), structural similarity index measure (SSIM), and root mean square error (RMSE) of DW image and microstructure metrics derived from diffusion kurtosis imaging (DKI) and neurite orientation dispersion and density imaging (NODDI) models at different upsampling scales on Human Connectome Project (HCP) and several in-house datasets.

Results

The comparison results demonstrate that our method achieves almost the best performance at all scales, with SSIM of reconstructed DW images improved by 10.04% at the upscale of 3 and 5.9% at the upscale of 15. Regarding the microstructures derived from DKI and NODDI models, when the upscale is not larger than 6, our method outperforms the best supervised learning method. In addition, the test results on external datasets show the well generality of our method.

Conclusions

SARDI-nn is currently the only method that can reconstruct high-angular resolution DW images with any upscales, which allows the variation of both input diffusion direction number and upscales, therefore, it can be easily extended to any unseen test datasets, not requiring to retrain the model. SARDI-nn provides a promising means for exploring the tissue microstructures from DW images along few diffusion gradient directions.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
自监督任意尺度超角分辨扩散MRI重建。
背景:扩散磁共振成像(dMRI)是目前唯一一种用于研究体内组织微观结构的无创成像技术。为了在亚体素尺度上充分探索复杂的组织微观结构,通常需要获取沿多个扩散梯度方向的扩散加权(diffusion weighted, DW)图像,这无疑是耗时的,并且阻碍了其临床应用。如何仅从少量扩散方向的DW图像中估计组织微观结构仍然是一个挑战。为了解决这一挑战,我们提出了一种自监督任意尺度超角度分辨率扩散MRI重建网络(SARDI-nn),该网络可以从少量采集中沿任何方向生成DW图像,从而克服扩散方向数对探索组织微观结构的限制。方法:SARDI-nn主要由扩散方向特定的DW图像特征提取(DWFE)模块和物理驱动的隐式表达与重建(IRR)模块组成。在训练过程中,采用双降采样操作。第一次下采样用于产生低角分辨率(LAR) DW图像;第二次下采样用于构造SARDI-nn的输入和学习目标。输入的LAR DW图像通过DWFE模块(由多个残差块组成)提取沿输入方向的DW图像的特征表示,然后将这些特征以及任意查询扩散方向与输入方向的差值输入到IRR模块中,导出沿该查询方向的隐式表示和DW图像。最后,基于dMRI原理,采用自适应加权方法对DW图像质量进行细化。在测试过程中,给定任意扩散方向,我们都可以沿着这些方向简单地推断出相应的DW图像,因此SARDI-nn可以实现任意尺度的角超分辨率。为了验证该方法的有效性,我们将其与几种现有方法进行了比较,包括峰值信噪比(PSNR)、结构相似指数度量(SSIM)和DW图像的均方根误差(RMSE),以及在人类连接组项目(HCP)和几个内部数据集上采样不同尺度下由扩散峰度成像(DKI)和神经突方向弥散和密度成像(NODDI)模型得出的微观指标。结果:对比结果表明,我们的方法在所有尺度上都取得了几乎最好的性能,在3级的高档次下,重构DW图像的SSIM提高了10.04%,在15级的高档次下,SSIM提高了5.9%。对于DKI和NODDI模型得到的微观结构,当高档度不大于6时,我们的方法优于最好的监督学习方法。此外,在外部数据集上的测试结果表明,该方法具有良好的通用性。结论:SARDI-nn是目前唯一可以重建任意上尺度的高角度分辨率DW图像的方法,它允许输入扩散方向数和上尺度的变化,因此,它可以很容易地扩展到任何未知的测试数据集,而不需要重新训练模型。SARDI-nn为从DW图像沿几个扩散梯度方向探索组织微结构提供了一种很有前途的方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Medical physics
Medical physics 医学-核医学
CiteScore
6.80
自引率
15.80%
发文量
660
审稿时长
1.7 months
期刊介绍: Medical Physics publishes original, high impact physics, imaging science, and engineering research that advances patient diagnosis and therapy through contributions in 1) Basic science developments with high potential for clinical translation 2) Clinical applications of cutting edge engineering and physics innovations 3) Broadly applicable and innovative clinical physics developments Medical Physics is a journal of global scope and reach. By publishing in Medical Physics your research will reach an international, multidisciplinary audience including practicing medical physicists as well as physics- and engineering based translational scientists. We work closely with authors of promising articles to improve their quality.
期刊最新文献
Real-time energy measurement of clinical carbon ion beams using a cross-correlation time-of-flight method with parallel-plate chambers Pushing the limits of spatial resolution in clinical PCD-CT using a dedicated high-resolution convolutional neural network (HR-CNN) Head radiotherapy positioning guidance system based on feature recognition and automatic annotation: Clinical validation and error analysis Independent verification of vendor-issued dosimetric data for 106Ru brachytherapy using diode detectors with traceability to external beam standards for absorbed dose to water Kinetic model of radiochemical oxygen depletion (ROD) in FLASH radiotherapy
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1