Incorporating spatial information in deep learning parameter estimation with application to the intravoxel incoherent motion model in diffusion-weighted MRI.
Misha P T Kaandorp, Frank Zijlstra, Davood Karimi, Ali Gholipour, Peter T While
{"title":"Incorporating spatial information in deep learning parameter estimation with application to the intravoxel incoherent motion model in diffusion-weighted MRI.","authors":"Misha P T Kaandorp, Frank Zijlstra, Davood Karimi, Ali Gholipour, Peter T While","doi":"10.1016/j.media.2024.103414","DOIUrl":null,"url":null,"abstract":"<p><p>In medical image analysis, the utilization of biophysical models for signal analysis offers valuable insights into the underlying tissue types and microstructural processes. In diffusion-weighted magnetic resonance imaging (DWI), a major challenge lies in accurately estimating model parameters from the acquired data due to the inherently low signal-to-noise ratio (SNR) of the signal measurements and the complexity of solving the ill-posed inverse problem. Conventional model fitting approaches treat individual voxels as independent. However, the tissue microenvironment is typically homogeneous in a local environment, where neighboring voxels may contain correlated information. To harness the potential benefits of exploiting correlations among signals in adjacent voxels, this study introduces a novel approach to deep learning parameter estimation that effectively incorporates relevant spatial information. This is achieved by training neural networks on patches of synthetic data encompassing plausible combinations of direct correlations between neighboring voxels. We evaluated the approach on the intravoxel incoherent motion (IVIM) model in DWI. We explored the potential of several deep learning architectures to incorporate spatial information using self-supervised and supervised learning. We assessed performance quantitatively using novel fractal-noise-based synthetic data, which provide ground truths possessing spatial correlations. Additionally, we present results of the approach applied to in vivo DWI data consisting of twelve repetitions from a healthy volunteer. We demonstrate that supervised training on larger patch sizes using attention models leads to substantial performance improvements over both conventional voxelwise model fitting and convolution-based approaches.</p>","PeriodicalId":18328,"journal":{"name":"Medical image analysis","volume":"101 ","pages":"103414"},"PeriodicalIF":10.7000,"publicationDate":"2024-11-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Medical image analysis","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1016/j.media.2024.103414","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
In medical image analysis, the utilization of biophysical models for signal analysis offers valuable insights into the underlying tissue types and microstructural processes. In diffusion-weighted magnetic resonance imaging (DWI), a major challenge lies in accurately estimating model parameters from the acquired data due to the inherently low signal-to-noise ratio (SNR) of the signal measurements and the complexity of solving the ill-posed inverse problem. Conventional model fitting approaches treat individual voxels as independent. However, the tissue microenvironment is typically homogeneous in a local environment, where neighboring voxels may contain correlated information. To harness the potential benefits of exploiting correlations among signals in adjacent voxels, this study introduces a novel approach to deep learning parameter estimation that effectively incorporates relevant spatial information. This is achieved by training neural networks on patches of synthetic data encompassing plausible combinations of direct correlations between neighboring voxels. We evaluated the approach on the intravoxel incoherent motion (IVIM) model in DWI. We explored the potential of several deep learning architectures to incorporate spatial information using self-supervised and supervised learning. We assessed performance quantitatively using novel fractal-noise-based synthetic data, which provide ground truths possessing spatial correlations. Additionally, we present results of the approach applied to in vivo DWI data consisting of twelve repetitions from a healthy volunteer. We demonstrate that supervised training on larger patch sizes using attention models leads to substantial performance improvements over both conventional voxelwise model fitting and convolution-based approaches.
期刊介绍:
Medical Image Analysis serves as a platform for sharing new research findings in the realm of medical and biological image analysis, with a focus on applications of computer vision, virtual reality, and robotics to biomedical imaging challenges. The journal prioritizes the publication of high-quality, original papers contributing to the fundamental science of processing, analyzing, and utilizing medical and biological images. It welcomes approaches utilizing biomedical image datasets across all spatial scales, from molecular/cellular imaging to tissue/organ imaging.