{"title":"Towards Accurate Microstructure Estimation via 3D Hybrid Graph Transformer.","authors":"Junqing Yang, Haotian Jiang, Tewodros Tassew, Peng Sun, Jiquan Ma, Yong Xia, Pew-Thian Yap, Geng Chen","doi":"10.1007/978-3-031-43993-3_3","DOIUrl":null,"url":null,"abstract":"<p><p>Deep learning has drawn increasing attention in microstructure estimation with undersampled diffusion MRI (dMRI) data. A representative method is the hybrid graph transformer (HGT), which achieves promising performance by integrating <math><mi>q</mi></math> -space graph learning and <math><mi>x</mi></math> -space transformer learning into a unified framework. However, this method overlooks the 3D spatial information as it relies on training with 2D slices. To address this limitation, we propose 3D hybrid graph transformer (3D-HGT), an advanced microstructure estimation model capable of making full use of 3D spatial information and angular information. To tackle the large computation burden associated with 3D <math><mi>x</mi></math> -space learning, we propose an efficient <math><mi>q</mi></math> -space learning model based on simplified graph neural networks. Furthermore, we propose a 3D <math><mi>x</mi></math> -space learning module based on the transformer. Extensive experiments on data from the human connectome project show that our 3D-HGT outperforms state-of-the-art methods, including HGT, in both quantitative and qualitative evaluations.</p>","PeriodicalId":94280,"journal":{"name":"Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention","volume":"14227 ","pages":"25-34"},"PeriodicalIF":0.0000,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11361334/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/978-3-031-43993-3_3","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Deep learning has drawn increasing attention in microstructure estimation with undersampled diffusion MRI (dMRI) data. A representative method is the hybrid graph transformer (HGT), which achieves promising performance by integrating -space graph learning and -space transformer learning into a unified framework. However, this method overlooks the 3D spatial information as it relies on training with 2D slices. To address this limitation, we propose 3D hybrid graph transformer (3D-HGT), an advanced microstructure estimation model capable of making full use of 3D spatial information and angular information. To tackle the large computation burden associated with 3D -space learning, we propose an efficient -space learning model based on simplified graph neural networks. Furthermore, we propose a 3D -space learning module based on the transformer. Extensive experiments on data from the human connectome project show that our 3D-HGT outperforms state-of-the-art methods, including HGT, in both quantitative and qualitative evaluations.
深度学习在利用采样不足的弥散核磁共振成像(dMRI)数据进行微观结构估计方面引起了越来越多的关注。混合图变换器(HGT)是一种具有代表性的方法,它将 q 空间图学习和 x 空间变换器学习整合到一个统一的框架中,从而实现了良好的性能。然而,由于这种方法依赖于二维切片的训练,因此忽略了三维空间信息。针对这一局限性,我们提出了三维混合图变换器(3D-HGT),这是一种能够充分利用三维空间信息和角度信息的先进微结构估计模型。为了解决三维 x 空间学习带来的巨大计算负担,我们提出了一种基于简化图神经网络的高效 q 空间学习模型。此外,我们还提出了基于变换器的三维 x 空间学习模块。在人类连接组项目数据上进行的大量实验表明,我们的 3D-HGT 在定量和定性评估方面都优于包括 HGT 在内的最先进方法。