GraFMRI:基于图形的鲁棒性多模态磁共振成像重建融合框架。

IF 2.1 4区 医学 Q2 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Magnetic resonance imaging Pub Date : 2024-11-17 DOI:10.1016/j.mri.2024.110279
Shahzad Ahmed , Feng Jinchao , Javed Ferzund , Muhammad Usman Ali , Muhammad Yaqub , Malik Abdul Manan , Atif Mehmood
{"title":"GraFMRI:基于图形的鲁棒性多模态磁共振成像重建融合框架。","authors":"Shahzad Ahmed ,&nbsp;Feng Jinchao ,&nbsp;Javed Ferzund ,&nbsp;Muhammad Usman Ali ,&nbsp;Muhammad Yaqub ,&nbsp;Malik Abdul Manan ,&nbsp;Atif Mehmood","doi":"10.1016/j.mri.2024.110279","DOIUrl":null,"url":null,"abstract":"<div><h3>Purpose</h3><div>This study introduces GraFMRI, a novel framework designed to address the challenges of reconstructing high-quality MRI images from undersampled k-space data. Traditional methods often suffer from noise amplification and loss of structural detail, leading to suboptimal image quality. GraFMRI leverages Graph Neural Networks (GNNs) to transform multi-modal MRI data (T1, T2, PD) into a graph-based representation, enabling the model to capture intricate spatial relationships and inter-modality dependencies.</div></div><div><h3>Methods</h3><div>The framework integrates Graph-Based Non-Local Means (NLM) Filtering for effective noise suppression and Adversarial Training to reduce artifacts. A dynamic attention mechanism enables the model to focus on key anatomical regions, even when fully-sampled reference images are unavailable. GraFMRI was evaluated on the IXI and fastMRI datasets using Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM) as metrics for reconstruction quality.</div></div><div><h3>Results</h3><div>GraFMRI consistently outperforms traditional and self-supervised reconstruction techniques. Significant improvements in multi-modal fusion were observed, with better preservation of information across modalities. Noise suppression through NLM filtering and artifact reduction via adversarial training led to higher PSNR and SSIM scores across both datasets. The dynamic attention mechanism further enhanced the accuracy of the reconstructions by focusing on critical anatomical regions.</div></div><div><h3>Conclusion</h3><div>GraFMRI provides a scalable, robust solution for multi-modal MRI reconstruction, addressing noise and artifact challenges while enhancing diagnostic accuracy. Its ability to fuse information from different MRI modalities makes it adaptable to various clinical applications, improving the quality and reliability of reconstructed images.</div></div>","PeriodicalId":18165,"journal":{"name":"Magnetic resonance imaging","volume":"116 ","pages":"Article 110279"},"PeriodicalIF":2.1000,"publicationDate":"2024-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"GraFMRI: A graph-based fusion framework for robust multi-modal MRI reconstruction\",\"authors\":\"Shahzad Ahmed ,&nbsp;Feng Jinchao ,&nbsp;Javed Ferzund ,&nbsp;Muhammad Usman Ali ,&nbsp;Muhammad Yaqub ,&nbsp;Malik Abdul Manan ,&nbsp;Atif Mehmood\",\"doi\":\"10.1016/j.mri.2024.110279\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Purpose</h3><div>This study introduces GraFMRI, a novel framework designed to address the challenges of reconstructing high-quality MRI images from undersampled k-space data. Traditional methods often suffer from noise amplification and loss of structural detail, leading to suboptimal image quality. GraFMRI leverages Graph Neural Networks (GNNs) to transform multi-modal MRI data (T1, T2, PD) into a graph-based representation, enabling the model to capture intricate spatial relationships and inter-modality dependencies.</div></div><div><h3>Methods</h3><div>The framework integrates Graph-Based Non-Local Means (NLM) Filtering for effective noise suppression and Adversarial Training to reduce artifacts. A dynamic attention mechanism enables the model to focus on key anatomical regions, even when fully-sampled reference images are unavailable. GraFMRI was evaluated on the IXI and fastMRI datasets using Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM) as metrics for reconstruction quality.</div></div><div><h3>Results</h3><div>GraFMRI consistently outperforms traditional and self-supervised reconstruction techniques. Significant improvements in multi-modal fusion were observed, with better preservation of information across modalities. Noise suppression through NLM filtering and artifact reduction via adversarial training led to higher PSNR and SSIM scores across both datasets. The dynamic attention mechanism further enhanced the accuracy of the reconstructions by focusing on critical anatomical regions.</div></div><div><h3>Conclusion</h3><div>GraFMRI provides a scalable, robust solution for multi-modal MRI reconstruction, addressing noise and artifact challenges while enhancing diagnostic accuracy. Its ability to fuse information from different MRI modalities makes it adaptable to various clinical applications, improving the quality and reliability of reconstructed images.</div></div>\",\"PeriodicalId\":18165,\"journal\":{\"name\":\"Magnetic resonance imaging\",\"volume\":\"116 \",\"pages\":\"Article 110279\"},\"PeriodicalIF\":2.1000,\"publicationDate\":\"2024-11-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Magnetic resonance imaging\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0730725X24002601\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Magnetic resonance imaging","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0730725X24002601","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}
引用次数: 0

摘要

目的:本研究介绍了 GraFMRI,这是一个新颖的框架,旨在解决从采样不足的 k 空间数据重建高质量 MRI 图像的难题。传统方法经常会出现噪声放大和结构细节丢失的问题,导致图像质量不理想。GraFMRI 利用图神经网络(GNN)将多模态 MRI 数据(T1、T2、PD)转换为基于图的表示,使模型能够捕捉复杂的空间关系和模态间的依赖关系:该框架整合了基于图的非局部均值(NLM)滤波技术和对抗训练技术,前者可有效抑制噪音,后者可减少伪影。动态关注机制使模型能够关注关键解剖区域,即使在无法获得全采样参考图像的情况下也是如此。使用峰值信噪比(PSNR)和结构相似性指数(SSIM)作为重建质量指标,在 IXI 和 fastMRI 数据集上对 GraFMRI 进行了评估:结果:GraFMRI 始终优于传统和自我监督重建技术。多模态融合有了显著改善,各模态的信息得到了更好的保存。通过 NLM 滤波抑制噪音,以及通过对抗训练减少伪影,使两个数据集的 PSNR 和 SSIM 得分更高。动态关注机制通过聚焦关键解剖区域,进一步提高了重建的准确性:GraFMRI为多模态磁共振成像重建提供了可扩展的稳健解决方案,在提高诊断准确性的同时解决了噪音和伪影难题。它能融合不同磁共振成像模式的信息,因此能适应各种临床应用,提高重建图像的质量和可靠性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
GraFMRI: A graph-based fusion framework for robust multi-modal MRI reconstruction

Purpose

This study introduces GraFMRI, a novel framework designed to address the challenges of reconstructing high-quality MRI images from undersampled k-space data. Traditional methods often suffer from noise amplification and loss of structural detail, leading to suboptimal image quality. GraFMRI leverages Graph Neural Networks (GNNs) to transform multi-modal MRI data (T1, T2, PD) into a graph-based representation, enabling the model to capture intricate spatial relationships and inter-modality dependencies.

Methods

The framework integrates Graph-Based Non-Local Means (NLM) Filtering for effective noise suppression and Adversarial Training to reduce artifacts. A dynamic attention mechanism enables the model to focus on key anatomical regions, even when fully-sampled reference images are unavailable. GraFMRI was evaluated on the IXI and fastMRI datasets using Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM) as metrics for reconstruction quality.

Results

GraFMRI consistently outperforms traditional and self-supervised reconstruction techniques. Significant improvements in multi-modal fusion were observed, with better preservation of information across modalities. Noise suppression through NLM filtering and artifact reduction via adversarial training led to higher PSNR and SSIM scores across both datasets. The dynamic attention mechanism further enhanced the accuracy of the reconstructions by focusing on critical anatomical regions.

Conclusion

GraFMRI provides a scalable, robust solution for multi-modal MRI reconstruction, addressing noise and artifact challenges while enhancing diagnostic accuracy. Its ability to fuse information from different MRI modalities makes it adaptable to various clinical applications, improving the quality and reliability of reconstructed images.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Magnetic resonance imaging
Magnetic resonance imaging 医学-核医学
CiteScore
4.70
自引率
4.00%
发文量
194
审稿时长
83 days
期刊介绍: Magnetic Resonance Imaging (MRI) is the first international multidisciplinary journal encompassing physical, life, and clinical science investigations as they relate to the development and use of magnetic resonance imaging. MRI is dedicated to both basic research, technological innovation and applications, providing a single forum for communication among radiologists, physicists, chemists, biochemists, biologists, engineers, internists, pathologists, physiologists, computer scientists, and mathematicians.
期刊最新文献
Preclinical validation of a metasurface-inspired conformal elliptical-cylinder resonator for wrist MRI at 1.5 T. P53 status combined with MRI findings for prognosis prediction of single hepatocellular carcinoma. Predicting progression in triple-negative breast cancer patients undergoing neoadjuvant chemotherapy: Insights from peritumoral radiomics. Deep learning radiomics nomograms predict Isocitrate dehydrogenase (IDH) genotypes in brain glioma: A multicenter study. Reliability of post-contrast deep learning-based highly accelerated cardiac cine MRI for the assessment of ventricular function.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1